this post was submitted on 05 Nov 2025
492 points (99.0% liked)

Technology

76635 readers
2481 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws
492
Bewildered enthusiasts decry memory price increases of 100% or more — the AI RAM squeeze is finally starting to hit PC builders where it hurts (www.tomshardware.com)
submitted 1 day ago by themachinestops@lemmy.dbzer0.com to c/technology@lemmy.world
116 comments fedilink hide all child comments
 

"I've been saving for months to get the Corsair Dominator 64GB CL30 kit," one beleagured PC builder wrote on Reddit. "It was about $280 when I looked," said u/RaidriarT, "Fast forward today on PCPartPicker, they want $547 for the same kit? A nearly 100% increase in a couple months?"

you are viewing a single comment's thread
view the rest of the comments
[–] Passerby6497@lemmy.world 4 points 1 day ago (3 children)

I for one would enjoy triggering your unskippable cutscenes in setting up local CPU based AI if it can work on Linux with an older amd card.

Don't have funds for anything fancy, but would be interesting in playing around with it. Been wanting to get something like that setup for home assistant.

[–] brucethemoose@lemmy.world 4 points 1 day ago* (last edited 1 day ago) (1 children)

Plenty of folks do AMD. A popular homelabsetup is 32GB AMD MI50 GPUs, which are quite cheap on eBay. Even Intel is fine these days!

But what's your setup, precisely? CPU, RAM, and GPU.

[–] afk_strats@lemmy.world 2 points 1 day ago

I have a MI50/7900xtx gaming/ai setup at homr which in i use for learning and to test out different models. Happy to answer questions

[–] ag10n@lemmy.world 3 points 1 day ago (1 children)

You can use Vulkan fairly easily as long as you have 8G vram

https://blog.linux-ng.de/2025/09/27/running-llms-with-llama-cpp-using-vulkan/

[–] brucethemoose@lemmy.world 3 points 23 hours ago* (last edited 23 hours ago)

The key is which model, and how.

For the really sparse MoEs, you might be better off trying ik_llama.cpp, especially if you are targeting a 'small' quant. But the dense Gemma models (as good as they are) are probably not the best choice for 8G RAM these days.

[–] SabinStargem@lemmy.today 1 points 13 hours ago

If you just want an easy way to setup AI on Windows or Linux, KoboldCPP is my recommendation for your backend. It supports the GGUF format, which allows you to use both RAM and VRAM simultaneously. It won't be the fastest thing, but it is easy enough to setup, with a bundled GUI for prep and actual usage. Through the IP address it gives, you can hook the backend into a frontend of choice.

KoboldCPP

collapsed inline media