I don't get the point. Framework laptops are interesting because they are modular but for desktop PCs that's the default. And Framework's PCs are less modular than a standard PC because the RAM is soldered
this post was submitted on 25 Feb 2025
4 points (100.0% liked)
Technology
65819 readers
5133 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
"To enable the massive 256GB/s memory bandwidth that Ryzen AI Max delivers, the LPDDR5x is soldered," writes Framework CEO Nirav Patel in a post about today's announcements. "We spent months working with AMD to explore ways around this but ultimately determined that it wasn’t technically feasible to land modular memory at high throughput with the 256-bit memory bus. Because the memory is non-upgradeable, we’re being deliberate in making memory pricing more reasonable than you might find with other brands."
😒🍎
Edit: to be clear, I was only trying to point out that "we’re being deliberate in making memory pricing more reasonable than you might find with other brands" is clearly targeting the Mac Mini, because Apple likes to price-gouge on RAM upgrades. ("Unamused face looking at Apple," get it? Maybe I emoji'd wrong.) My comment is not meant to be an opinion about the soldered RAM.
Would 256GB/s be too slow for large llms?
It runs on the gpu
Many LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
To anyone complaining about non-replaceable RAM: This machine is for AI, that is why.
Think of it like a GPU wirh a CPU on the side, vs the other way around.
Inference requires very fast ram transfer speed, and that is only possible (currently) on soldered buses. Even this is pretty slow at 256Gb/s, but it's RAM size of 96GB to GPU makes it interesting for larger models.
Holy moly this is awesome! I am in for the 128GB SKU.
That's 96GB of usable VRAM! And way more CPU bandwidth than any desktop Zen chip.
I know people are going to complain about non upgradable memory, but you can just replace the board, and in this case it’s so worth it for the speed/power efficiency. This isn’t artificial crippling, it physically has to be soldered, at least until LPCAMM catches on.
My only ask would be a full X16 (or at least a physical X16/electrical x8) PCIe slot or breakout ribbon. X4 would be a bit of a bottleneck for some GPUs/workloads… Does Strix Halo even support that?
I understand the memory constraints but it does feel weird for framework, is all I have to say. But that's also the general trajectory of computing from what it seems. I really want lpcamm to catch on!
Apparently Framework did try to get AMD to use LPCAMM, but it just didn't work from a signal integrity standpoint at the kind of speeds they need to run the memory at.
Eventually most system RAM will have to be packaged anyway. Physics dictates that one pays a penalty going over pins and mobo traces, and it gets more severe with every advancement.
It's possible that external RAM will eventually evolve into a "2nd tier" of system memory, for background processes, spillover, inactive programs/data, things like that.
That would be fine. But as long as it can use it as RAM and not just a staging ground.
Keep in mind that it would be pretty slow, as it doesn’t make sense to burn power and die area on a wide secondary bus.
Looks like a pile of shit for easily-impressionable morons, but that's to be expected from framework.
What exactly do you want instead?
Great products for great prices!
Like what, specifically, instead of this?
Lol. Are you nuts? Am I really supposed to sit here and list off what makes a great product for a great price?
Let's be real. You don't like how I criticized how people like you are getting taken for a ride so you're desperate to make it seem like it's not true.
The sooner you realize how you're being taken advantage of, the sooner you can start to do something about it.
Am I really supposed to sit here and list off what makes a great product for a great price?
I don't understand what you are asking for.
You don't have to be extensive, but... what would you want instead? A more traditional Mini PC? A dGPU instead? A different size laptop? Like, if you could actually tell Framework what you want, in brief, what would you say?
Fair enough.
I skimmed it for a few seconds, got a little bit ill at the $1100 starting price, and then it occurred to me: what is this for?
Wasn't framework's whole thing about making modular laptops? What value are they bringing to the mini-ITX market? They're already modular. In fact, it looks like they're taking away customizability with soldered RAM.
You asked me what I want, and this is definitely what I don't want. If they wanted to make this product appealing to me, they'd have to lower the price and live more modest lifestyles with the more modest profit margins.
Edit: After closer inspection (albeit, not that close so I may have missed something) it looks like this... thing doesn't even have a dedicated GPU. Yeah, framework can suck my fucking balls lol.
You can literally get a 4070 gaming laptop these days for ~$1000 and framework is trying to push this shit? They can fuck off so hard it's not even funny. This is why the free world never has enough to go around, because we waste our excess on dumb shit like this.
Here's a gaming laptop with a 4070 and a 144hz screen for $900 at Walmart:
Fuck framework.
This is ostensibly more of a workstation/dev thing. The integrated GPU is more or less like a very power efficient laptop 4070/4080 with unlimited VRAM, depending on which APU you pick, and the CPU is very fast, with desktop Ryzen CCDs but double the memory bandwidth of what even an 9800 X3D has. In that sense, it’s a steal compared to Nvidia DIGITs or an Apple M4 Max, and Mini PC makers alternatives haven’t really solidified yet.
I think Framework knows they can’t compete with a $900 Walmart laptop and the crazy bulk pricing/corner cutting they do, nor can they price/engineer things (with the same bulk discounts) at the higher end like a ROG Z13/G14.
So… this kinda makes sense to me. They filled a gap where OEMs are enshittifying things, which feels very framework to me.
The integrated GPU is more or less like a very power efficient laptop 4070/4080 with unlimited VRAM
I'd love to see some benchmarks comparing the two. I don't believe that this integrated GPU is able to hold a candle to a laptop's 4070, but I'd love to be proven wrong. It also looks, per the words of the article, the CPU with performance comparable to a "mid-range" laptop GPU (think xx60s) will cost $2000. Literally paying OVER TWICE the fucking price as a laptop with a 4070. AND LAPTOPS COME WITH SCREENS! This is a complete scam.
As far as CPU speed goes, couldn't people simply choose whatever CPU they want when building their computer without paying the "framework tax"? Are you trying to claim there's something "special" about this CPU like the PS3's cell processor?
Are you trying to claim there’s something “special” about this CPU like the PS3’s cell processor?
There is. It’s a 16-core desktop CPU kinda like Ryzen, but hooked up to an IO die with very fast (8533MHz) quad channel memory. It’s more like a small, power efficient threadripper CPU, if you want to look at it that way, and that is a $2K+ platform.
But that IO die has a 40 CU GPU (compared to 12 CUs for the previous highest end IGP, or 8 for the Steam Deck), so yeah, somewhere in the ballpark of a 4070, or (to be more accurate than my previous guess) the 4060 at the lower end of SKUs.
But the real appeal isn’t “magic”: its like an Apple M Pro or Mac, a decent GPU hooked up to a huge pool of reasonably fast VRAM without having to pay freaking $4000+ for a Quadro or A100. Workstation people are going crazy over this thing.
I’d buy it at the drop of a hat for workstation stuff. I also have some friends who want one as a home server, since it’s so powerful but power efficient, and more modular/repairable than some Chinese mini PC.
For $2000, you and your friends could be getting better hardware.
I'm sorry, this is a product for suckers. Anyone who buys this has more money than sense. It's just a fact of life.
It's okay if you don't realize this now, but hopefully one day you will. It's alright to be wrong and taken for a ride. We've all been there, including me. It's part of why I'm so keen on identifying bullshit like this now; I've seen it before and will continue to see it again.
I’m sorry, this is a product for suckers. Anyone who buys this has more money than sense. It’s just a fact of life.
There’s literally no better hardware. If I want 48Gb+ vram for $2000, it’s literally a bank of ancient, power sucking Tesla P40s or this… there’s nothing else because Nvidia/AMD price gouge everything else. Heck, the used 24GB 3090 I bought has skyrocketed in price. I’d still be paying l$1500+ for a bare minimum 3090 system now.
I’d love to be wrong, but the GPU market is totally fucked.
GPU aside, it’s the same for those that want a really fast transcoder box or whatever.
You're deluding yourself into thinking this iGPU is more powerful than it actually is.
Have you seen benchmarks comparing it to some of the competition?
Honestly I don’t even care if it’s half as fast as a 4070, that’s fast enough for me.
In workstation workloads, some stuff just will not run unless you have a ton of VRAM, and running slower is fine. Or in other cases, you get a gigantic speedup from the virtue of simply having tons of VRAM. That’s the value, not pure core speed compared to some 8GB GPU.
But I am not deluding myself, the core performance is in the ballpark of a laptop 7700S: https://www.notebookcheck.net/AMD-Radeon-RX-8060S-Benchmarks-and-Specs.942049.0.html
It’s also (on paper) slower than my desktop 3090, but in practice, an order of magnitude faster for stuff that struggles to fit on the 3090.
Honestly I don’t even care if it’s half as fast as a 4070, that’s fast enough for me.
You're the one who's trying to argue its power, and then when presented with a better option you say "it's fast enough for me."
Have you seen benchmarks comparing the performance of this iGPU to dGPUs?
Please share.
See the notebookcheck page above.
What benchmarks are you seeing that are telling you this is a better deal than the alternatives?
Come on, you can be specific so I don't have to assume what you're talking about.
Soldered on ram and GPU. Strange for Framework.
Ye the soldered ram is for sure making me doubt framework now.
Apparently AMD wasn't able to make socketed RAM work, timings aren't viable. So Framework has the choice of doing it this way or not doing it at all.
In that case, not at all is the right choice until AMD can figure out that frankly brain dead easy thing.
"brain dead easy thing"... All you need is to just manage signal integrity of super fast speed ram to a super hungry state of the art soc that benefits from as fast of memory as it can get. Sounds easy af. /s
They said that it was possible, but they lost over half of the speed doing it, so it was not worth it. It would severely cripple performance of the SOC.
The only real complaint here is calling this a desktop, it's somewhere in between a NUC and a real desktop. But I guess it technically sits on a desk top, while also being an itx motherboard.
Oh yeah I'm sure you could've done it no problem
Apparently AMD couldn’t make the signal integrity work out with socketed RAM. (source: LTT video with Framework CEO)
IMHO: Up until now, using soldered RAM was lazy and cheap bullshit. But I do think we are at the limit of what’s reasonable to do over socketed RAM. In high performance datacenter applications, socketed RAM is on it’s way out (see: MI300A, Grace-{Hopper,Blackwell},Xeon Max), with onboard memory gaining ground. I think we’ll see the same trend on consumer stuff as well. Requirements on memory bandwidth and latency are going up with recent trends like powerful integrated graphics and AI-slop, and socketed RAM simply won’t work.
It’s sad, but in a few generations I think only the lower end consumer CPUs will be possible to use with socketed RAM. I’m betting the high performance consumer CPUs will require not only soldered, but on-board RAM.
Finally, some Grace Hopper to make everyone happy: https://youtube.com/watch?v=gYqF6-h9Cvg
Sound like a downgrade to me I rather have capability of adding more ram than having a soldered limited one doesn't matter if it's high performance. Especially for consumer stuff.
I definitely wouldn't mind soldered RAM if there's still an expansion socket. Solder in at least a reasonable minimum (16G?) and not the cheap stuff but memory that can actually use the signal integrity advantage, I may want more RAM but it's fine if it's a bit slower. You can leave out the DIMM slot but then have at least one PCIe x16 expansion slot. A free one, one in addition to the GPU slot. PCIe latency isn't stellar but on the upside, expansion boards would come with their own memory controllers, and push come to shove you can configure the faster RAM as cache / the expansion RAM as swap.
Heck, throw the memory into the CPU package. It's not like there's ever a situation where you don't need RAM.
All your RAM needs to be the same speed unless you want to open up a rabbit hole. All attempts at that thus far have kinda flopped. You can make very good use of such systems, but I’ve only seen it succeed with software specifically tailored for that use case (say databases or simulations).
The way I see it, RAM in the future will be on package and non-expandable. CXL might get some traction, but naah.
Framework releasing a Mac Mini was certainly not on my bingo card for this year.
I wasn’t prepared. I’ve been eyeing a mini for a while and this thing kills it on value compared to what I would get in a similar price point.
What alternatives were you considering, and how does the product from Framework compare?
Mac mini and studio. The overall power comparison remains to be seen but cost to spec ratio I would have had to spend over 6k and couldn’t have 16tb of memory, frameworks was around 3200.
Not really sure who this is for. With soldered RAM is less upgradeable than a regular PC.
AI nerds maybe? Sure got a lot of RAM in there potentially attached to a GPU.
But how capable is that really when compared to a 5090 or similar?
The 5090 is basically useless for AI dev/testing because it only has 32GB. Mind as well get an array of 3090s.
The AI Max is slower and finicky, but it will run things you'd normally need an A100 the price of a car to run.
But that aside, there are tons of workstations apps gated by nothing but VRAM capacity that this will blow open.