2026-10-24 19:01 UTC
Replies (4)
-
@panda_abyss@lemmy.ca 2026-10-24 20:18
Most workers only spend ~1/3 of their time working. If you’re running GPU heavy automated workflows, you’re usually running batches before shifts start in the morning. So 50% utilization seems about right, probably higher than I expect. The real question is what is their peak utilization rate, because being capped when you need it most is more important than running the things 24/7/365. Even if you sell GPU compute, you’re still pricing it amortized based on average utilization, so this isn’t a deal breaker depending on the business model. Meanwhile, open models have gotten quite good, and if you have an enterprise grade GPU you can run a lot of the good ones. I run Qwen 3.8 125b on my home server and it’s acceptable. The value of owning your own GPU is getting stronger in my opinion. I guess I’ll keep an eye out on used server parts or something. As much as I think this is a bubble, fueled by effectively extortion from Nvidia and the memory makers, but initiated by Scam Altman, this isn’t the needle. The needle is the data centre funding.
-
@gastroglizzy@piefed.social 2026-10-24 19:21
That’s like daily driving a giant SUV because you drive eight hours to grandma’s house every Christmas
-
@Korkki@lemmy.ml 2026-10-24 19:36
It’s so over. They leverage debt to buy these things and NVIDIA is egging them on. The datacenter companies don’t have the market and even worse, they can’t even install the new hardware that they are buying and GPUs are just sitting idle. They buy this on debt well on advance because every CEO is fearing that they will miss out in the future if they don’t buy today. That money needs they need to paid back, but where is the money going to come from if they are not using the product? Next is Nvidia going to come in the next few years with a new product and say that all the continuously depreciating silicon that they have in their datacenters running half capacity and in warehouses sitting idle is now shit and here is the latest model, now pay up piggy. What then?
-
@redballooon@lemmy.world 2026-10-24 19:43
Oh, they don’t work at night? Me neither. But during work time I need more compute anyway.