ChatGPT and Current AIs Are Dumb

Yeah. I don’t think it’s quite as performant as direct VRAM but it’s way more accessible. I wouldn’t be surprised if in 5-10 years all PCs use unified memory.

It’s also worth noting that memory has historically been pretty cheap for consumer GPUs. Like here’s an article from 9 mo ago that cites $10/chip for 3GB GDDR7 chips:

Prices are a lot higher now, but I think this is curious becuase nvidia has been stingy on memory for a long time. Would we have these issues if nvidia had just shipped consumer cards with more memory earlier? I heard (based on tech specs and gpu board analysis) that the 3070 was going to have 16GB but shipped with 8GB instead (and memory was still cheap then). The GTX 1080 and 1080 are 10 years old now and shipped with 8GB and 11GB vram. Maybe there’s a good reason (like gpu die complexity) that they couldn’t, but definitely seems like some of nvidia’s anticonsumer practices have contributed to some negative side effects. But also maybe I’m just interpreting market decisions with the benefit of hindsight and shouldn’t make this kind of conclusion.