I’m pretty sure the thing about datatypes is wrong. From experience programming shaders the most typical float values were 4 bytes. The physics simulations are run on cpus typically, not gpus, but for graphics processing of all kinds, smaller floats are used. The conclusion is right though.
Sadly no. AI hardware does not relies on the same fundamentals as consumer hardware.
Long story short AI stuff use Float 4 or 8 because accuracy is not a factor. Games or physics simulation use Float 32 or 64.
I’m pretty sure the thing about datatypes is wrong. From experience programming shaders the most typical float values were 4 bytes. The physics simulations are run on cpus typically, not gpus, but for graphics processing of all kinds, smaller floats are used. The conclusion is right though.
4 bytes not 4 bits, so 32 bits. You can’t do graphics on 4 bits, that’s way too small.
Good catch, thanks
Yeah, even the Game&Watch was 8-bit
But you can use 4bits neural networks.
Some people already replied but I would like to add that even if float type where the right one.
AI dedicated hardware doesn’t bundle stuff you usually espect from a gpu like dedicated encoder and decoders.
The “GPUs” used in these AI datacentres can’t even do graphics anymore. They’re now sloppy approximate matrix math machines.
SAS hard drives and server ECC ram incoming!
deleted by creator