Tesla’s Dojo chip and supercomputer have mouth salivating specifications and capabilities, but cost, custom interconnects, memory constraints, lack of software, and the fact that this chip is…
The two things that stood out to me were CFP8 and the magic compiler solution.The Tesla Dojo Chip Is Impressive, But There Are Some Major Technical Issues
The CFP8 data type is odd to me, going to a 8 bit data type now seems completely opposite of the general trend. An 8 bit floating just seems baffling. Assuming they do a 5 / 3 split that is 0-32 for the significand and 0-7 for the exponent. Just does not seem much resolution for driving a car. But the lack of memory in the design seems to force CFP8.
Tesla is also claiming they have/will have a compiler that automatically optimizes for their hardware. Having seen this claim made before, and the success rate associated, this seems unlikely.