Nvidia, foundation models, and the future long tail
Nvidia's latest server product looks to lock up the most well-funded model creation companies. But many startups are trying to drop the cost of custom development for smaller models.
Earlier this week, Nvidia announced it would put out a tank of a server product in the form of the DGX GH200.
Since the announcement—and since it broke into he trillion-dollar club—I’ve had discussions with industry professionals now about the new products and who this is for in the first place. Sporting 256 Nvidia Grace-Hopper chips and an alm…