Nvidia’s highly specialized chips are unrivaled when it comes to training models.
In addition, as the market matures in the years ahead, the primary type of AI computing workload will shift from training to inference: that is, from building AI models to deploying those models in real-world settings. Nvidia’s highly specialized chips are unrivaled when it comes to training models. But inference can be done with cheaper and more commoditized chips, which may undermine Nvidia’s advantage in the market and create an opening for competitors.