Generative AI and large language models like OpenAI’s ChatGPT require massive amounts of computing power to run, and typically rely on chips like Nvidia’s graphics-processing units, or GPUs, that are specialized for these types of calculations.
Graphcore sells primarily to AI startups looking to build and train models at lower cost, he said, and the company is benefiting from the proliferation of those startups.
Shane Rau, who leads International Data Corp.’s semiconductor research, said chip startups are increasingly pivoting to focus their products on supporting large language models.
Still, he added, “you’re going to see a combination of real adaptation and marketing.”“There will be the pressure to say: ‘Hey, we’re already relevant, our AI chip technology’s already relevant to generative AI’,” said Mr. Rau.
Some chip makers say they expect yet another surge in demand once businesses more widely adopt generative AI.