All kinds of startups are rushing into the AI inference market.
AdvertisementJared Quincy Davis and his AI computing startup Foundry sell inference.
And cost in inference computing is even more important than in training, Groq cofounder Jonathan Ross recently told BI.
In other words, "it turns out, when you make inference cheaper, people decide to do a lot more inference," Davis said.
He agrees the next few years will be wildly competitive for inference providers, but he believes the winners will be decided on merit.
Persons:
—, Jared Quincy Davis, Davis, Jonathan Ross, Mitesh Agrawal, Agrawal, it's, Jensen Huang, Davis isn't, Intel Andy Grove, Sriram Viswanathan, Viswanathan, Hugh Langley
Organizations:
Service, Foundry, SambaNova Systems, Lambda, Nvidia, Microsoft, Business, o1, Intel, Celesta Capital