Forget Nvidia: DeepSeek AI Runs Near Instantaneously on These Weird Chips
1 min read
Summary
AI-focused chip startups Cerebras Systems and Groq are compiling successes with their respective offerings, performing tasks nearly instantly compared with older hardware offerings from larger tech firms, such as Nvidia.
Headlining the success of the smaller companies are reasoning models, which mimic human thought by producing several possible answers to a query and selecting and explaining the best one.
These offer particular benefits to complex queries, and while these take longer to create a result, the results are perceived as being better.
Such success showcases the efficiencies available beyond the big tech firms, and amid a commitment to scaling up from those same large tech firms, such efficiency may be crucial to maintaining performance as the AI models themselves get bulkier.