Huawei chips are powering DeepSeek AI
The AI wars are heating up with DeepSeek, a Chinese AI model that claims to surpass US competitors significantly when it comes to cost efficiency. Its open-source chatbot has propelled the app to the top position in the App Store in 51 countries, and it's now revealed that it operates on a Huawei AI chip.
The DeepSeek R1 LLM (large-language model) was trained on Nvidia H100 but uses an Ascend 910C chip for inference, which is the action of using the trained model to generate responses.
The information comes from @Dorialexander, who points out that Ascend chips are not dealing with training, so the GPU power requirements are not that high.
However, the Ascend 910C's relatively lower performance limits its suitability for training. Huawei plans to address this issue with the upcoming 920C chip aims to compete with Blackwell B200, the leading Nvidia chipset for AI operations.