Microsoft is Reportedly Working on An AI Chip Called Athena

AI Chip Called Athena

Microsoft is reportedly developing an AI chip called Athena, with the aim of offering a vertically integrated solution for scale-out artificial intelligence. This is similar to Apple's hardware-and-software stack that is deployed across billions of devices worldwide. Microsoft has been working on the chip, codenamed Athena, since 2019 and engineering samples are already available to some Microsoft and OpenAI employees.

For Inference and Large Language Model Training

This chip is essential for inference and large-language model training, and it is likely to be used across Microsoft's Azure stack. The first generation of the chip will be fabbed using TSMC's 5nm manufacturing process, and ex-Apple CPU architect, Mike Filippo, is likely to be involved in the project. According to The Information, the roadmap for the chip includes "multiple generations," which suggests that Microsoft is planning to invest in the technology for the long term.

A Follow-Up to Project Brainwave

The project is seen as a follow-up to Project Brainwave, the FPGA-powered system that Microsoft has been using since 2017. Back then, Intel Stratix 10 FPGA (Field Programmable Gate Array) cards were used to produce what now looks like the first draft of Microsoft AI strategy. Should Microsoft follow Google's step with a TPU-like product, we can expect a lot of high-bandwidth memory (HBM), a relatively low TDP, and a laser-focus on peak FLOPs per dollar.

Wants to Be A Major Player in AI Chip Market

Microsoft's investment in the Athena project is significant, and it shows that the company is serious about becoming a major player in the AI chip market. Other US-based companies, such as Amazon, Google, and Facebook, as well as non-US entities like Tencent and Alibaba, have already launched their own custom-built chips for AI. These companies aim to get a hardware solution that performs better than what is commercially available off the shelf.

Nvidia the Current Market Leader

Nvidia currently dominates the market with its A100 and H100 processors, which are essential for inference and large-language model training. However, Microsoft's investment in Athena could mean that the company is looking to reduce its reliance on Nvidia's technology. Microsoft is already collaborating with Nvidia to build a next-generation supercomputer, and it is likely that the world's largest software company may leverage Athena to get better rates or priority from Nvidia in the future.

Hardware Is the Biggest Obstacle to AI Rollout

Microsoft's focus on AI is not new. The company has embraced artificial intelligence at scale with enthusiasm, and it has baked ChatGPT across all its flagship products and services, including Bing, Microsoft 365, and Github. However, the biggest obstacle to the rollout of AI is the hardware cost, which, according to experts, could reach tens of billions of dollars per year.

A Vertically Integrated Solution for Scale-Out AI

Microsoft's move to develop its own AI chip is a strategic one. The company wants to position itself as the Apple of AI, offering a vertically integrated solution for scale-out artificial intelligence. 

Works Seamlessly With Microsoft Software and Services

A vertically integrated solution for scale-out artificial intelligence means that it is designed to work seamlessly with its software and services, including Azure. This integrated approach allows for the efficient scaling of AI, as the hardware and software are optimized to work together. This can lead to improved performance, lower costs, and faster processing times. This approach is similar to Apple's quasi obsessive approach to the stack, which has been one of the key factors behind the company's success.

An AI Chip Can Give Microsoft A Competitive Edge

However, Microsoft's attempt to follow in Apple's footsteps in the consumer market with the ill-fated Windows RT on ARM almost a decade ago was not successful. This time around, Microsoft seems to be more in control, and most importantly, not a laggard. The company has learned from its mistakes and is now focusing on developing an AI chip that could give it a competitive edge in the market.

Committed To Being a Major Player in the AI Chip Market

Microsoft's investment in the Athena project is a significant move that shows the company's commitment to becoming a major player in the AI chip market. The project is a strategic one, aimed at offering a vertically integrated solution for scale-out artificial intelligence, similar to Apple's hardware-and-software stack. The chip is essential for inference and large-language model training, and it is likely to be used across Microsoft's Azure stack. With the Athena chip, Microsoft could potentially reduce its reliance on Nvidia's technology, which could help the company to save on costs in the long term. The development of the Athena chip is also likely to benefit Microsoft's collaboration with OpenAI, which received a $1 billion investment from Microsoft in 2019.

AI Chips Perform Calculations Quickly

The development of AI chips has become increasingly important in recent years, as more and more companies invest in AI technology. AI chips are designed to perform complex mathematical calculations quickly and efficiently, which is essential for the development of AI models. The use of AI in a wide range of industries, including healthcare, finance, and manufacturing, has driven demand for these chips, and companies are racing to develop the best solutions.

Will Benefit Microsoft in the Long Term

Microsoft's investment in the Athena project is likely to benefit the company in the long term, as it positions itself as a leader in the AI chip market. The company's focus on AI technology is not new, but the development of the Athena chip is a significant move that could help to propel the company's AI strategy forward. The company's collaboration with OpenAI is also likely to benefit from the development of the chip, as the two companies work together to develop cutting-edge AI technology.

AI Will Become More Important in Many Industries

In conclusion, Microsoft's development of the Athena chip is a significant move that shows the company's commitment to becoming a leader in the AI chip market. The chip is essential for inference and large-language model training, and it is likely to be used across Microsoft's Azure stack. With the development of the Athena chip, Microsoft could reduce its reliance on Nvidia's technology and position itself as a major player in the AI chip market. This strategic move is likely to benefit the company in the long term, as AI technology becomes increasingly important across a wide range of industries.

Source:  Microsoft is working on an AI chip for ChatGPT as it emulates Apple’s perfect plan

Image by Colin Behrens from Pixabay 

Image by Simon from Pixabay