Microsoft AI Strategy Devours GPUs Like Nvidia

Although Microsoft has now made access to the AI-supported Bing bot available without a waiting list, the company apparently has problems servicing the resulting sharp increase in demand for the hardware behind it.

As the US magazine The Information reports, Microsoft is now internally restricting access to the server systems used for the new developments based on artificial intelligence in order to keep the capacities free for other types of use. It is said that anyone who works internally on AI technologies at Microsoft must now be put on a waiting list.

Waiting list due to server capacity shortage

Apparently, there is a bottleneck in the server hardware behind this, since Microsoft cannot expand the capacities quickly enough. According to other reports, the most important supplier is Nvidia, because the manufacturer supplies graphics cards in bulk, which are installed in Microsoft servers to process the data for the AI ​​systems.

More than 30,000 Nvidia GPUs are currently said to be in use to enable the currently available AI applications from Microsoft. The Redmond company relies on enterprise-grade models such as the Nvidia A100 and H100, which are installed in large numbers. Nevertheless, the capacities should not yet be sufficient to enable the perfect availability of the services in the medium term.

According to the report, because Microsoft also wants to present new AI functions for Office and its other productivity applications today, the group is trying to prioritize the use of the limited hardware available. One obviously wants to ensure that the announcements about new AI services, which have received a lot of attention, do not suffer from failures or short availability.

Behind all this is the group’s attempt to gain a competitive advantage over the competition with its AI-focused strategy. The Bing bot was launched as part of a multi-billion dollar cooperation with the start-up company OpenAI, which develops the underlying technology in the form of GPT-4, causing a “red alert” at Google. So Google is desperately trying to keep up so as not to lose touch.