Microsoft Announces Major Updates to Cloud and AI Infrastructure, Including New Chips, Liquid Cooling, and Flexible Deployments at Ignite Event

November 19, 2024
At the Microsoft Ignite event, Microsoft announced significant updates across its entire cloud and AI infrastructure. The updates include advancements in chips and liquid cooling, new data integrations, and more flexible cloud deployments. As part of its system optimization, Microsoft is expanding its custom silicon portfolio with Azure Maia AI accelerators and Azure Cobalt central processing units (CPUs). They are also introducing Azure Integrated HSM, a new in-house security chip, and Azure Boost DPU, a dedicated silicon for data-centric workloads. Azure Integrated HSM will be installed in every new server in Microsoft’s datacenters starting next year. The company is also advancing its cooling technology with a next-generation liquid cooling "sidekick" rack, and collaborating with Meta on a new disaggregated power rack design. These specifications will be open-sourced through the Open Compute Project. Furthermore, Microsoft announced the launch of the ND H200 V5 Virtual Machine (VM) series, utilizing NVIDIA’s H200 GPUs, and the introduction of the NVIDIA Blackwell platform to the cloud. Lastly, they shared advancements in CPU-based supercomputing with the Azure HBv5 virtual machine, powered by custom AMD EPYCTM 9V64H processors.