NVIDIA brings massive updates to flagship AI chips, make it more efficient to handle larger systems

AI chip manufacturing leader and one of the biggest GPU makers, NVIDIA has announced the upcoming release of its advanced artificial intelligence (AI) chip, the H200, scheduled to launch next year.

The H200, which is being positioned as a massive upgrade over the existing top-tier H100 chip, comes with key enhancements, with a primary focus on increased high-bandwidth memory—a pivotal component determining the chip’s rapid data processing capabilities.

NVIDIA’s dominance in the AI chip market, powering notable services like OpenAI’s ChatGPT, makes this announcement significant for various sectors relying on generative AI applications.

The augmented high-bandwidth memory and accelerated connection to the chip’s processing elements promise swifter response times for AI services, enabling quicker generation of human-like responses to user queries.

The H200 chip features an impressive 141 gigabytes of high-bandwidth memory, a substantial upgrade from the 80 gigabytes found in its predecessor, the H100.

While NVIDIA has not disclosed the memory suppliers for the new chip, Micron Technology expressed its intent in September to become a supplier for NVIDIA. NVIDIA also sources memory from SK Hynix, which reported a sales resurgence in the AI chip sector last month.

In a strategic move, NVIDIA has secured partnerships with major cloud service providers, ensuring rapid integration of the H200 chip into the market.

Amazon Web Services, Google Cloud, Microsoft Azure, and Oracle Cloud Infrastructure are among the notable providers set to offer access to the H200 chips. Additionally, speciality AI cloud service providers, including CoreWeave, Lambda, and Vultr, will also be part of the initial rollout.

The H200’s anticipated debut in collaboration with tech giants highlights the chip’s potential impact on diverse industries relying on cutting-edge AI capabilities. As AI applications continue to evolve, NVIDIA commitment to advancing AI hardware positions the H200 as a pivotal player in the unfolding landscape of artificial intelligence.

(With input from agencies)



from Firstpost Tech Latest News https://ift.tt/OvWjtVA
Share:

No comments:

Post a Comment

Categories

Rove Reviews Youtube Channel

  1. Subscribe to our youtube channel
  2. Like our videos and share them too.
  3. Our youtube channel name Rove reviews.

WITNUX

This website is made by Witnux LLC. This website provides you with all the news feeds related to technology from large tech media industries like GSM Arena, NDTV, Gadgets 360, Firstpost and many other such ates altogether at technical depicts so that you need not go to several sites to view their post provide you advantantage of time.

From the developer
Tanzeel Sarwar

OUR OTHER NETWORKS

OUR YOUTUBE CHANNEL

ROVE REVIEWS PLEASE SUBSCRIBE

OUR FACEBOOK PAGE

The Rove Reviews

Support

Trying our best to provide you the best DONATE or SUPPORTour site Contact me with details how are you gonna help us