0
HomeTech NewsNVIDIA H100 GPU sets a record in MLPerf standard tests

NVIDIA H100 GPU sets a record in MLPerf standard tests

After the rise of generative AI, many companies actively introduced products, attempting to gain a share of the market. As for the AI chip leader, NVIDIA, it recently announced a new record in the MLPerf standard test for the H100 GPU, showcasing NVIDIA’s strength as a leader.

In the latest MLPerf standard test by NVIDIA, the Eos supercomputer completed the training benchmark of the GPT-3 model, involving 1 billion lines of code and 175 billion parameters, in just 3.9 minutes. This is a remarkable improvement compared to the previous version, which took 10.9 minutes for the same standard test—a threefold increase in speed, representing a significant leap forward.

1-NV-H100-Leaps-to-New-Heights-min

The outstanding performance of the H100 GPU is attributed, first and foremost, to the integration of NVIDIA’s top-notch Hopper GPU architecture and comprehensive software resources. In the standard benchmark test conducted on the Eos supercomputer, which utilized 10,752 NVIDIA H100 Tensor Core GPUs, replacing the older A100 model, the significant improvement in performance is a key factor.

The synergy between the advanced Hopper GPU architecture and well-developed software resources, including NVIDIA NeMo for LLM training, has maximized the potential of the platform.

Another record-breaking achievement lies in the progress of system scalability, achieving a remarkable 93% efficiency improvement through various software enhancements. The supercomputer equipped with 10,752 H100 GPUs achieves the performance equivalent to training AI in six months, showcasing the efficiency gains.

NVIDIA’s use of 3,584 Hopper GPUs underscores the importance of efficient scalability. While achieving high computational power requires additional hardware resources, without proper software support, system efficiency could be significantly compromised.

Post Gallery

SOURCENVIDIA

Publish Date:

Mehmet S. Kaya
Mehmet S. Kayahttps://teknonel.com
Mehmet is one of the administrator of Teknonel. As a software developer, he loves to share his knowledge in related topics. He is highly familiar with the editorial process from the inception of an article idea, through the iterative process, publishing, and performance analysis as well as product reviews.

Follow us on Social Media!

12FansLike
15,848FollowersFollow
13FollowersFollow
676SubscribersSubscribe

Related Articles

OpenAI’s first developer conference: Will there be GPT-5?

OpenAI will hold its first developer conference, OpenAI DevDay, on November 6, two months later. During the full-day event, the OpenAI team will lead...

Proofing Your World: 8 Best Strategies for Ultimate Technology Security

Expanding the size of the attack surface inevitably amplifies the risk of cybersecurity breaches. Consequently, reducing the attack surface logically diminishes cybersecurity risk. It...

Future trends and innovations in Healthcare app development

IntroductionList of Future trends and Innovations in Healthcare app development●    Advantages●    DisadvantagesConclusionIntroductionAs technology continues to rapidly evolve, healthcare app development is also experiencing some...

Apple’s Vision Pro battery appears to be replaceable

Apple unveiled the long-rumored new Vision Pro at last week's WWDC conference. It is not difficult to see from the design of the product...

Explore More Articles