• About Us
  • Privacy Policy
  • Disclaimers
  • Terms and Conditions
  • Contact Us
  • DMCA Policy
Tech Chilli
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us
No Result
View All Result
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us
No Result
View All Result
Tech Chilli
No Result
View All Result

Home » News » Intel Gaudi 3 AI Chip Targets Cost-Effective AI Workloads, Challenging Nvidia’s Dominance

Intel Gaudi 3 AI Chip Targets Cost-Effective AI Workloads, Challenging Nvidia’s Dominance

Intel has unveiled its Gaudi 3 AI accelerator, designed to compete with Nvidia’s dominant H100 and H200 GPUs. Offering reduced pricing and total cost of ownership, Gaudi 3 aims to be a game-changer for AI and HPC workloads. With 64 tensor processor cores, advanced media engines, and 128GB of HBM2E memory, Intel promises impressive cost-performance advantages.

Kumud Sahni Pruthi by Kumud Sahni Pruthi
Wednesday, 25 September 2024, 5:12 AM
in News
Intel Gaudi 3 AI Chip Targets Cost-Effective AI Workloads, Challenging Nvidia’s Dominance

Intel Gaudi 3 AI Chip Targets Cost-Effective AI Workloads, Challenging Nvidia’s Dominance

Intel publicly unveiled the Gaudi 3 accelerator designed for AI workloads. Since Nvidia’s popular H100 and H200 GPUs for AI and HPC are faster than the new CPUs, Intel is staking its Gaudi 3’s success on its cheaper pricing and reduced total cost of ownership (TCO).

The 64 tensor processor cores (TPCs, 256×256 MAC structure with FP32 accumulators), 8 matrix multiplication engines (MMEs, 256-bit wide vector processor), and 96MB of on-die SRAM cache with a 19.2 TB/s bandwidth are all packed onto two chipsets of Intel’s Gaudi 3 processor. 

In addition, Gaudi 3 incorporates 14 media engines and 24 200 GbE networking ports, the latter of which can process H.265, H.264, JPEG, and VP9 to enable vision processing. Alongside the processor, there is 128GB of HBM2E memory spread across eight memory stacks, providing a whopping 3.67 TB/s of bandwidth.

Also Read: What is Intel Gaudi 3 AI Accelerator for AI Training and Inference?

Compared to Gaudi 2, which features 24 TPCs, two MMEs, and 96GB of HBM2E memory, Intel’s Gaudi 3 is a huge advance. But given that the Gaudi 3 processor only offers FP8 matrix operations in addition to BFloat16 matrix and vector operations (i.e., no more FP32, TF32, and FP16), it appears that Intel simplified both TPCs and MMEs.

In terms of performance, Intel claims that Gaudi 3 can provide up to 28.7 BF16 vector TFLOPS at about 600W TDP and up to 1856 BF16/FP8 matrix TFLOPS. Gaudi 3 offers two times poorer FP8 matrix performance (1,856 vs 3,958 TFLOPS), significantly worse BF16 vector performance (28.7 vs 1,979 TFLOPS), and somewhat lower BF16 matrix performance (1,856 vs 1,979 TFLOPS) when compared to Nvidia’s H100, at least on paper. 

Also Read: Intel Introduces Gaudi3 AI Chip to Challenge Nvidia and AMD

The Gaudi 3’s actual performance in the real world will be more significant than its specifications. It must contend with the Instinct MI300-series from AMD and the H100 and B100/B200 processors from Nvidia. And as much depends on software and other elements, this is something that has to be observed. For the time being, Intel displayed some slides asserting that Gaudi 3 can provide a notable cost-performance advantage over Nvidia’s H100.

Intel stated earlier last year that an accelerator system built on eight Gaudi 3 processors on a baseboard will set you back $125,000, or around $15,625 per CPU. In comparison, the current pricing of an Nvidia H100 card is $30,678, indicating that Intel does intend to have a significant price edge over its rival. It is unclear, though, if the blue business will be able to hold onto its lead over its competitor given the potentially enormous performance benefits provided by Blackwell-based B100/B200 GPUs. 

Also Read: Intel Announces New AI Chips to Compete with Nvidia and AMD

According to Justin Hotard, executive vice president of Intel and general manager of the Data Center and Artificial Intelligence Group, “the industry is asking for choice in hardware, software, and developer tools. Demand for AI is leading to a massive transformation in the data center.” “With our launch of Xeon 6 with P-cores and Gaudi 3 AI accelerators, Intel is enabling an open ecosystem that allows our customers to implement all of their workloads with greater performance, efficiency, and security.”

IBM Cloud and Intel Tiber Developer Cloud will offer Intel’s Gaudi 3 AI accelerators. Additionally, in the fourth quarter, systems based on Intel’s Xeon 6 and Gaudi 3 will be widely accessible from Dell, HPE, and Supermicro; systems from Supermicro and Dell will arrive in December, while workstations from Supermicro will ship in October.

Also Read: How AI-Enabled AMD  Ryzen PRO Processors will Revolutionize Mobile and Desktop

Previous Post

Pranay Agrawal Net Worth – Fractal AI CEO

Next Post

India’s UPI Set for Global Expansion: Africa & South America to Launch Digital Payments by 2027

Kumud Sahni Pruthi

Kumud Sahni Pruthi

A postgraduate in Science with an inclination towards education and technology. She always looks for ways to help people improve their lives by putting complex things into simple words through her writing.

Next Post
India’s UPI Set for Global Expansion: Africa & South America to Launch Digital Payments by 2027

India’s UPI Set for Global Expansion: Africa & South America to Launch Digital Payments by 2027

  • Trending
  • Comments
  • Latest
top Yield Farming Platforms

Top 13 Yield Farming Platforms in 2025: Maximize APY with Secure and Trusted Crypto Tools

April 17, 2025
scott wu net worth

Scott Wu Net Worth: Devin AI Software Engineer, CEO of Cognition Labs

April 17, 2025
Artificial Intelligence (AI) Glossary and Terminologies

Artificial Intelligence (AI) Glossary and Terminologies – Complete Cheat Sheet List

April 18, 2025
TurbolearnAI

Turbolearn AI: How to Use It for FREE, Features and Pricing Models

April 3, 2025
What is Blockchain Technology

What is Blockchain Technology And How Does It Work?

Enterprise AI

What is Enterprise AI? Meaning, Companies, Examples and More Details

Cosine Genie AI Software Engineer

What is Cosine Genie and How to Use? Check Benchmark, Functions, and Access Details

PhonePe Leads UPI Market in August 2024, Claims 50% Share by Value and 48% by Volume

PhonePe Partners with Liquid Group to Bring UPI Payments to Singapore for Indian Travelers

Meta AI App

Meta AI App: How to Download? Check Its Key Features and Benefits

May 10, 2025
AI in US education

AI in U.S. Education for American Youth by President DONALD TRUMP

May 10, 2025
Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025

Recent News

Meta AI App

Meta AI App: How to Download? Check Its Key Features and Benefits

May 10, 2025
AI in US education

AI in U.S. Education for American Youth by President DONALD TRUMP

May 10, 2025
Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025

Trending in AI

  • Perplexity CEO Net Worth
  • Grammarly AI Detection
  • What is LangChain
  • Canva AI Tool
  • Koupon AI
Tech Chilli

Tech Chilli is a beacon of knowledge, a relentless purveyor of the latest information, news, and groundbreaking research in the realm of cutting-edge technology.

We are dedicated to curating and delivering the most relevant, accurate, and up-to-the-minute information on the technologies that are shaping our world.
Contact us – [email protected]

Follow Us

Browse by Category

  • AI
  • AI India
  • Courses
  • Crypto
  • Featured
  • FinTech
  • Gaming
  • How-To
  • News
  • Puzzles
  • Robotics

Top Searches

  • Scott Wu Net Worth
  • Mira Murati Net Worth
  • Online Games for Couples
  • Amazon Q vs Microsoft Copilot
  • DarkGPT

Recent News

Meta AI App

Meta AI App: How to Download? Check Its Key Features and Benefits

May 10, 2025
AI in US education

AI in U.S. Education for American Youth by President DONALD TRUMP

May 10, 2025
Google is moving Android news to a virtual event before I/O

Google is moving Android news to a virtual event before I/O

April 29, 2025
Generative AI Companies

Top Generative AI Companies of the World 2025

April 28, 2025
  • About Us
  • Privacy Policy
  • Disclaimers
  • Terms and Conditions
  • Contact Us
  • DMCA Policy

© 2024 Tech Chilli

No Result
View All Result
  • News
  • AI
  • Fintech
  • Crypto
  • AI India
  • Robotics
  • Courses
  • How-To
  • Puzzles
  • Gaming
  • Contact Us

© 2024 Tech Chilli

We use cookies to ensure that we give you the best experience on our website. If you continue to use this site we will assume that you are happy with it.OK