Modern data centers optimize AI with Intel Xeon 6 and Gaudi 3 – News

Modern data centers are evolving rapidly, driven by a wave of innovations designed to meet the growing demands of cloud computing and artificial intelligence. As enterprises continue their digital transformation journeys, the need for more powerful, efficient and scalable systems is pushing the boundaries of traditional infrastructure.

Among the latest advancements, Intel Corp.’s Xeon 6 processor and Gaudi 3 accelerator stand out for the ability to optimize AI workloads and enhance overall performance while reducing energy consumption. These cutting-edge solutions are helping IT leaders address key challenges around power efficiency, system scalability and workload optimization, ultimately reshaping the landscape of modern data centers, according to Rakesh Mehrotra (pictured, right), vice president of strategy, product management and operations of data center and AI at Intel.

“We’ve had a relationship for 30 years, and in this modern age, that is rare. I think collectively we’ve innovated together for 30 years,” Mehrotra said, referring to the Intel and Dell Technologies Inc. partnership. “We’ve been looking around corners for a long time, and our goal is to solve our customer’s biggest and toughest problems by innovating, and we innovate together.”

Mehrotra and Jonathan Seckler (left), senior director of server networking, ISG and product marketing, at Dell Technologies, spoke with theCUBE’s John Furrier at the “Is Your IT Infrastructure Ready for the Age of AI?” event, during an exclusive broadcast on theCUBE, News Media’s livestreaming studio. They discussed the Dell and Intel partnership, as well as the rapid evolution of modern data center technologies, focusing on the impact of Intel’s Xeon 6 processor and Gaudi 3 accelerator in optimizing AI workloads and enhancing data center performance. (* Disclosure below.)

Optimizing AI in modern data centers

The introduction of Intel’s Xeon 6 processor has become a pivotal element in driving efficiency in data centers. These processors are optimized for AI workloads and offer significant improvements in both performance and total cost of ownership. The Xeon 6’s efficiency is a game-changer, according to Seckler.

“I think that great AI requires great power,” he explained. “The ability to be efficient is important. By working on standards to improve efficiency and to leverage each other’s strengths, we are able to partner now with Intel with the introduction of the Xeon 6 processor. It offers an efficiency core so that for workloads that need to be highly efficient, it’s the right platform for them.”

In the context of AI, the Xeon 6 processors not only increase power efficiency, but also provide the computing backbone for cutting-edge applications. These processors are important in enhancing AI workloads, according to Mehrotra.

“Xeon 6 is the best processor we’ve ever made,” he stated. “It’s the world’s best [central processing unit] for AI workloads … We’ve seen improvements up to 40% across the broader set of workloads. That’s a huge number.”

Together with Dell’s server solutions, the Xeon 6 processor enables enterprises to manage AI and data center workloads more effectively, providing them with a solution that balances power and performance. This combination allows businesses to run AI models efficiently without compromising on performance.

Improving management of AI and data center workloads

Furthermore, the collaboration has led to optimized systems for hybrid AI workflows. The Xeon 6 processor is particularly adept at running AI inferencing, a critical aspect of many modern AI applications. This gives businesses more flexibility and agility, especially when paired with the high-bandwidth capabilities of accelerators such as the Gaudi 3, Seckler pointed out.

“Gaudi 3 has integrated ethernet,” he said. “You could connect your network directly into the accelerator and feed it all the information. This ethernet is at 800 gigabytes per second. It’s like the highest bandwidth you can get in a network today. So incredible opportunity to keep those machines working efficiently.”

These innovations have far-reaching implications for IT decision-makers. As the industry pivots to accommodate increasing demand for AI and hybrid cloud environments, Intel and Dell’s combined solutions offer enterprises the ability to optimize data centers without overextending resources.

“What we are doing with PowerEdge … is we are enabling AI inferencing workloads on Gaudi 3 by enabling [application programming interface] calls that you can directly do on this PowerEdge infrastructure,” Mehrotra said. “We are enabling all of that. You have API into PowerEdge, and you can run the application by making a call through this API.”

Here’s the complete video interview, part of News’s and theCUBE’s coverage of the “Is Your IT Infrastructure Ready for the Age of AI?” event:

(* Disclosure: TheCUBE is a paid media partner for the “Is Your IT Infrastructure Ready for the Age of AI?” event. Neither Dell Technologies Inc., the sponsor of theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or News.)

Photo: News