Data Infrastructure will decide AI’s future, says Vast – News

Artificial intelligence may dominate the headlines, but the real strain is buried deep in enterprise data infrastructure. As AI moves into everyday operations, can the systems beneath it withstand the scale and speed it demands — or will they quietly become the breaking point?

“I think we’ve been building towards this moment for the last 10 years,” he told theCUBE. “Ten years is a long time, but from the very beginning we were always hopeful that AI will happen. It’s happened a lot faster than we expected it to, and it’s going to accelerate into the next decade. But that’s what we live for.”

Hallak spoke with theCUBE’s Dave Vellante and Rebbeca Knight at Vast Forward 2026, during an exclusive broadcast on theCUBE, News Media’s livestreaming studio. They discussed the evolution of data infrastructure for AI, the architecture behind the expanding Vast AI Operating System and the company’s long-term growth strategy. (* Disclosure below.)

AI turns data infrastructure into the operating layer

As Vast tightens its strategic relationships with companies such as Solidigm, those alliances point to a larger architectural shift. Each computing era has revolved around a defining principle, Hallak noted. Previous waves of computing were shaped by computing power or connectivity, but AI is defined by something different.

“Every one of the operating systems that we’ve had before was for a revolution — and a technological revolution that had a specific defining characteristic,” he said. “You both [hosts Vellante and Knight] have an Apple operating system in your desktop. That was computer-oriented. Internet was networking-oriented. AI is data.”

Naturally, a data-centric era forces enterprises to rethink their foundations. Training large models already requires enormous throughput, but inference at scale is even more demanding. As AI applications evolve into fleets of autonomous agents, data must be accessed simultaneously, refined continuously and fed back into learning loops. But traditional enterprise systems were not designed for this kind of concurrency, Hallak explained.

“Once you want to start inference, then it needs even faster access, because you have trillions of agents eventually all needing to access all of this data in parallel,” he said. “It’s not one-hop inference; it’s multi-hop for reasoning. And then it’s reinforced learning across inference and training as we fine-tune these models, and each agent will fine-tune its own [themselves] — every one of those things is another exponent.”

As those exponents compound, incremental upgrades are no longer enough. Vast’s position is that legacy architectures cannot stretch far enough to support agentic AI at a global scale, according to Hallak. What is required instead is a new, unified data infrastructure layer that integrates storage, database capabilities, scheduling and security into a single system built specifically for AI workloads.

“When you add two, three, four [or] five exponents, then you realize the old stuff was not built for it and it won’t be able to do it,” he said. “You need a new architecture; you need a new system. That’s why we’re becoming more relevant as we progress on this journey.”

Here’s the complete video interview, part of News’s and theCUBE’s coverage of Vast Forward:

(* Disclosure: TheCUBE is a media partner for Vast Forward. Sponsors of theCUBE’s coverage, including presenting sponsor Solidigm, do not have editorial control over content on theCUBE or News.)

Photo: News