Intel engineers as part of the OPEA Project today released the Generative AI Examples v1.5 update. This “GenAIExamples” open-source project is a collection of GenAI examples as part of showing the capabilities of the Open Platform for Enterprise AI (OPEA) and also highlighting Intel’s hardware strengths for generative AI.
Some of the highlights for the GenAIExamples v1.5 release include:
– For their browser-use agent there is now a new use-case to automate repetitive web tasks. This can be used for performing tasks like visiting websites and extracting data.
– There is a new use-case with a Arbitration Post Hearing Assistant Application to process and summarize post-hearing transcripts or arbitration-related documents.
– A Polylingua Translation Service has been added for translation work.
– Adding OpenAI API-compatible endpoints.
– There are a number of new GenAI Microservices such as for translating natural language queries into structured query languages.
– Faster Intel Arc GPU support via using an updated version of the LLM-Scaler-vLLM container.
– The GenAI Studio now supports drag-and-drop creation of fine-tuning applications.
While Intel involvement with the Generative AI Examples project is meant in part to show the latest GenAI capabilities and for showcasing the potential on Intel hardware, rather interesting is their actual “validated hardware” as of this release continues to be on prior-gen Intel offerings. Validated hardware with Generative AI Examples 1.5 are Intel Gaudi Gen2 AI accelerators and 3rd Gen Xeon Scalable processors… Of course, Gaudi 3 is the newest and greatest that released last year. 3rd Gen Xeon Scalable is Ice Lake that launched back in 2021… I would have figured Intel would have wanted to showcase/validate GenAI on Xeon 6 with the latest AVX-512 and AMX improvements while enjoying the memory bandwidth benefits of MRDIMMs for AI, among other benefits, as well as using their newest Gaudi 3 hardware. Or at least something a bit newer than 3rd Gen Xeon Scalable.
Those wanting to check out the Generative AI Examples 1.5 release can find it on GitHub.
