Openai, on Thursday, introduced new audio models in application programming interface (api) that offer improved performance in accuracy and reliability. The San Francisco-Based AI Firm Released Three New Artificial Intelligence (AI) Models for Both Speech-to-text Transcription and Text-to-Speech (TTS) Functions. The company claimed that these models will enable developers to build applications with agentic workflows. It also also stated that API can enable businesses to automate customer support-Like operations. Notably, the new models are based on the company’s GPT-4o and GPT-4o Mini Ai Models.
Openai brings new audio models in api
In a blog post, the AI firm detailed the new api-specific ai models. The company highlighted that over the Years it has released Several Ai agents such as operator, Deep Research, Computer-RESING AGENTS, and the Responses API with Built -in Tools. However, it added that the true potential of agents can only be unlocked when they can perform intuitively and interactive access media mediums beyond text.
There are three new audio models. GPT-4o-Transcribe and GPT-4O-Min-Transcribe are the speech-to-text models and the GPT-4o-Mini-Tts is, as the name sugges, a tts model. Openai Claims that these models outperform its existing whisper models which was released in 2022. However, Unlike the older models, the new ons are not open-resource.
Coming to the GPT-4O-TRANSCRIBE, The AI Firm Stated that It Showcases Improved “Word error Rate” (Wer) Performance on the FEW-Shot Learning evaluation of universal represencies of SPECH Benchmark which tests ai models on multilingual speech across 100 languages. Openai said the improvements were a result of targeted training techniques
These speech-to-text models can capture audio even in challenging Scenarios such as heavy accents, noisy environments, and varying speech speeds.
The GPT-4O-Mini-Tts Model also come with significant improvements. The AI Firm Claims that the models can speake with customisable inflections, interactions, and emotional Expressiveness. This will enable developers to build applications that can be used for a wide range of tasks including customer service and creative storytelling. Notable, the model only offers artificial and preset voices.
Openai’s api pricing page highlights that the GPT-4o-Based Audio Model will cost $ 40 (roughly Rs. On the other hand, the GPT-4o Mini-Based Audio Models will be charged at the rate of 10 (roughly Rs. 860) per million in input tokens and $ 20 (roughly Rs.
All of the audio models are available to developers via api. Openai is also related an integration with its agents software development kit (SDK) to help users build voice agents.
