Together AI has announced the launch of its Together Audio API, powered by Cartesia Sonic, a cutting-edge low-latency and ultra-realistic voice model. This collaboration allows developers to access the Sonic model directly through the Together API, offering support for multiple voices and languages. The initiative expands the platform’s capabilities, enabling the creation of multi-modal applications integrating chat, image, audio, and more, all through a single platform, according to Together AI.

Key Features and Compliance

The Together Audio API, powered by Cartesia Sonic, boasts state-of-the-art low latency and ultra-realistic voice capabilities. Developers can build enterprise-ready voice applications on the Together Platform, which is compliant with HIPAA and SOC2 standards. The platform also offers cookbooks to help developers get started, such as creating NotebookLM style podcasts using agentic workflows.

Building Multi-Modal Applications

The introduction of audio capabilities marks a significant milestone for Together AI, aiming to enable developers to build and orchestrate multi-modal applications. These applications can integrate multiple AI models, including chat, image, audio, and code, through the Together API Platform. The platform allows seamless orchestration of AI models like speech-to-text, large language models, and text-to-speech, ensuring minimal latency without the need for multiple API providers.

Voice AI Use Cases

Voice AI is transforming industries, with 85% of companies expecting widespread deployment within the next five years. Developers can leverage voice capabilities for AI-powered customer support, content creation, and personalized voice assistants. For instance, combining LLMs with Sonic’s natural responses can enhance customer inquiries, while AI can automate audio content production for podcasts and media.

Why Choose Cartesia Sonic?

Cartesia Sonic outperforms other voice models in blind human preference tests, offering ultra-low latency and superior content processing. With just 90ms streaming latency, Sonic provides the fastest end-to-end voice applications available. It excels in handling complex inputs and offers diverse voice options in 15 languages, thanks to Cartesia’s innovative State Space Model architecture.

Getting Started

Developers interested in building with voice AI can join Together AI’s developer community on Discord to share projects and ideas. The Together Audio API and Cartesia Sonic provide an opportunity to create advanced voice applications, enhancing user experience across various sectors.

Image source: Shutterstock