Tencent open-sources AI model for real-time Chinese-English interpretation
Tencent has open-sourced Hy-SimulMT, an AI model for simultaneous Chinese-English interpretation. The model processes continuous speech, offering both text and speech output, and includes real-time voice cloning designed to retain the original speaker’s vocal characteristics. Tencent reported a streaming translation lag of approximately three seconds on the RealSI benchmark.
Tencent's release of Hy-SimulMT provides developers with access to its model weights, inference software, and training tools for Chinese-English interpretation. This open-source approach means the underlying technology for real-time language translation, including its continuous speech processing and voice cloning, is available for broader experimentation and integration.
The model's reported performance offers a practical measure for simultaneous interpretation. Tencent stated that Hy-SimulMT achieved a streaming translation lag of approximately three seconds on the RealSI long-form audio benchmark. This indicates a rapid response time designed to maintain conversational flow, even if not truly instantaneous.
Beyond speed, Tencent also reported that Hy-SimulMT's translation quality scores surpassed those of other open-source models and four out of five commercial APIs in its comparison. This suggests the model aims to deliver not only quick but also accurate and natural-sounding translations. Users should note that speech generation and voice cloning require a separate, configured text-to-speech service to function fully.
Share this article
Related reading
6 stories
Apple rolls out iOS 27.2 with new Siri AI languages and security fixes
Apple's iOS 27.2 update also focuses on new Siri AI languages, showing the broader push for multilingual AI.

For Sale: A Rare 1971 Isuzu Bellett 1800 GT – The First Japanese “GT”

What happens when AI starts self-replicating?

Troubleshoot etcd Clusters Easily with Ivory

My first cognee connector: syncing Basecamp into an AI agent's memory

