Skip to main content

AI Voice-Cloning Tools

Knowledge Base Sync
@ Wing

Information compiled: 2026-06-11. Target scenario: a Chinese speech-configuration Skill embedded in a video workflow, with selectable voices and support for local voice cloning.

Lark Wiki
On this page
  1. 1.Key Conclusions
  2. 2.Public Libraries That Support Voice Cloning
  3. 3.Recommendations for an M4 MacBook Air with 16 GB RAM
  4. 4.Is There Already a Mature Skill We Can Use Directly?
  5. 5.Recommended Path

Information compiled: 2026-06-11 Target scenario: a Chinese speech-configuration Skill embedded in a video workflow, with selectable voices and support for local voice cloning.

Key Conclusions

Prioritize these categories:

  • Local-machine first: Qwen3-TTS, Chatterbox, Kokoro as a fallback, and GPT-SoVITS as a voice-production workbench.

  • Strong Chinese capabilities but better suited to a server or cloud GPU: CosyVoice, VoxCPM, and IndexTTS2.

  • Use cautiously for commercial video: F5-TTS, Spark-TTS, ChatTTS, Fish Speech, and Coqui XTTS-v2; verify each model's license individually.

  • None of these projects currently appears to offer a mature Codex/Agent Skill. They mainly provide Python APIs, WebUIs, CLIs, Gradio demos, FastAPI/gRPC services, or OpenAI-compatible servers, so we would need to build the Skill layer ourselves.

Public Libraries That Support Voice Cloning

Public library Voice-cloning capability Chinese support Licensing/commercial-use risk Local Mac fit Suitable for a video-workflow Skill? Link
Qwen3-TTS Supports voice cloning and voice design Strong Official project uses Apache-2.0; still verify each specific model Excellent for Apple Silicon; community MLX implementations already exist Strongly recommended as the first candidate GitHub
CosyVoice / CosyVoice2 Zero-shot voice cloning, cross-lingual cloning, and preset voices Very strong, including Chinese and dialects Apache-2.0 Official support favors Linux/NVIDIA; setup on a local Mac is cumbersome Strongly recommended, but better as a server backend GitHub
Chatterbox Multilingual Zero-shot voice cloning with audio prompts Supports Chinese MIT Includes Mac examples and MPS support; well suited to local experiments Recommended and easy to package quickly GitHub
GPT-SoVITS Five-second zero-shot, one-minute few-shot, and voice fine-tuning Mature Chinese ecosystem MIT Supports Apple Silicon, though the workflow is relatively heavy Recommended as a cloned-voice production workbench GitHub
IndexTTS2 Zero-shot voice cloning with duration and emotion control Strong Licensing and commercial use require additional confirmation CUDA/GPU oriented and unfriendly to a MacBook Air Suitable for lip-sync/duration control in video, but not recommended as the primary local solution GitHub
OpenVoice V2 Instant tone-color cloning, focused on timbre transfer Supported MIT; relatively commercial-friendly Lightweight and worth trying locally Suitable as a timbre-conversion module, usually paired with a base TTS system GitHub
F5-TTS Zero-shot/few-shot style cloning Supported Code is MIT, but many commonly used pretrained models are noncommercial Can run locally but needs practical tuning Fine for research/personal testing; use cautiously for commercial video GitHub
Fish Speech Rapid voice cloning from 10-30 seconds of audio Strong Fish Audio Research License; commercial use requires caution The model is heavy and unsuitable for sustained use on an M4 Air High quality, but not a first choice for a lightweight local Skill GitHub
VoxCPM / VoxCPM2 Reference-audio cloning and controllable speech generation Supports Chinese and multiple languages Apache-2.0 Official support favors CUDA/GPU A candidate for a server backend GitHub
Zonos Voice cloning from 10-30 seconds of audio Multilingual; Chinese requires testing Apache-2.0 Can be tested, but Chinese stability needs validation A candidate, not a first-tier choice for Chinese video workflows GitHub
Coqui XTTS-v2 Voice cloning from about six seconds of audio Supports Chinese Coqui is no longer maintained; verify the model license carefully Can run locally, but carries maintenance risk A longstanding option, but not recommended as a major bet for a new project Hugging Face
Spark-TTS Zero-shot voice cloning Supports Chinese CC BY-NC-SA; clear noncommercial risk The model is not lightweight Suitable only for research/personal experiments Hugging Face
StyleTTS2 Zero-shot speaker adaptation English-oriented; weak Chinese Verify each item Research-oriented Unsuitable as the main backend for a Chinese-video Skill GitHub
MaskGCT / Amphion Zero-shot TTS/voice-cloning research frameworks Supported, but research-oriented Verify each item High engineering cost to package Suitable for research, not for a production Skill out of the box GitHub
MegaTTS3 Zero-shot voice cloning Supported Review openness and usage restrictions carefully Not a first choice for local use Worth watching, but maturity and licensing need further validation GitHub
Confucius4-TTS Zero-shot voice transfer Supports 14 languages, including Chinese Verify each item Official support favors CUDA; a new project whose maturity remains to be seen A watch-list item, not recommended as the primary solution today GitHub
ChatTTS Voice/speaker controls, but not a standard local cloning workflow Strong Chinese AGPL code and CC BY-NC model Can run locally, but production constraints are substantial Not recommended as the main video-production Skill GitHub

Recommendations for an M4 MacBook Air with 16 GB RAM

  1. Qwen3-TTS + MLX / mlx-audio

  2. Chatterbox Multilingual

  3. GPT-SoVITS

  4. Kokoro

  • CosyVoice / VoxCPM / IndexTTS2: Strong Chinese capabilities and output, but more oriented toward CUDA/GPU or server environments; neither local deployment nor sustained batch inference is ideal on an M4 Air.

  • F5-TTS / Spark-TTS / ChatTTS / Fish Speech: Capable, but licensing, model weight, or production constraints are more troublesome.

  • StyleTTS2 / MaskGCT / Amphion / MegaTTS3 / Confucius4-TTS: More research-oriented or still emerging, so they are not yet suitable as a stable primary backend for a video workflow.

Is There Already a Mature Skill We Can Use Directly?

None of these public libraries currently appears to offer a mature Codex/Agent Skill. Their existing interfaces are mainly:

  • Python API

  • WebUI / Gradio Demo

  • CLI examples

  • Docker / FastAPI / gRPC services

  • OpenAI-compatible servers or similar interfaces

Therefore, integrating one into a video workflow requires a separately packaged Skill. A recommended minimum structure is:

Module Purpose
voices/registry.json Manage preset and cloned voices
scripts/list_voices.py List available voices
scripts/clone_voice.py Import reference audio and register a locally cloned voice
scripts/tts.py Convert one text input to speech
scripts/render_batch.py Generate speech in batches for video storyboards/subtitles

The most reliable short-term path is:

  1. Use Qwen3-TTS + MLX as the primary local engine.

  2. Use Chatterbox as a backup for cloning.

  3. Use GPT-SoVITS to produce high-quality cloned-voice assets.

  4. Keep Kokoro for rapid drafts and fallback output.

  5. If stronger Chinese dialect, emotion, or duration control is later required, deploy CosyVoice / IndexTTS2 on a cloud GPU or dedicated server.

Share

Let's Build Together

Follow our socials and join the community for the latest updates

WeChat QR Code

Scan to join WeChat group