modelscope/FunASR
1
0
Fork 0
mirror of https://github.com/modelscope/FunASR.git synced 2026-10-12 02:19:18 +00:00
Code Issues Packages Projects Releases Wiki Activity

docs: separate Nano and MLT-Nano language scope (#3227)

Browse Source 
Refs #3226
This commit is contained in:
vishnupratap3790
2026-07-15 07:51:35 +08:00
committed by GitHub
parent ddecf48db4
commit ea6ea1e849
22 changed files with 40 additions and 38 deletions
Download Patch File Download Diff File Expand all files Collapse all files
examples/dify/README.md
+1 -1
View File
@@ -40,7 +40,7 @@ In your Dify app settings:
| Model Name | Best For | Speed |
|-----------|----------|-------|
| `fun-asr-nano` | 31 languages + Chinese dialects | 340x realtime (vLLM) |
| `fun-asr-nano` | zh/en/ja + Chinese dialects/accents | 340x realtime (vLLM) |
| `sensevoice` | Ultra-fast, 5 languages | 170x realtime |
| `paraformer` | Chinese (classic, stable) | 120x realtime |
examples/industrial_data_pretraining/fun_asr_nano/README.md
+3 -3
View File
@@ -2,7 +2,7 @@
「[简体中文](README_zh.md)」|「English」
Fun-ASR is an end-to-end speech recognition large model launched by Tongyi Lab. It is trained on tens of millions of hours of real speech data, possessing powerful contextual understanding capabilities and industry adaptability. It supports low-latency real-time transcription and covers 31 languages. It excels in vertical domains such as education and finance, accurately recognizing professional terminology and industry expressions, effectively addressing challenges like "hallucination" generation and language confusion, achieving "clear hearing, understanding meaning, and accurate writing."
Fun-ASR is an end-to-end speech recognition large model launched by Tongyi Lab. It is trained on tens of millions of hours of real speech data, possessing powerful contextual understanding capabilities and industry adaptability. The Nano checkpoint supports low-latency real-time transcription for Chinese, English, and Japanese, plus Chinese dialect groups and regional accents; the separate MLT-Nano checkpoint extends coverage to 31 languages. It excels in vertical domains such as education and finance, accurately recognizing professional terminology and industry expressions, effectively addressing challenges like "hallucination" generation and language confusion, achieving "clear hearing, understanding meaning, and accurate writing."
<div align="center">
<img src="images/funasr-v2.png">
@@ -34,7 +34,7 @@ Online Experience:
# What's New 🔥
- 2025/12: [Fun-ASR-Nano-2512](https://modelscope.cn/models/FunAudioLLM/Fun-ASR-Nano-2512) is an end-to-end speech recognition large model trained on tens of millions of hours real speech data. It supports low-latency real-time transcription and covers 31 languages.
- 2025/12: [Fun-ASR-Nano-2512](https://modelscope.cn/models/FunAudioLLM/Fun-ASR-Nano-2512) is an end-to-end speech recognition large model trained on tens of millions of hours real speech data. It supports low-latency real-time transcription for Chinese, English, and Japanese, plus Chinese dialect groups and regional accents; the separate MLT-Nano checkpoint covers 31 languages.
- 2024/7: [FunASR](https://github.com/modelscope/FunASR) is a fundamental speech recognition toolkit that offers a variety of features, including speech recognition (ASR), Voice Activity Detection (VAD), Punctuation Restoration, Language Models, Speaker Verification, Speaker Diarization and multi-talker ASR.
# Core Features 🎯
@@ -45,7 +45,7 @@ Online Experience:
- **Chinese Dialects and Regional Accents:**
- Supports **7 major dialects**: Wu, Cantonese, Min, Hakka, Gan, Xiang, Jin
- Covers **26 regional accents**: including Henan, Shaanxi, Hubei, Sichuan, Chongqing, Yunnan, Guizhou, Guangdong, Guangxi and more than 20 other regions
- **Multi-language Free Speech:** Supports recognition of **31 languages**, with focused optimization on East and Southeast Asian languages, supporting free language switching and mixed recognition.
- **Multi-language Free Speech:** The separate **Fun-ASR-MLT-Nano** checkpoint supports recognition of **31 languages**, with focused optimization on East and Southeast Asian languages, supporting free language switching and mixed recognition.
- **Music Background Lyric Recognition:** Enhanced speech recognition performance under music background interference, supporting accurate recognition of lyric content in songs.
# Environment Setup 🐍
examples/industrial_data_pretraining/fun_asr_nano/README_zh.md
+3 -3
View File
@@ -2,7 +2,7 @@
「简体中文」|「[English](README.md)」
Fun-ASR 是通义实验室推出的端到端语音识别大模型，是基于数千万小时真实语音数据训练而成，具备强大的上下文理解能力与行业适应性，支持低延迟实时听写，并且覆盖 31 个语种。在教育、金融等垂直领域表现出色，能准确识别专业术语与行业表达，有效应对"幻觉"生成和语种混淆等挑战，实现"听得清、懂其意、写得准"。
Fun-ASR 是通义实验室推出的端到端语音识别大模型，是基于数千万小时真实语音数据训练而成，具备强大的上下文理解能力与行业适应性，支持低延迟实时听写。Fun-ASR-Nano 支持中文、英文、日语，以及 7 种中文方言和 26 种地域口音；独立的 Fun-ASR-MLT-Nano checkpoint 则覆盖 31 个语种。在教育、金融等垂直领域表现出色，能准确识别专业术语与行业表达，有效应对"幻觉"生成和语种混淆等挑战，实现"听得清、懂其意、写得准"。
<div align="center">
<img src="images/funasr-v2.png">
@@ -34,7 +34,7 @@ Fun-ASR 是通义实验室推出的端到端语音识别大模型，是基于数
# 最新动态 🔥
- 2025/12: [Fun-ASR-Nano-2512](https://modelscope.cn/models/FunAudioLLM/Fun-ASR-Nano-2512) 是一款基于数千万小时真实语音数据训练的端到端语音识别大模型。它支持低延迟实时转写，并涵盖 31 种语言识别功能。
- 2025/12: [Fun-ASR-Nano-2512](https://modelscope.cn/models/FunAudioLLM/Fun-ASR-Nano-2512) 是一款基于数千万小时真实语音数据训练的端到端语音识别大模型。它支持低延迟实时转写，覆盖中文、英文、日语，以及 7 种中文方言和 26 种地域口音；独立的 Fun-ASR-MLT-Nano checkpoint 则覆盖 31 种语言。
- 2024/7: [FunASR](https://github.com/modelscope/FunASR) 是一款功能全面的语音识别基础工具包，集成了多项核心功能，包括自动语音识别（ASR）、语音活动检测（VAD）、标点恢复、语言模型、说话人验证、说话人日志记录以及多说话人语音识别。
# 核心特性 🎯
@@ -45,7 +45,7 @@ Fun-ASR 是通义实验室推出的端到端语音识别大模型，是基于数
- **中文方言与地方口音：**
- 支持 **7 大方言**：吴语、粤语、闽语、客家话、赣语、湘语、晋语
- 覆盖 **26 个地区口音**：包括河南、陕西、湖北、四川、重庆、云南、贵州、广东、广西等 20 多个地区
- **多语言自由说：** 支持 **31 种语言**识别，重点优化东亚与东南亚语种，支持语种自由切换和混合识别。
- **多语言自由说：** 独立的 **Fun-ASR-MLT-Nano** checkpoint 支持 **31 种语言**识别，重点优化东亚与东南亚语种，支持语种自由切换和混合识别。
- **音乐背景歌词识别：** 强化在音乐背景干扰下的语音识别性能，支持对歌曲中歌词内容的精准识别。
# 环境安装 🐍
examples/industrial_data_pretraining/fun_asr_nano/client_mic.html
+3 -3
View File
@@ -82,11 +82,11 @@ body { font-family:'Inter',system-ui,sans-serif; background:#080810; color:#e0e0
<span class="feat feat-green">Streaming ASR</span>
<span class="feat feat-yellow">Speaker Diarization <span style="font-size:9px;opacity:0.7">(Beta)</span></span>
<span class="feat feat-purple">Hotword Customization</span>
<span class="feat feat-blue">31 Languages · 7 Dialects</span>
<span class="feat feat-blue">Nano: zh/en/ja + dialects · MLT-Nano: 31 languages</span>
</div>
<p class="hero-desc">
基于 <b>FunASR</b> 的 <b>vLLM 推理引擎</b>，实现流式语音识别服务。支持实时 VAD 分句、说话人分离 <span style="color:#f59e0b;font-size:11px">(Beta)</span>、<b>热词定制化</b>（加载人名、地名等实体词列表，提升专有名词识别准确率）、31种语言及中文方言。所有代码与模型已全部开源。<br>
<span style="font-size:12px">Streaming ASR with vLLM engine, real-time VAD, speaker diarization <span style="color:#f59e0b">(Beta)</span>, <b>hotword customization</b> (names, places, entities), 31 languages &amp; Chinese dialects. Fully open-sourced.</span>
基于 <b>FunASR</b> 的 <b>vLLM 推理引擎</b>，实现流式语音识别服务。支持实时 VAD 分句、说话人分离 <span style="color:#f59e0b;font-size:11px">(Beta)</span>、<b>热词定制化</b>（加载人名、地名等实体词列表，提升专有名词识别准确率）。Nano 覆盖中文、英文、日语及中文方言/口音；MLT-Nano 覆盖 31 种语言。所有代码与模型已全部开源。<br>
<span style="font-size:12px">Streaming ASR with vLLM engine, real-time VAD, speaker diarization <span style="color:#f59e0b">(Beta)</span>, <b>hotword customization</b> (names, places, entities), and checkpoint-specific language coverage: Nano for zh/en/ja plus Chinese dialects/accents, MLT-Nano for 31 languages. Fully open-sourced.</span>
&nbsp;·&nbsp; <a href="https://www.funasr.com" target="_blank">www.funasr.com</a>
</p>
</div>
examples/industrial_data_pretraining/fun_asr_nano/docs/realtime_demo.md
+1 -1
View File
@@ -44,7 +44,7 @@ ssh -L 10095:localhost:10095 <server>
- **流式 VAD 分句**：动态静音阈值，自然断句
- **说话人分离 (Beta)**：流式 ID 分配 + 最终重聚类
- **热词定制化**：加载人名、地名等实体词文件
- **语种指定**：31 种语言 + 中文方言
- **语种指定**：Nano 支持中/英/日及中文方言/口音；MLT-Nano 支持 31 种语言
- **幻觉检测**：自动检测重复模式并截断
## 文件列表
examples/openai_api/BLOG_POST.md
+1 -1
View File
@@ -107,7 +107,7 @@ Now your AI assistant can transcribe local audio files while keeping the audio i
| `sensevoice` | General purpose, emotion | 170x GPU / 17x CPU |
| `paraformer` | Chinese production | 120x GPU / 15x CPU |
| `paraformer-en` | English production | 120x GPU / 15x CPU |
| `fun-asr-nano` | 31 languages, LLM-based | 17x GPU |
| `fun-asr-nano` | zh/en/ja + Chinese dialects/accents, LLM-based | 17x GPU |
## Get Started
examples/openai_api/README.md
+1 -1
View File
@@ -91,7 +91,7 @@ curl http://localhost:8000/v1/audio/transcriptions \
| `sensevoice` | 170x realtime | 17x realtime | zh/en/ja/ko/yue | Emotion detection |
| `paraformer` | 120x realtime | 15x realtime | zh/en | Punctuation |
| `paraformer-en` | 120x realtime | 15x realtime | en | English only |
| `fun-asr-nano` | 17x realtime | 3.6x realtime | 31 languages | LLM-based, timestamps |
| `fun-asr-nano` | 17x realtime | 3.6x realtime | zh/en/ja + Chinese dialects/accents | LLM-based, timestamps |
## API Endpoints
examples/openai_api/README_ja.md
+1 -1
View File
@@ -88,7 +88,7 @@ curl http://localhost:8000/v1/audio/transcriptions \
| `sensevoice` | 170x realtime | 17x realtime | zh/en/ja/ko/yue | 感情・イベントタグ |
| `paraformer` | 120x realtime | 15x realtime | zh/en | 句読点復元 |
| `paraformer-en` | 120x realtime | 15x realtime | en | 英語認識 |
| `fun-asr-nano` | 17x realtime | 3.6x realtime | 31 languages | LLM-based、タイムスタンプ |
| `fun-asr-nano` | 17x realtime | 3.6x realtime | 中英日 + 中国語方言・地域アクセント | LLM-based、タイムスタンプ |
## API エンドポイント
examples/openai_api/README_ko.md
+1 -1
View File
@@ -88,7 +88,7 @@ curl http://localhost:8000/v1/audio/transcriptions \
| `sensevoice` | 170x realtime | 17x realtime | zh/en/ja/ko/yue | 감정 및 이벤트 태그 |
| `paraformer` | 120x realtime | 15x realtime | zh/en | 문장부호 복원 |
| `paraformer-en` | 120x realtime | 15x realtime | en | 영어 인식 |
| `fun-asr-nano` | 17x realtime | 3.6x realtime | 31 languages | LLM-based, 타임스탬프 |
| `fun-asr-nano` | 17x realtime | 3.6x realtime | 중영일 + 중국어 방언/지역 억양 | LLM-based, 타임스탬프 |
## API 엔드포인트
examples/openai_api/README_zh.md
+1 -1
View File
@@ -88,7 +88,7 @@ curl http://localhost:8000/v1/audio/transcriptions \
| `sensevoice` | 170x realtime | 17x realtime | zh/en/ja/ko/yue | 情感与事件标签 |
| `paraformer` | 120x realtime | 15x realtime | zh/en | 标点恢复 |
| `paraformer-en` | 120x realtime | 15x realtime | en | 英文识别 |
| `fun-asr-nano` | 17x realtime | 3.6x realtime | 31 languages | LLM-based，时间戳 |
| `fun-asr-nano` | 17x realtime | 3.6x realtime | 中/英/日 + 中文方言/口音 | LLM-based，时间戳 |
## API 端点
examples/voice_input/README.md
+1 -1
View File
@@ -55,7 +55,7 @@ python funasr_input.py --lang zh # 语言
|------|------|------|
| sensevoice (默认) | 170x GPU / 17x CPU | 中/英/日/韩/粤 |
| paraformer | 120x GPU / 15x CPU | 中/英 |
| fun-asr-nano | 17x GPU | 31种语言 |
| fun-asr-nano | 17x GPU | 中/英/日 + 中文方言/口音 |
## 架构