FunASR

mirror of https://github.com/modelscope/FunASR.git synced 2026-10-12 02:19:18 +00:00

Author	SHA1	Message	Date
游雁	4967c8bd8e	feat: add Qwen3-ASR speaker diarization; remove unnecessary punc_model from SPK examples - Qwen3-ASR: support spk_model with forced_aligner for speaker diarization - Qwen3-ASR: fix list input handling (numpy/tensor to tuple format) - Qwen3-ASR: output timestamp as [start_ms, end_ms] for pipeline compatibility - Qwen3-ASR: graceful fallback when forced_aligner not configured - Remove punc_model from Fun-ASR-Nano/SenseVoice/Qwen3-ASR SPK demos and tests (these models output punctuation natively) - Fix test scripts to handle both text/sentence keys in sentence_info - auto_model: set return_time_stamps=True when spk_model present	2026-05-21 04:38:21 +00:00
游雁	106cbb69a3	feat: add ERes2NetV2 speaker model with full AutoModel integration Integrates ERes2NetV2 from 3D-Speaker into FunASR as a speaker verification/diarization model. Can be used standalone or as spk_model combined with VAD + ASR for speaker-attributed transcription. Usage (standalone speaker embedding): model = AutoModel(model="iic/speech_eres2netv2_sv_zh-cn_16k-common") res = model.generate(input="audio.wav") embedding = res[0]["spk_embedding"] # shape: [1, 192] Usage (with ASR + speaker diarization): model = AutoModel( model="paraformer-zh", vad_model="fsmn-vad", spk_model="iic/speech_eres2netv2_sv_zh-cn_16k-common", ) res = model.generate(input="audio.wav") Tested end-to-end: ModelScope download + embedding extraction verified. New files: - funasr/models/eres2net/eres2netv2.py (network architecture) - funasr/models/eres2net/model.py (FunASR wrapper with inference) - tests_models/test_eres2netv2.py - examples/industrial_data_pretraining/eres2netv2_sv/demo.py - examples/industrial_data_pretraining/eres2netv2_sv/demo_sv.py	2026-05-20 05:27:53 +00:00
游雁	8a0c727051	feat: add GLM-ASR-Nano model support Add GLMASR wrapper class integrating GLM-ASR-Nano-2512 (1.5B) into FunASR. Uses HuggingFace transformers AutoModel + AutoProcessor with trust_remote_code. Supports 17 languages with dialect and low-volume speech optimization. Usage: from funasr import AutoModel model = AutoModel(model="zai-org/GLM-ASR-Nano-2512", hub="hf", device="cuda:0") res = model.generate(input="audio.wav") # ModelScope (Chinese users) model = AutoModel(model="ZhipuAI/GLM-ASR-Nano-2512", hub="ms", device="cuda:0") Tested end-to-end on CPU with Chinese and English audio. New files: - funasr/models/glm_asr/model.py - funasr/models/glm_asr/__init__.py - tests_models/test_glm_asr.py - examples/industrial_data_pretraining/glm_asr/demo.py - examples/industrial_data_pretraining/glm_asr/demo_ms.py Note: requires transformers>=5.0.0 (pip install git+https://github.com/huggingface/transformers)	2026-05-20 04:15:11 +00:00
游雁	a837ac3954	fix: repair broken paraformer_streaming demo.py syntax	2026-05-20 04:05:46 +00:00
游雁	12e7e93ab5	docs: add Qwen3-ASR to README and examples - Add Qwen3-ASR (0.6B/1.7B) to model zoo table in README.md and README_zh.md with links to HuggingFace and ModelScope - Add news entry for Qwen3-ASR release - Add example scripts: - examples/industrial_data_pretraining/qwen3_asr/demo.py (HuggingFace) - examples/industrial_data_pretraining/qwen3_asr/demo_ms.py (ModelScope)	2026-05-20 03:50:39 +00:00
游雁	10ac8cf39e	feat: support SenseVoice speaker diarization (#2706 ) - Auto-enable output_timestamp when spk_model is present in inference_with_vad - Add SenseVoice + SPK demo and update README news/quick-start	2026-05-19 14:51:12 +00:00
游雁	a424f4c6b6	feat: support speaker diarization for Fun-ASR-Nano (#2844 ) - Convert dict-format timestamps to list-format for downstream compatibility - Fix spk_embedding to concatenate all chunk embeddings from sv_chunk - Handle timestamps/timestamp key difference in vad_segment mode - Auto fallback to vad_segment mode when punc_model is missing - Add demo_spk.py example and test script - Update README/README_zh with news and usage demo	2026-05-19 13:35:16 +00:00
ZZUZSL1024	a397d0b27e	Codex/create training and inference scripts (#2791 ) * Update funasr_wss_server.py * Update funasr_wss_client.py * Add files via upload * Update funasr_wss_server.py * Update funasr_wss_client.py * Add LoRA Paraformer README	2026-02-04 19:49:29 +08:00
游雁	3e99d0e826	update	2026-01-26 20:57:57 +08:00
彭震东and启焚	7f9083daab	add ct_tn.py (#2795 ) Co-authored-by: 启焚 <[email protected]>	2026-01-26 20:46:21 +08:00
游雁	335eb1ea61	update	2026-01-26 20:39:06 +08:00
游雁	c42f2540cc	fun-asr-nano	2025-12-16 00:46:16 +08:00
SnakeEye-sudo (Er. Sangam Krishna)	318f294fbd	docs: Fix syntax error in real-time ASR example (Issue #2720 ) (#2730 ) * docs: Fix syntax error in real-time ASR example (Issue #2720) Added documentation to fix syntax error in real-time speech recognition example. * docs: Add implementation guide for syntax error fix (Issue #2720) Added a section detailing files needing updates for the total_chunk_num calculation syntax error, including examples and testing instructions. * fix: Correct total_chunk_num syntax error in paraformer_streaming/demo.py * Correct total_chunk_num calculation in demo.py Fix calculation of total_chunk_num for speech processing.	2025-12-11 21:37:41 +08:00
Xuning Tan	8c6d1642f5	fix: correct the deepspeed_config path reference in the finetuning script (#2680 )	2025-10-01 14:45:45 +08:00
Anjali Barge	e175dae50b	examples: add improved batch_asr CLI example with error handling (#2675 ) * examples: add improved batch_asr CLI example with error handling * examples: address PR feedback — use relative paths as keys, add --vad-model, remove unused import/cache	2025-09-20 22:39:57 +08:00
天地	3903d7c775	Update README_zh.md (#2436 ) 修正推理参数笔误	2025-03-18 14:36:27 +08:00
zhifu gao	3f8294b9d7	Revert "shfit to shift (#2266 )" (#2336 ) This reverts commit `1367973f98`.	2024-12-25 17:16:11 +08:00
Rin Arakaki	1367973f98	shfit to shift (#2266 )	2024-12-24 17:51:31 +08:00
Kun Zou	b5ad7c81be	Support eparaformer model on aishell1 recipe (#2327 )	2024-12-21 17:13:46 +08:00
zhifu gao	f921a71818	Update demo.py	2024-12-17 17:50:39 +08:00
游雁	fdafd3f6bc	emotion2vec	2024-12-17 11:15:53 +08:00
shixian	026b8e3fdc	update sensevoice small with timestamp	2024-12-05 19:29:19 +08:00
shixian	e71546b06d	debug	2024-12-05 15:14:47 +08:00
游雁	f4c6af4528	docs	2024-11-21 16:07:06 +08:00
游雁	5e100f1244	ds stage0	2024-11-08 13:51:50 +08:00
游雁	fc515cbe2e	refactor(deepspeed_conf): 移除旧配置文件	2024-11-08 13:30:48 +08:00
游雁	1a0de67a08	SenseVoice docs	2024-11-07 13:58:20 +08:00
zhifu gao	cc88b1b317	Update finetune.sh	2024-10-31 18:49:42 +08:00
游雁	5c28b4d612	whisper-large-v3-turbo	2024-10-14 00:21:24 +08:00
游雁	6d932da239	whisper-large-v3-turbo	2024-10-11 14:37:27 +08:00
sugarcaseandpengteng.spt	a8f0aad81d	fsmn_kws_mt finetune and inference adapt to right modelscope hub (#2113 ) Co-authored-by: pengteng.spt <[email protected]>	2024-09-27 14:16:28 +08:00
sugarcaseandpengteng.spt	8cd8e25f18	add demo.py for all kws models (#2107 ) Co-authored-by: pengteng.spt <[email protected]>	2024-09-25 23:24:58 +08:00
zhifu gaoandpengteng.spt	2196844d1d	Dev kws (#2105 ) * multi tokenizer * support fsmn_kws, fsmn_kws_mt, sanm_kws, sanm_kws_streaming training * kws --------- Co-authored-by: pengteng.spt <[email protected]>	2024-09-25 15:10:50 +08:00
游雁	10dd49637e	docs	2024-08-20 14:12:37 +08:00
YC	259343dda5	fix error: _pickle.UnpicklingError: invalid load key, 'v'. (#1966 ) some one run this script will got the below error keywords: `_pickle.UnpicklingError: invalid load key, 'v'.` so add `lfs` to `git clone`. well, more detail can see in [this Issue comment](https://github.com/modelscope/FunASR/issues/1859#issuecomment-2254177392).	2024-07-29 09:48:34 +08:00
游雁	a33bc50e78	python runtime	2024-07-22 21:13:17 +08:00
游雁	c2575f022d	docs	2024-07-22 17:11:44 +08:00
维石	2ae59b6ce0	ONNX and torchscript export for sensevoice	2024-07-22 16:58:27 +08:00
游雁	e42f539eb8	bugfix	2024-07-22 15:03:35 +08:00
kaixindelele	89b0f92fde	fix model name bug (#1934 )	2024-07-22 09:44:03 +08:00
游雁	374998bd36	sensevoice	2024-07-16 14:30:16 +08:00
游雁	f0eec4c4da	sensevoice	2024-07-16 14:22:07 +08:00
游雁	8b74979bd3	sensevoice	2024-07-16 13:57:51 +08:00
北念	0fe232fd7b	add postprocess for sensevoice	2024-07-10 11:32:49 +08:00
北念	5448e926a2	add postprocess for sensevoice	2024-07-10 11:27:35 +08:00
游雁	0170f534b0	sensevoice	2024-07-05 00:17:06 +08:00
游雁	05f8022500	update	2024-07-01 11:16:23 +08:00
+9 zhifu gao Yabin Li 北念 nichongjia-2007 haoneng.lhn ZihanLiao zhaomingwork szsteven008 Ephemeroptera 彭震东 Shi Xian 维石 xiaowan0322 zhuangzhong Xingchen Song liugz18 Marlowe zhong zhuang PerfeZ	8c87a9d8a7	Dev gzf deepspeed (#1858 ) * total_time/accum_grad * fp16 * update with main (#1817) * add cmakelist * add paraformer-torch * add debug for funasr-onnx-offline * fix redefinition of jieba StdExtension.hpp * add loading torch models * update funasr-onnx-offline * add SwitchArg for wss-server * add SwitchArg for funasr-onnx-offline * update cmakelist * update funasr-onnx-offline-rtf * add define condition * add gpu define for offlne-stream * update com define * update offline-stream * update cmakelist * update func CompileHotwordEmbedding * add timestamp for paraformer-torch * add C10_USE_GLOG for paraformer-torch * update paraformer-torch * fix func FunASRWfstDecoderInit * update model.h * fix func FunASRWfstDecoderInit * fix tpass_stream * update paraformer-torch * add bladedisc for funasr-onnx-offline * update comdefine * update funasr-wss-server * add log for torch * fix GetValue BLADEDISC * fix log * update cmakelist * update warmup to 10 * update funasrruntime * add batch_size for wss-server * add batch for bins * add batch for offline-stream * add batch for paraformer * add batch for offline-stream * fix func SetBatchSize * add SetBatchSize for model * add SetBatchSize for model * fix func Forward * fix padding * update funasrruntime * add dec reset for batch * set batch default value * add argv for CutSplit * sort frame_queue * sorted msgs * fix FunOfflineInfer * add dynamic batch for fetch * fix FetchDynamic * update run_server.sh * update run_server.sh * cpp http post server support (#1739) * add cpp http server * add some comment * remove some comments * del debug infos * restore run_server.sh * adapt to new model struct * 修复了onnxruntime在macos下编译失败的错误 (#1748) * Add files via upload 增加macos的编译支持 * Add files via upload 增加macos支持 * Add files via upload target_link_directories(funasr PUBLIC ${ONNXRUNTIME_DIR}/lib) target_link_directories(funasr PUBLIC ${FFMPEG_DIR}/lib) 添加 if(APPLE) 限制 --------- Co-authored-by: Yabin Li <[email protected]> * Delete docs/images/wechat.png * Add files via upload * fixed the issues about seaco-onnx timestamp * fix bug (#1764) 当语音识别结果包含 `http` 时，标点符号预测会把它会被当成 url * fix empty asr result (#1765) 解码结果为空的语音片段，text 用空字符串 * update export * update export * docs * docs * update export name * docs * update * docs * docs * keep empty speech result (#1772) * docs * docs * update wechat QRcode * Add python funasr api support for websocket srv (#1777) * add python funasr_api supoort * change little to README.md * add core tools stream * modified a little * fix bug for timeout * support for buffer decode * add ffmpeg decode for buffer * libtorch demo * update libtorch infer * update utils * update demo * update demo * update libtorch inference * update model class * update seaco paraformer * bug fix * bug fix * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * Dev gzf exp (#1785) * resume from step * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * train_loss_avg train_acc_avg * train_loss_avg train_acc_avg * train_loss_avg train_acc_avg * log step * wav is not exist * wav is not exist * decoding * decoding * decoding * wechat * decoding key * decoding key * decoding key * decoding key * decoding key * decoding key * dynamic batch * start_data_split_i=0 * total_time/accum_grad * total_time/accum_grad * total_time/accum_grad * update avg slice * update avg slice * sensevoice sanm * sensevoice sanm * sensevoice sanm --------- Co-authored-by: 北念 <[email protected]> * auto frontend * update paraformer timestamp * [Optimization] support bladedisc fp16 optimization (#1790) * add cif_v1 and cif_export * Update SDK_advanced_guide_offline_zh.md * add cif_wo_hidden_v1 * [fix] fix empty asr result (#1794) * english timestamp for valilla paraformer * wechat * [fix] better solution for handling empty result (#1796) * update scripts * modify the qformer adaptor (#1804) Co-authored-by: nichongjia-2007 <[email protected]> * add ctc inference code (#1806) Co-authored-by: haoneng.lhn <[email protected]> * Update auto_model.py 修复空字串进入speaker model时报raw_text变量不存在的bug * Update auto_model.py 修复识别出空串后spk_model内变量未定义问题 * update model name * fix paramter 'quantize' unused issue (#1813) Co-authored-by: ZihanLiao <[email protected]> * wechat * Update cif_predictor.py (#1811) * Update cif_predictor.py * modify cif_v1_export under extreme cases, max_label_len calculated by batch_len misaligns with token_num * Update cif_predictor.py torch.cumsum precision degradation, using float64 instead * update code --------- Co-authored-by: 雾聪 <[email protected]> Co-authored-by: zhaomingwork <[email protected]> Co-authored-by: szsteven008 <[email protected]> Co-authored-by: Ephemeroptera <[email protected]> Co-authored-by: 彭震东 <[email protected]> Co-authored-by: Shi Xian <[email protected]> Co-authored-by: 维石 <[email protected]> Co-authored-by: 北念 <[email protected]> Co-authored-by: xiaowan0322 <[email protected]> Co-authored-by: zhuangzhong <[email protected]> Co-authored-by: Xingchen Song(宋星辰) <[email protected]> Co-authored-by: nichongjia-2007 <[email protected]> Co-authored-by: haoneng.lhn <[email protected]> Co-authored-by: liugz18 <[email protected]> Co-authored-by: Marlowe <[email protected]> Co-authored-by: ZihanLiao <[email protected]> Co-authored-by: zhong zhuang <[email protected]> * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * v1.0.28 (#1836) * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * update (#1841) * v1.0.28 * version checker * version checker * rollback cif_v1 for training bug * fixbug * fixbug for cif * fixbug --------- Co-authored-by: 维石 <[email protected]> * update (#1842) * v1.0.28 * version checker * version checker * rollback cif_v1 for training bug * fixbug * fixbug for cif * fixbug --------- Co-authored-by: 维石 <[email protected]> * inference * inference * inference * requests * finetune * finetune * finetune * finetune * finetune * add inference prepare func (#1848) * docs * docs * docs * docs * docs --------- Co-authored-by: 雾聪 <[email protected]> Co-authored-by: zhaomingwork <[email protected]> Co-authored-by: szsteven008 <[email protected]> Co-authored-by: Ephemeroptera <[email protected]> Co-authored-by: 彭震东 <[email protected]> Co-authored-by: Shi Xian <[email protected]> Co-authored-by: 维石 <[email protected]> Co-authored-by: 北念 <[email protected]> Co-authored-by: xiaowan0322 <[email protected]> Co-authored-by: zhuangzhong <[email protected]> Co-authored-by: Xingchen Song(宋星辰) <[email protected]> Co-authored-by: nichongjia-2007 <[email protected]> Co-authored-by: haoneng.lhn <[email protected]> Co-authored-by: liugz18 <[email protected]> Co-authored-by: Marlowe <[email protected]> Co-authored-by: ZihanLiao <[email protected]> Co-authored-by: zhong zhuang <[email protected]> Co-authored-by: PerfeZ <[email protected]>	2024-06-28 17:28:09 +08:00
+11 Yabin Li 北念 zhaomingwork szsteven008 Ephemeroptera 彭震东 Shi Xian 维石 nichongjia-2007 haoneng.lhn ZihanLiao 游雁 gaochangfeng 常材 nsdou xiaowan0322 zhuangzhong Xingchen Song liugz18 Marlowe zhong zhuang	b7060884fa	Merge Dev tclas (#1847 ) * support clas torchscripts * fix CompileHotwordEmbedding * add batch for tensor_hw_emb * fix func of TimestampOnnx * fix func of TimestampOnnx * fix func of TimestampOnnx * fix paraformer-torch fwd * fix paraformer-torch fwd * fix paraformer-torch fwd * fix ~paraformer-torch * update funasr-onnx-offline-rtf * update funasr-onnx-offline-rtf * update funasr-onnx-offline-rtf * change tos model names * fix results of ParaformerTorch::Forward * fix results of ParaformerTorch::Forward * add FusionStrategy for torch * fix paraformer torch * sync to main (#1826) * resume from step * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * train_loss_avg train_acc_avg * train_loss_avg train_acc_avg * train_loss_avg train_acc_avg * log step * wav is not exist * wav is not exist * decoding * decoding * decoding * wechat * decoding key * decoding key * decoding key * decoding key * decoding key * decoding key * dynamic batch * start_data_split_i=0 * total_time/accum_grad * total_time/accum_grad * total_time/accum_grad * update avg slice * update avg slice * sensevoice sanm * sensevoice sanm * add * add * add * add * deepspeed * update with main (#1731) * c++ runtime adapt to 1.0 (#1724) * adapt vad runtime to 1.0 * add json * change yml name * add func LoadVocabFromJson * add token file for InitAsr * add token path for OfflineStream * add funcOpenYaml * add token file for InitPunc * add token file for stream * update punc-model * update funasr-wss-server * update runtime_sdk_download_tool.py * update docker list * Delete docs/images/wechat.png * Add files via upload * Emo2Vec限定选择的情感类别 (#1730) * 限定选择的情感类别 * 使用none来禁用情感标签输出 * 修改输出接口 * 使用unuse来禁用token --------- Co-authored-by: 常材 <[email protected]> * bugfix * v1.0.27 * update docs * hf hub * Fix incorrect assignment of 'end' attribute to 'start' in sentences list comprehension (#1680) --------- Co-authored-by: Yabin Li <[email protected]> Co-authored-by: gaochangfeng <[email protected]> Co-authored-by: 常材 <[email protected]> Co-authored-by: nsdou <[email protected]> * docs * docs * deepspeed * deepspeed * deepspeed * deepspeed * update * ds * ds * ds * ds * ds * ds * ds * add * add * bugfix * add * wenetspeech * wenetspeech * wenetspeech * wenetspeech * wenetspeech * wenetspeech * update export * update export * update export name * update * docs * update wechat QRcode * Add python funasr api support for websocket srv (#1777) * add python funasr_api supoort * change little to README.md * add core tools stream * modified a little * fix bug for timeout * support for buffer decode * add ffmpeg decode for buffer * libtorch demo * update libtorch infer * update utils * update demo * update demo * update libtorch inference * update model class * update seaco paraformer * bug fix * bug fix * auto frontend * auto frontend * update with main (#1783) * add cmakelist * add paraformer-torch * add debug for funasr-onnx-offline * fix redefinition of jieba StdExtension.hpp * add loading torch models * update funasr-onnx-offline * add SwitchArg for wss-server * add SwitchArg for funasr-onnx-offline * update cmakelist * update funasr-onnx-offline-rtf * add define condition * add gpu define for offlne-stream * update com define * update offline-stream * update cmakelist * update func CompileHotwordEmbedding * add timestamp for paraformer-torch * add C10_USE_GLOG for paraformer-torch * update paraformer-torch * fix func FunASRWfstDecoderInit * update model.h * fix func FunASRWfstDecoderInit * fix tpass_stream * update paraformer-torch * add bladedisc for funasr-onnx-offline * update comdefine * update funasr-wss-server * add log for torch * fix GetValue BLADEDISC * fix log * update cmakelist * update warmup to 10 * update funasrruntime * add batch_size for wss-server * add batch for bins * add batch for offline-stream * add batch for paraformer * add batch for offline-stream * fix func SetBatchSize * add SetBatchSize for model * add SetBatchSize for model * fix func Forward * fix padding * update funasrruntime * add dec reset for batch * set batch default value * add argv for CutSplit * sort frame_queue * sorted msgs * fix FunOfflineInfer * add dynamic batch for fetch * fix FetchDynamic * update run_server.sh * update run_server.sh * cpp http post server support (#1739) * add cpp http server * add some comment * remove some comments * del debug infos * restore run_server.sh * adapt to new model struct * 修复了onnxruntime在macos下编译失败的错误 (#1748) * Add files via upload 增加macos的编译支持 * Add files via upload 增加macos支持 * Add files via upload target_link_directories(funasr PUBLIC ${ONNXRUNTIME_DIR}/lib) target_link_directories(funasr PUBLIC ${FFMPEG_DIR}/lib) 添加 if(APPLE) 限制 --------- Co-authored-by: Yabin Li <[email protected]> * Delete docs/images/wechat.png * Add files via upload * fixed the issues about seaco-onnx timestamp * fix bug (#1764) 当语音识别结果包含 `http` 时，标点符号预测会把它会被当成 url * fix empty asr result (#1765) 解码结果为空的语音片段，text 用空字符串 * docs * docs * docs * docs * docs * keep empty speech result (#1772) * docs * docs * update wechat QRcode * Add python funasr api support for websocket srv (#1777) * add python funasr_api supoort * change little to README.md * add core tools stream * modified a little * fix bug for timeout * support for buffer decode * add ffmpeg decode for buffer * auto frontend * auto frontend --------- Co-authored-by: 雾聪 <[email protected]> Co-authored-by: zhaomingwork <[email protected]> Co-authored-by: szsteven008 <[email protected]> Co-authored-by: Ephemeroptera <[email protected]> Co-authored-by: 彭震东 <[email protected]> Co-authored-by: Shi Xian <[email protected]> Co-authored-by: 维石 <[email protected]> * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * Dev gzf exp (#1785) * resume from step * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * train_loss_avg train_acc_avg * train_loss_avg train_acc_avg * train_loss_avg train_acc_avg * log step * wav is not exist * wav is not exist * decoding * decoding * decoding * wechat * decoding key * decoding key * decoding key * decoding key * decoding key * decoding key * dynamic batch * start_data_split_i=0 * total_time/accum_grad * total_time/accum_grad * total_time/accum_grad * update avg slice * update avg slice * sensevoice sanm * sensevoice sanm * sensevoice sanm --------- Co-authored-by: 北念 <[email protected]> * auto frontend * update with main (#1786) * add cmakelist * add paraformer-torch * add debug for funasr-onnx-offline * fix redefinition of jieba StdExtension.hpp * add loading torch models * update funasr-onnx-offline * add SwitchArg for wss-server * add SwitchArg for funasr-onnx-offline * update cmakelist * update funasr-onnx-offline-rtf * add define condition * add gpu define for offlne-stream * update com define * update offline-stream * update cmakelist * update func CompileHotwordEmbedding * add timestamp for paraformer-torch * add C10_USE_GLOG for paraformer-torch * update paraformer-torch * fix func FunASRWfstDecoderInit * update model.h * fix func FunASRWfstDecoderInit * fix tpass_stream * update paraformer-torch * add bladedisc for funasr-onnx-offline * update comdefine * update funasr-wss-server * add log for torch * fix GetValue BLADEDISC * fix log * update cmakelist * update warmup to 10 * update funasrruntime * add batch_size for wss-server * add batch for bins * add batch for offline-stream * add batch for paraformer * add batch for offline-stream * fix func SetBatchSize * add SetBatchSize for model * add SetBatchSize for model * fix func Forward * fix padding * update funasrruntime * add dec reset for batch * set batch default value * add argv for CutSplit * sort frame_queue * sorted msgs * fix FunOfflineInfer * add dynamic batch for fetch * fix FetchDynamic * update run_server.sh * update run_server.sh * cpp http post server support (#1739) * add cpp http server * add some comment * remove some comments * del debug infos * restore run_server.sh * adapt to new model struct * 修复了onnxruntime在macos下编译失败的错误 (#1748) * Add files via upload 增加macos的编译支持 * Add files via upload 增加macos支持 * Add files via upload target_link_directories(funasr PUBLIC ${ONNXRUNTIME_DIR}/lib) target_link_directories(funasr PUBLIC ${FFMPEG_DIR}/lib) 添加 if(APPLE) 限制 --------- Co-authored-by: Yabin Li <[email protected]> * Delete docs/images/wechat.png * Add files via upload * fixed the issues about seaco-onnx timestamp * fix bug (#1764) 当语音识别结果包含 `http` 时，标点符号预测会把它会被当成 url * fix empty asr result (#1765) 解码结果为空的语音片段，text 用空字符串 * docs * docs * docs * docs * docs * keep empty speech result (#1772) * docs * docs * update wechat QRcode * Add python funasr api support for websocket srv (#1777) * add python funasr_api supoort * change little to README.md * add core tools stream * modified a little * fix bug for timeout * support for buffer decode * add ffmpeg decode for buffer * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * Dev gzf exp (#1785) * resume from step * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * train_loss_avg train_acc_avg * train_loss_avg train_acc_avg * train_loss_avg train_acc_avg * log step * wav is not exist * wav is not exist * decoding * decoding * decoding * wechat * decoding key * decoding key * decoding key * decoding key * decoding key * decoding key * dynamic batch * start_data_split_i=0 * total_time/accum_grad * total_time/accum_grad * total_time/accum_grad * update avg slice * update avg slice * sensevoice sanm * sensevoice sanm * sensevoice sanm --------- Co-authored-by: 北念 <[email protected]> * auto frontend --------- Co-authored-by: 雾聪 <[email protected]> Co-authored-by: zhaomingwork <[email protected]> Co-authored-by: szsteven008 <[email protected]> Co-authored-by: Ephemeroptera <[email protected]> Co-authored-by: 彭震东 <[email protected]> Co-authored-by: Shi Xian <[email protected]> Co-authored-by: 维石 <[email protected]> Co-authored-by: 北念 <[email protected]> * update paraformer timestamp * auto frontend * auto frontend * [Optimization] support bladedisc fp16 optimization (#1790) * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * add cif_v1 and cif_export * auto frontend * Update SDK_advanced_guide_offline_zh.md * add cif_wo_hidden_v1 * auto frontend * auto frontend * auto frontend * fix bug * [fix] fix empty asr result (#1794) * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fix bug * fp16 * english timestamp for valilla paraformer * fp16 * wechat * fixbug * [fix] better solution for handling empty result (#1796) * update scripts * modify the qformer adaptor (#1804) Co-authored-by: nichongjia-2007 <[email protected]> * add ctc inference code (#1806) Co-authored-by: haoneng.lhn <[email protected]> * Update auto_model.py 修复空字串进入speaker model时报raw_text变量不存在的bug * Update auto_model.py 修复识别出空串后spk_model内变量未定义问题 * update model name * fix paramter 'quantize' unused issue (#1813) Co-authored-by: ZihanLiao <[email protected]> * wechat * Update cif_predictor.py (#1811) * Update cif_predictor.py * modify cif_v1_export under extreme cases, max_label_len calculated by batch_len misaligns with token_num * Update cif_predictor.py torch.cumsum precision degradation, using float64 instead * update code --------- Co-authored-by: 游雁 <[email protected]> Co-authored-by: gaochangfeng <[email protected]> Co-authored-by: 常材 <[email protected]> Co-authored-by: nsdou <[email protected]> Co-authored-by: 维石 <[email protected]> Co-authored-by: zhaomingwork <[email protected]> Co-authored-by: szsteven008 <[email protected]> Co-authored-by: Ephemeroptera <[email protected]> Co-authored-by: 彭震东 <[email protected]> Co-authored-by: Shi Xian <[email protected]> Co-authored-by: 北念 <[email protected]> Co-authored-by: xiaowan0322 <[email protected]> Co-authored-by: zhuangzhong <[email protected]> Co-authored-by: Xingchen Song(宋星辰) <[email protected]> Co-authored-by: nichongjia-2007 <[email protected]> Co-authored-by: haoneng.lhn <[email protected]> Co-authored-by: liugz18 <[email protected]> Co-authored-by: Marlowe <[email protected]> Co-authored-by: ZihanLiao <[email protected]> Co-authored-by: zhong zhuang <[email protected]> * update runtime_sdk_download_tool * update funasr-wss-server * update vad_revision * update funasr-wss-server * update funasr-wss-server * update punc quant * rename torchscript * Delete examples/industrial_data_pretraining/ctc/infer_from_local.py * resolve conflicts --------- Co-authored-by: 游雁 <[email protected]> Co-authored-by: gaochangfeng <[email protected]> Co-authored-by: 常材 <[email protected]> Co-authored-by: nsdou <[email protected]> Co-authored-by: 维石 <[email protected]> Co-authored-by: zhaomingwork <[email protected]> Co-authored-by: szsteven008 <[email protected]> Co-authored-by: Ephemeroptera <[email protected]> Co-authored-by: 彭震东 <[email protected]> Co-authored-by: Shi Xian <[email protected]> Co-authored-by: 北念 <[email protected]> Co-authored-by: xiaowan0322 <[email protected]> Co-authored-by: zhuangzhong <[email protected]> Co-authored-by: Xingchen Song(宋星辰) <[email protected]> Co-authored-by: nichongjia-2007 <[email protected]> Co-authored-by: haoneng.lhn <[email protected]> Co-authored-by: liugz18 <[email protected]> Co-authored-by: Marlowe <[email protected]> Co-authored-by: ZihanLiao <[email protected]> Co-authored-by: zhong zhuang <[email protected]>	2024-06-25 17:38:04 +08:00
+8 zhifu gao Yabin Li 北念 nichongjia-2007 haoneng.lhn ZihanLiao zhaomingwork szsteven008 Ephemeroptera 彭震东 Shi Xian 维石 xiaowan0322 zhuangzhong Xingchen Song liugz18 Marlowe zhong zhuang	abb33d6b20	Dev gzf deepspeed (#1844 ) * total_time/accum_grad * fp16 * update with main (#1817) * add cmakelist * add paraformer-torch * add debug for funasr-onnx-offline * fix redefinition of jieba StdExtension.hpp * add loading torch models * update funasr-onnx-offline * add SwitchArg for wss-server * add SwitchArg for funasr-onnx-offline * update cmakelist * update funasr-onnx-offline-rtf * add define condition * add gpu define for offlne-stream * update com define * update offline-stream * update cmakelist * update func CompileHotwordEmbedding * add timestamp for paraformer-torch * add C10_USE_GLOG for paraformer-torch * update paraformer-torch * fix func FunASRWfstDecoderInit * update model.h * fix func FunASRWfstDecoderInit * fix tpass_stream * update paraformer-torch * add bladedisc for funasr-onnx-offline * update comdefine * update funasr-wss-server * add log for torch * fix GetValue BLADEDISC * fix log * update cmakelist * update warmup to 10 * update funasrruntime * add batch_size for wss-server * add batch for bins * add batch for offline-stream * add batch for paraformer * add batch for offline-stream * fix func SetBatchSize * add SetBatchSize for model * add SetBatchSize for model * fix func Forward * fix padding * update funasrruntime * add dec reset for batch * set batch default value * add argv for CutSplit * sort frame_queue * sorted msgs * fix FunOfflineInfer * add dynamic batch for fetch * fix FetchDynamic * update run_server.sh * update run_server.sh * cpp http post server support (#1739) * add cpp http server * add some comment * remove some comments * del debug infos * restore run_server.sh * adapt to new model struct * 修复了onnxruntime在macos下编译失败的错误 (#1748) * Add files via upload 增加macos的编译支持 * Add files via upload 增加macos支持 * Add files via upload target_link_directories(funasr PUBLIC ${ONNXRUNTIME_DIR}/lib) target_link_directories(funasr PUBLIC ${FFMPEG_DIR}/lib) 添加 if(APPLE) 限制 --------- Co-authored-by: Yabin Li <[email protected]> * Delete docs/images/wechat.png * Add files via upload * fixed the issues about seaco-onnx timestamp * fix bug (#1764) 当语音识别结果包含 `http` 时，标点符号预测会把它会被当成 url * fix empty asr result (#1765) 解码结果为空的语音片段，text 用空字符串 * update export * update export * docs * docs * update export name * docs * update * docs * docs * keep empty speech result (#1772) * docs * docs * update wechat QRcode * Add python funasr api support for websocket srv (#1777) * add python funasr_api supoort * change little to README.md * add core tools stream * modified a little * fix bug for timeout * support for buffer decode * add ffmpeg decode for buffer * libtorch demo * update libtorch infer * update utils * update demo * update demo * update libtorch inference * update model class * update seaco paraformer * bug fix * bug fix * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * auto frontend * Dev gzf exp (#1785) * resume from step * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * batch * train_loss_avg train_acc_avg * train_loss_avg train_acc_avg * train_loss_avg train_acc_avg * log step * wav is not exist * wav is not exist * decoding * decoding * decoding * wechat * decoding key * decoding key * decoding key * decoding key * decoding key * decoding key * dynamic batch * start_data_split_i=0 * total_time/accum_grad * total_time/accum_grad * total_time/accum_grad * update avg slice * update avg slice * sensevoice sanm * sensevoice sanm * sensevoice sanm --------- Co-authored-by: 北念 <[email protected]> * auto frontend * update paraformer timestamp * [Optimization] support bladedisc fp16 optimization (#1790) * add cif_v1 and cif_export * Update SDK_advanced_guide_offline_zh.md * add cif_wo_hidden_v1 * [fix] fix empty asr result (#1794) * english timestamp for valilla paraformer * wechat * [fix] better solution for handling empty result (#1796) * update scripts * modify the qformer adaptor (#1804) Co-authored-by: nichongjia-2007 <[email protected]> * add ctc inference code (#1806) Co-authored-by: haoneng.lhn <[email protected]> * Update auto_model.py 修复空字串进入speaker model时报raw_text变量不存在的bug * Update auto_model.py 修复识别出空串后spk_model内变量未定义问题 * update model name * fix paramter 'quantize' unused issue (#1813) Co-authored-by: ZihanLiao <[email protected]> * wechat * Update cif_predictor.py (#1811) * Update cif_predictor.py * modify cif_v1_export under extreme cases, max_label_len calculated by batch_len misaligns with token_num * Update cif_predictor.py torch.cumsum precision degradation, using float64 instead * update code --------- Co-authored-by: 雾聪 <[email protected]> Co-authored-by: zhaomingwork <[email protected]> Co-authored-by: szsteven008 <[email protected]> Co-authored-by: Ephemeroptera <[email protected]> Co-authored-by: 彭震东 <[email protected]> Co-authored-by: Shi Xian <[email protected]> Co-authored-by: 维石 <[email protected]> Co-authored-by: 北念 <[email protected]> Co-authored-by: xiaowan0322 <[email protected]> Co-authored-by: zhuangzhong <[email protected]> Co-authored-by: Xingchen Song(宋星辰) <[email protected]> Co-authored-by: nichongjia-2007 <[email protected]> Co-authored-by: haoneng.lhn <[email protected]> Co-authored-by: liugz18 <[email protected]> Co-authored-by: Marlowe <[email protected]> Co-authored-by: ZihanLiao <[email protected]> Co-authored-by: zhong zhuang <[email protected]> * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * v1.0.28 (#1836) * sensevoice * sensevoice * sensevoice * sensevoice * sensevoice * update (#1841) * v1.0.28 * version checker * version checker * rollback cif_v1 for training bug * fixbug * fixbug for cif * fixbug --------- Co-authored-by: 维石 <[email protected]> * update (#1842) * v1.0.28 * version checker * version checker * rollback cif_v1 for training bug * fixbug * fixbug for cif * fixbug --------- Co-authored-by: 维石 <[email protected]> * inference --------- Co-authored-by: 雾聪 <[email protected]> Co-authored-by: zhaomingwork <[email protected]> Co-authored-by: szsteven008 <[email protected]> Co-authored-by: Ephemeroptera <[email protected]> Co-authored-by: 彭震东 <[email protected]> Co-authored-by: Shi Xian <[email protected]> Co-authored-by: 维石 <[email protected]> Co-authored-by: 北念 <[email protected]> Co-authored-by: xiaowan0322 <[email protected]> Co-authored-by: zhuangzhong <[email protected]> Co-authored-by: Xingchen Song(宋星辰) <[email protected]> Co-authored-by: nichongjia-2007 <[email protected]> Co-authored-by: haoneng.lhn <[email protected]> Co-authored-by: liugz18 <[email protected]> Co-authored-by: Marlowe <[email protected]> Co-authored-by: ZihanLiao <[email protected]> Co-authored-by: zhong zhuang <[email protected]>	2024-06-24 17:06:21 +08:00

1 2 3 4 5 ...