Commit Graph
323 Commits
Author SHA1 Message Date
彭震东and启焚 7f9083daab add ct_tn.py (#2795)
Co-authored-by: 启焚 <[email protected]>
2026-01-26 20:46:21 +08:00
游雁 335eb1ea61 update 2026-01-26 20:39:06 +08:00
游雁 c42f2540cc fun-asr-nano 2025-12-16 00:46:16 +08:00
SnakeEye-sudo (Er. Sangam Krishna) 318f294fbd docs: Fix syntax error in real-time ASR example (Issue #2720) (#2730)
* docs: Fix syntax error in real-time ASR example (Issue #2720)

Added documentation to fix syntax error in real-time speech recognition example.

* docs: Add implementation guide for syntax error fix (Issue #2720)

Added a section detailing files needing updates for the total_chunk_num calculation syntax error, including examples and testing instructions.

* fix: Correct total_chunk_num syntax error in paraformer_streaming/demo.py

* Correct total_chunk_num calculation in demo.py

Fix calculation of total_chunk_num for speech processing.
2025-12-11 21:37:41 +08:00
Xuning Tan 8c6d1642f5 fix: correct the deepspeed_config path reference in the finetuning script (#2680) 2025-10-01 14:45:45 +08:00
Anjali Barge e175dae50b examples: add improved batch_asr CLI example with error handling (#2675)
* examples: add improved batch_asr CLI example with error handling

* examples: address PR feedback — use relative paths as keys, add --vad-model, remove unused import/cache
2025-09-20 22:39:57 +08:00
天地 3903d7c775 Update README_zh.md (#2436)
修正推理参数笔误
2025-03-18 14:36:27 +08:00
zhifu gao 3f8294b9d7 Revert "shfit to shift (#2266)" (#2336)
This reverts commit 1367973f98.
2024-12-25 17:16:11 +08:00
Rin Arakaki 1367973f98 shfit to shift (#2266) 2024-12-24 17:51:31 +08:00
Kun Zou b5ad7c81be Support eparaformer model on aishell1 recipe (#2327) 2024-12-21 17:13:46 +08:00
zhifu gao f921a71818 Update demo.py 2024-12-17 17:50:39 +08:00
游雁 fdafd3f6bc emotion2vec 2024-12-17 11:15:53 +08:00
shixian 026b8e3fdc update sensevoice small with timestamp 2024-12-05 19:29:19 +08:00
shixian e71546b06d debug 2024-12-05 15:14:47 +08:00
游雁 f4c6af4528 docs 2024-11-21 16:07:06 +08:00
游雁 5e100f1244 ds stage0 2024-11-08 13:51:50 +08:00
游雁 fc515cbe2e refactor(deepspeed_conf): 移除旧配置文件 2024-11-08 13:30:48 +08:00
游雁 1a0de67a08 SenseVoice docs 2024-11-07 13:58:20 +08:00
zhifu gao cc88b1b317 Update finetune.sh 2024-10-31 18:49:42 +08:00
游雁 5c28b4d612 whisper-large-v3-turbo 2024-10-14 00:21:24 +08:00
游雁 6d932da239 whisper-large-v3-turbo 2024-10-11 14:37:27 +08:00
sugarcaseandpengteng.spt a8f0aad81d fsmn_kws_mt finetune and inference adapt to right modelscope hub (#2113)
Co-authored-by: pengteng.spt <[email protected]>
2024-09-27 14:16:28 +08:00
sugarcaseandpengteng.spt 8cd8e25f18 add demo.py for all kws models (#2107)
Co-authored-by: pengteng.spt <[email protected]>
2024-09-25 23:24:58 +08:00
zhifu gaoandpengteng.spt 2196844d1d Dev kws (#2105)
* multi tokenizer

* support fsmn_kws, fsmn_kws_mt, sanm_kws, sanm_kws_streaming training

* kws

---------

Co-authored-by: pengteng.spt <[email protected]>
2024-09-25 15:10:50 +08:00
游雁 10dd49637e docs 2024-08-20 14:12:37 +08:00
YC 259343dda5 fix error: _pickle.UnpicklingError: invalid load key, 'v'. (#1966)
some one run this script will got the below error keywords:

`_pickle.UnpicklingError: invalid load key, 'v'.`

so add `lfs` to `git clone`.

well, more detail can see in [this Issue comment](https://github.com/modelscope/FunASR/issues/1859#issuecomment-2254177392).
2024-07-29 09:48:34 +08:00
游雁 a33bc50e78 python runtime 2024-07-22 21:13:17 +08:00
游雁 c2575f022d docs 2024-07-22 17:11:44 +08:00
维石 2ae59b6ce0 ONNX and torchscript export for sensevoice 2024-07-22 16:58:27 +08:00
游雁 e42f539eb8 bugfix 2024-07-22 15:03:35 +08:00
kaixindelele 89b0f92fde fix model name bug (#1934) 2024-07-22 09:44:03 +08:00
游雁 374998bd36 sensevoice 2024-07-16 14:30:16 +08:00
游雁 f0eec4c4da sensevoice 2024-07-16 14:22:07 +08:00
游雁 8b74979bd3 sensevoice 2024-07-16 13:57:51 +08:00
北念 0fe232fd7b add postprocess for sensevoice 2024-07-10 11:32:49 +08:00
北念 5448e926a2 add postprocess for sensevoice 2024-07-10 11:27:35 +08:00
游雁 0170f534b0 sensevoice 2024-07-05 00:17:06 +08:00
游雁 05f8022500 update 2024-07-01 11:16:23 +08:00
+9 8c87a9d8a7 Dev gzf deepspeed (#1858)
* total_time/accum_grad

* fp16

* update with main (#1817)

* add cmakelist

* add paraformer-torch

* add debug for funasr-onnx-offline

* fix redefinition of jieba StdExtension.hpp

* add loading torch models

* update funasr-onnx-offline

* add SwitchArg for wss-server

* add SwitchArg for funasr-onnx-offline

* update cmakelist

* update funasr-onnx-offline-rtf

* add define condition

* add gpu define for offlne-stream

* update com define

* update offline-stream

* update cmakelist

* update func CompileHotwordEmbedding

* add timestamp for paraformer-torch

* add C10_USE_GLOG for paraformer-torch

* update paraformer-torch

* fix func FunASRWfstDecoderInit

* update model.h

* fix func FunASRWfstDecoderInit

* fix tpass_stream

* update paraformer-torch

* add bladedisc for funasr-onnx-offline

* update comdefine

* update funasr-wss-server

* add log for torch

* fix GetValue BLADEDISC

* fix log

* update cmakelist

* update warmup to 10

* update funasrruntime

* add batch_size for wss-server

* add batch for bins

* add batch for offline-stream

* add batch for paraformer

* add batch for offline-stream

* fix func SetBatchSize

* add SetBatchSize for model

* add SetBatchSize for model

* fix func Forward

* fix padding

* update funasrruntime

* add dec reset for batch

* set batch default value

* add argv for CutSplit

* sort frame_queue

* sorted msgs

* fix FunOfflineInfer

* add dynamic batch for fetch

* fix FetchDynamic

* update run_server.sh

* update run_server.sh

* cpp http post server support (#1739)

* add cpp http server

* add some comment

* remove some comments

* del debug infos

* restore run_server.sh

* adapt to new model struct

* 修复了onnxruntime在macos下编译失败的错误 (#1748)

* Add files via upload

增加macos的编译支持

* Add files via upload

增加macos支持

* Add files via upload

target_link_directories(funasr PUBLIC ${ONNXRUNTIME_DIR}/lib)
target_link_directories(funasr PUBLIC ${FFMPEG_DIR}/lib)
添加 if(APPLE) 限制

---------

Co-authored-by: Yabin Li <[email protected]>

* Delete docs/images/wechat.png

* Add files via upload

* fixed the issues about seaco-onnx timestamp

* fix bug (#1764)

当语音识别结果包含 `http` 时,标点符号预测会把它会被当成 url

* fix empty asr result (#1765)

解码结果为空的语音片段,text 用空字符串

* update export

* update export

* docs

* docs

* update export name

* docs

* update

* docs

* docs

* keep empty speech result (#1772)

* docs

* docs

* update wechat QRcode

* Add python funasr api support for websocket srv (#1777)

* add python funasr_api supoort

* change little to README.md

* add core tools stream

* modified a little

* fix bug for timeout

* support for buffer decode

* add ffmpeg decode for buffer

* libtorch demo

* update libtorch infer

* update utils

* update demo

* update demo

* update libtorch inference

* update model class

* update seaco paraformer

* bug fix

* bug fix

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* Dev gzf exp (#1785)

* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* log step

* wav is not exist

* wav is not exist

* decoding

* decoding

* decoding

* wechat

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* dynamic batch

* start_data_split_i=0

* total_time/accum_grad

* total_time/accum_grad

* total_time/accum_grad

* update avg slice

* update avg slice

* sensevoice sanm

* sensevoice sanm

* sensevoice sanm

---------

Co-authored-by: 北念 <[email protected]>

* auto frontend

* update paraformer timestamp

* [Optimization] support bladedisc fp16 optimization (#1790)

* add cif_v1 and cif_export

* Update SDK_advanced_guide_offline_zh.md

* add cif_wo_hidden_v1

* [fix] fix empty asr result (#1794)

* english timestamp for valilla paraformer

* wechat

* [fix] better solution for handling empty result (#1796)

* update scripts

* modify the qformer adaptor (#1804)

Co-authored-by: nichongjia-2007 <[email protected]>

* add ctc inference code (#1806)

Co-authored-by: haoneng.lhn <[email protected]>

* Update auto_model.py

修复空字串进入speaker model时报raw_text变量不存在的bug

* Update auto_model.py

修复识别出空串后spk_model内变量未定义问题

* update model name

* fix paramter 'quantize' unused issue (#1813)

Co-authored-by: ZihanLiao <[email protected]>

* wechat

* Update cif_predictor.py (#1811)

* Update cif_predictor.py

* modify cif_v1_export

under extreme cases, max_label_len calculated by batch_len misaligns with token_num

* Update cif_predictor.py

torch.cumsum precision degradation, using float64 instead

* update code

---------

Co-authored-by: 雾聪 <[email protected]>
Co-authored-by: zhaomingwork <[email protected]>
Co-authored-by: szsteven008 <[email protected]>
Co-authored-by: Ephemeroptera <[email protected]>
Co-authored-by: 彭震东 <[email protected]>
Co-authored-by: Shi Xian <[email protected]>
Co-authored-by: 维石 <[email protected]>
Co-authored-by: 北念 <[email protected]>
Co-authored-by: xiaowan0322 <[email protected]>
Co-authored-by: zhuangzhong <[email protected]>
Co-authored-by: Xingchen Song(宋星辰) <[email protected]>
Co-authored-by: nichongjia-2007 <[email protected]>
Co-authored-by: haoneng.lhn <[email protected]>
Co-authored-by: liugz18 <[email protected]>
Co-authored-by: Marlowe <[email protected]>
Co-authored-by: ZihanLiao <[email protected]>
Co-authored-by: zhong zhuang <[email protected]>

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* v1.0.28 (#1836)

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* update (#1841)

* v1.0.28

* version checker

* version checker

* rollback cif_v1 for training bug

* fixbug

* fixbug for cif

* fixbug

---------

Co-authored-by: 维石 <[email protected]>

* update (#1842)

* v1.0.28

* version checker

* version checker

* rollback cif_v1 for training bug

* fixbug

* fixbug for cif

* fixbug

---------

Co-authored-by: 维石 <[email protected]>

* inference

* inference

* inference

* requests

* finetune

* finetune

* finetune

* finetune

* finetune

* add inference prepare func (#1848)

* docs

* docs

* docs

* docs

* docs

---------

Co-authored-by: 雾聪 <[email protected]>
Co-authored-by: zhaomingwork <[email protected]>
Co-authored-by: szsteven008 <[email protected]>
Co-authored-by: Ephemeroptera <[email protected]>
Co-authored-by: 彭震东 <[email protected]>
Co-authored-by: Shi Xian <[email protected]>
Co-authored-by: 维石 <[email protected]>
Co-authored-by: 北念 <[email protected]>
Co-authored-by: xiaowan0322 <[email protected]>
Co-authored-by: zhuangzhong <[email protected]>
Co-authored-by: Xingchen Song(宋星辰) <[email protected]>
Co-authored-by: nichongjia-2007 <[email protected]>
Co-authored-by: haoneng.lhn <[email protected]>
Co-authored-by: liugz18 <[email protected]>
Co-authored-by: Marlowe <[email protected]>
Co-authored-by: ZihanLiao <[email protected]>
Co-authored-by: zhong zhuang <[email protected]>
Co-authored-by: PerfeZ <[email protected]>
2024-06-28 17:28:09 +08:00
+11 b7060884fa Merge Dev tclas (#1847)
* support clas torchscripts

* fix CompileHotwordEmbedding

* add batch for tensor_hw_emb

* fix func of TimestampOnnx

* fix func of TimestampOnnx

* fix func of TimestampOnnx

* fix paraformer-torch fwd

* fix paraformer-torch fwd

* fix paraformer-torch fwd

* fix ~paraformer-torch

* update funasr-onnx-offline-rtf

* update funasr-onnx-offline-rtf

* update funasr-onnx-offline-rtf

* change tos model names

* fix results of ParaformerTorch::Forward

* fix results of ParaformerTorch::Forward

* add FusionStrategy for torch

* fix paraformer torch

* sync to main (#1826)

* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* log step

* wav is not exist

* wav is not exist

* decoding

* decoding

* decoding

* wechat

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* dynamic batch

* start_data_split_i=0

* total_time/accum_grad

* total_time/accum_grad

* total_time/accum_grad

* update avg slice

* update avg slice

* sensevoice sanm

* sensevoice sanm

* add

* add

* add

* add

* deepspeed

* update with main (#1731)

* c++ runtime adapt to 1.0 (#1724)

* adapt vad runtime to 1.0

* add json

* change yml name

* add func LoadVocabFromJson

* add token file for InitAsr

* add token path for OfflineStream

* add funcOpenYaml

* add token file for InitPunc

* add token file for stream

* update punc-model

* update funasr-wss-server

* update runtime_sdk_download_tool.py

* update docker list

* Delete docs/images/wechat.png

* Add files via upload

* Emo2Vec限定选择的情感类别 (#1730)

* 限定选择的情感类别

* 使用none来禁用情感标签输出

* 修改输出接口

* 使用unuse来禁用token

---------

Co-authored-by: 常材 <[email protected]>

* bugfix

* v1.0.27

* update docs

* hf hub

* Fix incorrect assignment of 'end' attribute to 'start' in sentences list comprehension (#1680)

---------

Co-authored-by: Yabin Li <[email protected]>
Co-authored-by: gaochangfeng <[email protected]>
Co-authored-by: 常材 <[email protected]>
Co-authored-by: nsdou <[email protected]>

* docs

* docs

* deepspeed

* deepspeed

* deepspeed

* deepspeed

* update

* ds

* ds

* ds

* ds

* ds

* ds

* ds

* add

* add

* bugfix

* add

* wenetspeech

* wenetspeech

* wenetspeech

* wenetspeech

* wenetspeech

* wenetspeech

* update export

* update export

* update export name

* update

* docs

* update wechat QRcode

* Add python funasr api support for websocket srv (#1777)

* add python funasr_api supoort

* change little to README.md

* add core tools stream

* modified a little

* fix bug for timeout

* support for buffer decode

* add ffmpeg decode for buffer

* libtorch demo

* update libtorch infer

* update utils

* update demo

* update demo

* update libtorch inference

* update model class

* update seaco paraformer

* bug fix

* bug fix

* auto frontend

* auto frontend

* update with main (#1783)

* add cmakelist

* add paraformer-torch

* add debug for funasr-onnx-offline

* fix redefinition of jieba StdExtension.hpp

* add loading torch models

* update funasr-onnx-offline

* add SwitchArg for wss-server

* add SwitchArg for funasr-onnx-offline

* update cmakelist

* update funasr-onnx-offline-rtf

* add define condition

* add gpu define for offlne-stream

* update com define

* update offline-stream

* update cmakelist

* update func CompileHotwordEmbedding

* add timestamp for paraformer-torch

* add C10_USE_GLOG for paraformer-torch

* update paraformer-torch

* fix func FunASRWfstDecoderInit

* update model.h

* fix func FunASRWfstDecoderInit

* fix tpass_stream

* update paraformer-torch

* add bladedisc for funasr-onnx-offline

* update comdefine

* update funasr-wss-server

* add log for torch

* fix GetValue BLADEDISC

* fix log

* update cmakelist

* update warmup to 10

* update funasrruntime

* add batch_size for wss-server

* add batch for bins

* add batch for offline-stream

* add batch for paraformer

* add batch for offline-stream

* fix func SetBatchSize

* add SetBatchSize for model

* add SetBatchSize for model

* fix func Forward

* fix padding

* update funasrruntime

* add dec reset for batch

* set batch default value

* add argv for CutSplit

* sort frame_queue

* sorted msgs

* fix FunOfflineInfer

* add dynamic batch for fetch

* fix FetchDynamic

* update run_server.sh

* update run_server.sh

* cpp http post server support (#1739)

* add cpp http server

* add some comment

* remove some comments

* del debug infos

* restore run_server.sh

* adapt to new model struct

* 修复了onnxruntime在macos下编译失败的错误 (#1748)

* Add files via upload

增加macos的编译支持

* Add files via upload

增加macos支持

* Add files via upload

target_link_directories(funasr PUBLIC ${ONNXRUNTIME_DIR}/lib)
target_link_directories(funasr PUBLIC ${FFMPEG_DIR}/lib)
添加 if(APPLE) 限制

---------

Co-authored-by: Yabin Li <[email protected]>

* Delete docs/images/wechat.png

* Add files via upload

* fixed the issues about seaco-onnx timestamp

* fix bug (#1764)

当语音识别结果包含 `http` 时,标点符号预测会把它会被当成 url

* fix empty asr result (#1765)

解码结果为空的语音片段,text 用空字符串

* docs

* docs

* docs

* docs

* docs

* keep empty speech result (#1772)

* docs

* docs

* update wechat QRcode

* Add python funasr api support for websocket srv (#1777)

* add python funasr_api supoort

* change little to README.md

* add core tools stream

* modified a little

* fix bug for timeout

* support for buffer decode

* add ffmpeg decode for buffer

* auto frontend

* auto frontend

---------

Co-authored-by: 雾聪 <[email protected]>
Co-authored-by: zhaomingwork <[email protected]>
Co-authored-by: szsteven008 <[email protected]>
Co-authored-by: Ephemeroptera <[email protected]>
Co-authored-by: 彭震东 <[email protected]>
Co-authored-by: Shi Xian <[email protected]>
Co-authored-by: 维石 <[email protected]>

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* Dev gzf exp (#1785)

* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* log step

* wav is not exist

* wav is not exist

* decoding

* decoding

* decoding

* wechat

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* dynamic batch

* start_data_split_i=0

* total_time/accum_grad

* total_time/accum_grad

* total_time/accum_grad

* update avg slice

* update avg slice

* sensevoice sanm

* sensevoice sanm

* sensevoice sanm

---------

Co-authored-by: 北念 <[email protected]>

* auto frontend

* update with main (#1786)

* add cmakelist

* add paraformer-torch

* add debug for funasr-onnx-offline

* fix redefinition of jieba StdExtension.hpp

* add loading torch models

* update funasr-onnx-offline

* add SwitchArg for wss-server

* add SwitchArg for funasr-onnx-offline

* update cmakelist

* update funasr-onnx-offline-rtf

* add define condition

* add gpu define for offlne-stream

* update com define

* update offline-stream

* update cmakelist

* update func CompileHotwordEmbedding

* add timestamp for paraformer-torch

* add C10_USE_GLOG for paraformer-torch

* update paraformer-torch

* fix func FunASRWfstDecoderInit

* update model.h

* fix func FunASRWfstDecoderInit

* fix tpass_stream

* update paraformer-torch

* add bladedisc for funasr-onnx-offline

* update comdefine

* update funasr-wss-server

* add log for torch

* fix GetValue BLADEDISC

* fix log

* update cmakelist

* update warmup to 10

* update funasrruntime

* add batch_size for wss-server

* add batch for bins

* add batch for offline-stream

* add batch for paraformer

* add batch for offline-stream

* fix func SetBatchSize

* add SetBatchSize for model

* add SetBatchSize for model

* fix func Forward

* fix padding

* update funasrruntime

* add dec reset for batch

* set batch default value

* add argv for CutSplit

* sort frame_queue

* sorted msgs

* fix FunOfflineInfer

* add dynamic batch for fetch

* fix FetchDynamic

* update run_server.sh

* update run_server.sh

* cpp http post server support (#1739)

* add cpp http server

* add some comment

* remove some comments

* del debug infos

* restore run_server.sh

* adapt to new model struct

* 修复了onnxruntime在macos下编译失败的错误 (#1748)

* Add files via upload

增加macos的编译支持

* Add files via upload

增加macos支持

* Add files via upload

target_link_directories(funasr PUBLIC ${ONNXRUNTIME_DIR}/lib)
target_link_directories(funasr PUBLIC ${FFMPEG_DIR}/lib)
添加 if(APPLE) 限制

---------

Co-authored-by: Yabin Li <[email protected]>

* Delete docs/images/wechat.png

* Add files via upload

* fixed the issues about seaco-onnx timestamp

* fix bug (#1764)

当语音识别结果包含 `http` 时,标点符号预测会把它会被当成 url

* fix empty asr result (#1765)

解码结果为空的语音片段,text 用空字符串

* docs

* docs

* docs

* docs

* docs

* keep empty speech result (#1772)

* docs

* docs

* update wechat QRcode

* Add python funasr api support for websocket srv (#1777)

* add python funasr_api supoort

* change little to README.md

* add core tools stream

* modified a little

* fix bug for timeout

* support for buffer decode

* add ffmpeg decode for buffer

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* Dev gzf exp (#1785)

* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* log step

* wav is not exist

* wav is not exist

* decoding

* decoding

* decoding

* wechat

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* dynamic batch

* start_data_split_i=0

* total_time/accum_grad

* total_time/accum_grad

* total_time/accum_grad

* update avg slice

* update avg slice

* sensevoice sanm

* sensevoice sanm

* sensevoice sanm

---------

Co-authored-by: 北念 <[email protected]>

* auto frontend

---------

Co-authored-by: 雾聪 <[email protected]>
Co-authored-by: zhaomingwork <[email protected]>
Co-authored-by: szsteven008 <[email protected]>
Co-authored-by: Ephemeroptera <[email protected]>
Co-authored-by: 彭震东 <[email protected]>
Co-authored-by: Shi Xian <[email protected]>
Co-authored-by: 维石 <[email protected]>
Co-authored-by: 北念 <[email protected]>

* update paraformer timestamp

* auto frontend

* auto frontend

* [Optimization] support bladedisc fp16 optimization (#1790)

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* add cif_v1 and cif_export

* auto frontend

* Update SDK_advanced_guide_offline_zh.md

* add cif_wo_hidden_v1

* auto frontend

* auto frontend

* auto frontend

* fix bug

* [fix] fix empty asr result (#1794)

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fix bug

* fp16

* english timestamp for valilla paraformer

* fp16

* wechat

* fixbug

* [fix] better solution for handling empty result (#1796)

* update scripts

* modify the qformer adaptor (#1804)

Co-authored-by: nichongjia-2007 <[email protected]>

* add ctc inference code (#1806)

Co-authored-by: haoneng.lhn <[email protected]>

* Update auto_model.py

修复空字串进入speaker model时报raw_text变量不存在的bug

* Update auto_model.py

修复识别出空串后spk_model内变量未定义问题

* update model name

* fix paramter 'quantize' unused issue (#1813)

Co-authored-by: ZihanLiao <[email protected]>

* wechat

* Update cif_predictor.py (#1811)

* Update cif_predictor.py

* modify cif_v1_export

under extreme cases, max_label_len calculated by batch_len misaligns with token_num

* Update cif_predictor.py

torch.cumsum precision degradation, using float64 instead

* update code

---------

Co-authored-by: 游雁 <[email protected]>
Co-authored-by: gaochangfeng <[email protected]>
Co-authored-by: 常材 <[email protected]>
Co-authored-by: nsdou <[email protected]>
Co-authored-by: 维石 <[email protected]>
Co-authored-by: zhaomingwork <[email protected]>
Co-authored-by: szsteven008 <[email protected]>
Co-authored-by: Ephemeroptera <[email protected]>
Co-authored-by: 彭震东 <[email protected]>
Co-authored-by: Shi Xian <[email protected]>
Co-authored-by: 北念 <[email protected]>
Co-authored-by: xiaowan0322 <[email protected]>
Co-authored-by: zhuangzhong <[email protected]>
Co-authored-by: Xingchen Song(宋星辰) <[email protected]>
Co-authored-by: nichongjia-2007 <[email protected]>
Co-authored-by: haoneng.lhn <[email protected]>
Co-authored-by: liugz18 <[email protected]>
Co-authored-by: Marlowe <[email protected]>
Co-authored-by: ZihanLiao <[email protected]>
Co-authored-by: zhong zhuang <[email protected]>

* update runtime_sdk_download_tool

* update funasr-wss-server

* update vad_revision

* update funasr-wss-server

* update funasr-wss-server

* update punc quant

* rename torchscript

* Delete examples/industrial_data_pretraining/ctc/infer_from_local.py

* resolve conflicts

---------

Co-authored-by: 游雁 <[email protected]>
Co-authored-by: gaochangfeng <[email protected]>
Co-authored-by: 常材 <[email protected]>
Co-authored-by: nsdou <[email protected]>
Co-authored-by: 维石 <[email protected]>
Co-authored-by: zhaomingwork <[email protected]>
Co-authored-by: szsteven008 <[email protected]>
Co-authored-by: Ephemeroptera <[email protected]>
Co-authored-by: 彭震东 <[email protected]>
Co-authored-by: Shi Xian <[email protected]>
Co-authored-by: 北念 <[email protected]>
Co-authored-by: xiaowan0322 <[email protected]>
Co-authored-by: zhuangzhong <[email protected]>
Co-authored-by: Xingchen Song(宋星辰) <[email protected]>
Co-authored-by: nichongjia-2007 <[email protected]>
Co-authored-by: haoneng.lhn <[email protected]>
Co-authored-by: liugz18 <[email protected]>
Co-authored-by: Marlowe <[email protected]>
Co-authored-by: ZihanLiao <[email protected]>
Co-authored-by: zhong zhuang <[email protected]>
2024-06-25 17:38:04 +08:00
+8 abb33d6b20 Dev gzf deepspeed (#1844)
* total_time/accum_grad

* fp16

* update with main (#1817)

* add cmakelist

* add paraformer-torch

* add debug for funasr-onnx-offline

* fix redefinition of jieba StdExtension.hpp

* add loading torch models

* update funasr-onnx-offline

* add SwitchArg for wss-server

* add SwitchArg for funasr-onnx-offline

* update cmakelist

* update funasr-onnx-offline-rtf

* add define condition

* add gpu define for offlne-stream

* update com define

* update offline-stream

* update cmakelist

* update func CompileHotwordEmbedding

* add timestamp for paraformer-torch

* add C10_USE_GLOG for paraformer-torch

* update paraformer-torch

* fix func FunASRWfstDecoderInit

* update model.h

* fix func FunASRWfstDecoderInit

* fix tpass_stream

* update paraformer-torch

* add bladedisc for funasr-onnx-offline

* update comdefine

* update funasr-wss-server

* add log for torch

* fix GetValue BLADEDISC

* fix log

* update cmakelist

* update warmup to 10

* update funasrruntime

* add batch_size for wss-server

* add batch for bins

* add batch for offline-stream

* add batch for paraformer

* add batch for offline-stream

* fix func SetBatchSize

* add SetBatchSize for model

* add SetBatchSize for model

* fix func Forward

* fix padding

* update funasrruntime

* add dec reset for batch

* set batch default value

* add argv for CutSplit

* sort frame_queue

* sorted msgs

* fix FunOfflineInfer

* add dynamic batch for fetch

* fix FetchDynamic

* update run_server.sh

* update run_server.sh

* cpp http post server support (#1739)

* add cpp http server

* add some comment

* remove some comments

* del debug infos

* restore run_server.sh

* adapt to new model struct

* 修复了onnxruntime在macos下编译失败的错误 (#1748)

* Add files via upload

增加macos的编译支持

* Add files via upload

增加macos支持

* Add files via upload

target_link_directories(funasr PUBLIC ${ONNXRUNTIME_DIR}/lib)
target_link_directories(funasr PUBLIC ${FFMPEG_DIR}/lib)
添加 if(APPLE) 限制

---------

Co-authored-by: Yabin Li <[email protected]>

* Delete docs/images/wechat.png

* Add files via upload

* fixed the issues about seaco-onnx timestamp

* fix bug (#1764)

当语音识别结果包含 `http` 时,标点符号预测会把它会被当成 url

* fix empty asr result (#1765)

解码结果为空的语音片段,text 用空字符串

* update export

* update export

* docs

* docs

* update export name

* docs

* update

* docs

* docs

* keep empty speech result (#1772)

* docs

* docs

* update wechat QRcode

* Add python funasr api support for websocket srv (#1777)

* add python funasr_api supoort

* change little to README.md

* add core tools stream

* modified a little

* fix bug for timeout

* support for buffer decode

* add ffmpeg decode for buffer

* libtorch demo

* update libtorch infer

* update utils

* update demo

* update demo

* update libtorch inference

* update model class

* update seaco paraformer

* bug fix

* bug fix

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* Dev gzf exp (#1785)

* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* log step

* wav is not exist

* wav is not exist

* decoding

* decoding

* decoding

* wechat

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* dynamic batch

* start_data_split_i=0

* total_time/accum_grad

* total_time/accum_grad

* total_time/accum_grad

* update avg slice

* update avg slice

* sensevoice sanm

* sensevoice sanm

* sensevoice sanm

---------

Co-authored-by: 北念 <[email protected]>

* auto frontend

* update paraformer timestamp

* [Optimization] support bladedisc fp16 optimization (#1790)

* add cif_v1 and cif_export

* Update SDK_advanced_guide_offline_zh.md

* add cif_wo_hidden_v1

* [fix] fix empty asr result (#1794)

* english timestamp for valilla paraformer

* wechat

* [fix] better solution for handling empty result (#1796)

* update scripts

* modify the qformer adaptor (#1804)

Co-authored-by: nichongjia-2007 <[email protected]>

* add ctc inference code (#1806)

Co-authored-by: haoneng.lhn <[email protected]>

* Update auto_model.py

修复空字串进入speaker model时报raw_text变量不存在的bug

* Update auto_model.py

修复识别出空串后spk_model内变量未定义问题

* update model name

* fix paramter 'quantize' unused issue (#1813)

Co-authored-by: ZihanLiao <[email protected]>

* wechat

* Update cif_predictor.py (#1811)

* Update cif_predictor.py

* modify cif_v1_export

under extreme cases, max_label_len calculated by batch_len misaligns with token_num

* Update cif_predictor.py

torch.cumsum precision degradation, using float64 instead

* update code

---------

Co-authored-by: 雾聪 <[email protected]>
Co-authored-by: zhaomingwork <[email protected]>
Co-authored-by: szsteven008 <[email protected]>
Co-authored-by: Ephemeroptera <[email protected]>
Co-authored-by: 彭震东 <[email protected]>
Co-authored-by: Shi Xian <[email protected]>
Co-authored-by: 维石 <[email protected]>
Co-authored-by: 北念 <[email protected]>
Co-authored-by: xiaowan0322 <[email protected]>
Co-authored-by: zhuangzhong <[email protected]>
Co-authored-by: Xingchen Song(宋星辰) <[email protected]>
Co-authored-by: nichongjia-2007 <[email protected]>
Co-authored-by: haoneng.lhn <[email protected]>
Co-authored-by: liugz18 <[email protected]>
Co-authored-by: Marlowe <[email protected]>
Co-authored-by: ZihanLiao <[email protected]>
Co-authored-by: zhong zhuang <[email protected]>

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* v1.0.28 (#1836)

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* update (#1841)

* v1.0.28

* version checker

* version checker

* rollback cif_v1 for training bug

* fixbug

* fixbug for cif

* fixbug

---------

Co-authored-by: 维石 <[email protected]>

* update (#1842)

* v1.0.28

* version checker

* version checker

* rollback cif_v1 for training bug

* fixbug

* fixbug for cif

* fixbug

---------

Co-authored-by: 维石 <[email protected]>

* inference

---------

Co-authored-by: 雾聪 <[email protected]>
Co-authored-by: zhaomingwork <[email protected]>
Co-authored-by: szsteven008 <[email protected]>
Co-authored-by: Ephemeroptera <[email protected]>
Co-authored-by: 彭震东 <[email protected]>
Co-authored-by: Shi Xian <[email protected]>
Co-authored-by: 维石 <[email protected]>
Co-authored-by: 北念 <[email protected]>
Co-authored-by: xiaowan0322 <[email protected]>
Co-authored-by: zhuangzhong <[email protected]>
Co-authored-by: Xingchen Song(宋星辰) <[email protected]>
Co-authored-by: nichongjia-2007 <[email protected]>
Co-authored-by: haoneng.lhn <[email protected]>
Co-authored-by: liugz18 <[email protected]>
Co-authored-by: Marlowe <[email protected]>
Co-authored-by: ZihanLiao <[email protected]>
Co-authored-by: zhong zhuang <[email protected]>
2024-06-24 17:06:21 +08:00
游雁 4071879e74 fixbug 2024-06-21 18:35:00 +08:00
zhifu gao 8f5576c3ea Dev gzf deepspeed (#1835)
* sensevoice

* sensevoice
2024-06-20 19:37:20 +08:00
+8 e65b1f701a Dev gzf deepspeed (#1833)
* update with main (#1817)

* add cmakelist

* add paraformer-torch

* add debug for funasr-onnx-offline

* fix redefinition of jieba StdExtension.hpp

* add loading torch models

* update funasr-onnx-offline

* add SwitchArg for wss-server

* add SwitchArg for funasr-onnx-offline

* update cmakelist

* update funasr-onnx-offline-rtf

* add define condition

* add gpu define for offlne-stream

* update com define

* update offline-stream

* update cmakelist

* update func CompileHotwordEmbedding

* add timestamp for paraformer-torch

* add C10_USE_GLOG for paraformer-torch

* update paraformer-torch

* fix func FunASRWfstDecoderInit

* update model.h

* fix func FunASRWfstDecoderInit

* fix tpass_stream

* update paraformer-torch

* add bladedisc for funasr-onnx-offline

* update comdefine

* update funasr-wss-server

* add log for torch

* fix GetValue BLADEDISC

* fix log

* update cmakelist

* update warmup to 10

* update funasrruntime

* add batch_size for wss-server

* add batch for bins

* add batch for offline-stream

* add batch for paraformer

* add batch for offline-stream

* fix func SetBatchSize

* add SetBatchSize for model

* add SetBatchSize for model

* fix func Forward

* fix padding

* update funasrruntime

* add dec reset for batch

* set batch default value

* add argv for CutSplit

* sort frame_queue

* sorted msgs

* fix FunOfflineInfer

* add dynamic batch for fetch

* fix FetchDynamic

* update run_server.sh

* update run_server.sh

* cpp http post server support (#1739)

* add cpp http server

* add some comment

* remove some comments

* del debug infos

* restore run_server.sh

* adapt to new model struct

* 修复了onnxruntime在macos下编译失败的错误 (#1748)

* Add files via upload

增加macos的编译支持

* Add files via upload

增加macos支持

* Add files via upload

target_link_directories(funasr PUBLIC ${ONNXRUNTIME_DIR}/lib)
target_link_directories(funasr PUBLIC ${FFMPEG_DIR}/lib)
添加 if(APPLE) 限制

---------

Co-authored-by: Yabin Li <[email protected]>

* Delete docs/images/wechat.png

* Add files via upload

* fixed the issues about seaco-onnx timestamp

* fix bug (#1764)

当语音识别结果包含 `http` 时,标点符号预测会把它会被当成 url

* fix empty asr result (#1765)

解码结果为空的语音片段,text 用空字符串

* update export

* update export

* docs

* docs

* update export name

* docs

* update

* docs

* docs

* keep empty speech result (#1772)

* docs

* docs

* update wechat QRcode

* Add python funasr api support for websocket srv (#1777)

* add python funasr_api supoort

* change little to README.md

* add core tools stream

* modified a little

* fix bug for timeout

* support for buffer decode

* add ffmpeg decode for buffer

* libtorch demo

* update libtorch infer

* update utils

* update demo

* update demo

* update libtorch inference

* update model class

* update seaco paraformer

* bug fix

* bug fix

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* auto frontend

* Dev gzf exp (#1785)

* resume from step

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* batch

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* train_loss_avg train_acc_avg

* log step

* wav is not exist

* wav is not exist

* decoding

* decoding

* decoding

* wechat

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* decoding key

* dynamic batch

* start_data_split_i=0

* total_time/accum_grad

* total_time/accum_grad

* total_time/accum_grad

* update avg slice

* update avg slice

* sensevoice sanm

* sensevoice sanm

* sensevoice sanm

---------

Co-authored-by: 北念 <[email protected]>

* auto frontend

* update paraformer timestamp

* [Optimization] support bladedisc fp16 optimization (#1790)

* add cif_v1 and cif_export

* Update SDK_advanced_guide_offline_zh.md

* add cif_wo_hidden_v1

* [fix] fix empty asr result (#1794)

* english timestamp for valilla paraformer

* wechat

* [fix] better solution for handling empty result (#1796)

* update scripts

* modify the qformer adaptor (#1804)

Co-authored-by: nichongjia-2007 <[email protected]>

* add ctc inference code (#1806)

Co-authored-by: haoneng.lhn <[email protected]>

* Update auto_model.py

修复空字串进入speaker model时报raw_text变量不存在的bug

* Update auto_model.py

修复识别出空串后spk_model内变量未定义问题

* update model name

* fix paramter 'quantize' unused issue (#1813)

Co-authored-by: ZihanLiao <[email protected]>

* wechat

* Update cif_predictor.py (#1811)

* Update cif_predictor.py

* modify cif_v1_export

under extreme cases, max_label_len calculated by batch_len misaligns with token_num

* Update cif_predictor.py

torch.cumsum precision degradation, using float64 instead

* update code

---------

Co-authored-by: 雾聪 <[email protected]>
Co-authored-by: zhaomingwork <[email protected]>
Co-authored-by: szsteven008 <[email protected]>
Co-authored-by: Ephemeroptera <[email protected]>
Co-authored-by: 彭震东 <[email protected]>
Co-authored-by: Shi Xian <[email protected]>
Co-authored-by: 维石 <[email protected]>
Co-authored-by: 北念 <[email protected]>
Co-authored-by: xiaowan0322 <[email protected]>
Co-authored-by: zhuangzhong <[email protected]>
Co-authored-by: Xingchen Song(宋星辰) <[email protected]>
Co-authored-by: nichongjia-2007 <[email protected]>
Co-authored-by: haoneng.lhn <[email protected]>
Co-authored-by: liugz18 <[email protected]>
Co-authored-by: Marlowe <[email protected]>
Co-authored-by: ZihanLiao <[email protected]>
Co-authored-by: zhong zhuang <[email protected]>

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

* sensevoice

---------

Co-authored-by: 雾聪 <[email protected]>
Co-authored-by: zhaomingwork <[email protected]>
Co-authored-by: szsteven008 <[email protected]>
Co-authored-by: Ephemeroptera <[email protected]>
Co-authored-by: 彭震东 <[email protected]>
Co-authored-by: Shi Xian <[email protected]>
Co-authored-by: 维石 <[email protected]>
Co-authored-by: 北念 <[email protected]>
Co-authored-by: xiaowan0322 <[email protected]>
Co-authored-by: zhuangzhong <[email protected]>
Co-authored-by: Xingchen Song(宋星辰) <[email protected]>
Co-authored-by: nichongjia-2007 <[email protected]>
Co-authored-by: haoneng.lhn <[email protected]>
Co-authored-by: liugz18 <[email protected]>
Co-authored-by: Marlowe <[email protected]>
Co-authored-by: ZihanLiao <[email protected]>
Co-authored-by: zhong zhuang <[email protected]>
2024-06-20 17:09:33 +08:00
游雁 45d7aa9004 decoding 2024-06-19 10:26:40 +08:00
游雁 de0b35b378 decoding 2024-06-19 10:19:18 +08:00
Shi Xian 6c467e6f0a Merge pull request #1825 from modelscope/dev_libt
Dev libt
2024-06-18 10:01:56 +08:00
北念 ada76b6312 sensevoice 2024-06-17 13:36:22 +08:00
游雁 59bc02b089 decoding 2024-06-14 13:59:49 +08:00
游雁 31c7f02d12 decoding 2024-06-14 10:57:49 +08:00