开发者社区 > ModelScope模型即服务 > 语音 > 正文

预处理时报错 nnet-forward ied with <Signals.SIGILL: 4>

run_auto_label出问题了,一直解决不了

notebook 执行

from modelscope.tools import run_auto_label

input_wav = "./test_female/"
output_data = "./output_training_data/"

ret, report = run_auto_label(input_wav=input_wav, work_dir=output_data, resource_revision="v1.0.4")

报错信息:


2023-04-19 15:59:34,896 - modelscope - INFO - Use user-specified model revision: v1.0.4
2023-04-19:15:59:34, INFO [api.py:463] Use user-specified model revision: v1.0.4
---  New folder /home/summerK/dev/personal_tts/output_training_data/paragraph/prosody...  ---
---  OK  ---
---  New folder /home/summerK/dev/personal_tts/output_training_data/log...  ---
---  OK  ---
2023-04-19:15:59:56, INFO [auto_label.py:289] 2023-04-19 15:59:56
2023-04-19:15:59:56, INFO [auto_label.py:340] wav_preprocess start...
---  new folder...  ---
---  OK  ---
100%|███████████████████████████████████████████████████████████████| 20/20 [00:00<00:00, 106.52it/s]
/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/audio2phone/rapid_paraformer/utils/utils.py:181: RuntimeWarning: CUDAExecutionProvider is not avaiable for current env, the inference part is automatically shifted to be executed under CPUExecutionProvider.
Please ensure the installed onnxruntime-gpu version matches your cuda and cudnn version, you can check their relations from the offical web site: https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html
  RuntimeWarning)
[2023/04/19 15:59:59] rapdi_paraformer INFO: Audio to text start...
100%|████████████████████████████████████████████████████████████████| 20/20 [00:01<00:00, 15.36it/s]
2023-04-19:16:00:01, INFO [audio2prosody.py:104] Text to label start...
100%|██████████████████████████████████████████████████████████████| 20/20 [00:00<00:00, 3434.58it/s]
text.cc: festival_Text_init
pre-break recording in paragraph by vad.
no need to break sentence!!!
2023-04-19:16:00:04, INFO [auto_label.py:759] Generate phone interval by asr align.
---  New folder /home/summerK/dev/personal_tts/output_training_data/align...  ---
---  OK  ---
prosody_dir=/home/summerK/dev/personal_tts/output_training_data/paragraph/prosody
run_asr_align step 2
speak_script=/home/summerK/dev/personal_tts/output_training_data/align/script.txt
2023-04-19:16:00:04, INFO [asr_align.py:189] job_num=20 process_num=4 fbank_config=/home/summerK/.cache/modelscope/hub/damo/speech_ptts_autolabel_16k/model/fsmn_16k_2/fbank.conf, data_dir=/home/summerK/dev/personal_tts/output_training_data/align/gen/data, fbank_dir=/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank
2023-04-19:16:00:04, INFO [make_fbank.py:48] run make_fbank with num=20 config_path=/home/summerK/.cache/modelscope/hub/damo/speech_ptts_autolabel_16k/model/fsmn_16k_2/fbank.conf
2023-04-19:16:00:04, INFO [make_fbank.py:49] data_path=/home/summerK/dev/personal_tts/output_training_data/align/gen/data fbank_path=/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank
2023-04-19:16:00:04, INFO [make_fbank.py:62] [{'id': 'SSB00180007', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180007.wav'}, {'id': 'SSB00180047', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180047.wav'}, {'id': 'SSB00180117', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180117.wav'}, {'id': 'SSB00180249', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180249.wav'}, {'id': 'SSB00180402', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180402.wav'}, {'id': 'SSB00180218', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180218.wav'}, {'id': 'SSB00180216', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180216.wav'}, {'id': 'SSB00180279', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180279.wav'}, {'id': 'SSB00180138', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180138.wav'}, {'id': 'SSB00180415', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180415.wav'}, {'id': 'SSB00180500', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180500.wav'}, {'id': 'SSB00180156', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180156.wav'}, {'id': 'SSB00180357', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180357.wav'}, {'id': 'SSB00180032', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180032.wav'}, {'id': 'SSB00180277', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180277.wav'}, {'id': 'SSB00180431', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180431.wav'}, {'id': 'SSB00180288', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180288.wav'}, {'id': 'SSB00180325', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180325.wav'}, {'id': 'SSB00180503', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180503.wav'}, {'id': 'SSB00180012', 'wav': '/home/summerK/dev/personal_tts/output_training_data/wav/SSB00180012.wav'}]
100%|████████████████████████████████████████████████████████████████| 20/20 [00:27<00:00,  1.38s/it]
2023-04-19:16:00:32, INFO [make_fbank.py:77] DONE compute fbank and copy feats
2023-04-19:16:00:32, INFO [make_fbank.py:84] DONE!
2023-04-19:16:00:32, INFO [asr_align.py:193] job_num=20 process_num=4 data_dir=/home/summerK/dev/personal_tts/output_training_data/align/gen/data lm_dir=/home/summerK/.cache/modelscope/hub/damo/speech_ptts_autolabel_16k/model/lang am_dir=/home/summerK/.cache/modelscope/hub/damo/speech_ptts_autolabel_16k/model/fsmn_16k_2, fbank_dir=/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank, align_dir=/home/summerK/dev/personal_tts/output_training_data/align/gen/align
2023-04-19:16:00:32, INFO [align_wave.py:274] [{'id': 'SSB00180007', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180007.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180007.scp'}, {'id': 'SSB00180047', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180047.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180047.scp'}, {'id': 'SSB00180117', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180117.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180117.scp'}, {'id': 'SSB00180249', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180249.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180249.scp'}, {'id': 'SSB00180402', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180402.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180402.scp'}, {'id': 'SSB00180218', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180218.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180218.scp'}, {'id': 'SSB00180216', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180216.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180216.scp'}, {'id': 'SSB00180279', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180279.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180279.scp'}, {'id': 'SSB00180138', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180138.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180138.scp'}, {'id': 'SSB00180415', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180415.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180415.scp'}, {'id': 'SSB00180500', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180500.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180500.scp'}, {'id': 'SSB00180156', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180156.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180156.scp'}, {'id': 'SSB00180357', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180357.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180357.scp'}, {'id': 'SSB00180032', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180032.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180032.scp'}, {'id': 'SSB00180277', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180277.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180277.scp'}, {'id': 'SSB00180431', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180431.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180431.scp'}, {'id': 'SSB00180288', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180288.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180288.scp'}, {'id': 'SSB00180325', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180325.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180325.scp'}, {'id': 'SSB00180503', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180503.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180503.scp'}, {'id': 'SSB00180012', 'ark': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180012.ark', 'scp': '/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/raw_fbank_data.SSB00180012.scp'}]
2023-04-19:16:01:31, INFO [align_wave.py:276] Feature preprocessing start...
  0%|                                                                         | 0/20 [00:34<?, ?it/s]
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/multiprocessing/pool.py", line 121, in worker
    result = (True, func(*args, **kwds))
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/align_wave.py", line 109, in do_nnet_forward
    return {'ret': run_kaldi_bin('nnet-forward', nnet_forward_opts), 'index':index, 'score': score, 'scp': final_scp, 'ark': final_ark}
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/run_kaldi_bin.py", line 14, in run_kaldi_bin
    stderr=subprocess.DEVNULL)
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/subprocess.py", line 363, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['python', '/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/kaldi_bin/nnet-forward.py', '--no-softmax=true', '--prior-scale=1.0', '--feature-transform=/home/summerK/.cache/modelscope/hub/damo/speech_ptts_autolabel_16k/model/fsmn_16k_2/lstm.mvn', '--class-frame-counts=/home/summerK/.cache/modelscope/hub/damo/speech_ptts_autolabel_16k/model/fsmn_16k_2/lstm.prior', '--use-gpu=no', '/home/summerK/.cache/modelscope/hub/damo/speech_ptts_autolabel_16k/model/fsmn_16k_2/lstm.net', 'ark:/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/final_fbank_data.SSB00180007.ark', 'ark:/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/score.SSB00180007.ark']' died with <Signals.SIGILL: 4>.
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "test_label.py", line 6, in <module>
    ret, report = run_auto_label(input_wav=input_wav, work_dir=output_data, resource_revision="v1.0.4")
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/modelscope/tools/speech_tts_autolabel.py", line 77, in run_auto_label
    ret_code, report = auto_labeling.run()
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/auto_label.py", line 760, in run
    self.asr_align()
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/auto_label.py", line 460, in asr_align
    run_asr_align(self.resource_dir, align_output, script_file, self.out_wav_dir, job_num = self.align_job_num, process_num=self.process_num)
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/asr_align.py", line 521, in run_asr_align
    process(job_num, process_num, lm_dir, am_dir, working_dir, speak_script, wave_dir, engine_test_dir, engine_data_dir, sy2ph_map, step)
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/asr_align.py", line 488, in process
    align_wave(job_num, process_num, data_dir, lm_dir, am_dir, fbank_dir, align_dir)
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/asr_align.py", line 194, in align_wave
    do_wave_align(job_num, process_num, lm_dir, am_dir, data_dir, fbank_dir, align_dir)
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/align_wave.py", line 277, in do_wave_align
    feats_list = feat_preprocess(num, process_num, am, data_path, feat_path, feats_list)
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/align_wave.py", line 139, in feat_preprocess
    ret = v.get()
  File "/home/summerK/anaconda3/envs/modelscope/lib/python3.7/multiprocessing/pool.py", line 657, in get
    raise self._value
subprocess.CalledProcessError: Command '['python', '/home/summerK/anaconda3/envs/modelscope/lib/python3.7/site-packages/tts_autolabel/kaldi_bin/nnet-forward.py', '--no-softmax=true', '--prior-scale=1.0', '--feature-transform=/home/summerK/.cache/modelscope/hub/damo/speech_ptts_autolabel_16k/model/fsmn_16k_2/lstm.mvn', '--class-frame-counts=/home/summerK/.cache/modelscope/hub/damo/speech_ptts_autolabel_16k/model/fsmn_16k_2/lstm.prior', '--use-gpu=no', '/home/summerK/.cache/modelscope/hub/damo/speech_ptts_autolabel_16k/model/fsmn_16k_2/lstm.net', 'ark:/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/final_fbank_data.SSB00180007.ark', 'ark:/home/summerK/dev/personal_tts/output_training_data/align/gen/fbank/score.SSB00180007.ark']' died with <Signals.SIGILL: 4>.

展开
收起
1593316062336815 2023-04-19 16:14:29 559 0
1 条回答
写回答
取消 提交回答
  • 似乎和硬件(CPU?)有关,

    我在云主机就可以运行,一样的脚本,可以运行的CPU信息(cpuinfo):

    flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl nonstop_tsc cpuid tsc_known_freq pni pclmulqdq monitor ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch cpuid_fault invpcid_single ibrs_enhanced fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves wbnoinvd arat avx512vbmi pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid fsrm arch_capabilities

    2023-04-19 16:17:16
    赞同 展开评论 打赏

包括语音识别、语音合成、语音唤醒、声学设计及信号处理、声纹识别、音频事件检测等多个领域

相关电子书

更多
低代码开发师(初级)实战教程 立即下载
冬季实战营第三期:MySQL数据库进阶实战 立即下载
阿里巴巴DevOps 最佳实践手册 立即下载