开发者社区> 问答> 正文

NLP自学习平台对话分类项目,训练模型报错,帮忙看一下呢?

NLP自学习平台对话分类项目,训练模型报错,帮忙看一下呢?
2024-05-21 22:50:10 - info 11.196.23.194 training start.clusterId:54394
{"pod_name":"54394-job-blvlb"
"status":"Error"
"status_info":"exit code is 1"
"training_log":"[2024-05-21 14:50:25,897] worker.py ():140 [INFO] Namespace(params='{\"method\":\"train\",\"upload_data\":{\"model_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/model/1_NLP_dialog_classification_bert_X7_work_order_classification_1.tar.gz\",\"metric_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/metrics/1_NLP_dialog_classification_bert_X7_work_order_classification_1.json\"},\"algo_params\":{\"model_info\":{\"re_train\":false,\"num_gpus\":1,\"type\":\"NLP_dialog_classification_bert\"},\"super_model_params\":{\"auto_select\":true,\"semi_supervised_model\":\"self_training\",\"data_augmentation\":false},\"hyper_params\":{\"lr\":5e-05,\"epochs\":6}},\"download_data\":{\"resource_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification/dialogbert/resource/zh900k-bigdata.zip\",\"train_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71\"}}')
[2024-05-21 14:50:25,900] data_loader.py download_file():53 [INFO] file_url:oss://nlp-automl-public/1/online/NLP_dialog_classification/dialogbert/resource/zh900k-bigdata.zip
[2024-05-21 14:50:25,900] data_loader.py download_oss():142 [INFO] begin to download file : oss://nlp-automl-public/1/online/NLP_dialog_classification/dialogbert/resource/zh900k-bigdata.zip
[2024-05-21 14:51:38,397] data_loader.py
download_oss():151 [INFO] success to download file : oss://nlp-automl-public/1/online/NLP_dialog_classification/dialogbert/resource/zh900k-bigdata.zip to /data/zh900k-bigdata.zip
[2024-05-21 14:51:38,398] data_loader.py download_file():53 [INFO] file_url:oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71
[2024-05-21 14:51:38,398] data_loader.py download_oss():142 [INFO] begin to download file : oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71
[2024-05-21 14:51:38,455] data_loader.py
download_oss():151 [INFO] success to download file : oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71 to /data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71
[2024-05-21 14:51:39,396] worker.py process_py():104 [INFO] call train: {\"model_info\": {\"re_train\": false, \"num_gpus\": 1, \"type\": \"NLP_dialog_classification_bert\"}, \"super_model_params\": {\"auto_select\": true, \"semi_supervised_model\": \"self_training\", \"data_augmentation\": false}, \"hyper_params\": {\"lr\": 5e-05, \"epochs\": 6}, \"resource_file\": \"/data/zh900k-bigdata.zip\", \"train_file\": \"/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71\", \"model_file\": \"/data/1_NLP_dialog_classification_bert_X7_work_order_classification_1.tar.gz\", \"metric_file\": \"/data/1_NLP_dialog_classification_bert_X7_work_order_classification_1.json\"}
Traceback (most recent call last):
File \"/home/user/miniconda/lib/python3.8/runpy.py\", line 193, in _run_module_as_main
return _run_code(code, main_globals, None,
File \"/home/user/miniconda/lib/python3.8/runpy.py\", line 86, in _run_code
exec(code, run_globals)
File \"/home/user/miniconda/lib/python3.8/site-packages/algo_worker/train/worker.py\", line 142, in
worker.run()
File \"/home/user/miniconda/lib/python3.8/site-packages/algo_worker/train/worker.py\", line 127, in run
self.
process()
File \"/home/user/miniconda/lib/python3.8/site-packages/algo_worker/train/worker.py\", line 119, in process
self.
process_py()
File \"/home/user/miniconda/lib/python3.8/site-packages/algo_worker/train/worker.py\", line 105, in process_py
obj = cls(algo_params)
File \"/home/user/miniconda/lib/python3.8/site-packages/business/train/DialogBertTrainDriver.py\", line 19, in
init
self.loader = data_loader(params)
File \"/home/user/miniconda/lib/python3.8/site-packages/business/data_process/data_loader_bert.py\", line 45, in
init__
self.trains, self.valids, self.task_label_counter = data_process_utils.load_and_split_data(params)
File \"/home/user/miniconda/lib/python3.8/site-packages/business/data_process/data_process_utils.py\", line 97, in load_and_split_data
assert len(raw_train_datas) > 0, 'need at least one train data'
AssertionError: need at least one train data
{\"method\":\"train\",\"upload_data\":{\"model_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/model/1_NLP_dialog_classification_bert_X7_work_order_classification_1.tar.gz\",\"metric_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/metrics/1_NLP_dialog_classification_bert_X7_work_order_classification_1.json\"},\"algo_params\":{\"model_info\":{\"re_train\":false,\"num_gpus\":1,\"type\":\"NLP_dialog_classification_bert\"},\"super_model_params\":{\"auto_select\":true,\"semi_supervised_model\":\"self_training\",\"data_augmentation\":false},\"hyper_params\":{\"lr\":5e-05,\"epochs\":6}},\"download_data\":{\"resource_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification/dialogbert/resource/zh900k-bigdata.zip\",\"train_file\":\"oss://nlp-automl-public/1/online/NLP_dialog_classification_bert/31767/X7_work_order_classification/1/data/oss-838d9eb3-ba43-48fd-a238-cf875d3b2d71\"}}
"}
lQLPJxTVH_RkEIFYzQK4sOAqmhtVz0-hBjiIQytkMQA_696_88.png

展开
收起
嘟嘟嘟嘟嘟嘟 2024-05-28 17:38:08 36 0
1 条回答
写回答
取消 提交回答
  • dc2f2f3066de8191b55132d76a89fe5b.png
    你这个json文件作为json解析的时候会报错
    9563ff803ab22f27d6050cd21442c47f.png
    这个地方有问题,不是字符串
    此回答整理自钉群“阿里云NLP自学习平台用户答疑群二群”

    2024-05-28 23:52:38
    赞同 1 展开评论 打赏
问答排行榜
最热
最新

相关电子书

更多
自然语言处理得十个发展趋势 立即下载
自然语言处理的十个发展趋势 立即下载
深度学习与自然语言处理 立即下载