ModelScope中开始训练后在notebook控制台的报错是为什么?是gpu实例。环境中的gradio版本3.47.1.框框中是我从本地上传到notebook的数据集日志输出如下
(o_proj): Linear(in_features=4096, out_features=4096, bias=False)
(rotary_emb): RotaryEmbedding()
)
(mlp): MLP(
(gate_proj): Linear(in_features=4096, out_features=11008, bias=False)
(down_proj): Linear(in_features=11008, out_features=4096, bias=False)
(up_proj): Linear(in_features=4096, out_features=11008, bias=False)
(act_fn): SiLU()
)
(input_layernorm): RMSNorm()
(post_attention_layernorm): RMSNorm()
)
)
(norm): RMSNorm()
)
(lm_head): NormHead()
)
)
device_count: 1
rank: -1, local_rank: -1, world_size: 1, local_world_size: 1
Traceback (most recent call last):
File "/opt/conda/lib/python3.10/site-packages/swift/cli/sft.py", line 5, in
sft_main()
File "/opt/conda/lib/python3.10/site-packages/swift/utils/run_utils.py", line 31, in x_main
result = llm_x(args, kwargs)
File "/opt/conda/lib/python3.10/site-packages/swift/llm/sft.py", line 85, in llm_sft
train_dataset, val_dataset = get_dataset(
File "/opt/conda/lib/python3.10/site-packages/swift/llm/utils/dataset.py", line 1098, in get_dataset
dataset = get_function(
File "/opt/conda/lib/python3.10/site-packages/swift/llm/utils/dataset.py", line 1168, in get_custom_dataset
train_dataset = load_dataset_from_local(train_subset_split_list,
File "/opt/conda/lib/python3.10/site-packages/swift/llm/utils/dataset.py", line 1146, in load_dataset_from_local
df = pd.read_csv(dataset_path, na_filter=False)
File "/opt/conda/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 1024, in read_csv
return _read(filepath_or_buffer, kwds)
File "/opt/conda/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 618, in _read
parser = TextFileReader(filepath_or_buffer, kwds)
File "/opt/conda/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 1618, in init
self._engine = self._make_engine(f, self.eng
根据提供的日志输出,报错信息显示在读取CSV文件时出现了问题。具体错误信息为:
File "/opt/conda/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 1024, in read_csv
return _read(filepath_or_buffer, kwds)
File "/opt/conda/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 618, in _read
parser = TextFileReader(filepath_or_buffer, kwds)
File "/opt/conda/lib/python3.10/site-packages/pandas/io/parsers/readers.py", line 1618, in init
self._engine = self._make_engine(f, self.eng
这个错误可能是由于以下原因之一引起的:
pandas
库。请确保已经安装了pandas
库,并且版本与代码中使用的版本兼容。要解决这个问题,你可以尝试以下几个步骤:
pandas
库,并确保安装的版本与代码中使用的版本兼容。ModelScope旨在打造下一代开源的模型即服务共享平台,为泛AI开发者提供灵活、易用、低成本的一站式模型服务产品,让模型应用更简单!欢迎加入技术交流群:微信公众号:魔搭ModelScope社区,钉钉群号:44837352