"使用swift sft 命令微调时,通过 --dataset 传入modelscope上的自定义数据集,报错如下:
path = self.resolve_path(path, revision=kwargs.get(""revision"")).unresolve()
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/huggingface_hub/hf_file_system.py"", line 183, in resolve_path
repo_and_revision_exist, err = self._repo_and_revision_exist(repo_type, repo_id, revision)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/huggingface_hub/hf_file_system.py"", line 131, in _repo_and_revision_exist
self._api.repo_info(repo_id, revision=revision, repo_type=repo_type, timeout=HF_HUB_ETAG_TIMEOUT)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py"", line 114, in _inner_fn
return fn(args, *kwargs)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/huggingface_hub/hf_api.py"", line 2588, in repo_info
return method(
TypeError: _dataset_info() got an unexpected keyword argument 'expand'
请问如何解决?"
拉最新代码安装一下swift, 您看下是不是缺少csv文件的原因,参考以下链接
https://www.modelscope.cn/docs/%E6%95%B0%E6%8D%AE%E9%9B%86%E7%9A%84%E5%88%9B%E5%BB%BA
此回答整理自钉群“魔搭ModelScope开发者联盟群 ①”
ModelScope旨在打造下一代开源的模型即服务共享平台,为泛AI开发者提供灵活、易用、低成本的一站式模型服务产品,让模型应用更简单!欢迎加入技术交流群:微信公众号:魔搭ModelScope社区,钉钉群号:44837352