"2024-07-24 17:08:52,021 - modelscope - INFO - Downloading to /root/.cache/modelscope/hub/datasets/2e502ee16ecb1b52e34442904bb199e00783e3f25034cf92ce405f9fd528e62e.incomplete
Downloading readme: 100%|█████████████████████████████████████████████████████████████████████████████████████████████| 406/406 [00:00<00:00, 2.46MB/s]
2024-07-24 17:08:52,521 - modelscope - INFO - storing https://www.modelscope.cn/api/v1/datasets/adcry99/dsaj/repo?Source=SDK&Revision=master&FilePath=README.md&View=False in cache at /root/.cache/modelscope/hub/datasets/2e502ee16ecb1b52e34442904bb199e00783e3f25034cf92ce405f9fd528e62e
2024-07-24 17:08:52,522 - modelscope - INFO - creating metadata file for /root/.cache/modelscope/hub/datasets/2e502ee16ecb1b52e34442904bb199e00783e3f25034cf92ce405f9fd528e62e
2024-07-24 17:08:52,526 - modelscope - INFO - Context manager of ms-dataset exited.
Traceback (most recent call last):
File """", line 1, in
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/modelscope/msdatasets/ms_dataset.py"", line 294, in load
with load_dataset_with_ctx(
File ""/root/miniconda3/envs/swift/lib/python3.10/contextlib.py"", line 135, in enter
return next(self.gen)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/modelscope/msdatasets/utils/hf_datasets_util.py"", line 1336, in load_dataset_with_ctx
dataset_res = DatasetsWrapperHF.load_dataset(args, kwargs)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/modelscope/msdatasets/utils/hf_datasets_util.py"", line 920, in load_dataset
builder_instance = DatasetsWrapperHF.load_dataset_builder(
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/modelscope/msdatasets/utils/hf_datasets_util.py"", line 1047, in load_dataset_builder
dataset_module = DatasetsWrapperHF.dataset_module_factory(
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/modelscope/msdatasets/utils/hf_datasets_util.py"", line 1306, in dataset_module_factory
raise e1 from None
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/modelscope/msdatasets/utils/hf_datasets_util.py"", line 1282, in dataset_module_factory
).get_module()
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/modelscope/msdatasets/utils/hf_datasets_util.py"", line 561, in get_module_without_script
patterns = _get_data_patterns(
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/modelscope/msdatasets/utils/hf_datasets_util.py"", line 500, in _get_data_patterns
return _get_data_files_patterns(resolver)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/datasets/data_files.py"", line 252, in _get_data_files_patterns
data_files = pattern_resolver(pattern)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/modelscope/msdatasets/utils/hf_datasets_util.py"", line 371, in _resolve_pattern
tmp_file_paths = fs.glob(pattern, detail=True, glob_kwargs)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/huggingface_hub/hf_file_system.py"", line 416, in glob
path = self.resolve_path(path, revision=kwargs.get(""revision"")).unresolve()
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/huggingface_hub/hf_file_system.py"", line 183, in resolve_path
repo_and_revision_exist, err = self._repo_and_revision_exist(repo_type, repo_id, revision)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/huggingface_hub/hf_file_system.py"", line 131, in _repo_and_revision_exist
self._api.repo_info(repo_id, revision=revision, repo_type=repo_type, timeout=HF_HUB_ETAG_TIMEOUT)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py"", line 114, in _inner_fn
return fn(args, **kwargs)
File ""/root/miniconda3/envs/swift/lib/python3.10/site-packages/huggingface_hub/hf_api.py"", line 2588, in repo_info
return method(
TypeError: _dataset_info() got an unexpected keyword argument 'expand'"
ModelScope中,这个错误怎么解决?
您看下是不是缺少csv文件的原因,参考以下链接
https://www.modelscope.cn/docs/%E6%95%B0%E6%8D%AE%E9%9B%86%E7%9A%84%E5%88%9B%E5%BB%BA
官方镜像上测了会报错。看起来有两个subset,您相应地改一下dataset_infos.json看看。 此回答整理自钉群“魔搭ModelScope开发者联盟群 ①”
ModelScope旨在打造下一代开源的模型即服务共享平台,为泛AI开发者提供灵活、易用、低成本的一站式模型服务产品,让模型应用更简单!欢迎加入技术交流群:微信公众号:魔搭ModelScope社区,钉钉群号:44837352