开发者社区 > ModelScope模型即服务 > 自然语言处理 > 正文

youku-mPLUG 预训练数据集下载报错

0% An exception was thrown by producer or consumer, backtrace: Traceback (most recent call last):
  File "/opt/conda/lib/python3.8/site-packages/oss2/task_queue.py", line 76, in __consumer_func
    consumer(self)
  File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 410, in __consumer
    self.__download_part(part)
  File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 425, in __download_part
    utils.copyfileobj_and_verify(result, f, part.end - part.start, request_id=result.request_id)
  File "/opt/conda/lib/python3.8/site-packages/oss2/utils.py", line 860, in copyfileobj_and_verify
    fdst.write(buf)
OSError: [Errno 22] Invalid argument

0% An exception was thrown by producer or consumer, backtrace: Traceback (most recent call last):
  File "/opt/conda/lib/python3.8/site-packages/oss2/task_queue.py", line 76, in __consumer_func
    consumer(self)
  File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 410, in __consumer
    self.__download_part(part)
  File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 425, in __download_part
    utils.copyfileobj_and_verify(result, f, part.end - part.start, request_id=result.request_id)
  File "/opt/conda/lib/python3.8/site-packages/oss2/utils.py", line 860, in copyfileobj_and_verify
    fdst.write(buf)
OSError: [Errno 22] Invalid argument

0% An exception was thrown by producer or consumer, backtrace: Traceback (most recent call last):
  File "/opt/conda/lib/python3.8/site-packages/oss2/task_queue.py", line 76, in __consumer_func
    consumer(self)
  File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 410, in __consumer
    self.__download_part(part)
  File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 425, in __download_part
    utils.copyfileobj_and_verify(result, f, part.end - part.start, request_id=result.request_id)
  File "/opt/conda/lib/python3.8/site-packages/oss2/utils.py", line 860, in copyfileobj_and_verify
    fdst.write(buf)
OSError: [Errno 22] Invalid argument

Traceback (most recent call last):
  File "pretrain_videos_download.py", line 29, in <module>
    test_download()
  File "pretrain_videos_download.py", line 25, in test_download
    for item in data:
  File "/opt/conda/lib/python3.8/site-packages/modelscope/msdatasets/ms_dataset.py", line 74, in __iter__
    for item in self._hf_ds:
  File "/opt/conda/lib/python3.8/site-packages/modelscope/msdatasets/dataset_cls/dataset.py", line 101, in __iter__
    ex_cache_path = dl_manager.download_and_extract(v)
  File "/opt/conda/lib/python3.8/site-packages/datasets/download/streaming_download_manager.py", line 973, in download_and_extract
    return self.extract(self.download(url_or_urls))
  File "/opt/conda/lib/python3.8/site-packages/datasets/download/streaming_download_manager.py", line 909, in download
    url_or_urls = map_nested(self._download, url_or_urls, map_tuple=True)
  File "/opt/conda/lib/python3.8/site-packages/datasets/utils/py_utils.py", line 436, in map_nested
    return function(data_struct)
  File "/opt/conda/lib/python3.8/site-packages/modelscope/msdatasets/download/download_manager.py", line 60, in _download
    return oss_utilities.download(
  File "/opt/conda/lib/python3.8/site-packages/modelscope/msdatasets/utils/oss_utils.py", line 106, in download
    oss2.resumable_download(
  File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 162, in resumable_download
    downloader.download(result.server_crc)
  File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 388, in download
    q.run()
  File "/opt/conda/lib/python3.8/site-packages/oss2/task_queue.py", line 44, in run
    raise self.__exc_info[1]
  File "/opt/conda/lib/python3.8/site-packages/oss2/task_queue.py", line 76, in __consumer_func
    consumer(self)
  File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 410, in __consumer
    self.__download_part(part)
  File "/opt/conda/lib/python3.8/site-packages/oss2/resumable.py", line 425, in __download_part
    utils.copyfileobj_and_verify(result, f, part.end - part.start, request_id=result.request_id)
  File "/opt/conda/lib/python3.8/site-packages/oss2/utils.py", line 860, in copyfileobj_and_verify
    fdst.write(buf)
OSError: [Errno 22] Invalid argument

展开
收起
MiraMo 2023-06-21 17:22:22 234 0
2 条回答
写回答
取消 提交回答
  • 北京阿里云ACE会长

    您在下载youku-mPLUG预训练数据集时遇到了连接超时或其他网络问题。这可能是由于网络状况不佳、下载链接失效或服务器故障等原因导致的。

    建议您尝试以下方法解决问题:

    检查网络连接:请确保您的网络连接正常,可以通过ping命令检查与下载服务器的连接是否正常。

    重试下载:网络问题可能导致下载过程中出现断点,建议您多次尝试下载,直到成功为止。

    更换下载链接:如果当前链接失效,您可以尝试在官方网站或其他可靠来源查找并使用其他下载链接。

    使用下载工具:您可以使用下载工具(如wget、curl等)来下载数据集,这些工具支持断点续传和自动重试等功能,可以提高下载成功的概率。

    联系数据集提供者:如果以上方法均无法解决问题,建议您联系youku-mPLUG预训练数据集的提供者,寻求技术支持或其他帮助。

    2023-07-18 21:38:17
    赞同 展开评论 打赏
  • 您好,抱歉给您带来使用问题,您可以去数据集的modelcard页面,更新到最新的modelscope库版本来解决这个问题

    image.png

    2023-06-25 10:15:03
    赞同 1 展开评论 打赏

包含命名实体识别、文本分类、分词、关系抽取、问答、推理、文本摘要、情感分析、机器翻译等多个领域

相关电子书

更多
低代码开发师(初级)实战教程 立即下载
冬季实战营第三期:MySQL数据库进阶实战 立即下载
阿里巴巴DevOps 最佳实践手册 立即下载