运行”Qwen-7B-Chat“时,报错too many 500 error responses'

我在尝试本地跑通义千问Qwen-7B-Chat的快速使用(Quickstart),但是模型多次下载失败后,再次执行程序会遇到如下报错信息。不知道该如何解决。

运行程序


# 官方示例:https://modelscope.cn/models/qwen/Qwen-7B-Chat/summary

from modelscope import AutoModelForCausalLM, AutoTokenizer
from modelscope import GenerationConfig

tokenizer = AutoTokenizer.from_pretrained("qwen/Qwen-7B-Chat", revision = 'v1.0.1',trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained("qwen/Qwen-7B-Chat", revision = 'v1.0.1',device_map="auto", trust_remote_code=True).eval()

报错信息如下:

urllib3.exceptions.ResponseError: too many 500 error responses

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/urllib3/connectionpool.py", line 941, in urlopen
return self.urlopen(
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/urllib3/connectionpool.py", line 941, in urlopen
return self.urlopen(
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/urllib3/connectionpool.py", line 931, in urlopen
retries = retries.increment(method, url, response=response, _pool=self)
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='127.0.0.1', port=12335): Max retries exceeded with url: http://www.modelscope.cn/api/v1/models/qwen/Qwen-7B-Chat/revisions?EndTime=1691207516 (Caused by ResponseError('too many 500 error responses'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "", line 1, in
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/modelscope/utils/hf_util.py", line 90, in from_pretrained
model_dir = snapshot_download(
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/modelscope/hub/snapshot_download.py", line 96, in snapshot_download
revision = _api.get_valid_revision(
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/modelscope/hub/api.py", line 479, in get_valid_revision
revisions = self.list_model_revisions(
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/modelscope/hub/api.py", line 432, in list_model_revisions
r = self.session.get(path, cookies=cookies, headers=self.headers)
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/requests/sessions.py", line 602, in get
return self.request("GET", url, kwargs)
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep,
send_kwargs)
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/home/jingli/.conda/envs/gpt/lib/python3.8/site-packages/requests/adapters.py", line 510, in send
raise RetryError(e, request=request)
requests.exceptions.RetryError: HTTPConnectionPool(host='127.0.0.1', port=12335): Max retries exceeded with url: http://www.modelscope.cn/api/v1/models/qwen/Qwen-7B-Chat/revisions?EndTime=1691207516 (Caused by ResponseError('too many 500 error responses'))

展开
收起
游客ml3chshbzawa4 2023-08-05 12:29:19 746 分享 版权
1 条回答
写回答
取消 提交回答
  • 北京阿里云ACE会长

    这可能是由于各种原因导致的,包括但不限于以下几点:

    服务器负载过高:如果服务器上同时处理的请求过多,可能会导致性能下降和服务器内部错误。这可能是由于流量量大或资源不足引起的。

    网络连接问题:不稳定的网络连接或网络延迟可能导致请求无法正常传输或处理,从而引发500错误。

    模型问题:可能存在模型自身的问题或错误,导致请求无法正确处理并返回500错误。

    针对这个问题,您可以尝试以下解决方法:

    重试:如果您只是偶尔遇到这个错误,可以尝试重新发送请求。这可能是由于临时的网络或服务器问题导致的。

    减少请求频率:如果您在一段时间内发送了大量请求,请考虑减少请求的频率,以减轻服务器的负载。

    2023-08-05 20:17:51
    赞同 展开评论

ModelScope旨在打造下一代开源的模型即服务共享平台,为泛AI开发者提供灵活、易用、低成本的一站式模型服务产品,让模型应用更简单!欢迎加入技术交流群:微信公众号:魔搭ModelScope社区,钉钉群号:44837352

还有其他疑问?
咨询AI助理