modelscope显示每天有2000次的API免费额度,在500次的时候,就提示限流了
我调用报错,不知道大佬碰到这种情况没,怎么解决的
response = client.chat.completions.create(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File '/opt/homebrew/Caskroom/miniconda/base/envs/vllm/lib/python3.12/site-packages/openai/_utils/_utils.py', line 287, in wrapper
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File '/opt/homebrew/Caskroom/miniconda/base/envs/vllm/lib/python3.12/site-packages/openai/resources/chat/completions/completions.py', line 925, in create
return self._post(
^^^^^^^^^^^
File '/opt/homebrew/Caskroom/miniconda/base/envs/vllm/lib/python3.12/site-packages/openai/_base_client.py', line 1249, in post
return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File '/opt/homebrew/Caskroom/miniconda/base/envs/vllm/lib/python3.12/site-packages/openai/_base_client.py', line 1037, in request
raise self._make_status_error_from_response(err.response) from None
openai.InternalServerError: Error code: 502
赞25
踩0