部署服务(SwingDeploy)免费部署的模型调用失败

报错信息:

Traceback (most recent call last):
  File "/Users/xinyi/dev/uiai/utils/ui-tars.py", line 8, in <module>
    response = client.chat.completions.create(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Caskroom/miniconda/base/envs/vllm/lib/python3.12/site-packages/openai/_utils/_utils.py", line 287, in wrapper
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Caskroom/miniconda/base/envs/vllm/lib/python3.12/site-packages/openai/resources/chat/completions/completions.py", line 925, in create
    return self._post(
           ^^^^^^^^^^^
  File "/opt/homebrew/Caskroom/miniconda/base/envs/vllm/lib/python3.12/site-packages/openai/_base_client.py", line 1249, in post
    return cast(ResponseT, self.request(cast_to, opts, stream=stream, stream_cls=stream_cls))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Caskroom/miniconda/base/envs/vllm/lib/python3.12/site-packages/openai/_base_client.py", line 1037, in request
    raise self._make_status_error_from_response(err.response) from None
openai.InternalServerError: Error code: 502

ModelScope 模型:

UI-TARS-1.5-7B-GGUF
HHaoAI/UI-TARS-1.5-7B-GGUF

计算资源名称

GPU
ms-ens-a6affd81-eeec

image.png

image.png

展开
收起
31349819 2025-08-15 15:47:17 70 分享 版权
0 条回答
写回答
取消 提交回答

包含图像描述、文本生成图片、版面分析、多模态表征、视觉问答、文档理解等多个领域

热门讨论

热门文章

还有其他疑问?
咨询AI助理