"2024-07-15 14:57:43,845 - modelscope - INFO - PyTorch version 2.0.1 Found.
2024-07-15 14:57:43,846 - modelscope - INFO - Loading ast index from /root/.cache/modelscope/ast_indexer
2024-07-15 14:57:43,874 - modelscope - INFO - Loading done! Current index file version is 1.15.0, with md5 6ab0f7f3aeff04f1ed5e6c013213ed1f and a total number of 980 components indexed
[INFO:swift] Successfully registered /home/pai/lib/python3.9/site-packages/swift/llm/data/dataset_info.json
Traceback (most recent call last):
File ""/mnt/workspace/zihan/QBI_LLM_FT/src/scripts/simple_cli.py"", line 42, in
from swift.llm import (
ImportError: cannot import name 'get_vllm_engine' from 'swift.llm' (/home/pai/lib/python3.9/site-packages/swift/llm/init.py)
请问ModelScope中，get_vllm_engine不是这样import的么？"
写回答
"您看下是不是装错了，
pip uninstall swift
pip install ms-swift -U 此回答整理自钉群“魔搭ModelScope开发者联盟群 ①”"
ModelScope旨在打造下一代开源的模型即服务共享平台，为泛AI开发者提供灵活、易用、低成本的一站式模型服务产品，让模型应用更简单！欢迎加入技术交流群：微信公众号：魔搭ModelScope社区，钉钉群号：44837352
