"import os
os.environ['CUDA_VISIBLE_DEVICES'] = ""0,1""
from swift.llm import AppUIArguments,app_ui_main
best_model_checkpoint = '/work/models/qwen-14b-chat/v0-xxxx/checkpoin-xxx'
infer_args = AppUIArguments(
model_id_or_path= 'qwen/Qwen-14B-Chat',
model_cache_dir='本地的qwen14b-chat模型路径',
load_args_from_ckpt_dir=True,
load_dataset_config=True,
ckpt_dir=best_model_checkpoint,
server_name='0.0.0.0',
server_port=7860,
share=True,
eval_human=True,
use_flash_attn=False
)
result = app_ui_main(infer_args) ModelScope中,出现以上错误是不是eval_human=True的原因?"
ModelScope旨在打造下一代开源的模型即服务共享平台,为泛AI开发者提供灵活、易用、低成本的一站式模型服务产品,让模型应用更简单!欢迎加入技术交流群:微信公众号:魔搭ModelScope社区,钉钉群号:44837352