通过oobabooga-text-generation-webui在本地部署,总是报以下错误,请问哪位知道如何解决吗?谢谢!
Traceback (most recent call last):
File "D:\AI\oobabooga_windows\text-generation-webui\modules\ui_model_menu.py", line 185, in load_model_wrapper
shared.model, shared.tokenizer = load_model(shared.model_name, loader)
File "D:\AI\oobabooga_windows\text-generation-webui\modules\models.py", line 79, in load_model
output = load_func_map
File "D:\AI\oobabooga_windows\text-generation-webui\modules\models.py", line 149, in huggingface_loader
model = LoaderClass.from_pretrained(Path(f"{shared.args.model_dir}/{model_name}"), low_cpu_mem_usage=True, torch_dtype=torch.bfloat16 if shared.args.bf16 else torch.float16, trust_remote_code=shared.args.trust_remote_code)
File "D:\AI\oobabooga_windows\installer_files\env\lib\site-packages\transformers\models\auto\auto_factory.py", line 498, in from_pretrained
model_class = get_class_from_dynamic_module(
File "D:\AI\oobabooga_windows\installer_files\env\lib\site-packages\transformers\dynamic_module_utils.py", line 451, in get_class_from_dynamic_module
final_module = get_cached_module_file(
File "D:\AI\oobabooga_windows\installer_files\env\lib\site-packages\transformers\dynamic_module_utils.py", line 279, in get_cached_module_file
modules_needed = check_imports(resolved_module_file)
File "D:\AI\oobabooga_windows\installer_files\env\lib\site-packages\transformers\dynamic_module_utils.py", line 152, in check_imports
raise ImportError(
ImportError: This modeling file requires the following packages that were not found in your environment: transformers_stream_generator. Run pip install transformers_stream_generator
oobabooga-text-generation-webui 无法正常运行,可能是以下原因导致的:
安装依赖的包不正确。
配置文件不正确。
环境变量设置错误。
启动命令错误。
其他未知原因。
ModelScope旨在打造下一代开源的模型即服务共享平台,为泛AI开发者提供灵活、易用、低成本的一站式模型服务产品,让模型应用更简单!欢迎加入技术交流群:微信公众号:魔搭ModelScope社区,钉钉群号:44837352