"ModelScope中使用开源的千问1_8预训练模型微调后测试模型的时候报错,怎么解决? :RuntimeError: probability tensor contains either `inf`
, `nan`
or element < 0
推理过程中我打印了权重:Warning: Found NaN or Inf in parameter transformer.h.22.mlp.w1.weight
Warning: Found NaN or Inf in parameter transformer.h.22.mlp.w2.weight
Warning: Found NaN or Inf in parameter transformer.h.22.mlp.c_proj.weight
Warning: Found NaN or Inf in parameter transformer.h.23.attn.c_attn.weight
Warning: Found NaN or Inf in parameter transformer.h.23.attn.c_proj.weight
Warning: Found NaN or Inf in parameter transformer.h.23.mlp.w1.weight
Warning: Found NaN or Inf in parameter transformer.h.23.mlp.w2.weight
Warning: Found NaN or Inf in parameter transformer.h.23.mlp.c_proj.weight"
ModelScope旨在打造下一代开源的模型即服务共享平台,为泛AI开发者提供灵活、易用、低成本的一站式模型服务产品,让模型应用更简单!欢迎加入技术交流群:微信公众号:魔搭ModelScope社区,钉钉群号:44837352