You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
ValueError: The checkpoint you are trying to load has model type multi_modality but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
#185
Open
xem123 opened this issue
Feb 25, 2025
· 0 comments
ValueError: The checkpoint you are trying to load has model type 'multi_modality' but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
My current configuration/software versions are as follows:
The text was updated successfully, but these errors were encountered:
please help me,I want to fine-tune the Janus-Pro-7B model. The model itself works correctly, but after installing ms-swift, when I run the command:
Bash
swift sft --model Janus-pro-7Bmodel --dataset data.jsonl --train_type lora --torch_dtype bfloat16 --num_train_epochs 5 --per_device_train_batch_size 1 --per_device_eval_batch_size 1 --learning_rate 1e-4 --lora_rank 8 --lora_alpha 32 --target_modules all-linear --freeze_vit true
it throws an error:
ValueError: The checkpoint you are trying to load has model type 'multi_modality' but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
My current configuration/software versions are as follows:

The text was updated successfully, but these errors were encountered: