requires Accelerate: pip install accelerate and bitsandbytes


If you’ve begun working with LLMs and particularly getting into fine-tuning models, then you may be running across this error: particularly strange as you already have accelerate installed.

Seriously though… I hate these kind of errors because they waste time and cause brain-fry. But here you go. I’m going to save you ton of time.

KEEP THESE TWO WORDS IN MIND AND WHEN YOU SEE THEM LET IT KEY YOUR MEMORY: Accelerate & Bitsandbytes
When you see those two, do the following:

–> Downgrade TRANSFORMERS <– and it will work

pip install transformers==4.30

Leave a Reply

Your email address will not be published. Required fields are marked *