If you’ve begun working with LLMs and particularly getting into fine-tuning models, then you may be running across this error: particularly strange as you already have accelerate installed.
Seriously though… I hate these kind of errors because they waste time and cause brain-fry. But here you go. I’m going to save you ton of time.
KEEP THESE TWO WORDS IN MIND AND WHEN YOU SEE THEM LET IT KEY YOUR MEMORY: Accelerate & Bitsandbytes
When you see those two, do the following:
–> Downgrade TRANSFORMERS <– and it will work
pip install transformers==4.30
Leave a Reply