Fine-tuning Phi-3 with QLoRA
Fine-tuning Microsoft’s Phi-3 Mini language model using QLoRA (Quantum Low-Rank Adaptation).
QLoRA will help improve conversational understanding and response generation.
To load models in 4bits with transformers and bitsandbytes, you have to install accelerate and transformers from source and make sure you have the latest version of the bitsandbytes library.
Samples