QLoRA: Efficient Finetuning of Quantized LLMs

Abstract

This paper introduces and evaluates the idea described in “QLoRA: Efficient Finetuning of Quantized LLMs”, and reports empirical results that helped shape subsequent work in finetuning, efficiency.