[Submitted on 30 May 2023]
Abstract: Emergent properties have been widely adopted as a term to describe behavior
not present in smaller models but observed in larger models. Recent work
suggests that the trade-off incurred by quantization is also an emergent
property, with sharp drops in performance in models over 6B parameters
