[Submitted on 15 Mar 2021 (v1), last revised 6 Apr 2021 (this version, v2)]
Abstract: When fine-tuning pretrained models for classification, researchers either use
a generic model head or a task-specific prompt for prediction. Proponents of
prompting have argued that prompts provid