Direct Preference Heads (Preprint) Collection This collection contains the pre-trained, fine-tuned and aligned models for the Direct Preference Heads paper. • 4 items • Updated May 31 • 1