preference distillation · 1 topics

smaller models better rejects preference distillation scaling