Definition
An open-weight Mistral-based assistant model fine-tuned with preference learning.
A Mistral-7B-based assistant model post-trained with DPO on preference data, used as an open-weights aligned model in alignment research.
An open-weight Mistral-based assistant model fine-tuned with preference learning.
A Mistral-7B-based assistant model post-trained with DPO on preference data, used as an open-weights aligned model in alignment research.