announcementPreference Model7 Oct 2026
Introducing Karotte
We're open-sourcing Karotte, our framework for building robust RL environments.
Jennifer Zhou and Felipe Peter
preferencemodel.com

A framework for building robust RL environments to train aligned AI.
An occasional email when notable AI dev tools and models land in the directory. No spam, unsubscribe anytime.