Molt
An agentic-first RL framework for research. Ray · vLLM · NVIDIA AutoModel — the smallest PyTorch-native stack for 1T-class fully-async, multimodal, multi-turn agentic RL.
Post-Training
5 tools in Post-Training.
PorTAL
PorTAL generates portable task specific LoRA adapters that can efficiently transfer across language models.
Tinker
Tinker is a training API for researchers and developers.
TRL
TRL is a cutting-edge library designed for post-training foundation models using advanced techniques like Supervised Fine-Tuning (SFT), Group Relative Policy Optimization (GRPO), and Direct Preference Optimization (DPO). Built on top of the Transformers ecosystem, TRL supports a variety of model architectures and modalities, and can be scaled-up across various hardware setups.
World Model Optimizer
Build continually improving models on your agent traces by distilling frontier open models