mid-training

Here are 6 public repositories matching this topic...

A high-performance framework for training LLMs, VLMs, diffusion, and embodied models on NVIDIA GPUs and Kunlun XPUs.

training gpu distributed lora wan diffusion vla vlm wam embodied sft megatron pretraining kunlun embodied-ai xpu llm mid-training

Revisiting Mid-training in the Era of Reinforcement Learning Scaling

rl llama reasoning post-training pre-training llm qwen verl mid-training

[𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models

Official code, models, and dataset for "Evolution Fine-Tuning (EFT): Learning to Discover Across 371 Optimization Tasks"

How Post-Training Shapes Biological Reasoning Models

Open catalog of datasets used to train and align LLMs across pretraining, mid-training, and post-training.

data datasets datahub post-training pretraining llm mid-training

To associate your repository with the mid-training topic, visit your repo's landing page and select "manage topics."