Quick Start
Eight GPUs: 2 trainer GPUs and 2 single-GPU engines per policy. Needs a cluster backend and a namespace, fromMILES_SCRIPT_CLUSTER_BACKEND / MILES_SCRIPT_NAMESPACE or --cluster-backend /
--namespace:
Recipes
Multi Policy Solver and Verifier
Two policies in one run — a solver answering gsm8k, and a verifier scored on ruling correctly about the solver’s answers.
Two policies trained against each other in one run: a solver answering a gsm8k question and a
verifier ruling on its work. Each rollout yields one sample per policy; each policy has its own
trainer and its own inference engines inside the same job.