> ## Documentation Index
> Fetch the complete documentation index at: https://miles.radixark.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Fully Asynchronous Rollout Example

> Demonstrates fully asynchronous rollout generation for higher efficiency.

This example shows a simple way to make rollout generation **fully asynchronous**: a single global worker is created once and then keeps running in the background, continuously pulling prompts and launching generation tasks. Training only needs to fetch already finished results. This removes the per‑step wait that happens in the normal synchronous style.

The implementation lives in the core library at `miles/rollout/fully_async_rollout.py` (`FullyAsyncRolloutFn`, a class-based rollout function that owns a persistent background worker).

## Files

* `run_qwen3_5_4b_fully_async_eval.py`: Qwen3.5‑4B with async checkpoint eval — `--eval-backend fleet` (dedicated eval fleet) or `--eval-backend external` (fn-launched sglang server, `examples.infra_features.fully_async.external_eval_fn.ExternalSglangEvalFn`).
* `run_qwen3_30b_a3b_fully_async.py`: the same pattern on a 30B MoE — `tp=8`, `ep=8`, one 8-GPU rollout engine.
* `external_eval_fn.py`: reference `CheckpointEvalFn` — launches/attaches an external sglang server and evals snapshots on it.

## Quick Start

Each launcher downloads its own checkpoint and converts it, then submits the job:

```bash theme={null}
python examples/infra_features/fully_async/run_qwen3_5_4b_fully_async_eval.py
```

You should see log lines like:

```
Started fully-async rollout worker
```

## At a larger scale

[`examples/experimental/openenv/glm52_tbench2`](https://github.com/radixark/miles/tree/main/examples/experimental/openenv/glm52_tbench2) runs
the same flag on a frontier-scale agentic workload: GLM-5.2 744B-A40B on terminal-bench-2,
16 GB300 nodes split 8 training / 8 inference, one Daytona sandbox per episode.