TarantuLabs' proprietary engine generates dozens of new environments an hour. The current focus is cybersecurity, the hardest domain to verify: multi-step exploit chains where up to five vulnerabilities must compose correctly for the flag to fall out. Each one is deterministically solvable and automatically verified, verifiably correct, by the intended path, enforced by gates: the chain composes or it doesn't, with no human judgment and no partial credit. The hard part isn't the exploits; it's generating environments whose correctness is provable at scale. The public corpus is on Hugging Face as TarantuBench v2 (~10k single-vuln labs) and v1 (100-lab suite with chains).
Acceptance-gated single-vulnerability labs on Hugging Face for training and broader eval — binary flags, technique-aware splits, raw + balanced configs.
Multi-step chains (v1 and the interactive catalog) that must fire in sequence — for long-horizon tool-use, not just single exploits.
Every HTTP request, tool call, and reasoning trace is logged. Full per-step telemetry into exactly how an agent reasons, acts, and fails.
If you need them built at scale, provably correct, deterministically verified, and checked to work via the intended path through exploit gates, reach out at [email protected] or on LinkedIn.
Interactive slice of the v1 suite. Launch any lab in your browser and attempt the exploit yourself — the same flag a model has to extract is the one you submit. For the full ~10k training corpus, use TarantuBench v2.
Proof-of-value for the environments: training runs and model evaluations conducted directly on them. Each study tests specific models or harness configurations under controlled conditions, with binary ground truth and full per-step telemetry. The environments are the product. These studies show they hold up.
Preparing scenario...