← Docs/ Agent / Tool use

Windows Agent Arena

Roadmap

Windows desktop tasks in parallelizable cloud VMs.

On the roadmap

Windows Agent Arena is catalogued but not runnable yet, so there are no usage docs — we do not document what does not run. The fact sheet below is sourced from the paper; the protocols it will implement are stable today.

Paper: Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale
Citation: Bonatti et al., 2024, arXiv:2409.08264
License: MIT
Homepage: https://microsoft.github.io/WindowsAgentArena

How an eval goes live

Implement an EvalRunner against the stable protocols.
Bundle a small real-schema sample so it runs offline.
Point the catalog entry's runner at the class.
Ship its docs in the same change — required to flip live.

pip install agi-evals