ALFRED

Roadmap

Follow language instructions to complete household tasks from vision.

On the roadmap

ALFRED is catalogued but not runnable yet, so there are no usage docs — we do not document what does not run. The fact sheet below is sourced from the paper; the protocols it will implement are stable today.

Paper: ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
Citation: Shridhar et al., 2019, arXiv:1912.01734
License: MIT
Homepage: https://askforalfred.com

How an eval goes live

Implement an EvalRunner against the stable protocols.
Bundle a small real-schema sample so it runs offline.
Point the catalog entry's runner at the class.
Ship its docs in the same change — required to flip live.

pip install agi-evals