Voyager Minedojo

What Is Voyager Minedojo?

Voyager Minedojo is a self-learning explorer for Minecraft, powered by large language models such as GPT-4. It navigates the Minecraft world autonomously, acquiring new skills and making discoveries without human intervention. The system combines three core components: an automatic curriculum that guides exploration, a skill library that stores learned behaviors for reuse, and an iterative prompting mechanism that generates executable code to determine its next actions.

Voyager is notable for finding unique items, mastering the game’s tech tree, covering large map areas, and quickly learning new tasks in unfamiliar Minecraft worlds, outperforming previous methods across these benchmarks.

Who’s Behind Voyager Minedojo?

Voyager was created by Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi “Jim” Fan, and Anima Anandkumar — a collaboration involving NVIDIA, Caltech, UT Austin, Stanford, and ASU. It was introduced as the first embodied lifelong learning agent for Minecraft powered by an LLM, designed to continuously explore, learn skills, and make discoveries without human guidance.

What Can Voyager Minedojo Do?

• Autonomous exploration: Continuously explores the Minecraft world, finding new items and terrain.
• Skill acquisition: Learns a wide range of abilities on its own, with no task-specific training required.
• Automatic curriculum: GPT-4 generates a curriculum that maximizes exploration and discovery.
• Skill library: Stores complex behaviors so they can be reused, preventing catastrophic forgetting.
• Code generation: Uses iterative prompting to produce executable code for actions.
• GPT-4 interaction: Communicates with GPT-4 via blackbox queries to manage its behavior.
• Zero-shot generalization: Adapts to new tasks and different Minecraft worlds.
• Benchmark performance: Outperforms earlier approaches at discovering unique items, traversing the map, and unlocking the tech tree.

Who Should Use Voyager Minedojo?

Voyager is relevant for AI engineers, game developers, robotics engineers, NLP researchers, and AI researchers.

Getting Started

Voyager is an open research project. Learn more and access it through the official website at voyager.minedojo.org.