embodied agents

embodied agents is a toolkit for integrating large multi-modal models into existing robot stacks with just a few lines of code. It provides a consistent interface for calling different AI models, handling multimodal data, and is configurable to any observation and action space.

• Overview
  • Motivation
  • Goals
  • Limitations
  • Scope
  • Features
  • Endpoints
• Installation
  • Optional Dependencies
• Getting Started
  • Run a robotics transformer model on a robot
  • Example Scripts
  • Notebooks
• Glossary
• Concepts
  • Agents
  • Types
  • Controls
• Building Blocks
  • The Sample Class
  • Message
  • Backend
  • Language Agent
  • Motor Agent
  • Sensory Agent
  • Motion Controls
  • Hardware Interface
  • Recorder
• Contributing Guidelines
  • Git Workflow 💻
  • 🌐 Environment Setup
  • 🛠️ Style Guide
• Deep Dive
  • mbodied.agents package
  • mbodied.agents.backends package
  • mbodied.agents.language package
  • mbodied.agents.motion package
  • mbodied.agents.sense package
  • mbodied.agents.sense.audio package
  • mbodied.data package
  • mbodied.hardware package
  • mbodied.types package
  • mbodied.types.language package
  • mbodied.types.motion package
  • mbodied.types.sense package
  • mbodied.types.utils package

Quickstart Guide

Start your path to understanding the embodied agents package with our quickstart guide.

Get started