# State-Only Imitation Learning for Dexterous Manipulation

Article · Ilija Radosavovic, Xiaolong Wang, Lerrel Pinto, Jitendra Malik

- Archive id: arxiv:2004.04650
- Published: 2020-04-07
- Venue: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- DOI: https://doi.org/10.1109/iros51168.2021.9636557
- arXiv: https://arxiv.org/abs/2004.04650
- Citations: 76
- Source URL: https://arxiv.org/abs/2004.04650
- PDF: https://arxiv.org/pdf/2004.04650
- Provenance: arxiv

## Abstract

Modern model-free reinforcement learning methods have recently demonstrated impressive results on a number of problems. However, complex domains like dexterous manipulation remain a challenge due to the high sample complexity. To address this, current approaches employ expert demonstrations in the form of state-action pairs, which are difficult to obtain for real-world settings such as learning from videos. In this paper, we move toward a more realistic setting and explore state-only imitation learning. To tackle this setting, we train an inverse dynamics model and use it to predict actions for state-only demonstrations. The inverse dynamics model and the policy are trained jointly. Our method performs on par with state-action approaches and considerably outperforms RL alone. By not relying on expert actions, we are able to learn from demonstrations with different dynamics, morphologies, and objects. Videos available at https://people.eecs.berkeley.edu/~ilija/soil .

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

Topics: [Robot Learning & Embodied AI](https://space-kitty.com/topics/robotics-embodied)

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.