Train a single reinforcement learning policy that controls multiple different robotic hand designs at once.
Deploy a pre-trained multi-hand policy to a completely new robotic hand without retraining it.
Reproduce the cube reorientation experiments from the associated research paper in Isaac Lab simulation.
Follow the included guide to add support for your own custom dexterous hand design.
| irvlutd/uhas_sim | a-shojaei/constructdrawingai | alex72-py/aria-termux | |
|---|---|---|---|
| Stars | 20 | 20 | 20 |
| Language | Python | Python | Python |
| Setup difficulty | hard | moderate | moderate |
| Complexity | 5/5 | 4/5 | 2/5 |
| Audience | researcher | developer | developer |
Figures from each repo's GitHub metadata at analysis time.
Requires NVIDIA Isaac Sim and Isaac Lab installed with a specific version, a Conda environment, and a GPU with 16GB or more VRAM.
This repository is the official code release for a robotics research paper called Cross-Embodiment Robot Manipulation via a Unified Hand Action Space, or UHAS. The core idea is that different robotic hands, like a four fingered hand or a five fingered hand, normally each need their own separately trained control policy because their joints and shapes are different. UHAS tries to solve that by representing any hand's motion as a deformation of a shared, imaginary sphere rather than as raw joint angles. A lightweight algorithm called Cascade Inverse Kinematics then translates those sphere deformations into the specific joint commands each real hand needs, and it can do this fast enough for real time control.\n\nBecause every hand's actions are described the same way, through this shared sphere representation, a single reinforcement learning policy can be trained once and then used to control several different robotic hands, including the LEAP Hand, Allegro Hand, Shadow Hand, and a simulated human hand model called MANO. The repository even includes a pre-trained policy that was trained jointly across all four of these hands, and it can reportedly be applied directly to a brand new hand it has never seen before, without retraining. The project provides everything needed to reproduce this: the pipeline that automatically builds the sphere representation from a hand's URDF description file, full simulation environments built on NVIDIA Isaac Lab and Isaac Sim for training and testing cube reorientation tasks, and scripts to train new policies or evaluate the pre-trained ones. There is also a guide explaining how to add support for an entirely new dexterous hand design. Running this project requires substantial setup: NVIDIA Isaac Sim 4.5.0, Isaac Lab 2.2.1, Python 3.10 or newer, a Conda environment, and a GPU with at least 16GB of video memory for running more than 1000 parallel training environments. Once installed, training and evaluating policies is done through command line scripts. The code is released under the Apache License 2.0, and the authors ask that anyone using the code or the UHAS idea cite their paper.
Research code letting one AI policy control many different robotic hands by representing all hand motions as deformations of a shared sphere shape.
Mainly Python. The stack also includes Python, NVIDIA Isaac Lab, NVIDIA Isaac Sim.
Use freely for any purpose, including commercial use, as long as you keep the copyright notice and license terms, also grants patent rights from contributors.
Setup difficulty is rated hard, with roughly 1day+ to a first successful run.
Mainly researcher.
This repo across BitVibe Labs
Don't trust strangers blindly. Verify against the repo.