gitwtfhub

wtf is sparsh?

facebookresearch/sparsh — explained in plain English

Analysis updated 2026-07-17 · repo last pushed 2025-02-27

★ 228Jupyter NotebookAudience · researcherComplexity · 4/5StaleSetup · hard

TL;DR

A self-supervised learning framework that trains a reusable AI model to understand tactile sensor images, without needing labeled touch data.

Mindmap

mindmap
  root((repo))
    What it does
      Learns from touch data
      Trains feature extractor
      No labels needed
    Tech stack
      Jupyter Notebook
      Python
      MAE and DINO
    Use cases
      Detect gripper slip
      Estimate applied force
      Assess grasp stability
      Classify textiles
    Audience
      Robotics researchers
      Tactile sensing engineers
    Setup
      Download pretrained weights
      Fine tune on new task
      Live force demo

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Fine-tune Sparsh's pretrained tactile representations to detect when a robot gripper is slipping.

REASON 2

Estimate the force applied at a contact surface using a DIGIT, GelSight 2017, or GelSight Mini sensor.

REASON 3

Train a slip-detection or grasp-stability model with far less labeled data than training from scratch.

REASON 4

Visualize real-time force fields from a DIGIT tactile sensor using the included live demo.

What's in the stack?

Jupyter NotebookPythonPyTorch

How it stacks up

facebookresearch/sparshfacebookresearch/unibenchkrishnaik06/text-summarization-nlp-project
Stars228228198
LanguageJupyter NotebookJupyter NotebookJupyter Notebook
Last pushed2025-02-272026-06-182024-08-17
MaintenanceStaleActiveStale
Setup difficultyhardmoderatehard
Complexity4/53/54/5
Audienceresearcherresearcherdeveloper

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · hard Time to first run · 1day+

Requires downloading large pretrained weights and datasets, plus a compatible tactile sensor for real-world use.

Not specified in the explanation.

Yoink these prompts

Prompt 1
How do I download Sparsh's pretrained tactile representation weights and fine-tune them for force estimation on my DIGIT sensor data?
Prompt 2
Explain how Sparsh uses self-supervised methods like MAE and DINO to learn from unlabeled tactile sensor images.
Prompt 3
How do I reproduce Sparsh's slip-detection benchmark using the labeled downstream task datasets included in the repo?
Prompt 4
Walk me through running Sparsh's live demo that visualizes force fields from a DIGIT sensor in real time.

Frequently asked questions

wtf is sparsh?

A self-supervised learning framework that trains a reusable AI model to understand tactile sensor images, without needing labeled touch data.

What language is sparsh written in?

Mainly Jupyter Notebook. The stack also includes Jupyter Notebook, Python, PyTorch.

Is sparsh actively maintained?

Stale — no commits in 1-2 years (last push 2025-02-27).

What license does sparsh use?

Not specified in the explanation.

How hard is sparsh to set up?

Setup difficulty is rated hard, with roughly 1day+ to a first successful run.

Who is sparsh for?

Mainly researcher.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.

Other repos in this lane