FEEL pairs piezoresistive glove force with egocentric video
TL;DR
- FEEL contains approximately 3 million force-synchronized frames of unscripted kitchen manipulation captured from custom piezoresistive gloves and egocentric video.
- 45% of frames involve hand-object contact; the paper reports state-of-the-art temporal contact segmentation without manual contacted-object annotations.
- Using force prediction as a self-supervised pretraining objective improved transfer to EPIC-Kitchens, SomethingSomething-V2, EgoExo4D, and Meccano.
FEEL, described in a preprint posted to arXiv on March 16, pairs force readings from custom piezoresistive gloves with egocentric video, releasing what its authors call the first large-scale dataset of its kind. The corpus, the paper says, "contains approximately 3 million force-synchronized frames of natural unscripted manipulation in kitchen environments, with 45% of frames involving hand-object contact."
The eight-author team, led by Eadom Dessalene, frames force as foundational: "Because force is the underlying cause that drives physical interaction, it is a critical primitive for physical action understanding." They apply the dataset to two task families: temporal and pixel-level contact segmentation, and action representation learning where force prediction serves as a self-supervised pretraining objective for video backbones.
The abstract reports "state-of-the-art temporal contact segmentation results and competitive pixel-level segmentation results without any need for manual contacted object segmentation annotations," and says force-pretrained representations improve transfer on EPIC-Kitchens, SomethingSomething-V2, EgoExo4D, and Meccano. Two researchers on our tracker circulated the link within days of the arXiv post.
The abstract publishes no per-benchmark accuracy figures and gives no timeline for releasing the gloves or the data.
Shared on Bluesky by 2 AI experts
-
FEEL (Force-Enhanced Egocentric Learning): A Dataset for Physical Action Understanding Dessalene et al., UMD #ECCV2026 oral arxiv.org/abs/2603.15847 Very nice!
View on Bluesky →
Originally reported by arxiv.org
Read the original article →Original headline: FEEL (Force-Enhanced Egocentric Learning): A Dataset for Physical Action Understanding