Research prototype, assistive robotics

ReFlex, a prosthetic hand that chooses its grip

A research prototype of a prosthetic hand that starts moving on the wearer's muscle signal and uses a camera in the palm to choose the grip.

A hardware, C AI

The ReFlex hand, a pale flexible hand on a dark forearm sleeve with a small camera in its palm, reaching towards a person's hand.
The hand, with the camera in its palm.

What is ReFlex?

ReFlex is a research prototype of a prosthetic hand, designed and built by WhiteHat Design Studio. The hard part of a hand is not any one input. It is coordinating three: what the wearer intends, what the object in front of them is, and where each finger actually is. ReFlex connects the mechanical design, the electronics and the control software into one working loop on the bench.

The fingers are 3D-printed in TPU 95A, a flexible material, and pulled closed by strings, much as tendons close a hand. A custom sleeve holds the assembly on the forearm.

How ReFlex works.

  1. Calibrate

    At start-up the hand calibrates to the wearer's EMG signal and sets its threshold.

  2. Sense intent

    An EMG sensor reads forearm muscle activity. A moving average smooths it, and a change above the threshold starts a movement.

  3. See the object

    If the hand is open, the camera in the palm looks at the object. A custom-trained MobileNetV2 model, running through TensorFlow Lite on a Raspberry Pi 5, chooses the grip, such as pinch or tripod.

  4. Close and stop

    The motors for that grip drive the string-driven fingers closed, and each one stops when its encoder reaches its limit or the finger stalls.

  5. Open

    The next signal drives the motors back until the fingers reach their rest position.

How the ReFlex control loop worksAn EMG sensor reads the forearm muscle signal. A moving average and a threshold, calibrated at start-up, decide whether the change is big enough to act on. If the hand is closed, the motors drive back until the fingers reach their rest position. If it is open, the palm camera and a MobileNetV2 model running through TensorFlow Lite on a Raspberry Pi 5 choose a pinch or tripod grip, and the finger motors close until each encoder reaches its limit or the finger stalls. Then the loop starts again.yesnoloopEMG sensorForearm muscle signalMoving average, thresholdCalibrated at start-upto the wearerHand closed?Open the handMotors back to restPalm camera, Pi 5MobileNetV2 onTensorFlow LiteGripPinch or tripodClose the fingersStop on encoder limitor stall

Questions about ReFlex

What is ReFlex?

ReFlex is a research prototype of a prosthetic hand, designed and built by WhiteHat Design Studio. It starts moving on the wearer's muscle signal and uses a camera in the palm to choose the grip.

How does ReFlex choose a grip?

The camera in the palm looks at the object, and a custom-trained MobileNetV2 model, running through TensorFlow Lite on a Raspberry Pi 5, chooses a grip such as pinch or tripod.

Is ReFlex a medical device?

No. ReFlex is a laboratory research prototype. It is not a medical device.

Recognition

  • Two conference papers at ICRAI 2024, on soft robotic fabrication with embedded vision and on a lightweight network for grasp classification.
  • An appreciation award at COMPECC for the intelligent prosthetic hand.

What we do not claim

  • ReFlex is a laboratory research prototype. It is not a medical device.
  • Grip accuracy is not quoted here.

Sources

Published , updated .

Read further

Tell us what has to work.

One sentence is enough. An engineer will reply.

    Arrow keys move, Enter opens, Escape closes.