Module Pixy 2 Head Tracking

Hello everyone
Let me introduce myself, my name is Stéphane, I am quadriplegic, that is to say that I am paralyzed in all four limbs. My disability therefore prevents me from being able to use a computer like everyone else. Currently to be autonomous in computing, I use what is called a Tracker Pro.
To schematize the operation, it is a reflective pad which is placed on my forehead, on my computer the tracker is positioned like a webcam, but which captures infrared. When I move my head the pad is in contact with the tracker and therefore moves the mouse cursor.

This system works very well the problem is that it is no longer developed! So I’m afraid that mine will break down and I’ll end up with nothing. So I try to anticipate things and be able to try to create my own tracker!

So my question is: is it possible to build this system with arduino or Raspberry Pi or other ?
I remain at your disposal for further information.
Thanks in advance

@foufouner Have you tried eye tracking software? Quick online searches:

Some other alternatives which require hardware:

1 Like

Good morning
First of all, thank you for answering my question. Indeed I know eye tracking software. The problem is that colme tells you it’s software and software sometimes it crashes. I am looking for something that works but without an application or softwar

1 Like

An Arduino Leonardo has examples which allow it to “emulate” a keyboard and/or mouse, whereas other microcontrollers require quite a bit more programming. Look up “Arduino Leonardo as Keyboard” and “Arduino Leonardo as Mouse” videos (ex. YouTube) and you’ll see plenty of tutorials.

For basic head tracking, you’d need an IMU ideally with a magnetic compass (absolute orientation which is not affected by sensor drift). You could add your choice of buttons, switches, knobs etc. for other functions like mouse left / right click, scroll etc.

Given that working on electronics likely is not the easiest for you, you might consider contacting a local engineering department at a university and seeing if they have final year students in a CAPSTONE class who are interested in taking on the challenge (might cost $2k or more though).

1 Like

I actually found several Arduino projects that talk about how a mouse works. The problem is that no one talks about creating a mouse with head movement. Regarding my project, and I found an article here.

what do you mean by that IMU ?

IMU = Internal Measurement Unit, which can measure linear and angular acceleration (accelerometer and gyro).

For compass direction:

1 Like