Guest
home
beatmaps
rankings
community
store
help
forum
  1. Forums
  2. osu!
  3. Development

Osu! control using Tobii EyeX and EyeXMouse

posted
Total Posts
8
remoford
5 posts
Joined May 2011
Topic Starter
remoford
The Tobii EyeX is an eye tracker. There are a number of sdk to develop against.

One of the simplest things you can do is use the raw gaze data to emulate a mouse. This is devkit hardware and beta software(not mine) but the results are promising.



http://www.tobii.com/en/eye-experience/eyex/

https://github.com/mikethrussell/EyeXMouse

There is a long ways to go with tuning and calibration but think about trying to play osu the first day you met a mouse...

What do ya'll think?
ninjastarr
41 posts
Joined February 2011
ninjastarr
While it is neat, it's awfully impractical for the use of Osu, I'd think.
(But it'd be fun to try out.)
- Marco -
7,042 posts
Joined December 2011
- Marco -
I would fail everytime because i watch the next note :c
Avail_old_1
Avail_old_1
This wouldn't really work for me as I always concentrate on the next note instead of the one I'm about to hit.
VoidnOwO
1,256 posts
Joined August 2012
VoidnOwO
:)
Last edited by VoidnOwO , edited 1 time in total.
Arcanine
181 posts
Joined May 2013
Arcanine
Didn't cookiezi master this already?
remoford
5 posts
Joined May 2011
Topic Starter
remoford
Thank you for your comments.

The more time I spend playing with this the more I've come to appreciate the limitations.

In the first video I had a calibration problem that put the mouse offset above my gaze point. I was having to look at the bottom edge of each circle to get hits in the middle. I'm slowly improving calibration and am confident that it can eventually be resolved so as to require no conscious offset.

A bigger problem is the latency. The raw gaze samples are pretty noisy and the EyeXMouse software does a lot of averaging to produce the stable cursor you see. Because of the way this averaging is done the cursor will always lag behind your latest gaze points. However, this should be tunable, a tradeoff between positional noise and lag. What its using now is clearly not optimal for a fast paced game like osu! (works pretty good for things like hearthstone though)

I recorded a session last night not using the EyeXMouse but with the gaze data overlaid onto the screen. The yellow and red dots are the raw gaze data. The larger spot is an average of those. Watching this you can gain an appreciation for the noise and what might be accomplished with some better averaging.

http://www.twitch.tv/remoford/c/4738852

I don't think that this particular device will ever be competitive with a mouse for high level osu! play but we can do a *lot* better than my first demo video shows.
FrzR
2,237 posts
Joined October 2012
FrzR
Thinking about using this on a slider would be awful. ;w;
Please sign in to reply.

New reply

0
1 / 8