https://github.com/shaoanlu/gazeml-keras

A keras port of swook/GazeML for pupil, iris and eye-lid detection
https://github.com/shaoanlu/gazeml-keras

eye-tracking gaze-estimation pupil-detection pupil-tracking

Last synced: 5 months ago
JSON representation

A keras port of swook/GazeML for pupil, iris and eye-lid detection

• Host: GitHub
• URL: https://github.com/shaoanlu/gazeml-keras
• Owner: shaoanlu
• Created: 2019-04-02T08:45:47.000Z (over 6 years ago)
• Default Branch: master
• Last Pushed: 2021-01-07T16:00:19.000Z (almost 5 years ago)
• Last Synced: 2025-04-01T08:21:16.995Z (7 months ago)
• Topics: eye-tracking, gaze-estimation, pupil-detection, pupil-tracking
• Language: Jupyter Notebook
• Size: 12 MB
• Stars: 54
• Watchers: 3
• Forks: 25
• Open Issues: 9
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# GazeML-keras

A keras port of [swook/GazeML](https://github.com/swook/GazeML) for eye region landmarks detection. 

The dlib face detector is replaced by MTCNN.

## Demo

[Here](https://github.com/shaoanlu/GazeML-keras/blob/master/demo_colab.ipynb) is the demo jupyter notebook, or [try it](https://colab.research.google.com/github/shaoanlu/GazeML-keras/blob/master/demo_colab.ipynb) on Colaboratory.

## Results

![](https://github.com/shaoanlu/GazeML-keras/raw/master/results/result_lenna.png)

![](https://github.com/shaoanlu/GazeML-keras/raw/master/results/result_fashion-1063100_640.png)

![](https://github.com/shaoanlu/GazeML-keras/raw/master/results/result_model-1439909_640.png)

![](https://github.com/shaoanlu/GazeML-keras/raw/master/results/result_reiwa.png)

## WIP

1. The preprocessing is very different (including not flipping left eye) from the [official implementation](https://github.com/swook/GazeML/blob/master/src/datasources/frames.py#L223), thus the results produced are suboptimal.

2. Model training as well as gaze estimation has not been ported yet.

## Dependency

- python 3.6

- keras 2.2.4

- tensorflow 1.12.0

## Acknoledgement

ELG model weights are converted from the official repo [swook/GazeML](https://github.com/swook/GazeML). We learnt a lot from there.