-
One step closer to EEG based eye tracking
Authors:
Wolfgang Fuhl,
Susanne Zabel,
Theresa Harbig,
Julia Astrid Moldt,
Teresa Festl Wiete,
Anne Herrmann Werner,
Kay Nieselt
Abstract:
In this paper, we present two approaches and algorithms that adapt areas of interest We present a new deep neural network (DNN) that can be used to directly determine gaze position using EEG data. EEG-based eye tracking is a new and difficult research topic in the field of eye tracking, but it provides an alternative to image-based eye tracking with an input data set comparable to conventional ima…
▽ More
In this paper, we present two approaches and algorithms that adapt areas of interest We present a new deep neural network (DNN) that can be used to directly determine gaze position using EEG data. EEG-based eye tracking is a new and difficult research topic in the field of eye tracking, but it provides an alternative to image-based eye tracking with an input data set comparable to conventional image processing. The presented DNN exploits spatial dependencies of the EEG signal and uses convolutions similar to spatial filtering, which is used for preprocessing EEG signals. By this, we improve the direct gaze determination from the EEG signal compared to the state of the art by 3.5 cm MAE (Mean absolute error), but unfortunately still do not achieve a directly applicable system, since the inaccuracy is still significantly higher compared to image-based eye trackers.
Link: https://es-cloud.cs.uni-tuebingen.de/d/8e2ab8c3fdd444e1a135/?p=%2FEEGGaze&mode=list
△ Less
Submitted 3 March, 2023;
originally announced March 2023.
-
Deep Learning-Based Position Detection for Hydraulic Cylinders Using Scattering Parameters
Authors:
Chen Xin,
Thomas Motz,
Wolfgang Fuhl,
Andreas Hartel,
Enkelejda Kasneci
Abstract:
Position detection of hydraulic cylinder pistons is crucial for numerous industrial automation applications. A typical traditional method is to excite electromagnetic waves in the cylinder structure and analytically solve the piston position based on the scattering parameters measured by a sensor. The core of this approach is a physical model that outlines the relationship between the measured sca…
▽ More
Position detection of hydraulic cylinder pistons is crucial for numerous industrial automation applications. A typical traditional method is to excite electromagnetic waves in the cylinder structure and analytically solve the piston position based on the scattering parameters measured by a sensor. The core of this approach is a physical model that outlines the relationship between the measured scattering parameters and the targeted piston position. However, this physical model has shortcomings in accuracy and adaptability, especially in extreme conditions. To address these limitations, we propose machine learning and deep learning-based methods to learn the relationship directly in a data-driven manner. As a result, all deep learning models in this paper consistently outperform the physical one by a large margin. We further deliberate on the choice of models based on domain knowledge and provide in-depth analyses combining model performance with real-world physical characteristics. Specifically, we use Convolutional Neural Network (CNN) to discover local interactions of input among adjacent frequencies, apply Complex-Valued Neural Network (CVNN) to exploit the complex-valued nature of electromagnetic scattering parameters, and introduce a novel technique named Frequency Encoding to add weighted frequency information to the model input. The combination of these techniques results in our best-performing model, a complex-valued CNN with Frequency Encoding, which exhibits substantial improvement in accuracy with an error reduction of 1/12 compared to the traditional physical model.
△ Less
Submitted 14 February, 2023; v1 submitted 1 September, 2022;
originally announced September 2022.
-
TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Types
Authors:
Wolfgang Fuhl,
Gjergji Kasneci,
Enkelejda Kasneci
Abstract:
We present TEyeD, the world's largest unified public data set of eye images taken with head-mounted devices. TEyeD was acquired with seven different head-mounted eye trackers. Among them, two eye trackers were integrated into virtual reality (VR) or augmented reality (AR) devices. The images in TEyeD were obtained from various tasks, including car rides, simulator rides, outdoor sports activities,…
▽ More
We present TEyeD, the world's largest unified public data set of eye images taken with head-mounted devices. TEyeD was acquired with seven different head-mounted eye trackers. Among them, two eye trackers were integrated into virtual reality (VR) or augmented reality (AR) devices. The images in TEyeD were obtained from various tasks, including car rides, simulator rides, outdoor sports activities, and daily indoor activities. The data set includes 2D and 3D landmarks, semantic segmentation, 3D eyeball annotation and the gaze vector and eye movement types for all images. Landmarks and semantic segmentation are provided for the pupil, iris and eyelids. Video lengths vary from a few minutes to several hours. With more than 20 million carefully annotated images, TEyeD provides a unique, coherent resource and a valuable foundation for advancing research in the field of computer vision, eye tracking and gaze estimation in modern VR and AR applications.
Download: Just connect via FTP as user TEyeDUser and without password to nephrit.cs.uni-tuebingen.de (ftp://nephrit.cs.uni-tuebingen.de).
△ Less
Submitted 6 June, 2023; v1 submitted 3 February, 2021;
originally announced February 2021.
-
1000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learning
Authors:
Wolfgang Fuhl
Abstract:
In this paper we present a new approach for pupil segmentation. It can be computed and trained very efficiently, making it ideal for online use for high speed eye trackers as well as for energy saving pupil detection in mobile eye tracking. The approach is inspired by the BORE and CBF algorithms and generalizes the binary comparison by Haar features. Since these features are intrinsically very sus…
▽ More
In this paper we present a new approach for pupil segmentation. It can be computed and trained very efficiently, making it ideal for online use for high speed eye trackers as well as for energy saving pupil detection in mobile eye tracking. The approach is inspired by the BORE and CBF algorithms and generalizes the binary comparison by Haar features. Since these features are intrinsically very susceptible to noise and fluctuating light conditions, we combine them with conditional pupil shape probabilities. In addition, we also rank each feature according to its importance in determining the pupil shape. Another advantage of our method is the use of statistical learning, which is very efficient and can even be used online. https://atreus.informatik.uni-tuebingen.de/seafile/d/8e2ab8c3fdd444e1a135/?p=%2FStatsPupil&mode=list
△ Less
Submitted 3 February, 2021;
originally announced February 2021.
-
Weight and Gradient Centralization in Deep Neural Networks
Authors:
Wolfgang Fuhl,
Enkelejda Kasneci
Abstract:
Batch normalization is currently the most widely used variant of internal normalization for deep neural networks. Additional work has shown that the normalization of weights and additional conditioning as well as the normalization of gradients further improve the generalization. In this work, we combine several of these methods and thereby increase the generalization of the networks. The advantage…
▽ More
Batch normalization is currently the most widely used variant of internal normalization for deep neural networks. Additional work has shown that the normalization of weights and additional conditioning as well as the normalization of gradients further improve the generalization. In this work, we combine several of these methods and thereby increase the generalization of the networks. The advantage of the newer methods compared to the batch normalization is not only increased generalization, but also that these methods only have to be applied during training and, therefore, do not influence the running time during use. Link to CUDA code https://atreus.informatik.uni-tuebingen.de/seafile/d/8e2ab8c3fdd444e1a135/
△ Less
Submitted 17 January, 2021; v1 submitted 2 October, 2020;
originally announced October 2020.
-
Differential Privacy for Eye Tracking with Temporal Correlations
Authors:
Efe Bozkir,
Onur Günlü,
Wolfgang Fuhl,
Rafael F. Schaefer,
Enkelejda Kasneci
Abstract:
New generation head-mounted displays, such as VR and AR glasses, are coming into the market with already integrated eye tracking and are expected to enable novel ways of human-computer interaction in numerous applications. However, since eye movement properties contain biometric information, privacy concerns have to be handled properly. Privacy-preservation techniques such as differential privacy…
▽ More
New generation head-mounted displays, such as VR and AR glasses, are coming into the market with already integrated eye tracking and are expected to enable novel ways of human-computer interaction in numerous applications. However, since eye movement properties contain biometric information, privacy concerns have to be handled properly. Privacy-preservation techniques such as differential privacy mechanisms have recently been applied to eye movement data obtained from such displays. Standard differential privacy mechanisms; however, are vulnerable due to temporal correlations between the eye movement observations. In this work, we propose a novel transform-coding based differential privacy mechanism to further adapt it to the statistics of eye movement feature data and compare various low-complexity methods. We extend the Fourier perturbation algorithm, which is a differential privacy mechanism, and correct a scaling mistake in its proof. Furthermore, we illustrate significant reductions in sample correlations in addition to query sensitivities, which provide the best utility-privacy trade-off in the eye tracking literature. Our results provide significantly high privacy without any essential loss in classification accuracies while hiding personal identifiers.
△ Less
Submitted 20 December, 2021; v1 submitted 20 February, 2020;
originally announced February 2020.
