(Translated by https://www.hiragana.jp/)
Conceptual Priming for In-game BCI Training | ACM Transactions on Computer-Human Interaction

research-article

Conceptual Priming for In-game BCI Training

Authors:

Nataliya Kosmyna,

Franck Tarpin-Bernard, and

Bertrand RivetAuthors Info & Claims

ACM Transactions on Computer-Human Interaction (TOCHI), Volume 22, Issue 5

Article No.: 26, Pages 1 - 25

https://doi.org/10.1145/2808228

Published: 08 October 2015 Publication History

Abstract

Using Brain Computer Interfaces (BCIs) as a control modality for games is popular. However BCIs require prior training before playing, which is hurtful to immersion and player experience in the game. For this reason, we propose an explicit integration of the training protocol in game by a modification of the game environment to enforce the synchronicity with the BCI system and to provide appropriate instructions to user. We then dissimulate the synchronicity in the game mechanics by using priming to mask the training instruction (implicit stimuli). We conduct an evaluation of the effects on game experience compared to standard BCI training on 36 subjects. We use the game experience questionnaire (GEQ) coupled with reliability analysis (Cronbach's alpha). The integration does not change the feeling of competence (3/4). However, flow and immersion increase sizably with explicit training integration (2.78 and 2.67/4 from 1.79/4 and 1.52/4) and even more with the implicit training integration (3.27/4 and 3.12/4).

Supplementary Material

MP4 File (a26-kosmyna.mp4)

Download
259.99 MB

References

[1]

Alvaro Barbero and Moritz Grosse-Wentrup. 2010. Biased feedback in brain-computer interfaces. J. Neuroeng. Rehabil. 7, 1 (January 2010), 34 pages.

[2]

Leonard Berkowitz and Anthony Lepage. 1967. Weapons as aggression-eliciting Stimuli. J. Pers. Soc. Psychol. 7, 2 (1967), 202--207.

[3]

Irving Biederman and Eric E. Cooper. 1992. Size invariance in visual object priming. J. Exp. Psychol. Hum. Percept. Perform. 8, 1 (1992), 121--133.

[4]

Benjamin Blankertz, Florian Losch, Matthias Krauledat, Guido Dornhege, Gabriel Curio, and Klaus Robert Müller. 2008. The Berlin brain - computer interface: Accurate performance from first-session in BCI-naïve subjects. IEEE Trans. Biomed. Eng. 55, 10 (Oct. 2008), 2452--2462.

[5]

Danny Plass-oude Bos, Michel Obbink, Anton Nijholt, Gido Hakvoort, and M. Christian. 2010. Towards multiplayer BCI games. In BioS-Play: Workshop on Multiuser and Social Biosignal Adaptive Games and Playful Applications. 1--4. http://www.physiologicalcomputing.net/?page_id=1767.

[6]

Pierre Chalfoun and Claude Frasson. 2012. Cognitive priming: Assessing the use of non-conscious perception to enhance learner's reasoning ability. In Intelligent Tutoring Systems, Stefano A. Cerri, William J. Clancey, Giorgos Papadourakis, and Kitty Panourgia (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 84--89. http://doi.org/10.1007/978-3-642-30950-2_12.

Digital Library

[7]

Marco Congedo et al. 2011. “Brain Invaders”: A prototype of an open-source P300-based video game working with the OpenViBE platform. In 5th International BCI Conference. Graz, Austria, 280--283.

[8]

Marco Congedo, Alexandre Barachant, and Anton Andreev. 2013. A new generation of brain-computer interface based on riemannian geometry. CoRR abs/1310.8. Retrieved from http://arxiv.org/abs/1310.8115.

[9]

Tamara Denning, Kevin Bowers, Marten van Dijk, and Ari Juels. 2011. Exploring implicit memory for painless password recovery. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, New York, NY, USA, 2615--2618.

Digital Library

[10]

Jerry Alan Fails and Dan R. Olsen Jr. 2003. Interactive machine learning. In Proceedings of the 8th International Conference on Intelligent User Interfaces (IUI’03). ACM, New York, NY, USA, 39--45.

[11]

Rebecca Fiebrink, Perry R. Cook, and Dan Trueman. 2011. Human model evaluation in interactive supervised learning. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, New York, NY, USA, 147--156.

Digital Library

[12]

David R. Flatla, Carl Gutwin, Lennart E. Nacke, Scott Bateman, and Regan L. Mandryk. 2011. Calibration games: Making calibration tasks enjoyable by adding motivating game elements. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST'11). ACM, New York, NY, USA, 403--412.

Digital Library

[13]

Marcel van Gerven, Jason Farquhar, and Peter Desain. 2013. Detecting semantic priming at the single-trial level. PLoS One 8, 4 (2013), 1--7.

[14]

Daniel Graybill, Janis R. Kirsch, and Edward D. Esselman. 1985. Effects of playing violent versus nonviolent video games on the aggressive ideation of aggressive and non aggressive children. Child Study J. 15, 3 (1985), 199--205.

[15]

C. Shawn Green and Daphne Bavelier. 2003. Action video game modifies visual selective attention. Nature 423, 6939, 534--537. Retrieved from http://www.nature.com/nature/journal/v423/n6939/suppinfo/nature01647_S1.html.

[16]

C. Shawn Green and Daphne Bavelier. 2007. Action-video-game experience alters the spatial resolution of vision. Psychol. Sci. 18 (2007), 88--94.

[17]

C. Shawn Green and Daphne Bavelier. 2006a. Effect of action video games on the spatial distribution of visiospatial attention. J. Exp. Psychol. Hum. Percept. Perform. 32 (2006), 1465--1478.

[18]

C. Shawn Green and Daphne Bavelier. 2006b. Enumeration versus multiple object tracking: The case of action. Cognition 101 (2006), 217--245.

[19]

Anthony G. Greenwald, Sean C. Draine, and Richard L. Abrams. 1996. Three cognitive markers of unconscious semantic activation. Science 273, 5282, 1699--1702.

[20]

Lane Harrison, Drew Skau, Steven Franconeri, Aidong Lu, and Remco Chang. 2013. Influencing visual judgment through affective priming. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'13). ACM, New York, NY, USA, 2949--2958.

Digital Library

[21]

Wouter Van Den Hoogen and Yvonne De Kort. 2008. Exploring behavioral expressions of player experience in digital games. In Proceedings of the Workshop for Facial and Bodily Expressions for Control and Adaptation of Games. CTIT, Enschede, The Netherlands, 11--19.

[22]

Aapo Hyvärinen and Erkki Oja. 1997. A fast fixed-point algorithm for independent component analysis. Neural Comput. 9 (1997), 1483--1492.

Digital Library

[23]

W. IJsselsteijn, W. van der Hoogen, C. Klimmt, Y. de Kort, C. Lindley, K. Mathiak, K. Poels, N. Ravaja, M. Turpeinen, and P. Vorderer. 2008. Measuring the experience of digital game enjoyment. In Proceedings of Measuring Behavior, A. J. Spink, M. R. Ballintijn, N. D. Bogers, F. Grieco, L.W.S. Loijens, L. P. J. J. Noldus, G. Smit, and P. H. Zimmerman (Eds.). Maastricht, The Netherland, 26--29.

[24]

Inaki Iturrate, Luis Montesano, and Javier Minguez. 2010. Single trial recognition of error-related potentials during observation of robot operation. In Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC'10). 4181--4184.

[25]

Ashish Kapoor, Bongshin Lee, Desney Tan, and Eric Horvitz. 2010. Interactive optimization for steering machine classification. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI’10. ACM Press, New York, New York, USA, 1343--1352.

Digital Library

[26]

Simon P. Kelly, Edmund C. Lalor, Richard B. Reilly, Senior Member, and John J. Foxe. 2005. Visual spatial attention tracking using high-density SSVEP data for independent brain -- computer communication. IEEE Trans. neural Syst. Rehabil. Eng. 13, 2 (2005), 172--178.

[27]

Nataliya Kos’myna, Franck Tarpin-Bernard, and Bertrand Rivet. 2013. Towards a general architecture for a co-learning of brain computer interfaces. In 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE, 1054--1057.

[28]

Nataliya Kosmyna and Franck Tarpin-Bernard. 2013. Evaluation and comparison of a multimodal combination of BCI paradigms and eye tracking with affordable consumer-grade hardware in a gaming context. IEEE Trans. Comput. Intell. AI Games 5, 2 (2013), 150--154.

[29]

Nataliya Kosmyna, Franck Tarpin-Bernard, and Bertrand Rivet. 2015a. Adding human learning in brain computer interfaces (BCIs): Towards a practical control modality. ACM Trans. Comput.-Hum. Interact. 22, 3, Article 12 (May 2015), 37 pages.

Digital Library

[30]

Nataliya Kosmyna, Franck Tarpin-Bernard, and Bertrand Rivet. 2015b. Towards brain computer interfaces for recreational activities: Piloting a drone. In Proceedings of INTERACT 2015. Bamberg, Germany.

Digital Library

[31]

Marta Kutas and Kara D. Federneier. 2000. Electrophysiology reveals semantic memory use in language comprehension. Trends Cogn. Sci. 4, 12 (2000), 463--470.

[32]

Marta Kutas and S. A. Hillard. 1980. Reading senseless sentences: Brain potentials reflect semantic incongruity. Science. 207, 4427, 203--205.

[33]

Karl LaFleur, Kaitlin Cassady, Alexander Doud, Kaleb Shades, Eitan Rogin, and Bin He. 2013. Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain-computer interface. J. Neural Eng. 10, 4 (2013), 046003.

[34]

Anatole Lécuyer, Fabien Lotte, RB Reilly, and R. Leeb. 2008. Brain-computer interfaces, virtual reality, and videogames. Computer (Long. Beach. Calif). 42, 10 (2008), 66--72.

Digital Library

[35]

Sheena Lewis, Mira Dontcheva, and Elizabeth Gerber. 2011. Affective computational priming and creativity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’11). ACM, New York, NY, USA, 735--744.

Digital Library

[36]

Renjie Li, Uri Polat, Walter Makous, and Daphne Bavelier. 2009. Enhancing the contrast sensitivity function through action video game training. Nat. Neurosci. 12 (2009), 549--551.

[37]

F. Lotte, M. Congedo, A. Lécuyer, F. Lamarche, and B. Arnaldi. 2007. A review of classification algorithms for EEG-based brain-computer interfaces. J. Neural Eng. 4, 2 (June 2007), R1--R13.

[38]

Fabien Lotte, Florian Larrue, and Christian Mühl. 2013. Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: Lessons learned from instructional design. Front. Hum. Neurosci. 7, September (Jan. 2013), 568.

[39]

José Del R. Millán and Josep Mouriño. 2003. Asynchronous BCI and local neural classifiers: An overview of the Adaptive Brain Interface project. IEEE Trans. Neural Syst. Rehabil. Eng. 11, 2 (June 2003), 159--61.

[40]

Gernot R. Müller-Putz and Reinhold Scherer. 2008. Better than random? A closer look on BCI results. Int. J. Bioelectromagn. 10, 1 (2008), 52--55.

[41]

Lennart E. Nacke. 2009. Affective Ludology: Scientific Measurement of User Experience in Interactive Entertainment. PhD Thesis. Blekinge Institute of Technology. Karlskrona, Sweden.

[42]

Lennart E. Nacke and C. A. Lindley. 2008. Flow and immersion in first-person shooters: Measuring the player's gameplay experience. In Proceedings of the 2008 Conference on Future Play: Research, Play, Share (Future Play '08). ACM, New York, NY, USA, 81--88.

Digital Library

[43]

Lennart Erik Nacke, Michael Kalyn, Calvin Lough, and Regan Lee Mandryk. 2011. Biofeedback game design: Using direct and indirect physiological control to enhance game interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'11). ACM, New York, NY, USA, 103--112.

Digital Library

[44]

Carsten Pohl, Wilfried Kunde, Thomas Ganz, Annette Conzelmann, Paul Pauli, and Andrea Kiesel. 2014. Gaming to see: Action video gaming is associated with enhanced processing of masked stimuli. Front. Psychol. 5, 70 (2014), 1--9.

[45]

Martin Rohm, Alex Kreilinger, Rüdiger Rupp, and Otto Bock Gmbh. 2010. A hybrid-brain computer interface for control of a reaching and grasping neuroprosthesis. Biomed. Eng. (NY). 55, 1 (2010), 3--6.

[46]

Peter A. M. Ruijten, Cees J. H. Midden, and Jaap Ham. 2011. Unconscious persuasion needs goal-striving: The effect of goal activation on the persuasive power of subliminal feedback. In Proceedings of the 6th International Conference on Persuasive Technology: Persuasive Technology and Design: Enhancing Sustainability and Health (PERSUASIVE '11), Curtis P. Haugtvedt and Agnis Stibe (Eds.). ACM, New York, NY, USA, Article 4, 6 pages.

Digital Library

[47]

N. S. Erlbaum. Schutte, J. M. Malouff, J. C. Post-Gorden, and A. L. Rodasta. 1988. Effects of playing videogames on cheilden's aggressive and other behaviours. J. Appl. Soc. Psychol. 18, 5 (1988), 454--460.

[48]

Roger W. Schvaneveld and David E. Meyer. 1973. Retreival and Comparison processes in semantic memory. In S. Kornblum (Ed.). Attention and Performance IV. New York, NY, USA: Academic Press, Inc., 395--409.

[49]

Irina Simanova, Marcel van Gerven, Robert Oostenveld, and Peter Hagoort. 2010. Identifying object categories from event-related EEG: Toward decoding of conceptual representations. PLoS One 5, 12 (Jan. 2010), e14465.

[50]

Tilo Strohbach, Peter A. Frensch, and Torsten Schubert. 2012. Video game practice optimizes executive control skills in dual-task and task-switching situations. Acta Psychol. 140 (2012), 13--24.

[51]

Yunsick Sung, Kyungeun Cho, and Kyhyun Um. 2012. A development architecture for serious games using BCI (brain computer interface) sensors. Sensors (Basel). 12, 11 (January 2012), 15671--88.

[52]

Justin Talbot, Bongshin Lee, Ashish Kapoor, and Desney S. Tan. 2009. EnsembleMatrix: Interactive visualization to support machine learning with multiple classifiers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'09). ACM, New York, NY, USA, 1283--1292.

Digital Library

[53]

Desney S. Tan and Anton Nijholt (Eds.). 2010. Brain-Computer Interfaces - Applying our Minds to Human-Computer Interaction. Human--Computer Interaction Series. Springer-Verlag London.

[54]

Eoin Thomas, Matthew Dyson, and Maureen Clerc. 2013. An analysis of performance evaluation for motor-imagery based BCI. J. Neural Eng. 10, 3 (Jun. 2013), 031001.

[55]

Chi Thanh Vi, Izdihar Jamil, David Coyle, and Sriram Subramanian. 2014. Error related negativity in observing interactive tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’14). ACM, New York, NY, USA, 3787--3796.

Digital Library

[56]

Carmen Vidaurre, Claudia Sannelli, Klaus-Robert Müller, and Benjamin Blankertz. 2010. Machine-Learning Based Co-adaptive Calibration: A Perspective to Fight BCI Illiteracy. In Manuel Graña Romay, Emilio Corchado, and M. Teres. Garcia Sebastian (Eds.). Hybrid Artificial Intelligence Systems SE - 50. Lecture Notes in Computer Science. Springer Berlin Heidelberg, 413--420.

Digital Library

[57]

Marijn van Vliet, Christian Mühl, Boris Reuderink, and Mannes Poel. 2010. Guessing What's on Your Mind: Using the N400 in Brain Computer Interfaces. In Yiyu Yao, Ron Sun, Tomaso Poggio, Jiming Liu, Ning Zhong, and Jimmy Huang (Eds.). Brain Informatics SE - 17. Lecture Notes in Computer Science. Springer Berlin Heidelberg, 180--191.

Digital Library

[58]

Jonathan R. Wolpaw, Niels Birbaumer, Dennis J. McFarland, Gert Pfurtscheller, and Theresa M. Vaughan. 2002. Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113, 6 (June 2002), 767--91.

Cited By

Wei JXia DXie HChang CLi CYang X(2024)SpaceEditing: A Latent Space Editing Interface for Integrating Human Knowledge into Deep Neural NetworksProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645211(489-503)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645211
Kosch TWelsch RChuang LSchmidt A(2023)The Placebo Effect of Artificial Intelligence in Human–Computer InteractionACM Transactions on Computer-Human Interaction10.1145/352922529:6(1-32)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3529225
Sun ZJiang YLi YSong JZhang M(2023)Short-Interval Priming Effects: An EEG Study of Action Observation on Motor ImageryIEEE Transactions on Cognitive and Developmental Systems10.1109/TCDS.2022.318777715:4(1765-1772)Online publication date: Dec-2023
https://doi.org/10.1109/TCDS.2022.3187777
Show More Cited By

Index Terms

Conceptual Priming for In-game BCI Training
1. Computing methodologies
  1. Machine learning
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Enhancing In-game Immersion Using BCI-controlled Mechanics
VRST '21: Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology

Due to multimodal approach, the virtual reality experiences become increasingly more immersive and entertaining. New control modalities, such as brain-computer interfaces (BCIs), enable the players to engage in the game with both their bodies and ...
Read More
Conceptual priming and familiarity: Different expressions of memory during recognition testing with distinct neurophysiological correlates

Familiarity and recollection are qualitatively different explicit-memory phenomena evident during recognition testing. Investigations of the neurocognitive substrates of familiarity and recollection, however, have typically disregarded implicit-memory ...
Read More
Speech Imagery BCI Training Using Game with a Purpose
AVI '24: Proceedings of the 2024 International Conference on Advanced Visual Interfaces

Games are used in multiple fields of brain–computer interface (BCI) research and applications to improve participants’ engagement and enjoyment during electroencephalogram (EEG) data collection. However, despite potential benefits, no current studies ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 22, Issue 5

October 2015

217 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/2814459

Editor:
Shumin Zhai
Google, Inc.

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2015

Accepted: 01 July 2015

Revised: 01 July 2015

Received: 01 February 2015

Published in TOCHI Volume 22, Issue 5

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tag

Interactive machine learning

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
625
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)2

Other Metrics

View Author Metrics

Citations

Cited By

Wei JXia DXie HChang CLi CYang X(2024)SpaceEditing: A Latent Space Editing Interface for Integrating Human Knowledge into Deep Neural NetworksProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645211(489-503)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645211
Kosch TWelsch RChuang LSchmidt A(2023)The Placebo Effect of Artificial Intelligence in Human–Computer InteractionACM Transactions on Computer-Human Interaction10.1145/352922529:6(1-32)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3529225
Sun ZJiang YLi YSong JZhang M(2023)Short-Interval Priming Effects: An EEG Study of Action Observation on Motor ImageryIEEE Transactions on Cognitive and Developmental Systems10.1109/TCDS.2022.318777715:4(1765-1772)Online publication date: Dec-2023
https://doi.org/10.1109/TCDS.2022.3187777
Putze FPutze SSagehorn MMicek CSolovey E(2022)Understanding HCI Practices and Challenges of Experiment Reporting with Brain Signals: Towards Reproducibility and ReuseACM Transactions on Computer-Human Interaction10.1145/349055429:4(1-43)Online publication date: 31-Mar-2022
https://dl.acm.org/doi/10.1145/3490554
Liu RLyu MYang J(2022)A hybrid BCI system combining motor imagery and conceptual imagery in a smart home environment2022 IEEE International Conference on Trust, Security and Privacy in Computing and Communications (TrustCom)10.1109/TrustCom56396.2022.00146(1066-1071)Online publication date: Dec-2022
https://doi.org/10.1109/TrustCom56396.2022.00146
Kosmyna NSoetaert NScheirer C(2021)A Pilot Study of Using Brain-Computer Interfaces in Classrooms for Promoting Formal Educational ActivitiesProceedings of the Future Technologies Conference (FTC) 2021, Volume 310.1007/978-3-030-89912-7_46(590-609)Online publication date: 25-Oct-2021
https://doi.org/10.1007/978-3-030-89912-7_46
Zhang R(2020)Virtual Reality Games based on Brain Computer Interface2020 International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI)10.1109/ICHCI51889.2020.00056(227-230)Online publication date: Dec-2020
https://doi.org/10.1109/ICHCI51889.2020.00056
Feng FLi PStockman T(2020)Exploring crossmodal perceptual enhancement and integration in a sequence-reproducing task with cognitive primingJournal on Multimodal User Interfaces10.1007/s12193-020-00326-y15:1(45-59)Online publication date: 13-Jul-2020
https://doi.org/10.1007/s12193-020-00326-y
Kosmyna N(2019)Towards An Implicit, In-Situ Training Protocol for EEG-based Brain-Computer Interfaces: a Feasibility Study2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)10.1109/SMC.2019.8914214(241-248)Online publication date: Oct-2019
https://doi.org/10.1109/SMC.2019.8914214
Mzurikwao DWilliams Samuel OGrace Asogbon MLi XLi GYeo WEfstratiou CSiang Ang C(2019)A Channel Selection Approach Based on Convolutional Neural Network for Multi-channel EEG Motor Imagery Decoding2019 IEEE Second International Conference on Artificial Intelligence and Knowledge Engineering (AIKE)10.1109/AIKE.2019.00042(195-202)Online publication date: Jun-2019
https://doi.org/10.1109/AIKE.2019.00042
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents