Brain-Inspired Cognitive Architectures

for Artificial Intelligence: BICA*AI 2020:

Proceedings of the 11th Annual Meeting
of the BICA Society Alexei V.
Samsonovich
Visit to download the full and correct content document:
https://textbookfull.com/product/brain-inspired-cognitive-architectures-for-artificial-intel
ligence-bicaai-2020-proceedings-of-the-11th-annual-meeting-of-the-bica-society-alex
ei-v-samsonovich/
More products digital (pdf, epub, mobi) instant
download maybe you interests ...

Biologically Inspired Cognitive Architectures 2019:

Proceedings of the Tenth Annual Meeting of the BICA
Society Alexei V. Samsonovich

https://textbookfull.com/product/biologically-inspired-cognitive-
architectures-2019-proceedings-of-the-tenth-annual-meeting-of-
the-bica-society-alexei-v-samsonovich/

TMS 2014 143rd Annual Meeting Exhibition Annual Meeting

Supplemental Proceedings 1st Edition Metals & Materials
Society (Tms) The Minerals

https://textbookfull.com/product/tms-2014-143rd-annual-meeting-
exhibition-annual-meeting-supplemental-proceedings-1st-edition-
metals-materials-society-tms-the-minerals/

Quantitative Psychology 83rd Annual Meeting of the

Psychometric Society New York NY 2018 Marie Wiberg

https://textbookfull.com/product/quantitative-psychology-83rd-
annual-meeting-of-the-psychometric-society-new-york-
ny-2018-marie-wiberg/

TMS 2019 148th Annual Meeting Exhibition Supplemental

Proceedings & The Minerals

https://textbookfull.com/product/tms-2019-148th-annual-meeting-
exhibition-supplemental-proceedings-the-minerals/
Proceedings of International Conference on Artificial
Intelligence and Applications ICAIA 2020 Poonam Bansal

https://textbookfull.com/product/proceedings-of-international-
conference-on-artificial-intelligence-and-applications-
icaia-2020-poonam-bansal/

Artificial Intelligence XXXVII 40th SGAI International

Conference on Artificial Intelligence AI 2020 Cambridge
UK December 15 17 2020 Proceedings 1st Edition Max
Bramer
https://textbookfull.com/product/artificial-intelligence-
xxxvii-40th-sgai-international-conference-on-artificial-
intelligence-ai-2020-cambridge-uk-
december-15-17-2020-proceedings-1st-edition-max-bramer/

Advances in Artificial Intelligence, Software and

Systems Engineering: Proceedings of the AHFE 2020
Virtual Conferences on Software and Systems
Engineering, and Artificial Intelligence and Social
Computing, July 16-20, 2020, USA Tareq Ahram
https://textbookfull.com/product/advances-in-artificial-
intelligence-software-and-systems-engineering-proceedings-of-the-
ahfe-2020-virtual-conferences-on-software-and-systems-
engineering-and-artificial-intelligence-and-social-comp/

Advances in Artificial Intelligence 18th Conference of

the Spanish Association for Artificial Intelligence
CAEPIA 2018 Granada Spain October 23 26 2018
Proceedings Francisco Herrera
https://textbookfull.com/product/advances-in-artificial-
intelligence-18th-conference-of-the-spanish-association-for-
artificial-intelligence-caepia-2018-granada-spain-
october-23-26-2018-proceedings-francisco-herrera/

Special Topics in Artificial Intelligence and Augmented

Reality: The Case of Spatial Intelligence Enhancement
(Cognitive Technologies) 1st Edition Christos
Papakostas
https://textbookfull.com/product/special-topics-in-artificial-
intelligence-and-augmented-reality-the-case-of-spatial-
intelligence-enhancement-cognitive-technologies-1st-edition-
Advances in Intelligent Systems and Computing 1310

Alexei V. Samsonovich
Ricardo R. Gudwin
Alexandre da Silva Simões Editors

Brain-Inspired
Cognitive
Architectures
for Artificial
Intelligence: BICA*AI
2020
Proceedings of the 11th Annual
Meeting of the BICA Society
Advances in Intelligent Systems and Computing

Volume 1310

Series Editor
Janusz Kacprzyk, Systems Research Institute, Polish Academy of Sciences,
Warsaw, Poland

Advisory Editors
Nikhil R. Pal, Indian Statistical Institute, Kolkata, India
Rafael Bello Perez, Faculty of Mathematics, Physics and Computing,
Universidad Central de Las Villas, Santa Clara, Cuba
Emilio S. Corchado, University of Salamanca, Salamanca, Spain
Hani Hagras, School of Computer Science and Electronic Engineering,
University of Essex, Colchester, UK
László T. Kóczy, Department of Automation, Széchenyi István University,
Gyor, Hungary
Vladik Kreinovich, Department of Computer Science, University of Texas
at El Paso, El Paso, TX, USA
Chin-Teng Lin, Department of Electrical Engineering, National Chiao
Tung University, Hsinchu, Taiwan
Jie Lu, Faculty of Engineering and Information Technology,
University of Technology Sydney, Sydney, NSW, Australia
Patricia Melin, Graduate Program of Computer Science, Tijuana Institute
of Technology, Tijuana, Mexico
Nadia Nedjah, Department of Electronics Engineering, University of Rio de Janeiro,
Rio de Janeiro, Brazil
Ngoc Thanh Nguyen , Faculty of Computer Science and Management,
Wrocław University of Technology, Wrocław, Poland
Jun Wang, Department of Mechanical and Automation Engineering,
The Chinese University of Hong Kong, Shatin, Hong Kong
The series “Advances in Intelligent Systems and Computing” contains publications
on theory, applications, and design methods of Intelligent Systems and Intelligent
Computing. Virtually all disciplines such as engineering, natural sciences, computer
and information science, ICT, economics, business, e-commerce, environment,
healthcare, life science are covered. The list of topics spans all the areas of modern
intelligent systems and computing such as: computational intelligence, soft comput-
ing including neural networks, fuzzy systems, evolutionary computing and the fusion
of these paradigms, social intelligence, ambient intelligence, computational neuro-
science, artificial life, virtual worlds and society, cognitive science and systems,
Perception and Vision, DNA and immune based systems, self-organizing and
adaptive systems, e-Learning and teaching, human-centered and human-centric
computing, recommender systems, intelligent control, robotics and mechatronics
including human-machine teaming, knowledge-based paradigms, learning para-
digms, machine ethics, intelligent data analysis, knowledge management, intelligent
agents, intelligent decision making and support, intelligent network security, trust
management, interactive entertainment, Web intelligence and multimedia.
The publications within “Advances in Intelligent Systems and Computing” are
primarily proceedings of important conferences, symposia and congresses. They
cover significant recent developments in the field, both of a foundational and
applicable character. An important characteristic feature of the series is the short
publication time and world-wide distribution. This permits a rapid and broad
dissemination of research results.
Indexed by SCOPUS, DBLP, EI Compendex, INSPEC, WTI Frankfurt eG,
zbMATH, Japanese Science and Technology Agency (JST), SCImago.
All books published in the series are submitted for consideration in Web of
Science.

More information about this series at http://www.springer.com/series/11156

Alexei V. Samsonovich Ricardo R. Gudwin
• •

Alexandre da Silva Simões

Editors

Brain-Inspired Cognitive
Architectures for Artificial
Intelligence: BICA*AI 2020
Proceedings of the 11th Annual Meeting
of the BICA Society

123
Editors
Alexei V. Samsonovich Ricardo R. Gudwin
Cybernetics Department University of Campinas
National Research Nuclear University Campinas, Brazil
Moscow, Russia

Alexandre da Silva Simões

Institute of Science and Technology
São Paulo State University (Unesp)
Sorocaba, Brazil

ISSN 2194-5357 ISSN 2194-5365 (electronic)

Advances in Intelligent Systems and Computing
ISBN 978-3-030-65595-2 ISBN 978-3-030-65596-9 (eBook)
https://doi.org/10.1007/978-3-030-65596-9
© The Editor(s) (if applicable) and The Author(s), under exclusive license
to Springer Nature Switzerland AG 2021
This work is subject to copyright. All rights are solely and exclusively licensed by the Publisher, whether
the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of
illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and
transmission or information storage and retrieval, electronic adaptation, computer software, or by similar
or dissimilar methodology now known or hereafter developed.
The use of general descriptive names, registered names, trademarks, service marks, etc. in this
publication does not imply, even in the absence of a specific statement, that such names are exempt from
the relevant protective laws and regulations and therefore free for general use.
The publisher, the authors and the editors are safe to assume that the advice and information in this
book are believed to be true and accurate at the date of publication. Neither the publisher nor the
authors or the editors give a warranty, expressed or implied, with respect to the material contained
herein or for any errors or omissions that may have been made. The publisher remains neutral with regard
to jurisdictional claims in published maps and institutional affiliations.

This Springer imprint is published by the registered company Springer Nature Switzerland AG
The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland
Preface

This volume documents the proceedings of the 2020 Annual International

Conference on Brain-Inspired Cognitive Architectures for Artificial Intelligence,
known as BICA*AI 2020, also known as the Eleventh Annual Meeting of the
BICA Society. BICA*AI 2020 was officially held in Natal, Rio Grande do Norte,
Brazil, as an event collocated with Robotica 2020. At the time of its organization, it
was impossible to guess that both, BICA*AI 2020 and Robotica 2020, will be
hosted online only, as entirely virtual events, due to the COVID-19 pandemic.
Nevertheless, this year BICA conference can be called a notable success—thanks to
the help of our technical team, primarily Arthur Chubarov, who under my super-
vision developed the Virtual Convention Center (VCC), the platform for hosting
virtual conferences, including this one (please see our paper in this volume). As a
result, VCC in conjunction with Zoom and Mozilla Hubs was used for hosting all
events of BICA*AI 2020. The project was funded by the Russian Science
Foundation Grant #18-11-00336. Speaking of official sponsors of BICA*AI 2020,
they are the BICA Society (bicasociety.org/about), AGI Laboratory, National
Research Nuclear University MEPhI, and two universities in Brazil: University of
Campinas (Unicamp) and Sao Paulo State University (UNESP).
Brain-Inspired Cognitive Architectures (BICA) are computational frameworks
for building intelligent agents that are inspired from natural intelligence. Since
2010, the annual BICA conference attracts researchers from the edge of scientific
frontiers around the world. It complements major conferences in artificial intelli-
gence (AI), cognitive science and neuroscience by offering to ambitious researchers
an informal brainstorming atmosphere and freedom of spontaneous social interac-
tions, together with great publication venues. This distinguishing feature of our
conference extends fully into the difficult year 2020.
BICA community members understand “biological inspirations” broadly, bor-
rowing them from psychology, neuroscience, linguistics, narratology, and creativity
studies in order to advance cognitive robotics and machine learning, among other
hot topics in AI. The selection criterion is based on the question of how much a
particular contribution may help us make machines our friends or understand how
the mind works. This principle corresponds to a broader understanding of the BICA

v
vi Preface

Challenge, put forward by the founders of BICA Society in 2010. BICA Society
(Biologically Inspired Cognitive Architectures Society) is a scientific non-profit 501
(c)(3) organization based in the USA, whose mission is to promote and facilitate the
many scientific efforts around the world in solving the BICA Challenge, i.e., cre-
ating a real-life computational equivalent of the human mind. BICA Society brings
together researchers from disjointed fields and communities who devote their efforts
to solving the challenge, despite that they may “speak different languages.” This is
achieved by promoting and facilitating the transdisciplinary study of cognitive
architectures, and in the long-term perspective, creating one unifying widespread
framework for the human-level cognitive architectures and their implementations.
Over 11 years of its existence, BICA Society organized or co-organized 11
international conferences (the BICA conferences), 2 schools, and 2 symposia.
These events were hosted in various countries around the world, including the
USA, Italy, France, Ukraine, Russia, the Czech Republic, and Brazil. In organizing
these events, BICA Society collaborated with several universities around the world.
BICA Society created and is maintaining an online database on cognitive archi-
tectures (http://bicasociety.org/mapped/), which includes one of the world’s largest
databases of freely accessible video records of scientific presentations about cog-
nitive architectures and related topics:
– https://vimeo.com/bicasociety
– https://youtube.com/channel/UC7Smq21YMKs0UjuVkFPpJJg
BICA Society initiated several mainstream periodic publication venues,
including Elsevier journals “Biologically Inspired Cognitive Architectures” and
“Cognitive Systems Research (CSR)–Special Issue Series on BICA*AI”. Plus,
BICA Society regularly publishes its proceedings in other editions dedicated to
BICA*AI, including Procedia Computer Science and, of course, the Springer Book
Series. The following topics at the front edge of science and technology, as before,
are in the focus of this and future BICA*AI conferences, books, and journals:
– Artificial social–emotional intelligence;
– Active humanlike learning and cognitive growth;
– Narrative intelligence and context understanding;
– Artificial creativity and creation of art by AI;
– Goal reasoning and true autonomy in artifacts;
– Embodied intelligence and cognitive robotics;
– Synthetic characters, HCI, and VR/MR paradigms for AI;
– Language capabilities and social competence;
– Robust and scalable machine learning mechanisms;
– Socially acceptable intelligent virtual agents;
– The role of emotions in artificial intelligence and their BICA models;
– Tests and metrics for BICA in the context of the BICA Challenge;
– Interaction between natural and artificial cognitive systems;
– Theory-of-Mind, episodic, and autobiographical memory in vivo and in vitro;
– Introspection, metacognitive reasoning, and self-awareness in BICA;
Preface vii

– AI and ethics, digital economics, and cybersecurity;

– Unifying frameworks, standards, and constraints for cognitive architectures.
Works of many, yet not all, distinguished speakers of BICA*AI 2020 are
included in this volume. Among the speakers of BICA*AI 2020 are top-level
scientists like John Laird, Paul Verschure, Terry Stewart, Antonio Chella, Paul
Robertson, Jan Treur, Rosario Sorbello, Ricardo Gudwin, to name only a few of the
famous names. The majority of authors of this volume is less known and never-
theless deserves attention. In particular, I would like to mention the work of
Natividad Vargas, Juan Luis del Valle-Padilla, Juan P. Jimenez and Félix Ramos, of
Lennart Zegerius, of Joey van den Heuvel, of Alessio Plebe and Pietro Perconti, of
Peter Boltuc and Thomas P. Connelly, of Kyrtin Atreides, David Kelley and Uplift
Masi.
As the General Chair of BICA*AI 2020, I would like to thank all members of the
Organizing Committee, the Program Committee, the Technical Support Team and
the Publishers teams for their great job in making the BICA conference a great
success story one more time. Particularly, my special thanks go to the publisher
Leontina Di Cecco from Springer, who made this publication possible.

November 2020 Alexei V. Samsonovich

Organization

Program Committee

Taisuke Akimoto Kyushu Institute of Technology, Japan

Kenji Araki Hokkaido University, Japan
Joscha Bach AI Foundation, USA
Feras Batarseh George Mason University, USA
Paul Baxter Plymouth University, USA
Paul Benjamin Pace University, New York, USA
Galina A. Beskhlebnova Scientific Research Institute for System
Analysis RAS, Russia
Jordi Bieger Reykjavik University, Iceland
Perrin Bignoli Yahoo Labs, USA
Douglas Blank Bryn Mawr College, USA
Peter Boltuc University of Illinois at Springfield, USA
Jonathan Bona University of Arkansas for Medical Sciences,
USA
Michael Brady Boston University, USA
Mikhail Burtsev Moscow Institute of Physics and Technology,
Russia
Erik Cambria Nanyang Technological University, Singapore
Suhas Chelian Fujitsu Laboratories of America, Inc., USA
Antonio Chella Dipartimento di Ingegneria Informatica,
Università di Palermo, Italy
Olga Chernavskaya P. N. Lebedev Physical Institute, Moscow, Russia
Thomas Collins University of Southern California (Information
Sciences Institute), USA
Christopher Dancy Penn State University, USA
Haris Dindo University of Palermo, Italy

ix
x Organization

Sergey A. Dolenko D. V. Skobeltsyn Institute of Nuclear Physics,

M. V. Lomonosov Moscow State University,
Russia
Alexandr Eidlin Sberbank, Moscow, Russia
Jim Eilbert AP Technology, USA
Thomas Eskridge Florida Institute of Technology, USA
Usef Faghihi Professor At Universite de Quebce in Trois-rivier,
Canada
Elena Fedorovskaya Rochester Institute of Technology, USA
Stan Franklin University of Memphis, USA
Marcello Frixione University of Genova, Italy
Salvatore Gaglio University of Palermo, Italy
Olivier Georgeon Claude Bernard Lyon 1 University, France
John Gero University of North Carolina at Charlotte, USA
Jaime Gomez Universidad Politécnica de Madrid, Spain
Ricardo R. Gudwin University of Campinas (Unicamp), Brazil
Eva Hudlicka Psychometrix Associates, USA
Dusan Husek Institute of Computer Science, Academy
of Sciences of the Czech Republic
Christian Huyck Middlesex University, UK
Ignazio Infantino Consiglio Nazionale delle Ricerche, Italy
Eduardo Izquierdo Indiana University, USA
Alex James Kunming University of Science and Technology,
China
Li Jinhai Kunming University of Science and Technology,
China
Magnus Johnsson Lund University, Sweden
Darsana Josyula Bowie State University, USA
Kamilla Jóhannsdóttir Reykjavik University, Iceland
Omid Kavehei The University of Sydney, Australia
David Kelley Artificial General Intelligence Inc, Seattle, USA
Troy Kelley U. S. Army Research Laboratory, USA
William Kennedy George Mason University, USA
Deepak Khosla HRL Laboratories LLC, USA
Swathi Kiran Boston University, USA
Muneo Kitajima Nagaoka University of Technology, Japan
Unmesh Kurup LG Electronics, USA
Giuseppe La Tona University of Palermo, Italy
Luis Lamb Federal University of Rio Grande do Sul, Brazil
Leonardo Lana de Carvalho Federal University of Jequitinhonha and Mucuri
Valleys, Brazil
Othalia Larue University of Quebec, Canada
Christian Lebiere Carnegie Mellon University, USA
Jürgen Leitner Australian Centre of Excellence for Robotic
Vision, Australia
Organization xi

Simon Levy Washington and Lee University, USA

Antonio Lieto University of Turin, Italy
James Marshall Sarah Lawrence College, USA
Olga Mishulina National Research Nuclear University MEPhI,
Russia
Sergey Misyurin National Research Nuclear University MEPhI,
Moscow, Russia
Steve Morphet Enabling Tech Foundation, USA
Amitabha Mukerjee Indian Institute of Technology Kanpur, India
Daniele Nardi Sapienza University of Rome, Italy
Sergei Nirenburg Rensselaer Polytechnic Institute, New York, USA
David Noelle University of California Merced, USA
Andrea Omicini Alma Mater Studiorum–Università di Bologna,
Italy
Marek Otahal Czech Institute of Informatics, Robotics and
Cybernetics, Czech Republic
Aleksandr I. Panov Moscow Institute of Physics and Technology,
Russia
David Peebles University of Huddersfield, UK
Giovanni Pilato ICAR-CNR, Italy
Roberto Pirrone University of Palermo, Italy
Michal Ptaszynski Kitami Institute of Technology, Japan
Uma Ramamurthy Baylor College of Medicine, Houston, USA
Thomas Recchia US Army ARDEC, USA
Vladimir Redko Scientific Research Institute for System
Analysis RAS, Russia
James Reggia University of Maryland, USA
Frank Ritter The Pennsylvania State University, USA
Paul Robertson DOLL Inc., USA
Brandon Rohrer Sandia National Laboratories, USA
Christopher Rouff Johns Hopkins Applied Physics Laboratory, USA
Rafal Rzepka Hokkaido University, Japan
Ilias Sakellariou Department of Applied Informatics, University
of Macedonia, Greece
Fredrik Sandin Lulea University of Technology, Sweden
Ricardo Sanz Universidad Politecnica de Madrid, Spain
Michael Schader Yellow House Associates, USA
Howard Schneider Sheppard Clinic North, Canada
Michael Schoelles Rensselaer Polytechnic Institute, USA
Valeria Seidita Dipartimento di Ingegneria - Università degli
Studi di Palermo
Ignacio Serrano Instituto de Automtica Industrial - CSIC, Spain
Javier Snaider FedEx Institute of Technology, The University
of Memphis, USA
Donald Sofge Naval Research Laboratory, USA
xii Organization

Meehae Song Simon Fraser University, Canada

Rosario Sorbello University of Palermo, Italy
John Sowa Kyndi, Inc., USA
Terry Stewart University of Waterloo, Canada
Sherin Sugathan Enview Research & Development Labs, India
Junichi Takeno Meiji University, Japan
Knud Thomsen Paul Scherrer Institute, Switzerland
Daria Tikhomirova NRNU MEPhI
Jan Treur Vrije Universiteit Amsterdam, Netherlands
Vadim L. Ushakov NRNU MEPhI, Russia
Alexsander V. Vartanov Lomonosov Moscow State University, Russia
Rodrigo Ventura Universidade de Lisboa, Portugal
Evgenii Vityaev Sobolev Institute of Mathematics SB RAS,
Russia
Pei Wang Temple University, USA
Mark Waser Digital Wisdom Institute, USA
Roseli S. Wedemann Universidade do Estado do Rio de Janeiro, Brazil
Özge Nilay Yalçin Simon Fraser University, Canada
Terry Zimmerman University of Washington, Bothell, USA
Contents

Acoustic Pattern Recognition Technology Based on the Viola-Jones

Approach for VR and AR Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Alexander M. Alyushin and Sergey V. Dvoryankin
Correlation of a Face Vibroimage Informative Parameters
with Characteristics of a Person’s Functional State When Using
VR and AR Technical Means . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
Victor M. Alyushin
Methodologies and Milestones for the Development
of an Ethical Seed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Kyrtin Atreides, David J. Kelley, and Uplift Masi
Design of a Transcranial Magnetic Stimulation System
with the Implementation of Nanostructured Composites . . . . . . . . . . . . 24
Gennady Baryshev, Yuri Bozhko, Igor Yudin, Aleksandr Tsyganov,
and Anna Kainova
Application of Information Measuring Systems for Development
of Engineering Skills for Cyber-Physical Education . . . . . . . . . . . . . . . . 32
Gennady Baryshev, Valentin Klimov, Aleksandr Berestov,
Anton Tokarev, and Valeria Petrenko
Principles of Design of a Learning Management System
for Development of Economic Skills for Nuclear
Engineering Education . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Gennady Baryshev, Aleksandr Putilov, Dmitriy Smirnov,
Aleksandr Tsyganov, and Vladimir Chervyakov
Post-quantum Group Key Agreement Scheme . . . . . . . . . . . . . . . . . . . . 49
Julia Bobrysheva and Sergey Zapechnikov
Uncanny Robots of Perfection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Piotr (Peter) Boltuc and Thomas P. Connelly

xiii
xiv Contents

Self and Other Modelling in Cooperative Resource Gathering

with Multi-agent Reinforcement Learning . . . . . . . . . . . . . . . . . . . . . . . 69
Vasilii Davydov, Timofei Liusko, and Aleksandr I. Panov
Eye Movement Correlates of Foreign Language Proficiency
in Russian Learners of English . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
Valeriia Demareva, Sofia Polevaia, and Julia Edeleva
Development of a Laboratory Workshops Management
Module as Part of a Learning Support System
for the ‘‘Decision-Making Theory’’ Course . . . . . . . . . . . . . . . . . . . . . . 84
Anastasia Devyatkina, Natalia Myklyuchenko, Anna Tikhomirova,
and Elena Matrosova
Algorithm for Constructing Logical Neural Networks Based
on Logical Various-Valued Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Dmitriy Dimitrichenko
The Electroencephalogram Based Classification of Internally
Pronounced Phonemes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97
Yuliya Gavrilenko, Daniel Saada, Eugene Ilyushin,
Alexander V. Vartanov, and Andrey Shevchenko
“Loyalty Program” Tool Application in Megaprojects . . . . . . . . . . . . . . 106
Anna Guseva, Elena Matrosova, Anna Tikhomirova,
and Nikolay Matrosov
Using Domain Knowledge for Feature Selection in Neural Network
Solution of the Inverse Problem of Magnetotelluric Sounding . . . . . . . . 115
Igor Isaev, Eugeny Obornev, Ivan Obornev, Eugeny Rodionov,
Mikhail Shimelevich, Vladimir Shirokiy, and Sergey Dolenko
Friction Model Identification for Dynamic Modeling
of Pneumatic Cylinder . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127
Vladimir I. Ivlev, Sergey Yu. Misyurin, and Andrey P. Nelyubin
Neurophysiological Features of Neutral and Threatening Visual
Stimuli Perception in Patients with Schizophrenia . . . . . . . . . . . . . . . . . 138
Sergey I. Kartashov, Vyacheslav A. Orlov,
Aleksandra V. Maslennikova, and Vadim L. Ushakov
Logical Circuits of a RP-Neuron Model . . . . . . . . . . . . . . . . . . . . . . . . . 143
Mukhamed Kazakov
Study of Neurocognitive Mechanisms in the Concealed
Information Paradigm . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149
Yuri I. Kholodny, Sergey I. Kartashov, Denis G. Malakhov,
and Vyacheslav A. Orlov
Contents xv

IT-Solutions in Money Laundering/Counter Terrorism Financing

Risk Assessment in Commercial Banks . . . . . . . . . . . . . . . . . . . . . . . . . 156
Sofya Klimova and Asmik Grigoryan
Expandable Digital Functional State Model of Operator
for Intelligent Human Factor Reliability Management Systems . . . . . . . 165
Lyubov V. Kolobashkina, Mikhail V. Alyushin, and Kirill S. Nikishov
Specialized Software Tool for Pattern Recognition
of Biological Objects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173
Sergey D. Kulik and Evgeny O. Levin
Designing Software for Risk Assessment Using a Neural Network . . . . . 181
Anna V. Lebedeva and Anna I. Guseva
Suitability of Object-Role Modeling Diagrams as an Intermediate
Model for Ontology Engineering: Testing the Rules for Mapping . . . . . 188
Dmitrii Litovkin, Dmitrii Dontsov, Anton Anikin, and Oleg Sychev
Cyber Threats to Information Security in the Digital Economy . . . . . . . 195
K. S. Luzgina, G. I. Popova, and I. V. Manakhova
Applying a Logical Derivative to Identify Hidden Patterns
in the Data Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206
Larisa A. Lyutikova
Algorithm for Constructing Logical Operations to Identify Patterns
in Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212
Larisa A. Lyutikova and Elena V. Shmatova
Graph-Ontology Model of Cognitive-Similar Information Retrieval
(on the Requirements Tracing Task Example) . . . . . . . . . . . . . . . . . . . . 218
Nikolay V. Maksimov, Olga L. Golitsina, Kirill V. Monankov,
and Natalia A. Bal
Toward a Building an Ontology of Artefact . . . . . . . . . . . . . . . . . . . . . . 225
Nikolay Maksimov and Alexander Lebedev
Cognitive Architectures of Effective Speech-Language
Communication and Prospective Challenges for Neurophysiological
Speech Studies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
Irina Malanchuk
Development of an AI Recommender System to Recommend
Concerts Based on Microservice Architecture Using Collaborative
and Content-Based Filtering Methods . . . . . . . . . . . . . . . . . . . . . . . . . . 241
Andrey Malynov and Igor Prokhorov
Visualization of T. Saati Hierarchy Analysis Method . . . . . . . . . . . . . . . 253
Elena Matrosova, Anna Tikhomirova, Nikolay Matrosov,
and Kovtun Dmitriy
xvi Contents

Labor Productivity Growth Based on Revolutionary Technologies

as a Factor for Overcoming the Economic Crisis . . . . . . . . . . . . . . . . . . 265
Y. M. Medvedeva and R. E. Abdulov
Network Security Intelligence Centres for Information Security
Incident Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270
Natalia Miloslavskaya and Steven Furnell
Block Formation for Storing Data on Information Security
Incidents for Digital Investigations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 283
Natalia Miloslavskaya, Andrey Nikiforov, and Kirill Plaksiy
Cyber Polygon Site Project in the Framework of the MEPhI
Network Security Intelligence Center . . . . . . . . . . . . . . . . . . . . . . . . . . . 295
Natalia Miloslavskaya and Alexander Tolstoy
Selection of a Friction Model to Take into Account the Impact
on the Dynamics and Positioning Accuracy of Drive Systems . . . . . . . . 309
S. Yu. Misyurin, G. V. Kreinin, N. Yu. Nosova, and A. P. Nelyubin
Kinematics and Dynamics of the Spider-Robot Mechanism,
Motion Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320
Sergey Yu. Misyurin, German V. Kreinin, Natalia Yu. Nosova,
and Andrey P. Nelyubin
Multiagent Model of Perceptual Space Formation in the Process
of Mastering Linguistic Competence . . . . . . . . . . . . . . . . . . . . . . . . . . . 327
Zalimkhan Nagoev and Irina Gurtueva
The Role of Gender in the Prosocial Behavior Mechanisms . . . . . . . . . . 335
Yulia M. Neroznikova and Alexander V. Vartanov
Reflection Mechanisms of Empathy Processes in Evoked Potentials . . . . 342
Yulia M. Neroznikova and Alexander V. Vartanov
Lateralization in Neurosemantics: Are Some Lexical Clusters More
Equal Than Others? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 350
Zakhar Nosovets, Boris M. Velichkovsky, Liudmila Zaidelman,
Vyacheslav Orlov, Sergey Kartashov, Artemiy Kotov, Vadim Ushakov,
and Vera Zabotkina
Brain Inspiration Is Not Panacea . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 359
Pietro Perconti and Alessio Plebe
Linear Systems Theoretic Approach to Interpretation of Spatial
and Temporal Weights in Compact CNNs: Monte-Carlo Study . . . . . . . 365
Artur Petrosyan, Mikhail Lebedev, and Alexey Ossadtchi
The Economic Cross of the Digital Post-coronavirus Economy
(on the Example of Rare Earth Metals Industry) . . . . . . . . . . . . . . . . . . 371
O. Victoria Pimenova, Olga B. Repkina, and Dmitriy V. Timokhin
Contents xvii

Comparative Analysis of Methods for Calculating the Interactions

Between the Human Brain Regions Based on Resting-State FMRI
Data to Build Long-Term Cognitive Architectures . . . . . . . . . . . . . . . . . 380
Alexey Poyda, Maksim Sharaev, Vyacheslav Orlov, Stanislav Kozlov,
Irina Enyagina, and Vadim Ushakov
The Use of the Economic Cross Method in IT Modeling
of Industrial Development (Using the Example
of Two-Component Nuclear Energy) . . . . . . . . . . . . . . . . . . . . . . . . . . . 391
Aleksandr V. Putilov, Dmitriy V. Timokhin, and Marina V. Bugaenko
Intelligence - Consider This and Respond! . . . . . . . . . . . . . . . . . . . . . . . 400
Saty Raghavachary
Simple Model of Origin of Feeling of Causality . . . . . . . . . . . . . . . . . . . 410
Vladimir G. Red’ko
Extending the Intelligence of the Pioneer 2AT Mobile Robot . . . . . . . . . 417
Michael A. Rudy, Eugene V. Chepin, and Alexander A. Gridnev
On the Regularity of the Bias of Throughput Estimates
on Traffic Averaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 425
Victor A. Rusakov
Virtual Convention Center: A Socially Emotional Online/VR
Conference Platform . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 435
Alexei V. Samsonovich and Arthur A. Chubarov
Ensembling SNNs with STDP Learning on Base of Rate
Stabilization for Image Classification . . . . . . . . . . . . . . . . . . . . . . . . . . . 446
Alexander Sboev, Alexey Serenko, Roman Rybka, and Danila Vlasov
Mathematical Methods for Solving Cognitive Problems
in Medical Diagnosis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 453
Yuri Kotov and Tatiana Semenova
Brain Cognitive Architectures Mapping for Neurosurgery:
Resting-State fMRI and Intraoperative Validation . . . . . . . . . . . . . . . . . 466
M. Sharaev, T. Melnikova-Pitskhelauri, A. Smirnov, A. Bozhenko,
V. Yarkin, A. Bernshtein, E. Burnaev, P. Petrov, D. Pitskhelauri,
V. Orlov, and I. Pronin
Machine Learning Based on the Principle of Minimizing Robust
Mean Estimates . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 472
Z. M. Shibzukhov
Parameterized Families of Correctly Functioning
Sigma-Pi Neurons . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 478
Z. M. Shibzukhov
xviii Contents

The Loop of Nonverbal Communication Between Human

and Virtual Actor: Mapping Between Spaces . . . . . . . . . . . . . . . . . . . . . 484
Vladimir R. Shirokiy, Daria V. Tikhomirova, Roman D. Vladimirov,
Sergei A. Dolenko, and Alexei V. Samsonovich
Preliminary Experiment on Emotion Detection in Illustrations
Using Convolutional Neural Network . . . . . . . . . . . . . . . . . . . . . . . . . . . 490
Alexander Shtanko and Sergey Kulik
AGI Components for Enterprise Management Systems . . . . . . . . . . . . . 495
Artem A. Sukhobokov and Liubov I. Lavrinova
Eligibility of English Hypernymy Resources for Extracting
Knowledge from Natural-Language Texts . . . . . . . . . . . . . . . . . . . . . . . 501
Oleg Sychev and Yaroslav Kamennov
The Use of Digital Tools in the Formation of Two-Component
Nuclear Energy on the Base of Economic Cross Method . . . . . . . . . . . . 508
D. V. Timokhin
Complex Objects Identification and Analysis Mechanisms . . . . . . . . . . . 517
Mikhail Ulizko, Larisa Pronicheva, Alexey Artamonov,
Rufina Tukumbetova, and Evheniy Tretyakov
To Help or Not to Help: A Network Modelling Approach
to the Bystander Effect . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 527
Joey van den Heuvel and Jan Treur
A Model of Top-Down Attentional Control for Visual Search Based
on Neurosciences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 541
Natividad Vargas, Juan Luis del Valle-Padilla, Juan P. Jimenez,
and Félix Ramos
Comparison of Brain Induced Potentials in Internal Speech
in Studied and Unknown Languages . . . . . . . . . . . . . . . . . . . . . . . . . . . 547
Alexander V. Vartanov and Alisa R. Suyuncheva
Analysis of Using of Neural Networks for Real-Time
Process Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 553
V. S. Volodin and A. O. Tolokonskij
Comparison Between Coordinated Control and Interpretation
Methods for Multi-channel Control of a Mobile Robotic Device . . . . . . 558
Timofei I. Voznenko, Alexander A. Gridnev, Eugene V. Chepin,
and Konstantin Y. Kudryavtsev
Combinator-as-a-Process for Representing the Information
Structure of Deep Computing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 565
Viacheslav Wolfengagen, Larisa Ismailova, and Sergey Kosikov
Contents xix

Applicative Model to Bring-in Conceptual Envelope

for Computational Thinking with Information Processes . . . . . . . . . . . . 572
Viacheslav Wolfengagen, Larisa Ismailova, and Sergey Kosikov
Computational Model for Capturing the Interdependencies
on Information Processes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 578
Viacheslav Wolfengagen, Larisa Ismailova, and Sergey Kosikov
Imposing and Superposing the Information Processes over
Variable Concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 585
Viacheslav Wolfengagen, Larisa Ismailova, and Sergey Kosikov
Improvement of the Technology of fMRI Experiments
in the Concealed Information Paradigm . . . . . . . . . . . . . . . . . . . . . . . . . 591
Yuri I. Kholodny, Sergey I. Kartashov, Denis G. Malakhov,
and Vyacheslav A. Orlov
Modelling Metaplasticity and Memory Reconsolidation During
an Eye-Movement Desensitization and Reprocessing Treatment . . . . . . 598
Lennart Zegerius and Jan Treur

Author Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 611

 Acoustic Pattern Recognition Technology
Based on the Viola-Jones Approach
for VR and AR Systems

Alexander M. Alyushin1,2(&) and Sergey V. Dvoryankin3

1
National Research Nuclear University MEPhI (Moscow Engineering Physics
Institute), Kashirskoe shosse 31, Moscow 115409, Russia
alyshin@list.ru
2
Plekhanov Russian University of Economics,
st. Hook, 43, Moscow 117997, Russia
3
Financial University under the Government of the Russian Federation,
Leningradsky prospect, 49, Moscow 125993, Russian Federation
SVDvoryankin@fa.ru

Abstract. The ability to solve problems of graphic images recognition in vir-

tual reality (VR), augmented reality (AR), mixed reality (MR) and cross reality
(XR) systems is highlighted as one of the most important. The urgency of
solving problems of recognition and classification of acoustic images has been
substantiated, which will bring the quality of VR, AR, MR and XR systems
closer to real reality (RR). Independent solution of graphic and acoustic patterns
recognition problems using heterogeneous algorithmic and software tools is
attributed to the disadvantages of modern systems. The study proposes an
approach that allows the use of unified methodological and software tools for the
simultaneous solution of graphic and acoustic patterns recognition problems.
The proposed approach is based on converting acoustic information into graphic
information using 2D-images of dynamic sonograms. This allows the recogni-
tion of acoustic patterns using unified algorithmic and software tools. It is
proposed to use the Viola-Jones technology as such a unified tool. It is shown
that the implementation of a two-stage determination of similarity measures of
primitives and areas of the original image makes it possible to increase the speed
of algorithms. For this purpose, at the first iteration, it is proposed to use not the
graphic primitives themselves, but their coordinate projections. In the study, by
analogy with Haar’s features, parametrizable acoustic primitives were devel-
oped, presented in the classical graphical version, as well as in the form of
coordinate projections.

Keywords: Recognition and classification
Graphic and acoustic patterns

Viola-Jones algorithm

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2021

A. V. Samsonovich et al. (Eds.): BICA 2020, AISC 1310, pp. 1–8, 2021.
https://doi.org/10.1007/978-3-030-65596-9_1
2 A. M. Alyushin and S. V. Dvoryankin

1 Introduction

One of the most important functions implemented in modern virtual reality (VR),
augmented reality (AR), mixed reality (MR) and cross reality (XR) systems and largely
determines their capabilities, is the recognition and classification of graphic images [1].
For example, the basis of AR, MR and XR technologies is the recognition of objects in
each frame of the video stream and the addition of new graphic information to them. In
addition, a number of AR, MR and XR technologies use the so-called graphic markers,
which are necessary to determine the spatial characteristics of objects of real reality
(RR) [2]. This function must be repeatedly performed in real time [3], which imposes
strict requirements on the speed of algorithms used for this purpose, for example,
various modifications of the well-known Viola-Jones algorithm [4, 5].
One of the main trends in the modern development of AR, MR, and XR systems is
the approach to RR, primarily due to the development of artificial intelligence tech-
nology, which allows simultaneous processing of video and audio patterns [6]. This
allows you to implement a natural user interface for a person, to carry out acoustic
navigation [7–9], to provide the necessary information interaction between characters,
for example, in training systems [10, 11], to increase the efficiency of solving pro-
duction tasks [12, 13].
The aim of the research is to unify algorithmic and technical means used for the
recognition of graphic and acoustic patterns based on the Viola-Jones approach for VR,
AR, MR and XR systems.

2 State of Research in This Area

Currently being developed VR, AR, MR and XR systems, as a rule, involve the use of
independent channels for processing video and audio information. It should be noted
that the applied algorithmic and methodological means of graphic patterns recognition
are forced to operate with significant data streams, which is associated with the use of
modern high-speed high-resolution video cameras. In this regard, the flow of acoustic
data even when using multichannel systems [7] has a significantly smaller volume.
For this reason, it is relevant to use algorithmic and methodological tools developed
for the recognition of graphic patterns for the recognition of acoustic patterns in VR,
AR, MR and XR systems. The feasibility of this approach in practice is due to a fairly
well-developed technology for converting acoustic information into a graphic repre-
sentation in the form of a 2D-image of dynamic sonograms. This technology is widely
used, for example, for the protection of documents against forgery based on the so-
called speech signature [14, 15]. The specificity of a 2D-image of a dynamic sonogram
is the presence of areas with different graphic structures, for example, linear and dotted,
as well as low image contrast with a high noise level.
Of all the existing variety of approaches and algorithms for recognizing graphic
objects in the image, which are also suitable for working with images of dynamic
sonograms, the most suitable is the approach proposed by Viola-Jones for recognizing
facial images [16]. Recognition of a graphic object in accordance with this approach is
carried out on the basis of the similarity measures analysis of a large set of
 Acoustic Pattern Recognition Technology 3

characteristic features typical of the analyzed image. At the same time, the features
themselves, known as Haar features [16–18], characterize the properties of limited
areas of the recognized object.
The disadvantages of this approach include a fairly large amount of calculations to
determine the measures of features similarity and areas of the analyzed image, as well
as a decrease in the reliability of the result obtained with a decrease in the contrast of
the analyzed image.

3 The Essence of the Proposed Approach

To recognize acoustic patterns presented in the form of 2D-images of dynamic sono-

grams, the study proposes to use a two-stage analysis of similarity measures for a set of
acoustic features and areas of a 2D-image. This allows you to significantly reduce the
necessary computational costs of the approach. This approach assumes the presence of
two forms of features representation and analyzed image areas − in the form of image
fragments and in the form of their coordinate projections. A two-stage analysis of
features similarity measures is applicable both in the analysis of acoustic signals and in
the analysis of video stream frames.
At the first step, it is proposed to analyze the features similarity of the coordinate
projections and the coordinate projections of the areas of the analyzed image, usually
selected using a floating rectangular window.
At the second step, the analysis of the features similarity measures selected in this
way and the corresponding image areas, presented as fragments of the corresponding
images, is carried out. This operation is completely analogous to the procedures used in
the Viola-Jones algorithm.
Figure 1 illustrates this approach.
0

F, Hz 4 1 2 3
PY

5
7

PX
Y

0 X
0

P*Y

9
8

10

P*X
Y

0 T, s 0 X

Fig. 1. Approach illustration.

4 A. M. Alyushin and S. V. Dvoryankin

The original image (IMG[i, j], i = 1, …, IMAX, j = 1, …, JMAX, where IMAX and
JMAX are the image size in pixels, respectively) of dynamic sonogram 1 contains areas
2 with a linear structure corresponding to vowel sounds of human speech (harmonic
signals), and area 3 corresponding to consonants (hissing) sounds. The X-axis of the
sonogram corresponds to time, and the Y-axis corresponds to the frequency F.
At the first step, in accordance with the proposed approach, by means of a floating
window 4 with a size of N  N pixels, a fragment of the image 5 is selected, for
example, containing characteristic stripes 6 and 7.
For a given fragment of the image, its coordinate projections PY ðYÞ and PX ðXÞ are
determined:

YX
0 þN

PX ðXÞ ¼ IMGðX; jÞ; X ¼ 1; . . .; N; ð1Þ

j¼Y0

XX
0 þN

PY ðYÞ ¼ IMGði; YÞ; Y ¼ 1; . . .; N; ð2Þ

i¼X0

where X0 and Y0 are the coordinates of the window anchor point.

These projections, as a rule, contain noise components that cause, for example,
nonzero values of the functions PY ðYÞ and PX ðXÞ in the intervals between bands 6 and
7. To minimize the influence of noise components in two forms of information pre-
sentation, it is proposed to carry out, respectively, threshold discrimination for the
functions PY ðYÞ and PX ðXÞ and contrasting for a fragment of the image 5. A typical
result of these operations is shown in Fig. 1 in the form of new obtained coordinate
projections PY ðYÞ and PX ðXÞ, as well as a fragment of a contrast image 8, containing
characteristic stripes 9 and 10.
Analysis of possible structures of image fragments of dynamic sonograms made it
possible to form a basic set of characteristic acoustic features. To describe the image
areas of a sonogram with a line structure, basic features SL(A, D, W) were formed,
where A is the relative angle of inclination of the lines (−AMAX  A  AMAX, the
value AMAX = 10, which corresponds to the angle of inclination of the lines in 90°),
D is the relative distance between the lines (1  D  DMAX, the value DMAX = 10
corresponds to the maximum distance), W is the relative width of the lines (1  W 
WMAX, the value WMAX = 10 corresponds to the maximum width).
In Fig. 2 shows examples of the formed basic acoustic features, which include two
forms of presenting information of the considered type − in the form of coordinate
projections and a fragment of a high-contrast image.
To describe image areas with a pixel structure, basic features of the NP(Q, G) type
were formed, where Q is the relative density of dark pixels (1  Q  QMAX, the
value QMAX = 10 corresponds to the maximum density of dark pixels), G − relative
density gradient with respect to the Y axis (−GMAX  G  GMAX, the value
GMAX = 10 corresponds to the maximum value of the gradient).
In Fig. 3 shows typical examples of formed basic features of the NP(Q, G) type.
 Acoustic Pattern Recognition Technology 5

SL(0, 10, 1) SL(0, 1, 10) SL(5, 5, 5) SL(-5, 5, 5)

Y Y Y Y

0 X 0 X 0 X 0 X

Fig. 2. Examples of SL(A, D, W) basic acoustic features.

NP(10, 0) NP(1, 0) NP(10, 10) NP(1, -10)

Y Y Y Y

0 X 0 X 0 X 0

Fig. 3. Examples of NP(Q, G) basic acoustic features.

The basic acoustic features of SL(A, D, W) and NP(Q, G) types formed in this way
were the basis for the creation of working features SL*(A, D, W, M) and NP*(Q, G, M),
differing in the scaling factor M (1  M  MMAX, for sonograms with a resolution
of less than 1024  1024 pixels, it is sufficient to use the value MMAX = 10).
In Fig. 4 shows an example of the created operating characteristics SL(A, D, W).

SL*(0, 10, 10)

Y SL*(0, 5, 7, 7)
Y SL*(-5, 5, 5, 5)
Y

0 X 0 X 0 X

Fig. 4. Examples of working acoustic signs of SL*(A, D, W, M) type.

Working acoustic signs allow you to get a graphic image of acoustic signals, speech
and sounds based on recognition of the structure of the sonogram. To determine the
similarity measure of coordinate projections at the first step, it is proposed to use the
value D:

X
N   X N  
D ¼ 1=ð1 þ PF ðYÞ  P ðYÞ  þ PF ðXÞ  P ðXÞ Þ; ð3Þ
Y X
Y¼1 X¼1

where PF ðYÞ and PF ðXÞ are, respectively, coordinate projections for working acoustic
features.
6 A. M. Alyushin and S. V. Dvoryankin

SL* SL*
NP* NP* NP* SL* NP* SL* NP*
(-3,5, (8,6,
(3,0,9) (2,0, (5,0,9) (-4,7, (4,0,3) (-3,6, (4,0,3)
4,5 ) 1,5 )
3) 2,5 ) 4,5 )
NP* NP* NP*
SL* (1,0, SL*
NP* NP* (3,0,3) (3,0,3)
(-3,5, 3) (7,6,
(4,0,9) (4,0,9)
3,5 ) 1,5 ) SL* SL*
NP* (-4,7, NP* (-3,6,
(1,0, NP*
SL* 1,5 ) (3,0,3) 3,5 ) (3,0,3)
3) SL*
NP* (-3,5, NP*
(6,6,
(5,0,9) 5,5 ) (4,0,9)
SL* 2,5 ) NP* SL*
(-3,4, SL* (2,0,3) (6,6,
SL*
2,3) (-4,7, 1,5 )
SL* SL* (-3,6,
NP* SL* NP* 5,5 ) 5,5 ) SL*
(-3,5, (5,6, NP*
(5,0,9) (-3,4, (5,0,9) (5,6,
5,5 ) 5,5 ) (3,0,3)
4,3) 3,5 )

Fig. 5. Example of structure recognition.

In Fig. 5 shows an example of structure recognition according to the proposed

technique of 2D-image of a dynamic sonogram shown in Fig. 1 (X-axis time scale not
saved).
The resulting structure of the sonogram is an image that is further processed by the
methodological and algorithmic means inherent in the Viola-Jones approach. This
makes it possible to use the existing graphic image processing tools for solving
problems of recognition and classification of acoustic patterns in VR, AR, MR and XR
systems.

4 Experimental Laboratory Approbation of the Approach

The conducted experimental laboratory testing of the approach confirmed the possi-
bility of its implementation in practice using the classical Viola-Jones algorithms. The
decrease in the performance of the tasks being solved for the recognition of graphic
objects with the simultaneous processing of acoustic patterns did not exceed 10%. The
implementation of a two-stage process for determining the measures of similarity of
features and areas of an image made it possible to increase the performance by 15–30%
for images with dimensions of 800  800 pixels–1600  1600 pixels, respectively.

5 Areas of Possible Application of the Developed Technology

The proposed approach is primarily focused on expanding the functionality of modern

VR, AR, MR and XR systems through the simultaneous processing of video and
acoustic information. Another area of possible application of the approach is systems
for protecting important documents based on the use of a speech signature [14, 15],
which involve solving the problems of searching for a sonogram on a document image,
as well as recognizing the structure of a sonogram in order to identify the author of the
document and his psycho-emotional state.
 Acoustic Pattern Recognition Technology 7

6 Conclusion

The approach proposed in the study makes it possible to use already available software
and methodological tools for solving problems of recognizing and classifying acoustic
patterns, initially focused on recognizing and classifying graphic images. The most
prominent representative of such tools are algorithmic and software tools that imple-
ment the principles of processing graphic data in accordance with Viola-Jones tech-
nology. The implementation of a two-stage procedure for determining the similarity
measure of features and image regions allows increasing the speed of the computational
process.

Acknowledgement. The research was carried out by grant of the Russian Scientific Foundation
(project №19-71-30008) in Plekhanov Russian University of Economics.

References
1. Park, H., Jeong, S., Kim, T., Youn, D., Kim, K.: Visual representation of gesture interaction
feedback in virtual reality games. In: IEEE Proceedings of the 2017 International
Symposium on Ubiquitous Virtual Reality (ISUVR), Nara, Japan, 27–29 June 2017,
pp. 20–23 (2017)
2. Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based
augmented reality conferencing system. In: Proceedings 2nd IEEE and ACM International
Workshop on Augmented Reality (IWAR 1999), San Francisco, CA, USA, 20–21 October
1999, pp. 85–94 (1999)
3. Prince, S., Cheok, A.D., Farbiz, F., Williamson, T., Johnson, N., Billinghurst, M., Kato, H.:
3D live: real time captured content for mixed reality. In: IEEE Proceedings of the
International Symposium on Mixed and Augmented Reality (ISMAR 2002), Darmstadt,
Germany, 1 October 2002, pp. 7–317 (2002)
4. Lee, Y.J.: Effective interface design using face detection for augmented reality interaction of
smart phone. Int. J. Smart Home 6(2), 25–32 (2012)
5. Lee, Y.J., Lee, G.H.: Augmented reality game interface using effective face detection
algorithm. Int. J. Smart Home 5(4), 77–88 (2011)
6. Godin, K.W., Rohrer, R., Snyder, J., Raghuvanshi, N.: Wave acoustics in a mixed reality
shell. In: Proceedings of the 2018 AES International Conference on Audio for Virtual and
Augmented Reality (AVAR), Redmond, USA, 20–22 August 2018, pp. 7−3 (2018)
7. Tylka, J.G., Choueiri, E.Y.: Fundamentals of a parametric method for virtual navigation
within an array of ambisonics microphones. J. Audio Eng. Soc. 68(3), 120–137 (2020a)
8. Tylka, J.G.: Virtual navigation of ambisonics-encoded sound fields containing near-field
sources. In: Computer Science (2019). 246 p.
9. Tylka, J.G., Choueiri, E.Y.: Performance of linear extrapolation methods for virtual sound
field navigation. J. Audio Eng. Soc. 68(3), 138–156 (2020b)
10. Yuen, S.C.-Y., Yaoyuneyong, G., Johnson, E.: Augmented reality: an overview and five
directions for AR in education. J. Educ. Technol. Dev. Exchange 4(1), 119−140 (2011)
11. Abdoli Sejzi, A.: Augmented reality and virtual learning environment. J. Appl. Sci. Res.
(JASR) 11(8), 1–5 (2015)
8 A. M. Alyushin and S. V. Dvoryankin

12. Lahti, H., Bahne, A.: Virtual tuning – a mixed approach based on measured RTFs. In:
Proceedings of the AES 2019 International Conference on Automotive Audio, Bavaria,
Germany, 11–13 September 2019, paper number 12 (2019)
13. Malbos, F., Bogdanski, M., Strauss, M.J.: Virtual reality experience for the optimization of a
car audio system. In: Proceedings of the AES 2019 International Conference on Automotive
Audio, Bavaria, Germany, 11–13 September 2019, paper number 13 (2019)
14. Alyushin, M.V., Alyushin, A.M., Kolobashkina, L.V.: Human face thermal images library
for laboratory studies of the algorithms efficiency for bioinformation processing. In: IEEE
Proceedings of the 11th IEEE International Conference on Application of Information and
Communication Technologies (AICT 2017), Russia, Moscow, 20–22 September 2017
(2017)
15. Alyushin, A.M.: Document protection technology in the digital economics using cognitive
biometric methods. Procedia Comput. Sci. 169, 887–891 (2020)
16. Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vision 57(2), 137–
154 (2004)
17. Alyushin, M.V., Alyushin, V.M., Kolobashkina, L.V.: Optimization of the data represen-
tation integrated form in the Viola-Jones algorithm for a person’s face search. Procedia
Comput. Sci. 123, 18–23 (2018)
18. Kolobashkina, L.V., Alyushin, M.V.: Analysis of the possibility of the neural network
implementation of the Viola-Jones algorithm. In: Advances in Intelligent Systems and
Computing, vol. 948, pp. 232−239 (2020)
 Correlation of a Face Vibroimage Informative
Parameters with Characteristics of a Person’s
Functional State When Using VR and AR
Technical Means

Victor M. Alyushin(&)

National Research Nuclear University MEPhI (Moscow Engineering Physics

Institute), Kashirskoe Shosse 31, Moscow 115409, Russia
vmalyushin@mephi.ru

Abstract. An analysis of the specifics of modern VR, AR, MR and XR systems

use in educational, recreational and recovery processes is presented. The
urgency of continuous monitoring of the current functional state (FS) and its
psycho-emotional state (PES) using VR, AR, MR and XR technical means has
been substantiated. Maintaining the state of health, as well as the required level
of performance, are highlighted as the main requirements for the applied VR,
AR, MR and XR means. The relevance of the use of infrared (IR) biometric
technologies for the registration of the most informative human bioparameters,
determining his current PES, has been substantiated. Analysis of IR vibraimage
of a face is highlighted as the most promising technology for assessing its
current PES. The possibility of determining the current FS on the basis of a set
of bioparameters determining its PES is substantiated. For this purpose, the
analysis of the correlation of the FS and the most informative bioparameters
determined by the analysis of the IR vibraimage of the user’s face by VR, AR,
MR and XR means is given. To assess the FS in the study, it was proposed to
use a value determined by the number of errors committed during periodic
execution of specialized tests integrated into the VR, AR, MR, and XR scenario.
Experimental data obtained during laboratory testing of the method confirmed
the possibility of assessing FS based on a set of bioparameters measured during
the processing and analysis of the IR vibraimage of the VR, AR, MR and XR
user’s face. The research results are of particular importance when training
operators to control potentially hazardous facilities using VR, AR, MR or XR
technologies, and, first of all, for the nuclear industry.

Keywords: Functional state
Psycho-emotional state
Facial vibraimage

analysis
Educational activity planning

1 Introduction

The widespread introduction of VR, AR, MR and XR technologies into everyday life
has undeniable advantages, but at the same time causes a number of serious problems.
Especially actively these technologies are currently being introduced in education,
medicine, in vocational training and retraining, in VR simulators, in the field of

© The Author(s), under exclusive license to Springer Nature Switzerland AG 2021

A. V. Samsonovich et al. (Eds.): BICA 2020, AISC 1310, pp. 9–14, 2021.
https://doi.org/10.1007/978-3-030-65596-9_2
10 V. M. Alyushin

recreation and entertainment [1, 2]. Indicative, in this regard, is the use of VR, AR, MR
and XR technologies as a tool for relieving stress, including for medical purposes [3].
The increased interest in VR, AR, MR and XR technologies in recent years is due,
among other things, to the desire to go on an exciting virtual journey during the
coronavirus epidemic.
However, frequent and prolonged presence in these realities can cause headaches,
vision problems, disturbances in the mental state of a person. Excessive fascination
with these realities by children is especially harmful. The negative impact of VR, AR,
MR and XR technologies depends to a large extent on factors such as the quality of the
synthesized video information, the accuracy and performance of the positioning sys-
tems. It is well known, for example, that disturbances between the visual perception of
the environment and its perception by the senses lead to headaches, dizziness, and
disorientation. As a result − to an increase in blood pressure, deterioration of health, in
some cases − to nausea and vomiting.
In connection with the above, it is relevant to constantly monitor the current FS and
PES of the VR, AR, MR and XR means user. It should be noted that FS determines the
ability of a person to perform certain actions, duties, for example, production. PES
shows what physical and mental costs are incurred by a person, taking into account the
resources available to him. For this reason, FS and PES depend on each other in a
rather complex way. Maintaining the state of health, as well as high performance,
necessitate constant monitoring of the VR, AR, MR and XR means user’s current PES.
The main requirements for the tools used for monitoring the current PES of a
person are safety and ease of use. The safety of use, first of all, assumes the absence of
harmful effects on humans, which determines the predominant use of the so-called
passive biometric technologies. The requirement for ease of use leads to the need to use
small-sized, including built-in biometric devices. Modern optical biometric technolo-
gies should be singled out as the most promising for use in conjunction with VR, AR,
MR and XR technical means. The latter, first of all, should include the technology for
analyzing the vibraimage of a person’s face [4, 5].
The aim of the work is to study the correlation of the face vibraimage informative
parameters, reflecting the PES, with the characteristics of the human FS when using
VR, AR, MR and XR technical means.

2 State of Research in This Area

Currently, biometric measurements are used to solve problems of user identification in

VR and AR systems [6, 7]. For this purpose, recognition of gestures, the nature of
movements, and gait features is usually used [8]. Another direction in the development
of virtual systems based on optical biometric technologies is the use of gaze tracking
tools [9] to create a convenient interface for managing such systems. To monitor the
human condition in [10], it is proposed to use the image analysis of the eyes and pupils.
Unfortunately, many of the technologies used in practice, primarily based on the
analysis of the direction of gaze, as well as the dynamics of changes in the pupil, are
characterized by the effect of interference with the scenario implemented by the virtual
Another random document with
no related content on Scribd:
students. They were an indistinguishable mass to her, with the exception of
two or three noticeably pretty, and about the same number of extremely
homely young women whose physique rendered them conspicuous. To her
uninterested gaze the large majority seemed to be distressingly like all
previous freshman classes, and endowed with the same modest amount of
good looks and intellectual foreheads.
But in college life it is a strange fact that while upper classes find it rather
difficult to become acquainted among the lower ones, owing, of course, to
the unwritten code which prevents a senior from appearing interested in any
but those of her own class, yet the incoming students are allowed and take
every opportunity of ingratiating themselves with upper-class girls, without
injury to their dignity. But Miss Hungerford, who had surrounded herself
with quite an impenetrable air of seniority, and who was so extremely
handsome and distant-looking, by her appearance and bearing had exercised
a rather chilling influence on young aspirants for an introduction, and was
secretly very much looked up to and feared.
She was not entirely unconscious of the effect she produced, and was
therefore decidedly surprised one day to receive a call from a freshman who
lived only a few doors from her, but of whose existence she had not been
aware. She thought the child—she was very young, not more than sixteen—
uninteresting, and that it was an evidence of extremely bad taste, and
unconventionality on her part to call in that unprovoked way. But she was
very polite to her uninvited guest, and asked her the usual questions, and the
girl, who was very naïve, replied with a loquacity quite trying to her hostess.
Miss Hungerford was rather indignant after her visitor had gone, and
wondered why she had had to be interrupted in an analytical study of
“Prometheus Unbound,” to listen to a child tell her that she had never been
out of Iowa before, and that her mother had not wanted her to come to
college, but that her father had always said she should have “a higher
education,” and so, after presumably much domestic wrangling, she was
there. Miss Hungerford could not remember much else of what the young
girl had told her, having listened rather absently to her replies, but she had a
distinct impression that her visitor was not at all good-looking, with only a
fine pair of eyes to redeem her pale face, and that her clothes were atrocious,
and that she was
 A RATHER CHILLING INFLUENCE

gauche and decidedly of a social class that Miss Hungerford was not in the
habit of mingling with away from college. For even in a very democratic
college there are social grades, and although it is the thing to meet in a most
friendly way at all class functions, still, a narrow line of distinction may be
perceived on social occasions.
Altogether Miss Hungerford felt rather aggrieved and hoped she would
not be bothered again. But she was. Miss Betty Harmon, of Sioux City, Ia.,
had had a fearful struggle with her timidity and retiring nature, when she
called on Miss Hungerford, and having gained a victory over herself, she had
no intention of resigning the benefits. So she would smile first when they
met in the corridors, and was not above showing how much she appreciated
a few words from Miss Hungerford in praise of her tennis serve, and that
young woman was even uncomfortably conscious that her youthful admirer
had more than once followed her to the library, where, under pretence of
reading, she had stolen furtive glances at her. Later there were notes, and
roses, and requests to go boating.
Miss Hungerford strongly objected to such proceedings, not only because
she did not wish to be rendered ridiculous by an insignificant freshman from
Iowa, but also because she was a very sensible girl, and entirely disapproved
of the “eclectic affinity” business, and she had no intention of allowing the
young girl’s admiration for herself to develop into that abnormal sort of
attraction that exists between girls in so many schools and colleges.
The temptation to exalt some upper-class girl into an ideal and lavish
upon her an affection which in society would naturally fall to the lot of some
very unideal boy, or man, is one of the greatest ordeals a college girl goes
through, and one who successfully resists all inducements to become a
“divinity student,” or who gets out of the entanglement without damage to
herself, is as successfully “proven” as was Lieutenant Ouless after his little
affair with Private Ortheris. Even the least romantic girl is apt to find
unexpected possibilities in her nature in the way of romantic devotion, so
that it was not surprising that Miss Betty Harmon, unimaginative and
unsentimental as she was, should have admired so extravagantly as
handsome and interesting a girl as Eva Hungerford. The crude Western girl
found something extremely attractive in the senior—grace, a social ease and
distinction, and that indefinable magnetism which a wealthy, consciously
beautiful girl possesses.

SHE HAD STOLEN FURTIVE GLANCES AT HER

 But Miss Hungerford, who had no notion of getting herself talked about,
and whose Eastern sensitiveness and prejudices were continually being
shocked by the younger girl’s crudities, so persistently frowned down upon
and ignored her under-class admirer, that even Miss Harmon’s devotion
paled, and the roses and notes and boating excursions ceased. She began to
perceive that the faint line of social distinction, so rarely perceptible in the
college, had been drawn in her case.
During the last semestre of the year Miss Hungerford, who was very tired
and busy, seemed almost oblivious of the young girl’s existence, and even
forgot to smile at her when they met on the campus. And when on her
Baccalaureate Sunday a box of white roses—the last mute expression of
Miss Harmon’s expiring affection—was handed her without any card, she
wondered who had sent them and concluded they must have been ordered by
a man she knew.

Three years after leaving college Miss Hungerford married, much to her
friends’ surprise, and a year after that she and her husband went abroad. Of
course they went to Paris, where Mrs. Stanhope, who had spent much time
there after leaving college, had a great many friends, and innumerable
dinners were given to them and they enjoyed themselves very much, until it
got so cold that Mrs. Stanhope said she must go to Cannes. Of course it
immediately struck Stanhope, who adored his wife, that it was entirely too
cold to stay in Paris, and so they went south, though their friends made a
great fuss over their departure.
They stayed away much longer than they had intended, having been
enticed into going to Malta by some American acquaintances, and when they
got back to Paris hundreds of interesting things seemed to have happened in
their absence, and a great many people and events were being talked about
of which they knew nothing. But the wife of the American minister, who
was an old friend, went to see Mrs. Stanhope immediately to invite her to an
informal dinner the next evening, and stayed the entire afternoon, telling her
of everything that had happened and who all the new people were—the New
American Beauty for instance. She could not believe that her friend had not
heard of nor seen the New Beauty.
“Why, haven’t you ever seen her pictures—and the notices of her?”
 Mrs. Stanhope was slightly aggrieved. She knew absolutely nothing about
her.
“And I am completely astonished that they aren’t talking of her at
Cannes.”
Mrs. Stanhope reminded her friend that she had been immured at Malta
since leaving the Riviera.
“Oh, well, of course her fame has reached there by this time. Why, all
Paris is talking about her—and you know yourself”—observed that astute
lady, impressively—“how much it takes to make Paris stop and look at you.”
Mrs. Stanhope said “Yes,” and wanted to know who The Beauty’s people
were, and where she had come from.
“Oh, I don’t know,” declared her friend. “No one seems to inquire. She is
so beautiful and sufficient in herself that one does not care much for the rest.
They are immensely rich—recently, I believe—though you would never
know it from her manner. She is charming and thoroughly well-bred. Her
father, I hear, is a typical American business man—not much en évidence,
you know. He leaves that to his daughter, and she does it very well. He is a
Senator—or something—from the West, and made such a name for himself
at Washington that they thought he was too bright to stay there, so they sent
him over here to help settle that international treaty affair—you know
perhaps—I don’t, I only pretend to.”
“How did she do it?” demanded Mrs. Stanhope, in that simply
comprehensive way women have when talking about another woman.
“Oh, she just started right in. Courtelais raved over her, and her father
paid him twenty thousand dollars to have her painted. The Colony took her
up, and the rest just followed naturally. The portrait is really charming,
though she was dressed—well, I don’t think any French girl would have sat
in that costume.”
“Is she really so beautiful?”
“Well—not regularly beautiful, perhaps—but charming and fascinating,
and awfully clever, they say—so clever that very few people suspect her of
it, and—oh! well, you can judge for yourself to-morrow evening. By the
way, everyone says she is engaged already—Comte de la Tour. You used to
know him, I think.” She rose to go. “He is very much in love with her, that is
evident.” She thought it best to let Mrs. Stanhope have that piece of news
from herself. She did not wish her friend to be taken at a disadvantage,
especially in her own house.
Mrs. Stanhope felt the least bit startled. She had known the Comte de la
Tour very well indeed in Paris, several years before, and he had been very
much in love with her, and had appeared quite genuinely broken-hearted
when she refused him. She had not seen him—he had not been in Paris when
she was there during the earlier part of the season—but with the comforting
faith of people who have never been in love, she had always believed that he
would get over his devotion to her, though she felt a rather curious sensation
on hearing that her expectations had been so fully realized, and she felt a
pardonable curiosity to see the girl who had made him forget her.
She dressed very carefully for the American Minister’s the next evening,
and looked a little more than her usual handsome self, when her carriage
turned rapidly into the Avenue Hoche. She was somewhat late, and although
the Minister and his wife were old friends, she felt worried with herself, for
she had made it a rule to be punctual at all social functions, and when she
entered the rooms she could see that the guests wore that rather expectant air
which signifies that dinner is already slightly behind time. She hurried
forward and denounced herself in polite fashion, but her hostess assured her
that several others had not yet arrived, and, much relieved, she turned to
speak to a bright newspaper man, an old acquaintance, who had arrived in
Paris during her absence.
“I am so glad to find you again,” he murmured in his drawl; “they tell me
you have been to Malta. How fortunate for you! I suppose now you have
been happy in an idyllic, out-of-the-world way, and have not heard a word
about Brice’s accident, nor the newspaper duel, nor the New Beauty——”
“But I am not happy, and shall not be until I see your Beauty,” protested
Mrs. Stanhope. “I’ve heard about her until I have an all-devouring curiosity
to behold her. I haven’t even seen the portrait, or a photograph!”
He fell away from her in mock surprise and despair, and was about to
reply, when the portières were drawn aside and Mrs. Stanhope saw coming
into the room a very beautiful young girl, with a rather childish, mobile face,
and magnificent eyes. She seemed to know everyone, and bowed and smiled
right and left in an easy, bright sort of way. Mrs. Stanhope would have
known this was The Beauty, even if her entrance had not been accompanied
by that significant hush and rather ridiculous closing up of the men in her
wake. There was a special charm about the soft contour of her face, and the
heavy white satin of her gown, though rather old for such a young girl, set
off her beauty admirably.
“Looks just like one of Goodrich’s girls, doesn’t she?” murmured the man
at Mrs. Stanhope’s elbow. But that lady was not paying any attention to his
remarks. She was looking in a puzzled fashion at the girl’s face, and
wondering what there was about it so familiar.
“Isn’t she deliciously beautiful?” he insisted, “and clever! I found it out
quite by accident. She’s very careful about letting people know how well
informed she is. She’s been to a college somewhere,” he ran on. Mrs.
Stanhope was not listening. She was still looking, in a rather abstracted way,
at the young girl who was holding a little court on the other side of the room.
Her hostess rustled up.
“I am going to send my husband to bring The Beauty to you,” she said,
laughingly, and swept across the room. In a moment Mrs. Stanhope saw the
girl take the Minister’s arm, and, followed on the other side by the Comte de
la Tour, start toward her. For some inexplicable reason she felt annoyed, and
half wished to avoid the introduction. The newspaper man was interested.
Mrs. Stanhope had never posed as a professional beauty, and she was too
noble a woman to have her head turned by flattery, but that did not alter the
fact that she had been considered the handsomest woman in the American
colony at Paris, and, of course, she knew it. He thought it would be
interesting to see how the acknowledged beauty received the younger one.
When the two women were within a few feet of each other, and before the
American Minister could say “Mrs. Stanhope,” they each gave a little cry of
recognition, and it was the younger one who first regained her composure
and extended her hand. She stood there, flushed and smiling, the lights
falling on her dark hair and gleaming shoulders, making of her, as the
newspaper man had said, one of “Goodrich’s girls.” The childish look had
gone out of her eyes, and a little gleam of conscious triumph was in them.
There was just a shade of coldness, almost of condescension, in her manner.
While the Comte was looking from one to the other, in a rather mystified
way, and the American Minister was saying, “Why, I didn’t know—I
thought—” Mrs. Stanhope’s mind was running quickly back to her first
meeting with the girl before her, and she could only remember, in a confused
sort of way, what this girl had once been like. And so they stood for a
moment—it seemed an interminably long time to the men—looking a little
constrainedly at each other and smiling vaguely. But the older woman
quickly recovered herself. She had no notion of being outdone

WHEN THE TWO WOMEN WERE WITHIN A FEW FEET OF EACH

OTHER

by the girl before her, and spoke brightly.

“I did not recognize you! How stupid of me! But you see the ‘Beatrice’
confused me, and then the French way everyone has of pronouncing H-a-r-
m-ö-n completely put me off the track!”
She tried to be very friendly, and the young girl smiled and looked easily
—the newspaper man thought almost defiantly—at her, but it was plain to
the three onlookers that in some inscrutable way the meeting had been
unfortunate, and they each felt relieved, in an inexplicable fashion, when
dinner was announced and the snowy, gleaming length of damask and silver
and wax lights stretched between the two women.
. . . . . . .
 That night the Comte thought a good deal about the reception of his
fiancée by the woman he had once loved, and decided that the American
woman was a trifle exigeante, and wondered whether Mrs. Stanhope had
really expected him never to marry.
The American Minister confided to his wife that he was disappointed in
Eva Stanhope, and that she had always appeared so free from vanity and so
superior to the little meannesses of women that he was very much surprised
at the way she had acted.
The newspaper man, being exceedingly wise in his generation, smoked
three cigars over it on the way to his hotel, and then—gave it up.
 THE GENIUS OF BOWLDER BLUFF

M ISS ARNOLD found him wandering aimlessly, though with a pleased,

interested look, around the dimly lit College Library. She had gone
there herself to escape for a few moments from the heat and lights and
the crowd around the Scotch celebrity to whom the reception was being
tendered, and was looking rather desultorily at an article in the latest Revue
des Deux Mondes, when he emerged from one of the alcoves and stood
hesitatingly before her. She saw that he was not a guest. He was not in
evening dress—it occurred to her even then how entirely out of his element
he would have looked in a conventional dress-suit—but wore new clothes of
some rough material which fitted him badly. He was so evidently lost and so
painfully aware of it that she hastened to ask him if she could do anything
for him.
“I’m lookin’ fur my daughter, Ellen Oldham,” he said, gratefully. “Do
you know her?”
He seemed much surprised and a little hurt when Miss Arnold shook her
head, smilingly.
“You see, there are so many——” she began, noting his disappointed
look.
“Then I s’pose you can’t find her fer me. You see,” he explained, gently,
“I wrote her I wuz comin’ ter-morrer, an’ I came ter-night fur a surprise—a
surprise,” he repeated, delightedly. “But I’m mighty disappointed not ter find
her. This is the first time I ever wuz so fur east. But I hed to see Ellen—
couldn’t stan’ it no longer. You see,” he continued, nervously, “I thought
mebbe I could stay here three or four days, but last night I got a telegram
from my pardner on the mountain sayin’ there wuz trouble among the boys
an’ fur me ter come back. But I—I jest couldn’t go back without seein’
Ellen, so I came on ter-night fur a surprise, but I must start back right off, an’
I’m mighty disappointed not ter be seein’ her all this time. Hed no idea yer
college wuz such a big place—thought I could walk right in an’ spot her,” he
ran on meditatively—“I thought it wuz something like Miss Bellairs’s an’
Miss Tompkins’s an’ Miss Rand’s all rolled inter one. But Lord! it’s a sight
bigger’n that! Well, I’m glad of it. I’ve thought fur years about Ellen’s
havin’ a college eddication, an’ I’m glad to see it’s a real big college. Never
hed no schoolin’ myself, but I jest set my heart on Ellen’s havin’ it. Why
shouldn’t she? I’ve got ther money. Hed to work mighty hard fur it, but I’ve
got it, an’ she wanted ter come to college, and I wanted her to come, so of
course she came. I met another young woman,” he continued, smiling
frankly at the girl before him; “she wasn’t so fine-lookin’ as you, but she
was a very nice young woman, an’ she promised to send Ellen ter me, but
she hasn’t done it!”
Miss Arnold felt a sudden interest in the old man.
“Perhaps,” she began, doubtfully, “if you could tell me what her class is,
or in what building she has her rooms, I might find her.”
He looked at the young girl incredulously.
“Ain’t you never heard of her?” he demanded. “Why, everybody knew
her at Miss Bellairs’s. But p’r’aps”—in a relieved sort of way—“p’r’aps you
ain’t been here long. This is Ellen’s second year.”
Miss Arnold felt slightly aggrieved. “I am a Senior,” she replied, and then
added courteously, “but I am sure the loss has been mine.”
She could not make this man out, quite—he was so evidently
uncultivated, so rough and even uncouth, and yet there was a look of quiet
power in his honest eyes, and he was so unaffectedly simple and kindly that
she instinctively recognized the innate nobility of his character. She felt
interested in him, but somewhat puzzled as to how to continue the
conversation, and so she turned rather helplessly to her magazine.
But he came over and stood beside her, looking down wonderingly at the
unfamiliar words and accents.
“Can you read all that?” he asked, doubtfully.
Miss Arnold said “Yes.”
“Jest like English?” he persisted.
She explained that she had had a French nurse when she was little, and
afterward a French governess, and that she had always spoken French as she
had English. He seemed to be immensely impressed by that and looked at
her very intently and admiringly, and then he suddenly looked away, and
said, in a changed tone:
“I never hed no French nurse fur Ellen. Lord! it wuz hard enough to get
any kind in them days,” he said, regretfully. “But she’s been studyin’ French
fur two years now—p’rhaps she speaks almost as good as you do by this
time—she’s mighty smart.”
Miss Arnold looked up quickly at the honest, kindly face above her with
the hopeful expression in the eyes, and some sudden impulse made her say,
quite cheerfully and assuringly, “Oh, yes—of course.”
She was just going to add that she would go to the office and send
someone to look for Miss Oldham, when a slender, rather pretty girl passed
the library door, hesitated, peering through the half-light, and then came
swiftly toward them.
With a cry of inexpressible tenderness and delight the old man sprang
toward her.
“Ellen!” he said, “Ellen!”
She clung to him for a few moments and then drew off rather shyly and
awkwardly, with a sort of mauvaise honte which struck disagreeably on Miss
Arnold, and looked inquiringly and almost defiantly from her father to the
girl watching them.
“This young woman,” he said, understanding her unspoken inquiry, “has
been very kind to me, Ellen—we’ve been talkin’.”
Miss Arnold came forward.
“I think we ought to be friends,” she said, graciously. “I am Clara Arnold.
Your father tells me this is your Sophomore year.”
The girl met her advances coldly and stiffly. She had never met Miss
Arnold before, but she had known very well who she was, and she had
envied her, and had almost disliked her for her good looks and her wealth
and her evident superiority. She comprehended that this girl had been born to
what she had longed for in a vague, impotent way, and had never known.
She wished that Miss Arnold had not witnessed the meeting with her father
—that Miss Arnold had not seen her father at all. And then, with the shame
at her unworthy thoughts came a rush of pity and love for the man standing
there, smiling so patiently and so tenderly at her. She put one hand on his
arm and drew herself closer to him.
“Father!” she said.
Miss Arnold stood looking at them, turning her clear eyes from one to the
other. It interested her tremendously—the simple, kindly old man, in his
rough clothes, and with his homely talk and his fatherly pride and happiness
in the pretty, irresolute-looking girl beside him. It occurred to her suddenly,
with a thrill of pity for herself, that she had never seen her father look at her
in that way. He would have been inordinately surprised and—she felt sure—
very much annoyed, if she had ever kissed his hand or laid her head on his
arm as this girl was now doing. He had been an extremely kind and
considerate father to her. It struck her for the first time that she had missed
something—that after providing the rather pretentiously grand-looking
house and grounds, and the servants and carriages and conservatories, her
father had forgotten to provide something far more essential. But she was so
much interested in the two before her that she did not have much time to
think of herself. She concluded that she did not want to go back to the
Scotch celebrity, and resolutely ignored the surprised looks of some of her
friends who passed the library door and made frantic gestures for her to
come forth and join them. But when they had moved away it occurred to her
that she ought to leave the two together, and so she half rose to go, but the
man, divining her intention, said, heartily:
“Don’t go—don’t go! Ellen’s goin’ to show me about this big college, an’
we want you to go, too.”
He was speaking to Miss Arnold, but his eyes never left the girl’s face
beside him, while he gently stroked her hair as if she had been a little child.
And so they walked up and down the long library, and they showed him
the Milton shield, and dragged from their recesses rare books, and pointed
out the pictures and autographs of different celebrities. He seemed very
much interested and very grateful to them for their trouble, and never
ashamed to own how new it all was to him nor how ignorant he was, and he
did not try to conceal his pride in his daughter’s education and mental
superiority to himself. And when Miss Arnold realized that, she quietly
effaced herself and let the younger girl do all the honors, only helping her
now and then with suggestions or statistics.
“You see,” he explained, simply, after a lengthy and, as it seemed to Miss
Arnold, a somewhat fruitless dissertation on the splendid copy of the
“Rubaiyat” lying before them—“you see I don’t know much about these
things. Never hed no chance. But Ellen knows, so what’s the use of my
knowin’? She can put her knowledge to use; but, Lord! I couldn’t if I hed it.
“You see it was like this,” he continued, cheerfully, turning to Miss
Arnold, while the girl at his side raised her head for an instant and uttered a
low exclamation of protest. “We lived out West—in a minin’ camp in
Colorado—Bowlder Bluff wuz its name. Awfully lonesome place. No
schools—nothin’, jest the store—my store—an’ the mines not fur off. Ellen
wuz about twelve then”—he turned inquiringly to the girl, but she would not
look up—“about twelve,” he continued, after a slight pause, and another
gentle caress of the brown hair; “an’ I hedn’t never given a thought to
wimmen’s eddication, an’ Ellen here wuz jest growin’ up not knowin’ a
thing—except how I loved her an’ couldn’t bear her out of my sight” (with
another caress), “when one day there came to ther camp a college chap. He
wuz an English chap, an’ he wuz hard-up. But he wuz a gentleman an’ he’d
been to a college—Oxford wuz the name—an’ he took a heap of notice of
Ellen, an’ said she wuz mighty smart—yes, Ellen, even then we knew you
wuz smart—an’ that she ought to have schoolin’ an’ not run aroun’ the camp
any more. At first I didn’t pay no attention to him. But by an’ by his views
did seem mighty sensible, an’ he kep’ naggin at me. He used to talk to me
about it continual, an’ at night we’d sit out under the pines and talk—he with
a fur-away sort of look in his eyes an’ the smoke curlin’ up from his pipe—
an’ he’d tell me what eddication meant to wimmen—independence an’
happiness an’ all that, an’ he insisted fur Ellen to go to a good school. He
said there wuz big colleges fur wimmen just like there wuz fur men, an’ that
she ought to have a chance an’ go to one.
“An’ then he would read us a lot of stuff of evenin’s—specially poetry.
Shelley in particular. And yet another chap, almost better’n Shelley. Keats
wuz his name. P’rhaps you’ve read some of his poetry?” he inquired, turning
politely to Miss Arnold. Something in her throat kept her from speaking, so
she only lowered her head and looked away from the drawn, averted face of
the girl before her. “He wuz great! All about gods an’ goddesses an’ things
one don’t know much about; but then, as I take it, poetry always seems a
little fur off, so it wuz kind of natural. But Shelley wuz our favorite. He used
to read us somethin’ about the wind. Regularly fine—jest sturred us up, I can
tell you. We knew what storms an’ dead leaves an’ ‘black rain an’ fire an’
hail’ wuz out on them lonesome mountains. An’ sometimes he’d read us
other things, stories from magazines, an’ books, but it kind of made me feel
lonesomer than ever.
“But Ellen here, she took to it all like a duck to water, an’ the college
chap kep’ insistin’ that she ought to go to a good school, an’ that she showed
‘great natural aptitude’—them wuz his words—an’ that she might be famous
some day, till at last I got regularly enthusiastic about wimmen’s eddication,
an’ I jest determined not to waste any more time, an’ so I sent her to Miss
Bellairs’s at Denver. She wuz all I hed, an’ Lord knows I hedn’t no particular
reason to feel confidence in wimmen folks”—a sudden, curious, hard
expression came into his face for a moment and then died swiftly away as he
turned from Miss Arnold and looked at the girl beside him. “But I sent her,
an’ she ain’t never been back to the camp, an’ she’s been all I ever hoped
she’d be.”
They had passed from the faintly lighted library into the brilliant
corridors, and the man, towering in rugged strength above the two girls, cast
curious glances about him as they walked slowly along. Everything seemed
to interest him, and when they came to the Greek recitation-rooms he
insisted, with boyish eagerness, upon going in, and the big photogravures of
the Acropolis and the charts of the Ægean Sea, and even a passage from the
“Seven against Thebes” (copied upon the walls doubtless by some unlucky
Sophomore), and which was so hopelessly unintelligible to him, seemed to
fascinate him. And when they came to the physical laboratories he took a
wonderful, and, as it seemed to Miss Arnold, an almost pathetic interest in
the spectroscopes and Ruhmkorff coils, and the batteries only half-
discernable in the faintly flaring lights.
And as they strolled about he still talked of Ellen and himself and their
former life, and the life that was to be—when Ellen should become famous.
For little by little Miss Arnold comprehended that that was his one fixed
idea. As he talked, slowly it came to her what this man was, and what his life
had been—how he had centred every ambition on the girl beside him,
separated her from him, at what cost only the mountain pines and the stars
which had witnessed his nightly struggles with himself could tell; how he
had toiled and striven for her that she might have the education he had never
known. She began to understand what “going to college” had meant to this
girl and this man—to this man especially. It had not meant the natural ending
of a preparatory course at some school and a something to be gone through
with—creditably, if possible, but also, if possible, without too great exertion
and with no expectation of extraordinary results. It had had a much greater
significance to them than that. It had been regarded as an event of
incalculable importance, an introduction into a new world, the first distinct
step upon the road to fame. It had meant to them what a titled offer means to
a struggling young American beauty, or a word of approbation to an under-
lieutenant from his colonel, or a successful maiden speech on the absorbing
topic of the day, or any other great and wonderful happening, with greater
and more wonderful possibilities hovering in the background.
She began to realize just how his hopes and his ambitions and his belief
in this girl had grown and strengthened, until the present and the future held
nothing for him but her happiness and advancement and success. It was a
curious idea, a strange ambition for a man of his calibre to have set his
whole heart upon, and as Miss Arnold looked at the girl who was to realize
his hopes, a sharp misgiving arose within her and she wondered, with sudden
fierce pity, why God had not given this man a son.
But Ellen seemed all he wanted. He told, in a proud, apologetic sort of
way, while the girl protested with averted eyes, how she had always been
“first” at “Miss Bellairs’s” and that he supposed “she stood pretty well up in
her classes” at college. And Miss Arnold looked at the white, drawn face of
the girl and said, quite steadily, she had no doubt but that Miss Oldham was
a fine student. She was an exceptionally truthful girl, but she was proud and
glad to have said that when she saw the look of happiness that kindled on the
face of the man. Yet she felt some compunctions when she noted how simply
and unreservedly he took her into his confidence.
And what he told her was just such a story as almost all mothers and
fathers tell—of the precocious and wonderful intellect of their children and
the great hopes they have of them. But with this man it was different in some
way. He was so deeply in earnest and so hopeful and so tender that Miss
Arnold could scarcely bear it. “Ellen” was to be a poet. Had she not written
verses when she was still a girl, and had not the “college chap” and her
teachers declared she had great talents? Wait—he would let Miss Arnold
judge for herself. Only lately he had written to Ellen, asking her if she still
remembered their lonely mountain-home, and she had sent him this. They
had strolled down the corridor to one of the winding stairways at the end. He
drew from his large leather purse a folded paper. The girl watched him open
it with an inexpressible fear in her eyes, and when she saw what it was she
started forward with a sort of gasp, and then turned away and steadied
herself against the balustrade.
He spread out the paper with exaggerated care, and read, with the
monotonously painful intonations of the unpractised reader:
 “Ye storm-winds of Autumn!
Who rush by, who shake
The window, and ruffle
The gleam-lighted lake;
Who cross to the hill-side
Thin sprinkled with farms,
Where the high woods strip sadly
Their yellow arms—
Ye are bound for the mountains!
Oh! with you let me go
Where your cold, distant barrier,
The vast range of snow,
Through the loose clouds lifts dimly
Its white peaks in air—
How deep is their stillness!
Ah! would I were there!”

As he read, Miss Arnold turned her eyes, burning with an unutterable

indignation and scorn, upon the girl, but the mute misery and awful
supplication in her face checked the words upon her lips. When he had
finished reading, Miss Arnold murmured something, she hardly knew what,
but he would not let her off so easily.
What did she think of it?—did she not think he ought to be proud of
Ellen? and was the “gleam-lighted lake” the lake they could see from the
piazza?
He ran on, taking it for granted that Miss Arnold was interested in his
hopes and dreams, and almost without waiting for or expecting replies. And
at last he told her the great secret. Ellen was writing a book. He spoke of it
almost with awe—in a suppressed sort of fashion. She had not told him yet
much about it, but he seemed wholly confident in its future success. He
wondered which of the big publishing houses would want it most.
Miss Arnold gave a quick gasp of relief. There was more to this girl, then,
than she had dared to hope. She glanced eagerly and expectantly toward her,
and in that one look she read the whole pitiable lie. Ellen was looking
straight ahead of her, and the hopeless misery and shame in her eyes Miss
Arnold never forgot. All the pretty, weak curves about the mouth and chin
had settled into hard lines, and a nameless fear distorted every feature. But
the man seemed to notice nothing, and walked on with head uplifted and a
proud, almost inspired look upon his rugged face.
“When will the book be finished, Ellen?” he asked, at length.
The girl looked up, and Miss Arnold noted with amazement her
wonderful control.
“It will not be very long now, father,” she replied. She was acting her
difficult part very perfectly. It occurred to Miss Arnold that for many years
this girl had been so acting, and as she looked at the strong, quiet features of
the man she shuddered slightly and wondered how it would be with her
when he knew.

When the carriage which was to take him to the station for the midnight
train into Boston had driven from the door, the two girls looked at each other
steadily for an instant.
“Come to my study for a few moments,” said the younger one,
imperiously. Miss Arnold acquiesced silently, and together they moved
down the long corridor to Miss Oldham’s rooms.
“I want to explain,” she began, breathlessly, leaning against the closed
door and watching with strained, wide-opened eyes Miss Arnold’s face,
upon which the light from the lamp fell strong and full.
“I want to explain,” she repeated, defiantly this time. “You had no right to
come between myself and my father! I wish with all my heart you had never
seen him, but since you have seen him I must explain. I am not entirely the
hypocrite and the coward you take me for.” She stopped suddenly and gave a
low cry. “Ah! what shall I say to make you understand? It began so long ago
—I did not mean to deceive him. It was because I loved him and he thought
me so clever. He thought because I was quick and bright, and because I was
having a college education, that I was—different. In his ignorance how
could he guess the great difference between a superficial aptitude and real
talents? How could I tell him—how could I,” with a despairing gesture, “that
I was just like thousands of other girls, and that there are hundreds right here
in this college who are my superiors in every way? It would have broken his
heart.” Her breath came in short gasps and the pallor of her face had changed
to a dull red.
Miss Arnold leaned forward on the table.
“You have grossly deceived him,” she said, in cold, even tones.
 “Deceived him?—yes—a thousand times and in a thousand ways. But I
did it to make him happy. Am I really to blame? He expected so much of me
—he had such hopes and such dreams of some great career for me. I am a
coward. I could not tell him that I was a weak, ordinary girl, that I could
never realize his aspirations, that the mere knowledge that he depended and
relied upon me weighed upon me and paralyzed every effort. When I loved
him so could I tell him this? Could I tell him that his sacrifices were in vain,
that the girl of whom he had boasted to every man in the mining camp was a
complete failure?”
She went over to the table and leaned her head upon her shaking hand.
“If my mother—if I had had a brother or sister, it might have been
different, but I was alone and I was all he had. And so I struggled on, half
hoping that I might become something after all. But I confessed to myself
what I could not to him, that I would never become a scholar, that my
intellect was wholly superficial, that the verses I wrote were the veriest trash,
that I was only doing what ninety-nine out of every hundred girls did, and
that ninety-eight wrote better rhymes than I. There is a whole drawerful of
my ‘poetry’ ”—she flung open a desk disdainfully—“until I could stand it no
longer, and one day when he asked me to write something about the
mountains, in desperation I copied those verses of Matthew Arnold’s. I knew
he would never see them. After that it was easy to do so again.” She stopped
and pressed her hands to her eyes.
“I am the most miserable girl that lives,” she said.
Miss Arnold looked at her coldly.
“And the book?” she said at length.
Miss Oldham lifted her head wearily.
“It was all a falsehood. He kept asking me if I were not writing a book.
He thought one had only to write a book to become famous. It seemed so
easy not to oppose the idea, and little by little I fell into the habit of talking
about ‘the book’ as if it were really being written. I did not try to explain to
myself what I was doing. I simply drifted with the current of his desires and
hopes. It may seem strange to you that a man like my father should have had
such ambitions, and stranger still that he should have ever dreamed I could
realize them. But one has strange fancies alone with one’s self out on the
mountains, and the isolation and self-concentration of the life give an