IoT Devices and Remotely Controlled Machines

3rd Engineer's Week of the School of Chemical Engineering and Mineral Industries at the University of Ngaoundere
Prof. Dr. Julius Schöning
27. November 2023

Osnabrück University of Applied Sciences - Faculty of Engineering and Computer Science

Internet of Things (IoT) of Non-Road Mobile Machinery

user interface / dashboard

mobile machinery / implements

data hub

measuring stations / sensors

infrastructure

creating digital value

3
Internet of Things (IoT) of Non-Road Mobile Machinery

user-machine interface

user interface / dashboard

mobile machinery / implements

data hub

measuring stations / sensors

infrastructure

creating digital value

4
Multiple IoT Devices and Machines
challenges of remote operations
Multiple Machines, One Operator – The Use Case
Today – One Machine; One Operator Tomorrow – Multiple Machines; One Operator

https://www.claas.de/unternehmen/historie/products/combines/lexion
Multiple Machines, One Operator – The UI
Today – One Machine; One Operator Tomorrow – Multiple Machines; One Operator

?
https://www.claas.de/unternehmen/historie/products/combines/lexion
One Machine and Multiple IoT, One Operator – The Use Case

…
Multiple Machine and Multiple IoT, One Operator – The Use Case
UI / UX Considerations – Multiple IoT Devices and Machines

compressed information presentation

clear identification of which machine and IoT is being operated / displayed

easy definition of the common objective, i.e. the goal of all machines and IoTs

consider different working modes – mirroring, master-slave, task sharing etc.

easy coupling and uncoupling of single machines and IoTs

10
Situational Awareness and Convenience
IoT for remote monitoring and control of machines
Situational Awareness and Convenience – The Use Cases

DON‘T PANIC

DON‘T DON‘T
PANIC PANIC

https://newmobility.news/wp-content/uploads/2019/01/Unknown-1-960x640.jpeg / https://www.flaticon.com/free-icon/moose_185747
https://www.zeit.de/hamburg/2019-03/lkw-unfaelle-radfahrer-abbiegeassistent-toter-winkel-schuld
Situational Awareness and Convenience – The UI

emergency situation — deer

ahead of the driverless vehicle

ambient light HMI—signaling

passengers that the situation is
recognized

tactile HMI—preparing passengers

for evasive maneuvers
T. M. Yekta and J Schöning, Keep Calm and Relax — HMI for Self-Driving Vehicles (under Review)
13
Situational Awareness and Convenience – The UI

Schöning, J., Kettler, J., Jäger, M. I., & Gunia, A. (2023). Grand Theft Auto-based cycling simulator for cognitive enhancement technologies in dangerous traffic situations. Sensors, 23(7), 3672.
14
UI / UX Considerations – Situational Awareness and Convenience

Yekta, T. M. & Schöning, J. (under review) Keep Calm and Relax — HMI for Self-Driving Vehicles
15
Increased Safety by IoT
fuse IoT-based information by intuitive UX concepts
Increased Safety by IoT

user-machine interface

user interface / dashboard

mobile machinery / implements

data hub

measuring stations / sensors

infrastructure

creating digital value

20
safety
UI / UX Considerations – Increased Safety by IoT

operator

task

Schöning, J., Kettler, J., Jäger, M. I., & Gunia, A. (2023). Grand Theft Auto-based cycling simulator for cognitive enhancement technologies in dangerous traffic situations. Sensors, 23(7), 3672.
21
Setup of the Olfactory UI for Usability Tests

Schöning, J., Diers, J., Lindner, D., & Pafeld, T. (2021). Olfactory UIs - New Possibilities for Displaying System and Application States
https://doi.org/10.1007/978-3-030-98012-2_50
Olfactory UIs – Displaying System and Application States

success (8) – hot apple pie

information (6) – garden mint
warning (4) – Japanese cypress
error (3) – black peper
alert (1) – gundpowder

Schöning, J., Diers, J., Lindner, D., & Pafeld, T. (2021). Olfactory UIs - New Possibilities for Displaying System and Application States
https://doi.org/10.1007/978-3-030-98012-2_50 23
Keeping Operators Awake
non-distracting and non-tiring secondary tasks for
operators of highly automated machines
Keeping Operators Awake
attention of workload for
the users the users no more user
required

secondary tasks
needed

level of
non partial full automation

25
Considerations – Non-Distracting and Non-Tiring Secondary Tasks

Instrument Monitoring: fuel tank level, charge state, machine temperature etc. (visual)

Environmental Observations: weather, soil condition, etc. (visual)

Communication: telephone service / call-center (auditive) / social media (visual)

Documentation: invoicing, construction documentation, etc. (visual)

Safety Checks: safety protocols and dead man switch (multi sensory)

26
Q? Prof. Dr. Julius Schöning
j.schoening@hs-osnabrueck.de

A! Publications
0000-0003-4921-5179

Research Gate

Homepage

31