Professional Documents
Culture Documents
Aoa Training
Aoa Training
Configuration Training
Document Modification History
This document contains proprietary information of Schneider Electric, and neither the document
nor said proprietary information shall be published, reproduced, copied, disclosed or used, in
whole or in part, for any purpose other than consideration of this document without the express
written permission of a duly authorized representative of the said company.
Contents
Chapter 1: Introduction to EcoStruxure™ Augmented Operator Advisor .................................... 9
What is EcoStruxure™ Augmented Operator Advisor ...................................................................... 10
EcoStruxure™ Augmented Operator Advisor Architecture .............................................................. 11
EcoStruxure™ Augmented Operator Advisor Examples of Use ........................................................ 12
Licensing ............................................................................................................................................ 13
Chapter 2: The Builder .............................................................................................................. 17
What is EcoStruxure™ Augmented Operator Advisor Builder .......................................................... 18
Prerequisites to Start Building a Project ........................................................................................... 19
Getting Started.................................................................................................................................. 20
EcoStruxure™ Augmented Operator Advisor Builder User Interface ............................................... 21
Chapter 3: Projects, Areas and Scenes ...................................................................................... 27
Key Concepts ..................................................................................................................................... 28
Projects ............................................................................................................................................. 29
Areas ................................................................................................................................................. 31
Scenes ............................................................................................................................................... 32
Why the Split Between Projects, Areas and Scenes?........................................................................ 33
Limitations ........................................................................................................................................ 34
Chapter 4: Points of Interest ..................................................................................................... 43
What is a Point of Interest? .............................................................................................................. 44
Types of Points of Interest ................................................................................................................ 45
Chapter 5: Building a Project ..................................................................................................... 53
Building a Project .............................................................................................................................. 54
Deploying a Project ........................................................................................................................... 55
Chapter 6: The App ................................................................................................................... 61
What is EcoStruxure™ Augmented Operator Advisor App ............................................................... 62
Using the App .................................................................................................................................... 63
App’s User Interface ......................................................................................................................... 64
Chapter 7: Subscenes ................................................................................................................ 69
What is a Subscene? ......................................................................................................................... 70
Chapter 8: Triggers .................................................................................................................... 77
What is a Trigger? ............................................................................................................................. 78
Chapter 9: The Runtime Software ............................................................................................. 83
What is EcoStruxure™ Augmented Operator Advisor Runtime........................................................ 84
EcoStruxure™ Augmented Operator Advisor Manager .................................................................... 85
Node-RED .......................................................................................................................................... 86
EcoStruxure Operator Terminal Expert / BLUE ................................................................................. 87
Chapter 10: Procedures ............................................................................................................... 93
What are Procedures? ...................................................................................................................... 94
Procedure Limitations ....................................................................................................................... 96
Chapter 11: The Manager .......................................................................................................... 105
What is the Manager?..................................................................................................................... 106
Users Management......................................................................................................................... 107
Node-RED Management ................................................................................................................. 108
Notes Management ........................................................................................................................ 109
Procedures Management ............................................................................................................... 110
Chapter 12: Image Recognition and Tracking ............................................................................ 115
Image or Tags, Which One to Use? ................................................................................................. 116
Guidelines for Taking Photographs ................................................................................................. 119
Image Limitations ............................................................................................................................ 120
Appendix A: Node-RED ................................................................................................................. 123
What is Node-RED? ......................................................................................................................... 124
Nodes and Flows ............................................................................................................................. 125
Safety Information
PLEASE NOTE
Electrical equipment should be installed, operated, serviced, and
maintained only by qualified personnel. No responsibility is
assumed by Schneider Electric for any consequences arising out of
the use of this material.
A qualified person is one who has skills and knowledge related to
the construction and operation of electrical equipment and its
installation, and has received safety training to recognize and avoid
the hazards involved.
DISCLAIMER
Schneider Electric makes no representations or warranties with respect to this manual and, to the maximum extent permitted by law,
expressly limits its liability for breach of any warranty that may be implied to the replacement of this manual with another. Furthermore,
Schneider Electric reserves the right to revise this publication at any time without incurring an obligation to notify any person of the
revision.
The information provided in this documentation contains general descriptions and/or technical characteristics of the performance of the
products contained herein. This documentation is not intended as a substitute for and is not to be used for determining suitability or
reliability of these products for specific user applications. It is the duty of any such user or integrator to perform the appropriate and
complete risk analysis, evaluation and testing of the products with respect to the relevant specific application or use thereof. Neither
Schneider Electric nor any of its affiliates or subsidiaries shall be responsible or liable for misuse of the information that is contained herein.
If you have any suggestions for improvements or amendments or have found errors in this publication, please notify us.
All pertinent state, regional, and local safety regulations must be observed when installing and using this product. For reasons of safety and
to help ensure compliance with documented system data, only the manufacturer should perform repairs to components.
When devices are used for applications with technical safety requirements, the relevant instructions must be followed.
Failure to use Schneider Electric software or approved software with our hardware products may result in injury, harm, or improper
operating results.
Failure to observe this information can result in injury or equipment damage.
© 2018 Schneider Electric. All rights reserved.
The contents of this manual are proprietary to Schneider Electric and all rights, including copyright, are reserved by Schneider Electric. No
part of this document may be reproduced in any form or by any means, electronic or mechanical, including photocopying, without express
written permission of Schneider Electric.
EcoStruxure™ Augmented Operator Advisor Configuration Training Manual
Satisfactory completion of the course evaluation is mandatory for you to obtain a Schneider Electric certificate of completion of the training
course.
Schneider Electric will not accept any liability for action taken in reliance on this training manual.
TRADEMARKS
Schneider Electric has made every effort to supply trademark information about company names, products and services mentioned in this
manual. Trademarks shown below were derived from various sources.
EcoStruxure™, EcoStruxure™ Augmented Operator Advisor are trademarks owned by Schneider Electric or its affiliated companies. All
other trademarks are the property of their respective owners.
Excel and Windows are either registered trademarks or trademarks of Microsoft® Corporation in the United States and/or other countries.
VirtualBox is a registered trademark of Oracle Corporation in the United States and other countries.
Some product names used in this manual are used for identification purposes only and may be trademarks of their respective companies.
Validity Note
The present documentation is intended for qualified technical personnel responsible for the implementation, operation and maintenance of
the products described. It contains information necessary for the proper use of the products.
About Us
Members of Schneider Electric’s team of Instructional Designers have tertiary qualifications in Education, Educational Course Development
and are also experienced Instructors. Currently, the team is supporting a range of Schneider Electric courses in multiple languages and
multiple software environments.
Authors
Contributors
Arvin Pitt
Creation Date:
15 October 2018
Course Overview
Course Objectives By the completion of this training course the student will:
Be able to create a EcoStruxure™ Augmented Operator Advisor
project
Understand best practices to take photographs to optimize image
recognition process
Scope of this This training manual is a supplement to the authorised training. To make
Training Manual proper use of the software, students should also refer to the documentation
that has been provided with the product such as the Help Files, User
Guides or Knowledge Base.
The graphics displaying screen captures were taken using the Windows®
10 operating system. If students are running a different version of
Windows, the screen images may differ slightly from those shown in the
training manual.
Some screen captures may have been taken from beta or earlier versions
of the software and may vary slightly from release screen captures.
Course Overview (cont.)
Course Program The training course will take two days to complete. The following
program outlines the topics that will be covered on each day:
Day Topic
Introduction to EcoStruxure™ Augmented
Operator Advisor
The Builder
Projects, Areas and Scenes
1
Points of Interest
Building a project
The App
Subscenes
Triggers
The Runtime Software
Procedures
2 The Manager
Image Recognition and Tracking
Node-RED Introduction
Course Assets For the training course, the following are also required:
8
Chapter 1: Introduction to EcoStruxure™ Augmented
Operator Advisor
Overview
Introduction EcoStruxure™ Augmented Operator Advisor is a solution proposed by
Schneider Electric based on Augmented Reality technology, which allows
the fusion of a real physical world with virtual objects, on a real scene.
This chapter will take an initial overview look at the product to set the
scene for the training.
By the completion of this chapter the student will be able to:
Describe the purpose of EcoStruxure™ Augmented Operator
Advisor
Launch the product
Contents
What is EcoStruxure™ Augmented Operator Advisor .......................... 10
EcoStruxure™ Augmented Operator Advisor Architecture .................. 11
EcoStruxure™ Augmented Operator Advisor Examples of Use ............ 12
Licensing ................................................................................................ 13
Tablet App The EcoStruxureTM Augmented Operator Advisor App is compatible with
iPads running iOS 11.2.5 or greater and Android tablets running OS V5.0
or greater.
The EcoStruxure™ Augmented Operator Advisor App does not require a
license. It is available from the application store of the tablet.
Learning
By the completion of this exercise you will be able to:
Outcome
Run the sample project available in EcoStruxure™ Augmented
Operator Advisor App.
1) Download and install the App on your tablet and run it.
2) Login to Sample projects from the Preferred sites page of the app. No
username or password will be needed.
3) Tap on Start after selecting the Water plant scene under Sample
folder.
Note:
The image gallery for sample projects is available for download from
Schneider Electric’s website. Ask your instructor to show you how to
access it.
6) Tap on the POI on top of the building flashing red. This is a subscene
and the image on the tablet will change.
Overview
Introduction The EcoStruxure™ Augmented Operator Advisor Builder is the
environment in which the user develops the project.
By the completion of this chapter the student will be able to:
Describe the purpose of EcoStruxure™ Augmented Operator
Advisor Builder
Understand the prerequisites to start creating a project with the
Builder.
Contents
What is EcoStruxure™ Augmented Operator Advisor Builder .............. 18
Prerequisites to Start Building a Project ............................................... 19
Getting started ...................................................................................... 20
EcoStruxure™ Augmented Operator Advisor Builder User Interface ... 21
Note:
These steps will be covered in more details in a later chapter.
Start Building When all prerequisites are met and the images are available, start using
EcoStruxure™ Augmented Operator Advisor Builder to create a project.
Learning
By the completion of this exercise you will be able to:
Outcome
Create an account to login with EcoStruxure™ Augmented Operator
Advisor Builder.
Note:
For Schneider Electric employees it is possible to login by clicking on the
icon.
7) You will now be able to login, and a pop up window will ask for a
license Activation ID. If you do not have one, click on Start Trial and
launch the builder.
8) After login, examine the User Interface of the Builder and get familiar
with the different menus and options available.
Overview
Introduction Projects, Areas and Scenes are essential parts of a EcoStruxure™
Augmented Operator Advisor project. These are created and configured
using the Builder.
By the completion of this chapter the student will be able to:
Create a new project
Configure a new area in the project
Configure a new scene within an area
Contents
Key Concepts ......................................................................................... 28
Projects ................................................................................................. 29
Note:
The number of areas you can monitor depends on the type of license you
purchase.
New Project After being signed up, logged in and having a first look at the
Creation EcoStruxure™ Augmented Operator Advisor Builder user interface you
can now start creating your first project.
In this course, we will create a project using the water plant image demo
available on: www.schneider-electric.com.
This image can be downloaded from the EcoStruxure™ Augmented
Operator Advisor web page or alternatively it can be provided by your
instructor.
On the Project Toolbar menu, you must click on Create a new project to
start.
How to Create a On the Project Toolbar menu, click on Create a new project to start.
New Project
Backup / Restore You can make a backup of your project on your local device using the
icon. At a later time, you can use this backup to restore your project
into the EcoStruxure™ Augmented Operator Advisor Builder. Backups
can be encrypted using a password.
The backup / restore function is only available when you have activated an
EcoStruxure™ Augmented Operator Advisor Builder license.
When the Backup / Restore function is launched, a window is displayed as
example below:
How to Create a On the Contextual Toolbar menu, you must click on the Area icon
New Area
How to Create a On the tabs menu, you can select the Scenes tab, highlight the area you are
New Scene
working with and click on the scene icon to create a new scene.
Points of Interest
Element Maximum Number
Scenes
Element Maximum Number
Scenes in a project 100(1)
Subscene levels 1
Subscenes in a scene 10
2D images in a project 100
Tags in a project 100
Characters in labels/names 50
Characters in descriptions 255
(1) 100 images in 1 scene, or 100 scenes with 1 image
Learning
By the completion of this exercise you will be able to:
Outcome
Create a new project with the Builder.
3) Select a language and click the ‘+’ sign to add it to the project. More
languages can be added if required.
5) Click Validate.
You will be warned about not being able to change the reference
language later. Agree by clicking Yes.
Note:
There is an in-built translator in case the project needs to be translated into
one of the selected languages from the reference language.
Learning
By the completion of this exercise you will be able to:
Outcome
Create a new area within your project.
3) Notice the left sidebar. The tree structure of the project has changed.
You also should have access to these items from the main window.
Learning
By the completion of this exercise you will be able to:
Outcome
Create a new scene within an area of your project.
2) Highlight the area you are working with on the left sidebar tree
structure menu.
3) Click on the Scene icon from the Toolbar menu to start configuring a
new scene.
4) You will be prompted to fill in some information about the scene. The
Scene type will be Image Recognition.
5) Give the scene a label, in this example, we can use Water Plant.
Note:
The file formats supported for the images are .PNG or .JPG and they must
have a maximum of 2MB data size.
7) Once the information is provided and the image chosen, the right
sidebar will look like this, and you can now click on Validate.
8) You will see the image placed on the main window and your new
scene populated on the tree structure menu on the left sidebar of
the page.
Overview
Introduction Points of Interest are used to display information on the screen of the
tablet for the operator.
By the completion of this chapter the student will be able to:
Understand what is a Point of Interest
Create Points of Interest in your project
Contents
What is a Point of Interest? .................................................................. 44
Types of Points of Interest .................................................................... 45
Note:
EcoStruxure™ Augmented Operator Advisor Builder variable names must
be exactly the same as the variable names defined in EcoStruxure
Operator Terminal Expert or Node-RED.
Note:
Storing too many documents locally can fill up the tablet storage.
External App The App is launched when the operator taps the POI.
Any external app can be launched on the tablet screen from the point of
interest, as long as the app provides a Uniform Resource Identifier (URI)
path type.
This is used to point to an object such as a file, and defines which
application is used to open it.
The use of external apps may require the installation of third party
applications.
Below is an example of a URL used to open the e-mail app and send an e-
mail to a defined recipient.
mailto:toto@toto.fr?subject=test&body=test_mail_content
Learning
By the completion of this exercise you will be able to:
Outcome
Create a new point of interest within a scene.
1) Drag and drop the List POI icon from the toolbar menu on
the scene image.
2) You will see a new POI on the image, and some information being
requested on the right sidebar. Give this POI a title, such as
Pump_house, and click on Configure Information.
Note:
If you uncheck the Show checkbox, that means a trigger condition will
need to be configured for the POI to appear on the tablet screen.
The Keep opened checkbox is used to configure whether the list’s
content will be already open once the image is recognized on the tablet
screen, or if the operator will need to click the POI in order to view its
content.
The Security Level field is used to manage which users will have access to
this POI, this will be explained later in this course.
3) You should now see the POI with its title on your image, and new
information being requested on the right sidebar. This means you are
now able to configure the first item on this List.
4) Note that you can configure this item as any POI type. In this
example, give it a label such as Water_Pumping, and leave the type
as Text, and then click on Validate.
Note:
If you wish to delete an item from the list POI, click on the icon.
If you wish to create a new item on the list POI, click on the icon.
https://www.google.com/maps/place/CERN/@46.2351762,6.039288
9,15z/data=!3m1!4b1!4m5!3m4!1s0x478c62fcec737b11:0x81bef3ae
7a885e31!8m2!3d46.234032!4d6.052951
8) Add a third item to the List POI, this time make it a Document type.
Use the file AOA_QSG.pdf given with the course resources.
Overview
Introduction This chapter will show how to build and deploy a project.
By the completion of this chapter the student will be able to:
Build a project
Deploy the built project locally in your tablet
Contents
Building a Project .................................................................................. 54
Deploying a Project ............................................................................... 55
How to Build a On the project toolbar menu, you must click on the Build Project icon.
Project
Download the After the project is built, it must be downloaded to your computer. A .zip
Project file is generated containing all the project’s data.
The content of the .zip file must be deployed to your Runtime Device.
It can also be deployed locally to your tablet.
Deploy Locally It is also possible to deploy the project locally, directly in the tablet. This
Option is mainly used for testing and demonstration purposes.
There are different methods to deploy the project to the tablet depending
on which tablet you are using.
For Android tablets, the access to the correct path can be done using
Windows Explorer, as if the tablet were a regular external hard drive.
For iOS tablets, iTunes must be used to copy the project to the correct
path in the tablet.
Learning
By the completion of this exercise you will be able to:
Outcome
Build a EcoStruxure™ Augmented Operator Advisor project.
Deploy a EcoStruxure™ Augmented Operator Advisor project to a
tablet.
1) Click on the Build a project icon on the project toolbar.
2) You will be informed about what type of license is needed for the
Runtime. Click on Start Build.
3) After the process is finished, click on Download to save a .zip file that
is created containing all the project data.
4) This file will be named after the project’s name and current Builder
version.
Note:
You may need to access your tablet’s settings to give the app permission
to access the camera and data storage when you run it for the first time.
7) Run the EcoStruxure™ Augmented Operator Advisor App for the first
time and accept the Terms & Conditions.
8) Unzip the project file that has been built in the previous exercise.
9) Copy the unzipped project folder from your computer to the tablet.
The procedure is different for iOS and Android tablets.
• On Android tablets:
..\Tablet\Android\data\com.schneiderelectric.AugmentedOpe
rator\Local
• On IOS tablets:
..\Apps\EcoStruxure Augmented Operator
Advisor\Documents\Local
Note:
It is essential that you unzip the built project file, and copy the whole
folder to the tablet.
Note:
For iOS tablets, iTunes is needed to copy the folder. There are alternative
third-party software available to manage file transferring to iOS tablets.
Learning
By the completion of this exercise you will be able to:
Outcome
Deploy the project to an iPad using iTunes
5) Drag and drop the Local folder from your computer to iTunes.
Overview
Introduction This chapter will show how to use the app.
By the completion of this chapter the student will be able to:
Run a project with the EcoStruxure™ Augmented Operator
Advisor App
Get familiar with EcoStruxure™ Augmented Operator Advisor
App main features
Contents
What is EcoStruxure™ Augmented Operator Advisor App ................... 62
Using the App ........................................................................................ 63
App’s User Interface.............................................................................. 64
App Compatibility The EcoStruxureTM Augmented Operator Advisor App is compatible with
iPads running iOS 11.2.5 or greater and Android tablets running OS V5.0
or greater.
The EcoStruxure™ Augmented Operator Advisor App does not require a
license. It is available from the application store of the tablet.
Scene Recognition When you run a project with EcoStruxure™ Augmented Operator Advisor
App, it will trigger the algorithm to compare the perceived reality through
the tablet’s camera with the image database deployed to tablet or Run
Time device.
Once image recognition is achieved, a few of the app’s features can be
used.
Learning
By the completion of this exercise you will be able to:
Outcome
Run a local EcoStruxure™ Augmented Operator Advisor project.
2) You will be prompted for login, but since we have not yet created any
users, just click on Login without filling any username and password.
3) Under your project folder, navigate down to the Scenes section and
tap Start.
5) With the App’s User Interface started on your tablet, now you can
scan the image in your computer screen.
6) Experiment the different features available and get familiar with them.
Overview
Introduction This chapter will cover the subscene part of a project.
By the completion of this chapter the student will be able to:
Understand what is a subscene
Implement a subscene within a project
Contents
What is a Subscene? ............................................................................. 70
Chapter 7 – Subscenes 69
What is a Subscene?
Overview A subscene is a type of point of interest that appears in a scene. When the
operator clicks the subscene point of interest on the tablet, an image is
displayed. This image could be, for example, an electrical cabinet with the
doors opened, or a zoomed-in view of part of the scene.
Points of interest can be added to a subscene in the same way as for a
scene.
Only one Subscene level is possible to be configured. Nested subscenes is
not possible.
How to Create a
Subscene
Under the Scenes tab, drag and drop the subscene icon on the
main scene.
70 Chapter 7 – Subscenes
Exercise – Create a Subscene
Learning
By the completion of this exercise you will be able to:
Outcome
Add a subscene to a scene.
1) Drag and drop the subscene icon to the scene where you
want the POI to appear in the image.
2) Fill in the information on the right sidebar as per the example below
and click Validate. Use the Pump_house.jpg image file provided with
the course resources.
Chapter 7 – Subscenes 71
Exercise – Create a Subscene
4) On the left sidebar you will notice the subscene has been populated
under the tree structure of your project.
5) You can now add Points of Interest to the subscene just as you do
with a scene.
72 Chapter 7 – Subscenes
Exercise – Create a Subscene
7) Fill in the information on the right sidebar . Make sure the Create
variable checkbox is selected so a new variable will be created.
Validate after filling the info as below.
Note:
The variable name must match the exact Folder name and Variable Name
from EcoStruxure Operator Terminal Expert or Pro-face Blue variables.
Chapter 7 – Subscenes 73
Exercise – Create a Subscene
9) Fill in its details on the right sidebar as below. Use the image file
Pump_Maintence.jpg provided with this course resources.
Uncheck the Show checkbox.
Note:
In the next chapter, you will implement a trigger to change the visibility of
this object on the tablet screen.
74 Chapter 7 – Subscenes
Exercise – Create a Subscene
10) Resize and adjust the image position on the subscene so it looks like
the example below and validate it.
Note:
Use the Zoom In / Zoom Out function on the Project Toolbar
menu to help with positioning the image properly on the screen.
Chapter 7 – Subscenes 75
Summary
Summary This chapter explained what is a subscene and how to configure it.
76 Chapter 7 – Subscenes
Chapter 8: Triggers
Overview
Introduction This chapter will cover the Triggers feature.
By the completion of this chapter the student will be able to:
Create a new Trigger
Deploy the project to a Run Time device
Contents
What is a Trigger? ................................................................................. 78
Chapter 8 – Triggers 77
What is a Trigger?
Overview A trigger contains one or more trigger conditions. A trigger condition
compares the current value of a variable to a specific value according to a
test condition and performs a specified action if the test condition is true.
For example, a point of interest could start flashing on the tablet whenever
the value of the Speed variable is less than 100.
Trigger Condition A trigger condition is a test performed on the value of a variable. If the
test result is “true”, the trigger actions are performed. If the test result is
“false”, nothing happens and the next trigger condition in the list is
evaluated.
How to Create a The Triggers menu is located under the project tree structure on the left
Trigger sidebar. After clicking on it, you can add a new trigger from the main
window.
78 Chapter 8 – Triggers
Exercise – Creating a Trigger
Learning
By the completion of this exercise you will be able to:
Outcome
Create a trigger.
2) On the main window, click the “+” sign to create a new Trigger.
3) Fill in the information on the right sidebar as example below. You will
use an existing variable, so you can select it from the dropdown list
and leave the “Create Variable” checkbox unchecked. Validate.
4) On the main window, the new trigger will appear. Click on the
icon to configure its properties.
Chapter 8 – Triggers 79
Exercise – Creating a Trigger
5) Click on to add a new trigger condition and fill the right sidebar
as below:
7) That means the Image POI will blink on the screen once the variable
reaches a value greater or equal than 40.
8) Now you must configure it to stop blinking once the value is lower
than 40. Add a new Condition using the Else operator:
80 Chapter 8 – Triggers
Exercise – Creating a Trigger
9) Add two new actions as you did in previous steps, this time choosing
Change visibility to Hide and Stop Blinking action types. The end
result in your main window should look like the example below:
Chapter 8 – Triggers 81
Summary
Summary This chapter explained what is a Trigger, how to configure it and how it is
executed.
82 Chapter 8 – Triggers
Chapter 9: The Runtime Software
Overview
Introduction This chapter will go through the steps required to run a project in a
Windows based HMI with the EcoStruxure™ Augmented Operator
Advisor Runtime service.
By the completion of this chapter the student will be able to:
Understand the requirements of running a project in the Runtime
device
Deploy the project to a Run Time device
Contents
What is EcoStruxure™ Augmented Operator Advisor Runtime ............ 84
EcoStruxure™ Augmented Operator Advisor Manager ........................ 85
Node-RED .............................................................................................. 86
EcoStruxure Operator Terminal Expert................................................. 87
Where to Find it? The EcoStruxure™ Augmented Operator Advisor Runtime Software can
be downloaded from Schneider Electric website ( http://www.schneider-
electric.com ).
Click on in the
EcoStruxure™ Augmented Operator Advisor page of Schneider Electric
website to download.
Firewall Rule It is important to configure the Windows Firewall in the HMI to allow an
Prerequisite incoming connection on port 80 (HTTP), and alternatively on port 443 (if
using HTTPS connection).
EWF Disable On Windows embedded systems, EWF (Enhanced Write Filter) protection
Prerequisite feature must be disabled before Runtime installation. It is also highly
recommended to keep EWF disabled when operating runtime, as any
database modification (notes, procedure history, user configuration) might
be lost on system reboot if EWF remains enabled.
This can be found on the Windows taskbar in the HMI / iPC being used as
Runtime device.
Note:
Node-RED is pre-installed with EcoStruxure™ Augmented Operator
Advisor Runtime. If the user decides to update or change its version, or
add new nodes, Schneider does not guarantee its functionality, neither
support.
See Also:
For more information on Node RED, visit its web page on
https://nodered.org/
Once the project is downloaded to the HMI with this driver configured,
the HMI will be ready to serve the EcoStruxure™ Augmented Operator
Advisor Runtime software with its variables data.
Learning
By the completion of this exercise you will be able to:
Outcome
Check if all necessary ports are open.
1) Launch the Runtime software from the Windows Start menu in the
HMI.
3) You will see a list of the ports in their default settings. It is possible to
change port numbers in case there are conflicts with existing
software blocking these ports.
Note:
If port 80 is not open, you may need to create a firewall rule in Windows
firewall settings in order to open this port.
Port 8082 is only open if you have a valid license or if your trial period is
still valid.
Learning
In Chapter 6 you have learned how to deploy and run a project locally in
Outcome
the tablet. In this exercise you will see the difference in deploying it to a
Runtime device. By the completion of this exercise you will be able to:
If you are using a HMI as the Runtime device, check its date and
time is correct before installing the Runtime. If the date and time is
in the past, the trial period of the Runtime will not be activated.
4) Download the project M340a.sta to the Unity Pro simulator and run
it. This project file is provided with the course resources.
7) Open the Extracted folder and copy all its contents to the Project
folder in the Runtime device, which is your PC or the HMI (if you
have one). The project folder can be reached from the Windows Start
Menu, as shown below:
8) Launch the app on your tablet. Select Custom connection and enter
the IP address of the Runtime device (PC or HMI). The default
credentials are:
Note:
In case you are using a PC as the Runtime Device, in order to create a
point-to-point network between the tablet and the PC hosting the Runtime,
the mobile hotspot feature will need to be used on the PC, unless both
devices (tablet and PC) are on the same wi-fi network.
9) Start the project’s scene and perform image recognition with your
tablet. Observe its behaviour.
What are the other two components installed with the Runtime
Software?
Overview
Introduction This chapter will go through the steps required to run a project in a
Windows based HMI with the EcoStruxure™ Augmented Operator
Advisor Runtime service.
By the completion of this chapter the student will be able to:
Understand the requirements of running a project in the Runtime
device
Deploy the project to a Run Time device
Contents
What are Procedures? .......................................................................... 94
Procedure Limitations ........................................................................... 96
Chapter 10 – Procedures 93
What are Procedures?
Overview Procedures are a set of instructions that the operator must perform. The
instructions are displayed on the tablet screen to guide the operator
through every step needed to perform a set of tasks related to maintenance
or operation.
Expert Mode User It is possible to give a user the rights to skip steps during a procedure. This
is done by checking the Expert Mode when creating users in the Manager.
Chapter 10 – Procedures 95
Procedure Limitations
Maximum The following describes the maximum number of procedures that can be
Numbers of used in a EcoStruxure™ Augmented Operator Advisor project.
Procedures The number of elements that can be added may also be limited by the
License Requirements.
96 Chapter 10 – Procedures
Exercise – Create a Procedure
Learning
By the completion of this exercise you will be able to:
Outcome
Create Procedures
1) Click on the Procedures Tab, highlight Area1 on the left sidebar and
Chapter 10 – Procedures 97
Exercise – Create a Procedure
8) Make it will be populated under the Scenes tab on the left sidebar, as
below.
10) Drag and drop a Standard step from the Toolbar to the
main window.
11) Fill in the information requested on the right sidebar as per example
below and Validate.
98 Chapter 10 – Procedures
Exercise – Create a Procedure
13) Move the mouse pointer over the Step 1 box to find a dot, click and
hold it to create a link with the Start step. It will look like this:
14) Create a second standard step with the below configuration and link
it to the first step.
Chapter 10 – Procedures 99
Exercise – Create a Procedure
15) Now create a Multiple Choice step. Drag and drop the
icon to the main window and configure it as below:
You will attach the same document attached in Step 1, but this time
you only need to select it from the drop down list.
17) Finish linking the steps together like the example below:
18) Highlight Step 1 and you will see down the bottom right of the main
window a reference to the attached scene. Click on it.
19) Drag and drop a List POI to the scene and name it Procedures.
Validate it. This List POI is now associated with Step 1 and it will be
shown on the tablet screen when this Step is active.
21) Add a Text item to the List POI and name it Pump is ON.
22) Deploy the project to the Runtime device and run it on your tablet.
23) Click on the Procedures icon on the bottom left menu of the
app.
24) From the displayed menu above, select the Check tank procedure to
start it.
25) You will need to have the Pump_house.jpg image file on your laptop
screen for the app to recognize it.
26) Once the procedure is started and the scene is recognized, notice
the List POI associated with Step 1 is on the screen as well as the Step
1 itself. You can open the attached document User Manual, and you
can proceed to the next step.
28) Proceed until you reach the end of the procedure. A summary will be
displayed. Tap on Save.
29) Go back to the App’s welcome page and navigate to the Procedures
option under your project Area1.
30) Tap on the icon and examine the window displayed. You
can check the procedure’s history, for example.
Overview
Introduction The EcoStruxure™ Augmented Operator Advisor Manager is included in
the EcoStruxure™ Augmented Operator Advisor Runtime Software. The
EcoStruxure™ Augmented Operator Advisor Manager gets installed
automatically when the EcoStruxure™ Augmented Operator Advisor
Runtime software is installed.
This chapter will cover the main features of the EcoStruxure™
Augmented Operator Advisor Manager.
By the completion of this chapter the student will be able to:
Access the Manager and use its functions
Contents
What is the Manager? ......................................................................... 106
Users Management ............................................................................. 107
Node-RED Management ..................................................................... 108
Notes Management ............................................................................ 109
Procedures Management.................................................................... 110
Note:
The EcoStruxure™ Augmented Operator Advisor Manager can
manage (create / modify / delete) the users (Runtime and Operator)
only. You cannot create Builder users.
You cannot delete Admin group.
Learning
By the completion of this exercise you will be able to:
Outcome
Understand the different options within the Manager.
4) Give this Group a name and a Security Level of Access such as the
example below and Validate.
6) Give the User a name, a password, and select the Group it will belong
to. Validate.
Expert mode is marked when you want the user to have the rights to
skip steps on Procedures.
Overview
Introduction There are best practices and guidelines recommended to be followed in
order to maximize the efficiency of image recognition and tracking when
using the EcoStruxure™ Augmented Operator Advisor App. This chapter
will cover this topic.
By the completion of this chapter the student will be able to:
Understand the prerequisites for image recognition
Understand the differences between image and tag recognition
Identify when each method is preferred
Contents
Image or Tags, Which One to Use? ..................................................... 116
Guidelines for Taking Photographs ..................................................... 119
Image Limitations ................................................................................ 120
How to Choose? Depending on the nature of the equipment being imaged and its
surrounding environment, the following detection methods can be utilized
for the EcoStruxure™ Augmented Operator Advisor App:
Image recognition: compares the complete image used in the
EcoStruxure™ Augmented Operator Advisor Builder scene with
the real scene.
Tag recognition: used when image recognition is unsuccessful.
The EcoStruxure™ Augmented Operator Advisor App searches
the real scene for a known, uniquely identifiable tag. These tags
are built into the EcoStruxure™ Augmented Operator Advisor
Builder library.
There are a number of criteria that needs to be considered when deciding
if image or tag recognition should be used.
First, you should consider the environment. Is the environment stable or
unstable one?
Stability in this case refers to the equipment in the scene as viewed from a
particular viewpoint.
As we require a close match between the real scene and photo reference, a
big object added to or missing from the real scene can impact the
detection. Generally, image and reality need to match at around 90% in
order to achieve recognition.
Another consideration is the detail in the image. Does the equipment have
some identifiable and unique detail features in the scene that enable it to
be both recognizable and correctly identified?
Tag recognition should be considered in cases where there are few details,
or if the equipment in the scene is similar to other scenes or objects.
CAUTION
FALSE SCENE DETECTION
• Use tags in situations where similar equipment and/or
environments could result in false scene detection.
• Attach tags firmly to the equipment with sufficient protection
against damage or deterioration of the tag.
Failure to follow these instructions can result in injury or
equipment damage.
Tag Recognition In the tag recognition method, detection is made possible by attaching tags
to the equipment being imaged. The tag is a uniquely identifiable object
that is placed in the scene to enable detection.
Tag recognition method is suitable in the following circumstances:
When image recognition or partial-image recognition methods do
not yield satisfactory results.
When some of the scenes or equipment being imaged may not be
easily identified. For example, in a row of machines, tags must be
printed and attached to the machines to assist EcoStruxure™
Augmented Operator Advisor to uniquely identify the scene and
display the appropriate points of interest.
When the equipment is in a poorly or very brightly lit area that
prevents taking high-contrast photographs.
Note:
The original file type of a tag is .ppm (Portable Pixmap). Before using
it in the Builder, it must be converted to either a .png or .jpg file type.
Note:
More photos will lead to better detection and tracking, especially with
varying light conditions. A minimum of 300 lux is recommended.
Learning
By the completion of this exercise you will be able to:
Outcome
Take photographs and use them as scenes in your project.
Overview
Introduction This chapter will give a brief introduction on Node-RED.
By the completion of this chapter the student will be able to:
Understand why Node-RED is used as part of the Augmented
Operator solution.
Contents
What is Node-RED? ............................................................................. 124
See Also:
For more information on Node RED, visit its web page on
https://nodered.org/
AOA Nodes When launching Node-RED from the Runtime Device, there are two
nodes that can be used to interface data with the Runtime software. These
nodes are available in the node palette.
Augmented When using the Augmented Operator Variables Node, the name of the
Operator Variable variable in the node must match the internal variable in the Augmented
Operator project running in the Runtime device.
Learning
By the completion of this exercise you will be able to:
Outcome
Create variables in the Builder to be used with Node-RED;
Create a flow in Node-RED;
Deploy a flow to Node-RED.
3) In Node-RED, drag and drop an Inject Node from the node palette in
the canvas.
6) Drag and drop a Split node from the node palette to the canvas.
8) Drag and drop a Switch node from the node palette to the canvas.
10) Wire the output of the Split node to the input of the Switch node.
11) Drag and drop a AOA Variable node from the node palette to the
canvas.
12) Double click on the AOA Variable node and configure it as below.
13) Wire the first output of the Switch node to the input of the AOA
Variable node.
14) Repeat steps 11, 12 and 13 to create three new AOA Variable nodes
with new variable names, the flow will look like below image.
15) Drag and drop a AOA Server node from the node palette to the
canvas.
16) Double click the AOA Server node and configure it as below.
17) Wire the outputs of all AOA Variable nodes to the input of the AOA
Server node.
1) In the Builder, click the Areas tab, click on Variables under the
structure of your project’s Area.
2) Create new internal variables and make their names match the
names created in AOA variable nodes in Node-RED, as example
below:
6) With the App in the tablet, perform image recognition and check the
variables coming from Node-RED.