Professional Documents
Culture Documents
Paper 14
Paper 14
Article
Can Artificial Intelligence Assist Project Developers
in Long-Term Management of Energy Projects?
The Case of CO2 Capture and Storage
Eric Buah 1, *, Lassi Linnanen 1 , Huapeng Wu 2 and Martin A. Kesse 3
1 Laboratory of Sustainability Science, School of Energy Systems, LUT University, FI-53851 Lappeenranta,
Finland; lassi.linnanen@lut.fi
2 Laboratory of Intelligent Machines, School of Energy Systems, LUT University, FI-53851 Lappeenranta,
Finland; huapeng.wu@lut.fi
3 School of Energy Systems, Mechanical Engineering Department, LUT University, FI-53851 Lappeenranta,
Finland; martin.a.kesse@gmail.com
* Correspondence: eric.buah@gmail.com or eric.buah@student.lut.fi; Tel.: +358-44-2929862
Received: 27 September 2020; Accepted: 23 November 2020; Published: 27 November 2020
Abstract: This paper contributes to the state of the art of applications of artificial intelligence (AI)
in energy systems with a focus on the phenomenon of social acceptance of energy projects. The aim
of the paper is to present a novel AI-powered communication and engagement framework for energy
projects. The method can assist project managers of energy projects to develop AI-powered virtual
communication and engagement agents for engaging their citizens and their network of stakeholders
who influence their energy projects. Unlike the standard consultation techniques and large-scale
deliberative engagement approaches that require face-to-face engagement, the virtual engagement
platform provides citizens with a forum to continually influence project outcomes at the comfort
of their homes or anywhere via mobile devices. In the communication and engagement process,
the project managers’ cognitive capability can be augmented with the probabilistic capability of
the algorithm to gain insights into the stakeholders’ positive and negative feelings on the project,
in order to devise interventions to co-develop an acceptable energy project. The proposed method
was developed using the combined capability of fuzzy logic and a deep neural network incorporated
with a Likert scaling strategy to reason with and engage people. In a mainstream deep neural network,
one requires lots of data to build the system. The novelty of our system, however, in relation to the
mainstream deep neural network approach, is that one can even use small data of a few hundreds to
build the system. Further, its performance can be improved over time as it learns more about the
future. We have tested the feasibility of the system using citizens’ affective responses to CO2 storage
and the system demonstrated 90.476% performance.
Keywords: artificial intelligence; CO2 capture and storage; deep neural network; CCS communication
and engagement; fuzzy logic; fuzzy deep learning
1. Introduction
Social acceptance of energy projects is the social license or social permission granted to an energy
project and its infrastructure by stakeholders at the market, socio-political and community levels [1,2].
It is not a one-time approval of the project. Its nature is dynamic and evolves over time. It means
that the fact that an energy project has been approved initially does not suggest that it has achieved
its social license and will be acceptable forever. Overtime, the social license can be withdrawn if the
stakeholders feel a need to do so [3,4]. The withdrawal can manifest in different forms, including
protest action and vandalism such as the case in the Niger Delta on oil and gas pipelines [5]. Literature
reports from wind energy, CO2 capture and storage and nuclear energy show that a lack of social
acceptance for an energy project can bring the project to a stop or delay the policy decisions for its
implementation if overlooked in the decision-making process. The retaining and withdrawal of the
social license is influenced by a number of psychological factors. These include the stakeholders’
emotion, competence and integrity-based trust of project managers, moral values and risk and benefits
perception. These psychological factors are often seen by some project developers as non-technical
issues and are often overlooked in the decision-making process [6–9]. The work of [7] even found that
they sometimes labeled the stakeholders as too emotional and irrational. But the author’s findings
add that the project managers’ decisions are also without emotion. Due to this emotionally influenced
decision, even if they are aware of the inherent risk of the energy project if developed and deployed,
they may overlook it. The public is not so naïve and are aware of some of these biases inherent in the
top-down decision-making process in energy projects. These days, the withdrawal of the social license
of some CCS, wind energy and nuclear energy projects in some countries has made project developers
and decision-makers promote these energy technologies to realize that they can no longer take this
emotional side of their stakeholders for granted and should rather address it [7].
To address this problem, in recent years, the recommended practices of developers for engaging
citizens and their network of stakeholders to gain insights into their perceptions, sentiments and emotions
have exclusively relied on mainstream consultation techniques and large-scale deliberative engagement [10].
These standard approaches have merit, but their main limitations include social desirability bias and
lack of communication after the workshop which makes the state of the social license uncertain. Further,
over time, they could become tedious due to repetitive tasks. The approach is also resource-intensive
and time-consuming and may even contribute to logistic emissions (see Discussion for more review).
One approach of overcoming this limitation is harnessing the power of artificial intelligence and machine
learning to construct decision-making algorithms to aid the human experts [11]. To demonstrate this
approach, in our previous work, we provided a framework for modeling emotional behavior in the
energy system. What is missing in this work is how to adapt the framework to the communication
and engagement problem discussed above to overcome some of the limitations above. Building
on this prior work [11], in this present study, an artificial intelligence-powered communication and
engagement agent to complement the standard engagement practice is proposed and tested.
This AI-powered engagement agent allows the project developers and decision-makers to work
with artificial intelligent agents using deep machine learning to interact with their stakeholders and
gain insights into the future. Deep machine learning, also known as deep learning, is a way to train
computers to do what comes naturally to humans: learn from examples. It can model complex
structures in data and develop the capability to enable decision-makers to make accurate predictions
of the future with limited human influence [12,13]. Using this deep learning technique as shown in
Figure 1, an AI agent powered by deep learning is an intelligent agent that perceives its environment
using the neural network’s capability and reacts. Its smartness can be quantified as predictive accuracy.
Predictive accuracy is how well an AI agent performs the intended action relative to the reality [14,15].
Human agents have sensory organs to get information (perceive) from the world (environment)
and have muscles (effectors) to take actions in response to the percept. An intelligent agent, on the
other hand, can be a robot agent (Figure 1) or a software agent. The proposed communication and
engagement agent for an energy project is a software agent. A software agent deployed as a chatbot
is tasked to perform specific tasks for a user and possesses a degree of intelligence that permits it to
perform part of its task.
To demonstrate the practical feasibility of the proposed method, CO2 capture and storage (CCS)
was used as a case study. It is interesting for the study because it is among the portfolio of low-carbon
energy technologies that have emerged without challenges in social acceptance, including nuclear
energy, wind energy and hydrogen technology. Despite its ability for radical emission reduction to
contribute to fighting climate change [16], in some countries such as the Netherlands, some CCS
with artificial intelligent agents using deep machine learning to interact with their stakeholders and
gain insights into the future. Deep machine learning, also known as deep learning, is a way to train
computers to do what comes naturally to humans: learn from examples. It can model complex
structures in data and develop the capability to enable decision-makers to make accurate predictions
of the future with limited human influence [12,13]. Using this deep learning technique as shown in
Energies 2020, 13, 6259 3 of 15
Figure 1, an AI agent powered by deep learning is an intelligent agent that perceives its environment
using the neural network’s capability and reacts. Its smartness can be quantified as predictive
demonstration
accuracy. 13, xplants
Predictive
Energies 2020, have
accuracy
FOR PEER been
REVIEW brought
is how welltoana AI
stop. Thisperforms
agent is because
theofintended
a lack ofaction
social relative
acceptance
3to 15in
of the
addition to other challenges such as costs [6].
reality [14,15].
Human agents have sensory organs to get information (perceive) from the world (environment)
and have muscles (effectors) to take actions in response to the percept. An intelligent agent, on the
other hand, can be a robot agent (Figure 1) or a software agent. The proposed communication and
engagement agent for an energy project is a software agent. A software agent deployed as a chatbot
is tasked to perform specific tasks for a user and possesses a degree of intelligence that permits it to
perform part of its task.
To demonstrate the practical feasibility of the proposed method, CO2 capture and storage (CCS)
was used as a case study. It is interesting for the study because it is among the portfolio of low-carbon
energy technologies that have emerged without challenges in social acceptance, including nuclear
energy, wind energy and hydrogen technology. Despite its ability for radical emission reduction to
Figure 1. An illustration
illustration of an intelligent agent. The agent can be a robot or a software agent.
agent. A robot
contribute toAn fighting climate change [16], in some countries such as the Netherlands, some CCS
agent, for example, can perceive its environment through sensors and act on that environment
demonstration plants have been brought to a stop. This is because of a lack of social acceptance in
through
through effectors.
effectors.
addition to other challenges such as costs [6].
Thepaper
The paperis is organized
organized as follows:
as follows: In Section
In Section 2, the2,theoretical
the theoretical framework
framework of the of the proposed
proposed method
method is presented. In Section 3, a simulation experiment demonstrating
is presented. In Section 3, a simulation experiment demonstrating how it can be applied how it can beisapplied is
presented.
presented. In Section 4, the implication of the method is discussed
In Section 4, the implication of the method is discussed with concluding remarks. with concluding remarks.
2.2.The
TheFramework
Framework of
of the
the Proposed
Proposed AI
AI Communication
Communication and
and Engagement
EngagementAgent
Agent
2.1.General
2.1. General Description
Description of
of the
the System
Buildingon
Building onthe
thework
workofof[11]
[11]and
andusing
usingaaCO
CO22 capture
captureand
and storage
storage(CCS)
(CCS)project
projectas
asaacase,
case,Figure
Figure2
2 presents
presents thethe block
block architecture
architecture of the
of the proposed
proposed AI communication
AI communication andand engagement
engagement agent
agent in CCS
in the the
CCS context. In the example, it is designed to help the project managers gain an understating
context. In the example, it is designed to help the project managers gain an understating of their of their
stakeholders’emotional
stakeholders’ emotionalbehavior
behavior to to predict
predict their
their feelings
feelings aboutabout the energy
the energy projectproject as it through
as it moves moves
through life
different different life cycle phases.
cycle phases.
Figure 2. The block architecture of the proposed AI-powered communication and engagement agent
Figure 2. The block architecture of the proposed AI-powered communication and engagement agent
for an energy project. In the illustration, CO2 capture and storage (CCS) is used as a case.
for an energy project. In the illustration, CO2 capture and storage (CCS) is used as a case.
In real life, the system will be implemented as a chatbot. As a real-time agent, it will offer 24/7
services to the citizens faced with the energy project in question. As shown in the block architecture,
Energies 2020, 13, 6259 4 of 15
In real life, the system will be implemented as a chatbot. As a real-time agent, it will offer 24/7 services
to the citizens faced with the energy project in question. As shown in the block architecture, the citizens
will be able to chat with the agent through voice or text, via Messenger or WhatsApp. As indicated in
Figure 2, the system has two agents that communicate with one another to engage the citizens. Agent 1
is the front-end agent and Agent 2 is the back-end agent. In real life, Agent 1 can be implemented
via conversational platforms such as Dialogflow. Dialogflow is a Google software that helps to build
conversational applications in various languages and on multiple platforms, including Messenger and
WhatsApp. It uses a pre-trained natural language processing algorithm that runs through Google
servers (cloud). Agent 2 can be implemented using the Keras deep learning library with the Google
Tensorflow back-end.
In the real-time communication and engagement process, Agent 1 handles the basic small talk
(e.g., How are you? How are you feeling about the project?). It also includes the domain questions on the
energy project in question that the project managers want to ask the citizens to gain insights into their
feelings about the project. Using these two agents, the system works as follows when deployed: (a) the
user opens the communication and engagement chatbot (Agent 1) via the Dialogflow platform; (b) the
user chats with Agent 1; (c) Agent 1 collects user answers and stores them on a database; and (d) after the
user submits the last answer, Agent 1 will tell the user, “Please, wait a moment, I am processing your
information.” Whilst the user is waiting, Agent 1 seeks advice from Agent 2. Therefore, behind the scenes,
it is not Agent 1 that is making the final decision. It is Agent 2 that takes the answers from Agent 1 as input,
X, processes them with the three inference algorithms (receptor, DNN and effector algorithms) and makes
the prediction. This prediction is then passed on to Agent 1 in real time for it to communicate the answer
to the user. It then gets feedback and communicates this to the project developers for the human cognitive
task to enable appropriate intervention. In this paper, we will focus on Agent 2 since it is responsible for
the decision-making task. Survey responses will be used to replicate Agent 1’s task.
0 and 1 (e.g., I somehow trust them) can also be accommodated by the system if a user expresses them
and assigns them weight (for review about fuzzy mathematics, see [23,24].
The fuzzy Likert system uses a fuzzy logic inference engine called the Takagi–Sugeno–Kang (TSK)
fuzzy model. This fuzzy type allows human experts to tell the algorithm how to perform the X to
XFL mappings. However, the TSK fuzzy Likert system can be optimized using the neural network’s
capability to adapt the system to a more complex response. When this is done, it reduces the number
of rules which need to be defined by the human experts in the loop. The human experts can teach
the system using IF (Premise) . . . THEN (Conclusion) rules. In this computation, a fuzzy rule Rs is
represented as
Rs : If X1 is As1 and . . . Xn is Asn then Y is A y (1)
In reference to Equation (1), the fuzzy rule output Y is a polynomial function of the inputs, and the
rule is then expressed as
Rs : If X1 is As1 and . . . Xn is Asn then
The defuzzification of the final output calculates the weighted consequent value of a given rule as
I Ps xl1 , . . . xIn
P
I vls
Rs ∈ RB hs
P
L Rs ∈ RB hs
y = P I
= P I
(3)
Rs ∈ RB hs Rs ∈ RB hs
RB is the rule base of a given set and Rs ∈ RB.e1 xl1 . . . (xIn is the input; where
hIs = T µAs1 xl1 , . . . .µAsn (xIn ) is the compatibility degree of the instance e1 with the rule Rs ; T is
a T-norm; and vls = Ps xl1 , . . . xIn = as1 xl1 + . . . . + asn xIn + bs ) is the output of Rs and takes the values
from e1 (Cozar et al., 2017).
Using this inference method, depending on the complexity of the problem, the fuzzy Likert
inference engine can have the following five linguistic rules Rs = (R1 . . . R5 ) to convert the X variables
to XFL . The rules are as follows:
R1 If the Likert response is VERY LOW = 1, then the output is VERY LOW→[0];
R2 If the Likert response is VERY HIGH = 5, then the output is VERY HIGH→[1];
R3 If the Likert response is MEDIUM = 3, then the output is MEDUIM→[0.5];
R4 If the Likert response is LOW = 2, then the output is LOW→[0.25];
R5 If the Likert response is HIGH = 4, then the output is HIGH→[0.75].
As interval details between the ordinal points on the fuzzy Likert scale are known, the transformation
from X to XFL provides a high-dimensional behavioral space. In this high-dimensional space, data
augmentation can be performed to obtain augmented big data to train a deep neural network.
This data augmentation strategy uses the fuzzy logic-based rules in Equation (3) to mimic image data
augmentation, as illustrated in Figure 3.
As indicated in Figure 3, the X feature used to observe the social context of the energy system
could be thought of as an image, for example, an original butterfly image. As indicated in Figure 3,
in the image data problem, after data augmentation, we obtained augmented forms of the images
such as de-texturized, de-colored and flipped. The XFL features labeled X1FL . . . . . . .XnFL after the
data manipulation could be thought of as the augmented images. These X1FL . . . . . . .XnFL are the data
representations that are extracted from the high-dimensional data space of XFL features of each predictor
in the original datasets to train the fuzzy-driven deep neural network (DNN) algorithm shown in
Figure 4. The simulation experiment in Section 3 shows this example.
Energies 2020, 13, 6259 6 of 15
Energies 2020, 13, x FOR PEER REVIEW 6 of 15
Fuzzy Variable of
Butterfly X
X1FL
X2FL
X3FL
X4FL
X5FL
XnFL
Figure
Figure Image
3. 3. Imagedata augmentation
data augmentationtechnique forfor
technique increasing
increasingthethe
size of of
size ananimage
imageto to
train a deep
train neural
a deep neural
network
network algorithm. The
algorithm. drawing
The drawinghashas
been modified
been modified forfor
thethe
purpose
purposeof of
this study.
this The
study. Thevariables
variables X and
X and
XFLXFLare are
mathematical representations
mathematical used in
representations this in
used study
thistostudy
mimictothe imagethe
mimic data augmentation
image strategy
data augmentation
using fuzzy
strategy
Energies 2020,
mathematics
13, xusing
to design the
fuzzyREVIEW
FOR PEER mathematics to proposed
design thesystem.
proposed system. 7 of 15
As indicated in Figure 3, the 𝑋 feature used to observe the social context of the energy system
could be thought of as an image, for example, an original butterfly image. As indicated in Figure 3,
in the image data problem, after data augmentation, we obtained augmented forms of the images
such as de-texturized, de-colored and flipped. The 𝑋 features labeled 𝑋 … … . 𝑋 after the data
manipulation could be thought of as the augmented images. These 𝑋 … … . 𝑋 are the data
representations that are extracted from the high-dimensional data space of 𝑋 features of each
predictor in the original datasets to train the fuzzy-driven deep neural network (DNN) algorithm
shown in Figure 4. The simulation experiment in Section 3 shows this example.
are small. In a situation where one has big data, one can decide to by-pass step 1 and directly train
the system with X features. In this case, the interpretation of the model will be lost. This makes XFL
features important features in the system architecture even if one has big data at hand.
Using the trust in actors example, X1 . . . .Xn in Figure 2, let Xtrust represent the XFL feature for
trust in the competence (CBT) of the project actors, X1 , and integrity (IBT)-based trust be Xn after the
data transformation. After the data transformation, the fuzzy deep neural network receives the Xtrust
information including other responses on other predictors as input, as illustrated in Figure 4.
During computation, the incoming XFL features are multiplied by an appropriate weight function,
w, and then summed up. The result is recalculated by an activation function, f , plus a bias (+1).
Mathematically, the output decision of a neuron in the network is expressed in Equation (4):
XP
A f f ective f eelings, y = f ( Xtrust W1 + bias) (4)
i=1
From Equation (4), in the decision-making process as shown in Figure 3, the neurons in the deep
neural network construct its hypothesis on the problem by learning directly from the XFL features used
to train the network. In mainstream practice, human experts would have defined the hypothesis, but it
is carried out otherwise in this context. The relationship between features and labels is built out of
simpler ones to form a graph of hierarchies. As shown in Figure 3, these graphs are many artificial
neurons which are connected layer to layer. In this connection, an output of a neuron automatically
becomes input information to another [11,12,25,26]. In the learning process, the network is trained
using supervised learning. In supervised learning, the network learns to predict the affective feelings
on the energy project in question based on example input–output pairs. However, because the system
is an ensemble system, different networks are trained to learn to solve the problem and output their
own decisions, Y = (y1 , y2 . . . yn ). In this decision, y1 is the decision of network 1, y2 is the decision of
network 2 and yn is the decision of the final network.
have a problem having the CO2 storage close to your house and want it far away. Did I get your feelings right,
and why this decision?” Finally, if Agent 2 predicts the final decision as MOD, Agent 1 will say to the user,
“Oh, my intelligence tells me you seem to have a problem having the CO2 storage close to your house and want it
far away. Did I get your feelings right, and why this decision?” These scripts are designed depending on the
need of the project developers. In this context, a typical fuzzy IF . . . THEN rule in the inference engine
of the effector algorithm will be as follows: IF Agent 2’s prediction is PA THEN Agent 1 says to the user
“Oh, my intelligence tells me you don’t have a problem having the CO2 storage close to your house. Did I get
your feelings right, and why this decision?”
Energies 2020, 13, x FOR PEER REVIEW 8 of 15
FigureFigure 5. The
5. The affective
affective frameworkwith
framework withwhich
which Agent
Agent 22 makes
makesitsitsprediction.
prediction.PA PA
indicates positive
indicates positive
affective feelings; NA indicates negative affective feelings and MOD indicates moderate feelings.
affective feelings; NA indicates negative affective feelings and MOD indicates moderate feelings.
These affective clusters are positive affective feelings (PA), moderate affective feelings (MOD)
Table 1. Structure
and negative of thefeelings
affective data and howUsing
(NA). the agent
the COis expected
2 storage to react toas
example a citizen
shown and collect1,their
in Table PA
qualitative information
indicates positive andfeelings
affective communicate
towarditthe
to the
COproject developers
2 storage. for appropriate
NA indicates intervention.
negative affective feelings.
It is a prediction for those who have problems with the CO2 storage being close to them and who are
Prediction Associated Statements (Intended Action of the Agent) Numerical Fuzzy Class Label
emotionally averse to its approval. Finally, MOD indicates moderate feelings. It is a prediction for
“Oh, my intelligence tells me you don’t have a problem
those with indecisive feelings and struggling to take a position.
PA (positive affective feelings) having the CO2 storage close to your house. Did I get 0 to 0.455
your feelings right, and why this decision?”
Table 1. Structure of the data and how the agent is expected to react to a citizen and collect their
“Oh, my intelligence tells me you seem to have a
qualitative information and communicate
problem having theitCO
to 2the project
storage developers
close for appropriate
to your house and intervention.
NA (negative affective feelings) 0.645 to 1
want it far away. Did I get your feelings right, and why
this decision?” Numerical Fuzzy
Prediction Associated Statements (Intended Action of the Agent)
Class Label
“Oh, my intelligence tells me you seem to have a
“Oh, my intelligence tells me you don’t have a problem having
problem having the CO2 storage close to your house and
MODPA (positivefeelings)
(moderate the COwant
2 storage close to your house. Did I get your feelings 0.455
0 toto 0.645
0.455
affective feelings) it far away. Did I get your feelings right and why
right, and
thiswhy this decision?”
decision?”
“Oh, my intelligence tells me you seem to have a problem
NA (negative
having the CO2 storage close to your house and want it far 0.645 to 1
affective feelings)
away. Did I get your feelings right, and why this decision?”
“Oh, my intelligence tells me you seem to have a problem
MOD (moderate
having the CO2 storage close to your house and want it far 0.455 to 0.645
feelings)
away. Did I get your feelings right and why this decision?”
Energies 2020, 13, 6259 9 of 15
This communication will likely encourage the user to freely express his or her feelings qualitatively.
The system will then communicate this qualitative information as feedback to the project developers.
However, that part of the system design is beyond the scope of this work. This qualitative information
will give them insight into the problem. This could assist them to devise the intervention needed to
address people’s concerns. In the section that follows, an evaluation of the model is presented using a
hypothetical CO2 storage.
Table 2. Predictors used in the simulation experiment to predict the emotional response to the CO2
storage nearby.
Figure 6. How
Figure 6. Howthe the
deepdeep
neural network
neural algorithms
network werewere
algorithms trained on theontraining
trained datasetdataset
the training and objectively
and
evaluated using
objectively the testing
evaluated usingdataset thatdataset
the testing was hidden from
that was the algorithm
hidden during training.
from the algorithm during training.
DueThe todata
this were
learning
thenprocedure, the All
pre-processed. 198missing
raw datasets, X, were
information wasdivided intothe
filled with a training dataset and
global constant,
testing dataset.
“I don’t know.”In machine
Having learning,
acquired thesethe training
values after dataset is used the
pre-processing, for receptor
constructing the inference
algorithm (TSK fuzzymodel
(inLikert
the case of thissystems)
inference paper, Agent 2). During
rule strategy training
in Section andapplied
2.2 was validation,
to thethe data
raw can leak
dataset. Five to
(5)the model.
fuzzy
TheIF...THEN
testing datarulesare
were definedused
therefore as human-level
to offer an rules to initiate
objective the learning
evaluation. of the
The test receptor
data algorithm,
help in quantifying
theaspredictive
shown in Table 3 of the model to estimate its ability to generalize to unseen cases. To achieve
accuracy
this goal, the 198 raw data were randomly divided into a training dataset and testing dataset using the
Table 3. Sample fuzzy rules used in the experiment to transform the original data 𝑋 on a Likert scale
60/40 rule. This split should have led to a 118.8 dataset for training and 79.2 dataset for testing, but a
to their corresponding fuzzy Likert features, 𝑋 .
subjective decision was made. This subjective decision rounded up the decimal split and it led to a 114
(raw training IF ... THEN… This decision Fuzzy Scale Range of 𝑿𝑭𝑳that
on athe training
Rules data) and 84 (raw testing data) split. 𝑭𝑳
was made to ensure
dataset was not dominated 𝑿 by, for example,𝑿responses from 5-Level Membershipfrom
the participants Function, 𝝁(𝒙)
the developed or
Rule 1 LOW LOW 0 to 0.134
developing world. If it is overlooked, it would have increased the chance of the model becoming
Rule 2it might
biased since SOMEHOW LOW
learn one-sided SOMEHOW LOW
information. 0.134 to 0.44
Rule 3 MEDIUM MEDIUM 0.44 to 0.644
Rule 4 SOMEHOW HIGH SOMEHOW HIGH 0.644 to 0.9444
Rule 5 HIGH HIGH 0.944 to 1
This helped to obtain the corresponding fuzzy Likert features, 𝑋 . The 114 training data would
have led to overfitting when used to train the second subsystem (DNN) because it is a complex
Energies 2020, 13, 6259 11 of 15
The data were then pre-processed. All missing information was filled with the global constant,
“I don’t know.” Having acquired these values after pre-processing, the receptor algorithm (TSK fuzzy
Likert inference systems) rule strategy in Section 2.2 was applied to the raw dataset. Five (5) fuzzy
IF...THEN rules were defined as human-level rules to initiate the learning of the receptor algorithm,
as shown in Table 3.
Table 3. Sample fuzzy rules used in the experiment to transform the original data X on a Likert scale to
their corresponding fuzzy Likert features, XFL .
This helped to obtain the corresponding fuzzy Likert features, XFL . The 114 training data would
have led to overfitting when used to train the second subsystem (DNN) because it is a complex
algorithm. If the model overfits, it can perform excellently on the validation dataset as part of the
training, but when it is tested with the test data, it can lead to poor generalization [13,14,34]. To prevent
this, data augmentation was performed on the high-dimensional data space of the XFL labels of the 114
training data. Through this data augmentation, a large experimental dataset of 72,105 training samples
was collected. This augmented dataset using the XFL features and lables was then used to train three
deep neural networks. The training was implemented using the Keras machine learning library with
the Google TensorFlow back-end. The following is the architecture of the ensemble DNN of Agent
2: training iterations: 200 epochs; learner type: neural networks; activation function: rectified linear
unit (ReLU); optimization algorithm: stochastic gradient descent; learning rate: 0.003; regularization:
dropout; loss function: categorical cross-entropy; number of output nodes: 3 classes (PA, NA and
MOD); hidden layer: Model 1 is a 12-layer network (including input and output layer, Model 1);
Model 2 is an 11-layer network; and Model 3 had 10 hidden layers.
Table 4. Result (performance) from the CCS communication and engagement agent (Agent 2) to be
shared with Agent 1 to communicate with the user using its corresponding human languages in Table 1.
Author Contributions: E.B. planned and wrote the first draft of the paper. L.L. supervised, reviewed the paper
and made suggestions to improve the paper. H.W. supervised, reviewed the paper and made suggestions to
improve the paper. M.A.K. reviewed the paper and made suggestions. All authors have read and agreed to the
published version of the manuscript.
Funding: This research received no external funding.
Acknowledgments: In this section, you can acknowledge any support given which is not covered by the author
contribution or funding sections. This may include administrative and technical support, or donations in kind
(e.g., materials used for experiments).
Conflicts of Interest: The authors declare no conflict of interest.
Energies 2020, 13, 6259 14 of 15
References
1. Wüstenhagen, R.; Wolsink, M.; Bürer, M.J. Social acceptance of renewable energy innovation: An introduction
to the concept. Energy Policy 2007, 35, 2683–2691. [CrossRef]
2. Upham, P.; Oltra, C.; Boso, À. Towards a cross-paradigmatic framework of the social acceptance of energy
systems. Energy Res. Soc. Sci. 2015, 8, 100–112. [CrossRef]
3. Dowd, A.M.; James, M. A social licence for carbon dioxide storage and capture: How engineers and managers
describe community relations. Soc. Epistemol. 2014, 28, 364–384. [CrossRef]
4. Gough, C.; Cunningham, R.; Mander, S. Understanding key elements in establishing a social license for CCS:
An empirical approach. Int. J. Greenh. Gas Control 2018, 68, 16–25. [CrossRef]
5. Umar, A.T.; Othman, M.S.H. Causes and Consequences of Crude Oil Pipeline Vandalism in the Niger Delta Region of
Nigeria: A Confirmatory Factor Analysis Approach; Cogent Economics & Finance: London, UK, 2017; Volume 5,
pp. 1–15. [CrossRef]
6. Ashworth, P.; Bradbury, J.; Feenstra, C.F.J.; Greenberg, S.; Hund, G.; Mikunda, T.; Shaw, H. Communication/
Engagement Toolkit for CCS Projects, Communication/Engagement Tool Kit for CCS Projects; Energy Transformed
Flagship, National Flagships Research, Commonwealth Scientific and Industrial Research Organisation
(CSIRO): Canberra, Australia, 2011.
7. Roeser, S.; Philos, T. Nuclear Energy, Risk, and Emotions. Philos. Technol. 2011, 24, 197–201. [CrossRef]
8. Janhunen, S.; Hujala, M.; Pätäri, S. The acceptability of wind farms: The impact of public participation.
J. Environ. Policy Plan. 2018, 20, 214–235. [CrossRef]
9. Perlaviciute, G.; Steg, L.; Contzen, N.; Roeser, S.; Huijts, N.M.A. Emotional Responses to Energy Projects:
Insights for Responsible Decision Making in a Sustainable Energy Transition. Sustainability 2018, 10, 2526.
[CrossRef]
10. Coyle, F. ‘Best practice’ community dialogue: The promise of a small-scale deliberative engagement around
the siting of a carbon dioxide capture and storage (CCS) facility. Int. J. Greenh. Gas Control 2016, 45, 233–244.
[CrossRef]
11. Buah, E.; Linnanen, L.; Wu, H. Emotional responses to energy projects: A new method for modeling and
prediction beyond self-reported emotion measure. Energy 2020, 190, 116210. [CrossRef]
12. LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. [CrossRef]
13. Goodfellow, I. Deep Learning; MIT Press: Cambridge, MA, USA, 2018; Available online: www.deeplearningbook.
org (accessed on 9 August 2020).
14. Breiman, L. Statistical modeling: The two cultures. Statist. Sci. 2001, 16, 199–231. [CrossRef]
15. Yarkoni, T.; Westfall, J. Choosing prediction over explanation in psychology: Lessons from machine learning.
Perspect. Psychol. Sci. 2017, 12, 1100–1122. [CrossRef] [PubMed]
16. Haszeldine, R.S.; Flude, S.; Johnson, G.; Scott, V. Negative emissions technologies and carbon capture and
storage to achieve the Paris Agreement commitments. Philos. Trans. R. Soc. A 2018, 376, 20160447. [CrossRef]
[PubMed]
17. Huijts, N. Sustainable Energy Technology Acceptance: A Psychological Perspective. Ph.D. Thesis, Delft University
of Technology, Delft, The Netherlands, 2013. [CrossRef]
18. Terwel, B.W.; Harinck, F.; Ellemers, N.; Daamen, D.D.L.; De Best-Waldhober, M. Trust as predictor of
public acceptance of CCS, In Energy Procedia, Proceedings of the 9th International Conference on Greenhouse Gas
Control Technologies (GHGT-9), Washington, DC, USA, 16–20 November 2008; Elsevier Ltd.: Amsterdam,
The Netherlands, 2008; Volume 1, pp. 4613–4616.
19. Wolpert, D.H. Stacked Generalization. Neural Netw. 1992, 5, 241–259. [CrossRef]
20. Naimi, A.I.; Balzer, L.B. Stacked generalization: An introduction to super learning. Eur. J. Epidemiol. 2018,
33, 459–464. [CrossRef]
21. Symeona, I.; Kazani, A.M. Developing a fuzzy Likert scale for measuring Xenophobia in Greece. ASMDA Rome
2011, 7–10. [CrossRef]
22. Li, Q. A novel Likert scale based on fuzzy sets theory. Expert Syst. Appl. 2013, 40, 1609–1618. [CrossRef]
23. Zadeh, L. Fuzzy sets. Inf. Control 1965, 8, 338–353. [CrossRef]
24. Zadeh, L. The concept of a linguistic variable and its application to approximate reasoning—I. Inf. Sci. 1975,
8, 199–249. [CrossRef]
Energies 2020, 13, 6259 15 of 15
25. Deng, L.; Yu, D. Deep Learning: Methods and Applications. Found. Trends Signal Proc. 2014, 7, 197–387.
[CrossRef]
26. Deng, Y.; Bao, F.; Kong, Y.; Ren, Z.; Dai, Q. Deep direct reinforcement learning for financial signal
representation and trading. IEEE Trans. Neural Netw. Learn. Syst. 2017, 28, 653–664. [CrossRef] [PubMed]
27. Huijts, N.M.A.; Midden, C.J.H.; Meijnders, A.L. Social acceptance of carbon dioxide storage. Energy Policy
2007, 35, 2780–2789. [CrossRef]
28. Midden, C.J.H.; Huijts, N.M.A. The Role of Trust in the Affective Evaluation of Novel Risks: The Case of
CO2 Storage. Risk Anal. 2009, 29, 743–751. [CrossRef] [PubMed]
29. Xuan, Y.; Wang, Z. Carbon capture and storage perceptions and acceptance: A survey of Chinese university
students. Int. Proc. Comput. Sci. Inf. Technol. 2012, 38, 1489–1499.
30. Huijts, N.M.A.; Molin, E.J.E.; Steg, L. Psychological factors influencing sustainable energy technology
acceptance: A review-based comprehensive framework. Renew. Sustain. Energy Rev. 2012, 16, 525–531.
[CrossRef]
31. Krause, R.M.; Carley, S.; Warren, D.C.; Rupp, J.; Graham, J.D. “Not in (or Under) My Backyard”: Geographic
Proximity and Public Acceptance of Carbon Capture and Storage Facilities. Risk Anal. 2014, 34, 529–540.
[CrossRef]
32. Seigo, S.L.; Dohle, S.; Siegrist, M. Public perception of carbon capture and storage (CCS): A review. Renew. Sustain.
Energy Rev. 2014, 38, 848–863. [CrossRef]
33. Posner, J.; Russell, J.A.; Petersona, B.S. The circumplex model of affect: An integrative approach to affective
neuroscience, cognitive development, and psychopathology. Dev. Psychopathol. 2005, 17, 715–734. [CrossRef]
34. Shmueli, G. To explain or to predict. Stat. Sci. 2010, 25, 289–310. [CrossRef]
35. Latkin, C.A.; Edwards, C.; Davey-Rothwell, M.A.; Tobin, K.E. The relationship between social desirability
bias and self-reports of health, substance use, and social network factors among urban substance users in
Baltimore, Maryland. Addict. Behav. 2017, 73, 133–136. [CrossRef]
36. Gallois, C.; Ashworth, P.; Leach, J.; Moffat, K. The Language of Science and Social Licence to Operate. J. Lang.
Soc. Psychol. 2016, 36, 45–60. [CrossRef]
37. Barrett, L.F. How Emotions are Made: The Secret Life the Brain; Houghton-Mifflin-Harcourt: New York, NY,
USA, 2017.
38. Wilson, T.D.; Gilbert, D.T. Affective forecasting. In Advances in Experimental Social Psychology; Zanna, M.P.,
Ed.; Academic Press: Cambridge, MA, USA, 2003; Volume 35, pp. 345–411.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional
affiliations.
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access
article distributed under the terms and conditions of the Creative Commons Attribution
(CC BY) license (http://creativecommons.org/licenses/by/4.0/).