Physics-informed-neural-networks-in-groundwater-fl_2024_Groundwater-for-Sust

You might also like

Download as pdf or txt
Download as pdf or txt
You are on page 1of 8

Groundwater for Sustainable Development 25 (2024) 101172

Contents lists available at ScienceDirect

Groundwater for Sustainable Development


journal homepage: www.elsevier.com/locate/gsd

Research paper

Physics-informed neural networks in groundwater flow modeling:


Advantages and future directions
Ahmed Shakir Ali Ali a, Farhad Jazaei a, b, *, T. Prabhakar Clement c, Brian Waldron a, b
a
Department of Civil Engineering, University of Memphis, Memphis, TN, USA
b
Center for Applied Earth Science and Engineering Research, University of Memphis, Memphis, TN, USA
c
Department of Civil, Construction and Environmental Engineering, The University of Alabama, Tuscaloosa, AL, USA

H I G H L I G H T S G R A P H I C A L A B S T R A C T

• PINN has the potential to become a rival


groundwater modeling as an AI
alternative.
• PINN addressing conventional model
limitations will promote its industry
adoption.
• PINN models can provide a solution at
any arbitrary and continuous point and
time.
• PINN can deliver solutions without
starting computations at a specific time.
• PINN still needs to be improved to solve
complex groundwater flow problems.

A R T I C L E I N F O A B S T R A C T

Keywords: In recent years, there has been enormous development in soft computing, especially artificial intelligence (AI),
Artificial intelligence which has developed robust methods for solving complex engineering problems. Researchers in the field of water
Physics-informed neural network resources engineering have applied these AI methods to solve a variety of hydrological problems. Despite their
PINN
widespread use in the surface and atmospheric hydrology fields, groundwater hydrologists have not widely used
Groundwater modeling
MODFLOW
AI methods in their routine field-scale modeling efforts. This is because AI models have been primarily
considered black box models that lack physical meaning. Furthermore, using AI models to generate the space-
time distribution of transient groundwater level variations is challenging and requires further flux balance
and mass transport analyses. More recently, a new type of physics-informed neural network (PINN) model has
been developed to address several limitations by integrating governing physics (groundwater flow equations)
into the AI tools. This study presents the systematic advantages of the PINN algorithm for solving groundwater
problems using a set of classic test problems. As discussed in detail in the article, these advantages and potentials
are associated with the meshless nature of PINN, its continuous time and space dimensions, its independence

* Corresponding author. Department of Civil Engineering, University of Memphis, Memphis, TN, USA.
E-mail address: fjazaei@memphis.edu (F. Jazaei).

https://doi.org/10.1016/j.gsd.2024.101172
Received 15 June 2023; Received in revised form 2 April 2024; Accepted 3 April 2024
Available online 12 April 2024
2352-801X/© 2024 Elsevier B.V. All rights reserved.
A.S.A. Ali et al. Groundwater for Sustainable Development 25 (2024) 101172

from time-stepping and incremental marching in space, and its efficiency in running time. However, despite
PINN’s promising attributes, it is important to acknowledge its nascent stage of development and the inherent
limitations of all neural network models, such as training challenges and hyperparameter selection. Thus,
collaborative efforts between groundwater modelers and computer scientists are imperative to explore and
exploit the full potential of PINN in tackling increasingly complex groundwater problems and nurturing PINN
into a dependable modeling tool in industry and academia.

1. Introduction techniques, such as finite difference and symbolic derivations, which


have been used in computational statistics and neural network sciences
Groundwater is a crucial water source, especially in areas with (Margossian, 2019). AD is a family of techniques analogous to back­
limited or unreliable surface water. However, it is essential to manage propagation that can efficiently calculate the derivatives of numerical
this valuable resource sustainably to ensure its availability in the long functions utilizing the chain-rule calculus (Baydin et al., 2018). The
run (Alakayleh et al., 2022; Muenratch and Nguyen, 2023; Sanga and reader is encouraged to review the cited sources for more detailed in­
Koli, 2023). Therefore, it has become imperative to comprehend formation about AD (e.g., Verma, 2000; Elliott, 2018; Baydin et al.,
groundwater flow dynamics and develop models that simulate the ef­ 2018; Margossian, 2019).
fects of both natural and human-induced stress on groundwater flow. PINN model is currently attracting attention for solving a variety of
This information is crucial for making informed decisions on ground­ PDEs in a variety of fields, such as fluid mechanics (Cai et al., 2021;
water development (Jazaei et al., 2018; Paul et al., 2022). Eivazi et al., 2022; Mahmoudabadbozchelou et al., 2022; Qiu et al.,
Simulating groundwater flow processes using standardized public- 2022), geosciences (Lu and Mei, 2022; Zheng et al., 2020; Shen et al.,
domain numerical codes that solve partial differential equations 2023), hydrology (Feng et al., 2023; Mahesh et al., 2022), and hy­
(PDEs) first emerged in the 1970s with various research codes developed draulics (Raynaud et al., 2022; Walter et al., 2022). PINN models have
by the US Geological Survey (USGS). These efforts eventually led to the also been used for solving some relatively small and simple problems,
development of well-known public domain USGS codes such as the such as steady-state saturated groundwater flow (Tartakovsky et al.,
modular finite-difference (FD) flow model (MODFLOW) (McDonald and 2018; Shadab et al., 2023), calibration of Richard’s Equation (Depina
Harbaugh, 1988; Mehl and Hill, 2013) and the finite element code et al., 2022), one and two-dimensional confined flow (Cuomo et al.,
SUTRA (Voss, 1984). During the same period, FEFLOW, another 2023), unconfined groundwater flow (Secci et al., 2024), and some
finite-element-based model, was also developed at the German Academy groundwater radial flow problems (Zhang et al., 2022).
of Sciences Berlin (Diersch, 1981, 2013) and became increasingly pop­ The objective of this effort is to present a methodical explanation of
ular in the mid-2000s. Various numerical discretization algorithms and a the PINN algorithm for solving groundwater flow equations and discuss
variety of matrix solvers, such as Preconditioned Conjugate-Gradient the advantages of PINN computational algorithms over conventional
(PCG) and Strongly Implicit Procedure (SIP), are employed in these groundwater models, such as MODFLOW. This article aims to elucidate
numerical models that solve the governing groundwater flow equations the various potentials that can make PINN a competitive AI-based
(Ashiq et al., 2020; Bailey et al., 2016; Sankar et al., 1982; Tiwari and alternative to traditional groundwater models. This article emphasizes
Vadhiyar, 2022). the importance of researchers focusing on aspects beyond the accuracy
Soft computing algorithms that utilize artificial intelligence (AI) are of PINN in solving partial differential equations already offered by
recent developments, and these algorithms have been used to solve conventional models (e.g., MODFLOW). The article provides a quanti­
problems in several areas, including hydraulics and hydrology problems tative exploration and discussion of PINN’s running time as an advan­
(Ali and Günal, 2021; Azizi et al., 2022; Manzoor et al., 2021). However, tage over traditional models and introduces additional potential benefits
the application of AI tools in the groundwater field has been limited to that merit further investigation in the future. To do that, this article uses
analyzing time series data for modeling fluctuations in groundwater PINN to solve four classic groundwater problems. These problems
heads at specific monitoring points and performing lumped analyses for illustrate the use of different types of forcing and boundary conditions,
the entire investigating areas for many years (Ao et al., 2021; Dey et al., including uniform and nonuniform recharge, instantaneously changing
2021; Manandhar et al., 2020; Roshni et al., 2022; Vadiati et al., 2022). head, fixed head, and no-flow boundary conditions. All the problems are
Despite several successful groundwater studies conducting lumped non-dimensionalized to ensure the results are applicable to both small
time-series analyses, these AI models are commonly criticized for and large-scale problems (Jazaei et al., 2014). The performance of the
requiring large amounts of high-resolution data to train the models and PINN was verified by comparing the results with MODLFOW 2005,
for the lack of physics. From groundwater modelers’ viewpoint, the most MODFLOW-6, and MATLAB-based FD results.
critical limitation of these AI models is the apparent lack of
physics-driven thinking in the approach employed by the numerical 2. Confined groundwater flow equation
models such as MODFLOW, SUTRA, and FEFLOW. Thus, AI has been a
bit of a challenge to become a catalyst for progress in the groundwater The one-dimensional confined groundwater equation can be written
field, especially among traditional numerical modelers. as (Jazaei et al., 2016):
However, recent developments in AI science could restructure the
use of AI tools in the groundwater field. A significant development is ∂φ′(x′, t′) ∂2 φ′(x′, t′)

− D′ − w′ = 0, x′ ∈ (0, L′), (1)
that the AI models can now directly integrate physics-driven partial ∂t ∂x′2
differential equations (PDEs) into their computations (Faroughi et al., where, φ′(x′, t′) [L] is the groundwater head at the position, x′ [L], and
2022; Raissi et al., 2017). The additional constraints provided by the
time, t′ [T]; D′ [L− 2 T − 1 ] is the diffusivity, w′ [LT− 1] is the sink/source
governing equations, boundary conditions (BCs), and initial conditions
(ICs) can substantially reduce the training data required for AI models. A term, and L′ [L] is the length domain. In this study, we limited the time
recently developed physics-informed neural network (PINN) model can domain to t ′ ∈ (0, SST), which SST refers to the moment at which the
solve PDEs successfully by integrating two algorithmic methods: deep flow effectively reaches the steady-state condition (Simpson et al., 2013;
learning and automatic differentiation (AD) (Raissi et al., 2017). AD, Jazaei et al., 2014, 2017).
also called algorithmic differentiation, is a new method of computing In this study, we non-dimensionalized Eq. (1) using the following
derivatives that has proved to be a powerful alternative to traditional dimensionless parameters (Jazaei et al., 2017):

2
A.S.A. Ali et al. Groundwater for Sustainable Development 25 (2024) 101172

x′ φ′(x′, t′) t′ D′
x = ′, φ(x, t) = , and t= , (2) f = |MSEPDE + MSEIC + MSEBC | (4)
L φ′ L′
2

where, MSEPDE , MSEIC , and MSEBC indicate the mean squared error of
where, φ(x, t) is the dimensionless groundwater head, at the dimen­
the solution at the internal space and time of PDE (i.e., x ∈ (0, 1) and
sionless position, x, and time, t, and φ′ is the characteristic value of a t > 0), IC, and BC, respectively. To calculate these terms for problems in
dependent variable. Combining Eqs. (1) and (2), the non-dimensional Fig. 1, the information provided by the governing equation, Eq. (3), IC,
form of Eq. (1) can be written as: and BC is used as:
∂φ(x, t) ∂2 φ(x, t) N ⃒ ⃒2
(3) 1 ∑ ⃒∂ φ 2 ⃒
∂t

∂x2
− w = 0, x ∈ (0, 1),
MSEPDE = ⃒ ̂ (xi , ti ) − ∂ φ̂ (xi , ti )
− w⃒⃒ , (5)
N i=1 ⃒ ∂t ∂x 2

where, w = w′L′/D′φ′ (Jazaei et al., 2017). Eq. (3) was studied under four
classic initial (IC) and boundary (BC) conditions, as depicted in Fig. 1. 1 ∑N
MSEIC = ̂ (xi , 0)|2 , and
|φ(xi , 0) − φ (6)
All problems include a uniform IC produced by BCs. In Fig. 1(a), the N i=1
head at the BCs increases instantly without any recharge occurring. The
BCs in Fig. 1(b) are fixed, while a uniform recharge occurs throughout 1 ∑N

the system. The problem depicted in Fig. 1(c) has fixed BCs and a MSEBC = ̂ (0, ti )|2 + |φ(1, ti ) − φ
|φ(0, ti ) − φ ̂ (1, ti )|2 (7)
N i=1
non-uniformly (linearly) varying recharge. Fig. 1(d) includes fixed and
no-flow BCs, while uniform recharge occurs over the entire area. The where, xi ∈ (0, 1) , and ti > 0, φ ̂ denotes the solution predicted by the
dotted red line is representative of the general transient head distribu­ PINN in each iteration at collocation points until the value of f is less
tion under each condition. These problems were solved using a PINN than a threshold value, ε, (f→0), and φ denotes known IC and BCs. As
model and verified by the industrial-grade MODFLOW 2005 code. shown in Eqs. (5)–(7) and represented in Fig. 2, there are three types of
collocation points within the time-space domains of the solution — in­
3. Physics- informed neural network (PINN) model ternal PDE collocation points, (xi , ti ), where xi ∈ (0, 1) and ti > 0, IC
collocation points, (xi ,0), and BC collocation points, (0,ti ) and (1,ti ). The
The PINN model solves PDEs by combining deep neural networks subscript i denotes the ith collocation point. Fig. 2 schematically shows
with an AD algorithm (Faroughi et al., 2022; Raissi et al., 2019). The AD the randomly distributed collocation points within the transient space-
method is based on chain rules, as opposed to FD-based numerical de­ time domains, once the system is yet in transient condition before
rivatives used, e.g., in MODFLOW (Hou et al., 2022; Mao et al., 2020). effectively asymptote to steady-state condition at t ≈ 0.5 [ − ], that are
AD allows encoding a PDE, e.g., Eq. (3), within a deep learning network used to train the PINN model.
algorithm to find nonlinear relations between input parameters (e.g., x
PINN determines the derivative values of ∂ φ ̂ /∂t and ∂2 φ
̂ /∂x2 in Eq.
and t) and output quantities (e.g., the derivatives in Eq. (3)), by lowering
(3) through an AD approach (Baydin et al., 2018; Huang et al., 2021;
a loss function (e.g., Eq. (4)) (Meng et al., 2020). These processes are
Rall and Corliss, 1996) and aims to find the best spatial and temporal
illustrated in Fig. 3. Interested readers are referred to the cited refer­
distributions of φ
̂ (xi , ti ) at the collocation points by minimizing the loss
ences for a detailed description of the PINN method (Raissi et al., 2017,
function, f, (Eq. (4)).
2019).
In this study, the PINN model was used with a fully connected deep
The main advantage of PINN models is that, unlike other neural
neural network and the hyperbolic tangent (tanh) operation between its
network models, the loss function can be calculated independently of the
layers (Ding et al., 2018; Lau and Lim, 2018). The basis of the fully
exact training or collocation point values owing to the additional in­
connected deep neural network was explained broadly by (Goodfellow
formation provided by the PDE, BC, and IC conditions. The loss function
et al., 2016; Nabian et al., 2021). All PINN models used in this study
of the PINN includes three terms that can be written as,
employ eight hidden layers with 20 neurons in each layer. The learning

Fig. 1. Four groundwater problems solved by PINN and MODFLOW 2005 with different forcing conditions as, a) the head at the left and right BCs increases instantly
without any recharge occurring, b) BCs are fixed, while a uniform recharge occurs throughout the system, c) BCs are fixed and a non-uniformly (linearly) varying
recharge occurs, and d) left BC is fixed and the right BC is no-flux with uniform recharge term. Dotted red lines and solid arrows represent transient groundwater head
distribution and aquifer recharge, respectively.

3
A.S.A. Ali et al. Groundwater for Sustainable Development 25 (2024) 101172

Fig. 2. Illustration of three types of collocation points, including internal PDE, IC, and BC points, distributed randomly throughout the space and time domains of the
PINN model.

Fig. 3. General computational scheme of a PINN model that combines a deep learning algorithm with an automatic differentiation feature to solve Eq. (3), the
governing equation of 1D non-dimensional groundwater flow (Cai et al., 2021).

rate was set to 0.01, and the weights and biases of the neural networks 4. Results
were determined and updated utilizing the Adam Optimizer (Bock and
Weiβ, 2019; Kingma and Ba, 2014). This section compares PINN solutions of the four groundwater flow

Table 1
Summary of collocation points, epochs, and forcing conditions used in various test problems in Fig. 1.
Problem in Fig. 1 Randomly distributed Collocation Points Epochs Recharge Term, w IC (x, 0) BC1 φ(0, t) BC2

Internal PDE BC IC

(a) 10,000 600 100 20,000 0 0 0.2 φ(1, t) = 0.7


(b) 10,000 1700 850 17,000 1 0.5 0.5 φ(0, t) = 0.5
(c) 20,000 14,000 7000 15,000 w =x 0.5 0.5 φ(0, t) = 0.5
)
(d) 10,000 700 350 15,000 1 0 0 ( ∂φ
=0
∂x |x=1

4
A.S.A. Ali et al. Groundwater for Sustainable Development 25 (2024) 101172

problems, shown in Fig. 1, with MODFLOW 2005 results. Table 1 sum­ Table 2
marizes the number of internal PDE, IC, and BC collocation points and Mean squared error between PINN and MODFLOW 2005 solutions for the four
epochs that control the number of passes of the entire dataset within test problems in Fig. 1.
each PINN for each problem (Brownlee, 2018). The governing equation Problem in Time, t MSE [− ] Problem in Time, t MSE [− ]
of all problems is Eq. (3), which has been solved by the different Fig. 1 [− ] Fig. 1 [− ]
recharge and BCs, as summarized in Table 1. These problems include (a) 0.07 1.68 × (c) 0.07 8.32 ×
uniform initial conditions and different forcing conditions, such as 10− 4 10− 8
uniform and nonuniform recharge with suddenly changing, fixed, or 0.15 3.15 × 0.15 5.58 ×
10− 6 10− 8
no-flow BCs.
0.50 3.47 × 0.50 1.20 ×
After training PINN models according to Table 1, both PINN and 10− 6 10− 8
MODFLOW 2005 were formulated to compute the solutions at 10,000 × (b) 0.07 2.19 × (d) 0.07 6.55 ×
10,000 uniformly distributed points within the non-dimensional space, 10− 7 10− 7
x ∈ [0, 1] and transient time domains, t ∈ [0, 0.5], before effectively 0.15 2.86 × 0.25 1.42 ×
10− 7 10− 6
reaching steady-state conditions. Fig. 4 illustrates the results at three 0.50 1.93 × 0.50 2.69 ×
different times: 0.07, 0.15, and 0.50, corresponding to the early, inter­ 10− 7 10− 6
mediate, and late (steady-state) stages of transition. Table 2 also com­
pares the solutions using mean squared error (MSE) values.

Fig. 4. Comparison of solutions performed by PINN and MODFLOW 2005 for four groundwater flow problems shown in Fig. 1 at various time steps (i.e., early,
intermediate, and late transition stages).

5
A.S.A. Ali et al. Groundwater for Sustainable Development 25 (2024) 101172

5. Discussion and future directions traditional time-methods such as the forward Euler and the Crank-
Nicolson schemes exhibit a notable escalation in computational costs
Scientists, engineers, and policymakers agree that recent AI advances (Zhang et al., 2022). The PINN models developed in this study were
have significantly impacted their respective fields. Hence, they all strive executed by MATLAB, which is known to be slower than Fortran and
to challenge AI’s ability to provide novel solutions to their problems by C++ compilers used by numerical modeling tools such as MODFLOW
pushing the boundaries of AI capabilities. In surface hydrology, AI tools (Andrews, 2012; Zhang, 1998). MATLAB is an interpreted language that
have been used to study several problems since the late 1970s, including executes a code line by line through an interpreter. In contrast, Fortran is
rainfall-runoff modeling, streamflow modeling, and water quality compiled, with the entire code translated into machine code before
modeling (Czyczula Rudjord et al., 2022; Talei, 2022). AI tools inspire execution, contributing to its faster performance (De Rose and Padua,
surface hydrologists to improve AI applications in their problems. In 1996).
contrast, groundwater hydrologists have not yet viewed AI as a prom­ In this study, we trained all four PINN models using MATLAB on a
ising method for solving problems related to flow and contaminant personal computer with an Intel Core i7-9750H CPU with 2.60 GHz and
transport issues. The main reason is that the black-box nature of AI a 64-bit Windows 11 operating system. We were able to train each model
models could not capture the groundwater flow physics. So far, the with fewer than five trials, and each try took less than 3.5 h. The speed of
application of AI in the groundwater field has been mostly limited to the developed PINN models was compared with MODFLOW 2005 and
time series analysis of groundwater head fluctuations at individual MODFLOW 6 using PCG Solver. Table 3 summarizes the computational
monitoring points (Bahmani and Ouarda, 2021; Momeneh and Nourani, performance data for all models that employed 10,000 spatial and
2022; Mozaffari et al., 2022; Rajaee et al., 2019; Vadiati et al., 2022). 10,000 time steps before the flow relaxes into a steady-state condition.
These scalar applications could not develop vector-based flux informa­ PINN models run by MATLAB Compiler produced transient solutions
tion, which is heavily relied upon by groundwater modelers in various slightly slower than MODFLOW 2005 executed in Fortran. However,
investigations. However, with the recent developments in the PINN MODFLOW 6 and the finite-difference model developed within MATLAB
model, a new window of opportunity has opened for using AI to solve were significantly slower. In the future, it should be possible to
groundwater flow PDEs with different initial and boundary conditions. dramatically improve the runtime of the PINN models by using Fortran
Table 4 presents a detailed comparison between the PINN and the or C++ codes instead of the MATLAB coding environment.
widely used MODFLOW model in groundwater science. By assessing The fifth advantage is that the PINN models are capable of providing
various criteria of both models, the table offers insights into PINN’s solutions at any particular time with a single calculation (like analytical
limitations, advantages over MODFLOW, and its unexplored potential, solutions), as opposed to MODFLOW models that require a series of
which is further elaborated upon below. calculations starting from the initial condition and marching forward in
Potential and advantages of PINN: There are six main reasons why time until reaching the desired time or location. With effective and
PINN models have the potential to advance significantly in the appropriate use of this capability of PINN models, it is possible to reduce
groundwater modeling field (Table 4). Firstly, PINN is not a mesh-based the runtime significantly. Moreover, this capability allows for focused
solver (Zhang et al., 2022). In contrast to mesh-based models, such as analysis on specific temporal and spatial domains as needed, stream­
MODFLOW and FEFLOW, which only provide solutions at specific nodes lining the modeling process and enhancing flexibility in addressing
(that depend on grid discretization) and at particular time points (that targeted scenarios.
rely on time step), PINN models can provide the solution at any arbitrary Finally, since AI tools are based on the principles of biological neu­
and continuous point and time (like analytical solutions). This charac­ rons, as pointed out by recent investigations, it has a fascinating
teristic can help better represent groundwater dynamics when evolutionary capability known as Curriculum Learning (Wang et al.,
high-resolution spatial and temporal information is required at specific 2021). AI was conceived as a model of the human brain. Therefore, it
spatio-temporal scales, such as in the simulation of surface-groundwater makes sense that the learning process can be patterned after how
interactions in hyporheic zones. However, it should be noted that the humans (babies) learn, from simple to complex problems (Soviany et al.,
accuracy of the PINN model in capturing the physics of groundwater 2022). This easy-to-hard training paradigm would allow the develop­
flow is contingent upon training it using an optimal number of collo­ ment of simple AI groundwater models and later improve (or grow)
cation points in both time and space domains. Typically, the complexity them to solve complex systems. Using this approach, an AI-based
of a problem, including factors such as initial conditions (e.g., nonuni­ groundwater model trained to solve simple problems has the potential
formity) and boundary conditions (e.g., time-varying), dictates the to be progressively re-trained to solve more complex problems.
suitable number of collocation points. Like other deep learning models, Challenges and limitations of PINN: Despite the promising attri­
this determination is made using iterative testing and refinement steps. butes of PINN, it is important to acknowledge its current limitations and
Thus, understanding the significance of each collocation point (i.e., in­ challenges, specifically compared with conventional packages such as
ternal PDE, IC, and BC collocation points) in solving the groundwater MODFLOW (Table 4). PINN models still suffer from the limitations
flow problem can enhance the allocation of computational resources, inherent in all neural network models. In neural networks, overfitting
potentially leading to improved efficiency in PINN models. This aspect and underfitting are common challenges, and PINN models are no
certainly warrants further investigation. exception. Additionally, PINN solutions must be tuned according to
The second advantage is that it is possible that PINN models might several hyperparameters (e.g., learning rate, number of layers, and
not have the instability or drying cell issues that conventional ground­ number of neurons per layer). A poorly chosen set of hyperparameters
water models have under certain conditions, such as a numerical layer can adversely affect the performance of the model. Furthermore, The
becoming thin or dry. Although the stability of PINN models in
groundwater problems has yet to be thoroughly investigated, the
Table 3
absence of timestps and incremental space constraints suggests that they
Comparing the PINN model runtime for four test problems with MODLFOW
could be free from conventional instability problems.
2005, MODFLOW-6, and MATLAB-based FD models.
The third advantage is that the PINN models have the potential to
Models Running time to solve the problem in Fig. 1 (seconds)
find solutions faster than numerical codes such as MODFLOW. Although
training PINN models may be more time-consuming than developing a (a) (b) (c) (d)
well-designed MODFLOW model, it is crucial to consider that once a PINN 163 192 189 173
PINN model is trained, forecasting simulations can be more computa­ MODFLOW 2005 133 139 141 141
tionally efficient. Differences become more apparent when high spatial MODFLOW 6 4030 4030 4015 3975
MATLAB FD 6747 6421 7210 6870
and temporal resolution is necessary. With increasing time iterations,

6
A.S.A. Ali et al. Groundwater for Sustainable Development 25 (2024) 101172

Table 4 CRediT authorship contribution statement


Comparative assessment of PINN and MODFLOW.
Criteria MODFLOW PINN Ahmed Shakir Ali Ali: Writing – review & editing, Writing – original
draft, Validation, Investigation, Formal analysis, Data curation. Farhad
Modeling Approach Finite Difference Artificial Neural
Network Jazaei: Writing – review & editing, Validation, Supervision, Resources,
Mesh-based or meshless Mesh-based Meshless Conceptualization. T. Prabhakar Clement: Writing – review & editing,
Marching in time/space Time-stepping/ Direct/Direct Supervision, Conceptualization. Brian Waldron: Writing – review &
incremental editing, Supervision, Conceptualization.
Input data dependency Low-high High
Incorporation of physics Yes Yes
Establishment in industry/academia High/High None/Low
The complexity of problems solved Simple to complex Simple Declaration of competing interest
Efficiency in model setup and Low to high High due to
preparation for running training
Running time Lower than PINN Higher than
The authors declare the following financial interests/personal re­
MODFLOW lationships which may be considered as potential competing interests:
Computational resource Low to high High Prabhakar Clement reports financial support was provided by National
Stability issues Low to high Unknown Science Foundation, United States.

training process for PINNs can become exceedingly time-consuming and Data availability
computationally demanding when dealing with large and intricate ar­
chitectures, such as those involving numerous layers and neurons. In Data will be made available on request.
order to accomplish this, it is necessary to utilize specialized computa­
tional resources, which are often quite costly. When compared to References
MODFLOW, which can typically be run on standard computer configu­
Alakayleh, Z., Fang, X., Clement, T.P., 2022. A simple method for correcting the effects of
rations in recent years, the training of PINN may require access to
initial soil moisture on Modified Philip-Dunne Infiltrometer drawdown curves.
expensive computing infrastructure. The discrepancy in resource re­ Groundwater for Sustainable Development 18, 100775.
quirements underscores the practical challenges associated with Ali, A.S.A., Günal, M., 2021. Artificial neural network for estimation of local scour depth
implementing PINN models, particularly in comparison with more around bridge piers. Arch. Hydro-Eng. Environ. Mech. 68 (2), 87–101.
Andrews, T., 2012. Computation Time Comparison between Matlab and C++ Using
established alternatives such as MODFLOW. Launch Windows.
Ao, C., Zeng, W., Wu, L., Qian, L., Srivastava, A.K., Gaiser, T., 2021. Time-delayed
6. Conclusion machine learning models for estimating groundwater depth in the Hetao Irrigation
District, China. Agric. Water Manag. 255, 107032.
Ashiq, M.M., Rehman, H.U., Khan, N.M., 2020. Impact of large diameter recharge wells
Technology growth over the past decade has indicated that AI will for reducing groundwater depletion rates in an urban area of Lahore, Pakistan.
continue to make significant advances. In light of these facts, ground­ Environ. Earth Sci. 79, 1–14.
Azizi, K., Kashani, A.R., Ebrahimi, S., Jazaei, F., 2022. Application of a multi-objective
water hydrologists need to develop the application of PINN models to optimization model for the design of piano key weirs with a fixed dam height. Can. J.
handle future groundwater problems. Both industry professionals and Civ. Eng. 49 (11), 1764–1778.
academicians have widely used and trusted MODFLOW due to its Bahmani, R., Ouarda, T.B., 2021. Groundwater level modeling with hybrid artificial
intelligence techniques. J. Hydrol. 595, 125659.
robustness and established methodologies, during the last decades. Even Bailey, R.T., Wible, T.C., Arabi, M., Records, R.M., Ditty, J., 2016. Assessing regional-
though PINN has not yet established itself as a trustworthy package, it scale spatio-temporal patterns of groundwater–surface water interactions using a
presents a promising solution to some of the challenges inherent in coupled SWAT-MODFLOW model. Hydrol. Process. 30 (23), 4420–4433.
Baydin, A.G., Pearlmutter, B.A., Radul, A.A., Siskind, J.M., 2018. Automatic
MODFLOW. There are several steps that need to be taken in order to
differentiation in machine learning: a survey. Journal of Marchine Learning
enhance its reputation and application. Firstly, PINN’s solution should Research 18, 1–43.
be rigorously validated and verified across diverse and complex Bock, S., Weiß, M., 2019. A proof of local convergence for the Adam optimizer. In: 2019
groundwater modeling scenarios (e.g., varying stresses and heteroge­ International Joint Conference on Neural Networks (IJCNN), pp. 1–8.
Brownlee, J., 2018. What is the difference between a batch and an epoch in a neural
neity) in order to ensure its accuracy and performance. Thus, a collab­ network. Machine Learning Mastery 20.
oration between groundwater modelers, computer scientists, and Cai, S., Mao, Z., Wang, Z., Yin, M., Karniadakis, G.E., 2021. Physics-informed neural
domain experts is essential for iteratively improving PINN and estab­ networks (PINNs) for fluid mechanics: a review. Acta Mech. Sin. 37 (12),
1727–1738.
lishing it as a trusted tool, of course, with a healthy dose of skepticism Cuomo, S., De Rosa, M., Giampaolo, F., Izzo, S., Di Cola, V.S., 2023. Solving groundwater
and optimism. Furthermore, comprehensive documentation and user flow equation using physics-informed neural networks. Comput. Math. Appl. 145,
support should be provided to facilitate its adoption and implementation 106–123.
Czyczula Rudjord, Z., Reid, M.J., Schwermer, C.U., Lin, Y., 2022. Laboratory
within the groundwater modeling community. With these concerted development of an AI system for the real-time monitoring of water quality and
efforts, PINN may be able to evolve into a robust and widely used detection of anomalies arising from chemical contamination. Water 14 (16), 2588.
groundwater modeling package, complementing and potentially De Rose, L., Padua, D., 1996. A MATLAB to Fortran 90 translator and its effectiveness. In:
Proceedings of the 10th International Conference on Supercomputing, pp. 309–316.
exceeding the capabilities of traditional approaches such as MODFLOW. Depina, I., Jain, S., Mar Valsson, S., Gotovac, H., 2022. Application of physics-informed
neural networks to inverse problems in unsaturated groundwater flow. Georisk 16
Funding (1), 21–36.
Dey, S., Dey, A.K., Mall, R.K., 2021. Modeling long-term groundwater levels by exploring
deep bidirectional long short-term memory using hydro-climatic data. Water Resour.
The Herff College of Engineering at the University of Memphis sup­ Manag. 35, 3395–3410.
ported ASAA through its graduate student assistantship program. TPC Diersch, H., 1981. Finite-Element-Galerkin-Modell zur Simulation zweidimensionaler
efforts were partly supported by a research grant awarded by the Na­ konvektiver und dispersiver Stofftransportprozesse im Boden.
Diersch, H.-J.G., 2013. FEFLOW: Finite Element Modeling of Flow, Mass and Heat
tional Science Foundation (R11-Track2 IGM project award: OIA Transport in Porous and Fractured Media. Springer Science & Business Media.
2019561). FJ also kindly acknowledges the partial summer support Ding, B., Qian, H., Zhou, J., 2018. Activation functions and their characteristics in deep
provided by the IGM project. neural networks. In: 2018 Chinese Control and Decision Conference (CCDC),
pp. 1836–1841.
Eivazi, H., Tahani, M., Schlatter, P., Vinuesa, R., 2022. Physics-informed neural networks
for solving Reynolds-averaged Navier–Stokes equations. Phys. Fluids 34 (7), 075117.
Elliott, C., 2018. The simple essence of automatic differentiation. Proceedings of the
ACM on Programming Languages 2, 1–29. ICFP.

7
A.S.A. Ali et al. Groundwater for Sustainable Development 25 (2024) 101172

Faroughi, S.A., Pawar, N., Fernandes, C., Das, S., Kalantari, N.K., Mahjour, S.K., 2022. Paul, S., Waldron, B., Jazaei, F., Larsen, D., Schoefernacker, S., 2022. Groundwater well
Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in optimization to minimize contaminant movement from a surficial shallow aquifer to
Scientific Computing. ArXiv Preprint ArXiv:2211.07377. a lower water supply aquifer using stochastic simulation-optimization modeling
Feng, D., Tan, Z., He, Q., 2023. Physics-informed neural networks of the saint-venant techniques: strategy formulation. MethodsX 9, 101765.
equations for downscaling a large-scale river model. Water Resour. Res. 59 (2), Qiu, R., Huang, R., Xiao, Y., Wang, J., Zhang, Z., Yue, J., Zeng, Z., Wang, Y., 2022.
e2022WR033168. Physics-informed neural networks for phase-field method in two-phase flow. Phys.
Goodfellow, I., Bengio, Y., Courville, A., 2016. Deep Learning. MIT press. Fluids 34 (5), 052109.
Hou, Q., Sun, Z., He, L., Karemat, A., 2022. Orthogonal grid physics-informed neural Raissi, M., Perdikaris, P., Karniadakis, G.E., 2017. Machine learning of linear differential
networks: a neural network-based simulation tool for advection–diffusion–reaction equations using Gaussian processes. J. Comput. Phys. 348, 683–693.
problems. Phys. Fluids 34 (7), 077108. Raissi, M., Perdikaris, P., Karniadakis, G.E., 2019. Physics-informed neural networks: a
Huang, X., Alkhalifah, T., Song, C., 2021. A modified physics-informed neural network deep learning framework for solving forward and inverse problems involving
with positional encoding. SEG/AAPG/SEPM First International Meeting for Applied nonlinear partial differential equations. J. Comput. Phys. 378, 686–707.
Geoscience & Energy. Rajaee, T., Ebrahimi, H., Nourani, V., 2019. A review of the artificial intelligence
Jazaei, F., Simpson, M.J., Clement, T.P., 2016. Spatial analysis of aquifer response times methods in groundwater level modeling. J. Hydrol. 572, 336–351.
for radial flow processes: nondimensional analysis and laboratory-scale tests. Rall, L.B., Corliss, G.F., 1996. An introduction to automatic differentiation.
J. Hydrol. 532, 1–8. Computational Differentiation: techniques. Applications, and Tools 89, 1–18.
Jazaei, F., Simpson, M.J., Clement, T.P., 2014. An analytical framework for quantifying Raynaud, G., Houde, S., Gosselin, F.P., 2022. ModalPINN: an extension of physics-
aquifer response time scales associated with transient boundary conditions. informed Neural Networks with enforced truncated Fourier decomposition for
J. Hydrol. 519, 1642–1648. periodic flow reconstruction using a limited number of imperfect sensors. J. Comput.
Jazaei, F., Simpson, M.J., Clement, T.P., 2017. Understanding time scales of diffusive Phys. 464, 111271.
fluxes and the implication for steady state and steady shape conditions. Geophys. Roshni, T., Mirzania, E., Hasanpour Kashani, M., Bui, Q.-A.T., Shamshirband, S., 2022.
Res. Lett. 44 (1), 174–180. Hybrid support vector regression models with algorithm of innovative gunner for the
Jazaei, F., Waldron, B., Schoefernacker, S., Larsen, D., 2018. Application of numerical simulation of groundwater level. Acta Geophys. 70 (4), 1885–1898.
tools to investigate a leaky aquitard beneath urban well fields. Water 11 (1), 5. Sanga, U., Koli, U., 2023. Mental models of sustainable groundwater management among
Kingma, D.P., Ba, J., 2014. Adam: A Method for Stochastic Optimization. ArXiv Preprint farmers in semi-arid regions of Maharashtra, India. Groundwater for Sustainable
ArXiv:1412.6980. Development, 100904.
Lau, M.M., Lim, K.H., 2018. Review of adaptive activation function in deep neural Sankar, N., Malone, J., Tassa, Y., 1982. A strongly implicit procedure for steady three-
network. In: 2018 IEEE-EMBS Conference on Biomedical Engineering and Sciences dimensional transonic potential flows. AIAA J. 20 (5), 598–605.
(IECBES), pp. 686–690. Secci, D., Godoy, V.A., Gómez-Hernández, J.J., 2024. Physics-Informed Neural Networks
Lu, Y., Mei, G., 2022. A deep learning approach for predicting two-dimensional soil for solving transient unconfined groundwater flow. Comput. Geosci. 182, 105494.
consolidation using physics-informed neural networks (PINN). Mathematics 10 (16), Shadab, M.A., Luo, D., Hiatt, E., Shen, Y., Hesse, M.A., 2023. Investigating steady
2949. unconfined groundwater flow using Physics Informed Neural Networks. Adv. Water
Mahesh, R.B., Leandro, J., Lin, Q., 2022. Physics informed neural network for spatial- Resour., 104445
temporal flood forecasting. In: Climate Change and Water Security: Select Shen, C., Appling, A.P., Gentine, P., Bandai, T., Gupta, H., Tartakovsky, A., et al., 2023.
Proceedings of VCDRR 2021, pp. 77–91. Differentiable modelling to unify machine learning and physical models for
Mahmoudabadbozchelou, M., Karniadakis, G.E., Jamali, S., 2022. nn-PINNs: non- geosciences. Nat. Rev. Earth Environ. 4 (8), 552–567.
Newtonian physics-informed neural networks for complex fluid modeling. Soft Simpson, M.J., Jazaei, F., Clement, T.P., 2013. How long does it take for aquifer recharge
Matter 18 (1), 172–185. or aquifer discharge processes to reach steady state? J. Hydrol. 501, 241–248.
Margossian, C.C., 2019. A review of automatic differentiation and its efficient Soviany, P., Ionescu, R.T., Rota, P., Sebe, N., 2022. Curriculum learning: a survey. Int. J.
implementation. Wiley interdisciplinary reviews: Data Min. Knowl. Discov. 9 (4), Comput. Vis. 130 (6), 1526–1565.
e1305. Talei, A., 2022. Artificial intelligence in real-time rainfall-runoff modelling and flood
Manandhar, A., Greeff, H., Thomson, P., Hope, R., Clifton, D.A., 2020. Shallow aquifer forecasting. In: Artificial Intelligence and Environmental Sustainability: Challenges
monitoring using handpump vibration data. J. Hydrol. X 8, 100057. and Solutions in the Era of Industry 4.0. Springer, pp. 87–103.
Manzoor, B., Othman, I., Durdyev, S., Ismail, S., Wahab, M.H., 2021. Influence of Tartakovsky, A.M., Marrero, C.O., Perdikaris, P., Tartakovsky, G.D., Barajas-Solano, D.,
artificial intelligence in civil engineering toward sustainable development—a 2018. Learning Parameters and Constitutive Relationships with Physics Informed
systematic literature review. Applied System Innovation 4 (3), 52. Deep Neural Networks. ArXiv Preprint ArXiv:1808.03398.
Mao, Z., Jagtap, A.D., Karniadakis, G.E., 2020. Physics-informed neural networks for Tiwari, M., Vadhiyar, S., 2022. Pipelined Preconditioned Conjugate Gradient Methods
high-speed flows. Comput. Methods Appl. Mech. Eng. 360, 112789. for real and complex linear systems for distributed memory architectures. J. Parallel
McDonald, M.G., Harbaugh, A.W., 1988. A modular three-dimensional finite-difference Distr. Comput. 163, 147–155.
ground-water flow model. US Geological Survey. Vadiati, M., Rajabi Yami, Z., Eskandari, E., Nakhaei, M., Kisi, O., 2022. Application of
Mehl, S.W., Hill, M.C., 2013. MODFLOW-LGR-documentation of ghost node local grid artificial intelligence models for prediction of groundwater level fluctuations: case
refinement (LGR2) for multiple areas and the boundary flow and head (BFH2) study (Tehran-Karaj alluvial aquifer). Environ. Monit. Assess. 194 (9), 619.
package. US Geological Survey Techniques and Methods 6–A44. Verma, A., 2000. An introduction to automatic differentiation. Curr. Sci. 804–807.
Meng, X., Li, Z., Zhang, D., Karniadakis, G.E., 2020. PPINN: parareal physics-informed Voss, C.I., 1984. A finite-element simulation model for saturated-unsaturated, fluid-
neural network for time-dependent PDEs. Comput. Methods Appl. Mech. Eng. 370, density-dependent ground-water flow with energy transport or chemically-reactive
113250. single-species solute transport. Water Resources Investigation Report 84, 4369.
Momeneh, S., Nourani, V., 2022. Forecasting of groundwater level fluctuations using a Walter, L., Parisio, F., Vilarrasa, V., 2022. Prediction of Subsurface Fluid Flow via Physics
hybrid of multi-discrete wavelet transforms with artificial intelligence models. Nord. Informed Neural Networks. EGU General Assembly Conference Abstracts, EGU22-
Hydrol 53 (6), 914–944. 12361.
Mozaffari, S., Javadi, S., Moghaddam, H.K., Randhir, T.O., 2022. Forecasting Wang, X., Chen, Y., Zhu, W., 2021. A survey on curriculum learning. IEEE Trans. Pattern
groundwater levels using a hybrid of support vector regression and particle swarm Anal. Mach. Intell. 44 (9), 4555–4576.
optimization. Water Resour. Manag. 36 (6), 1955–1972. Zhang, X., Zhu, Y., Wang, J., Ju, L., Qian, Y., Ye, M., Yang, J., 2022. GW-PINN: a deep
Muenratch, P., Nguyen, T.P.L., 2023. Determinants of water use saving behaviour toward learning algorithm for solving groundwater flow equations. Adv. Water Resour. 165,
sustainable groundwater management. Groundwater for Sustainable Development 104243.
20, 100898. Zhang, Y., 1998. Solving large-scale linear programs by interior-point methods under the
Nabian, M.A., Gladstone, R.J., Meidani, H., 2021. Efficient training of physics-informed MATLAB environment. Optim. Methods Software 10 (1), 1–31.
neural networks via importance sampling. Comput. Aided Civ. Infrastruct. Eng. 36 Zheng, Q., Zeng, L., Karniadakis, G.E., 2020. Physics-informed semantic inpainting:
(8), 962–977. application to geostatistical modeling. J. Comput. Phys. 419, 109676.

You might also like