Professional Documents
Culture Documents
FNO Darcy 3
FNO Darcy 3
The complete mathematical description of the AFNO model is beyond the scope of this material,
and we refer you to Modulus User Documentation for additional details.
𝒫(𝑢, 𝑎) = 0, in 𝐷 ⊂ ℝ𝑑 , (6)
𝑢 = 𝑔, in 𝜕𝐷. (7)
Here, 𝒫 is a Partial Differential Operator, 𝑎 are the coefficients/parameters and 𝑢 is the PDE
solution.
In the FNO framework, the surrogate ML model is given by the solution operator 𝒢†𝜃 , which maps
any given coefficient in the coefficient space 𝑎 to the solution 𝑢. The FNO is trained in a supervised
fashion using training data in the form of input/output pairs {𝑎𝑗 , 𝑢𝑗 }𝑁
𝑗=1 . The training loss for the
FNO is given by summing the data loss, ℒ𝑑𝑎𝑡𝑎 (𝒢𝜃 ) = ‖𝑢−𝒢𝜃 (𝑎)‖2 over all training pairs {𝑎𝑖 , 𝑢𝑖 , }𝑁
𝑖=1 .
In the PINO framework, the solution operator is optimized with an additional PDE loss given
by ℒ𝑝𝑑𝑒 (𝑎, 𝒢𝜃 (𝑎)) computed over i.i.d. samples 𝑎𝑗 from an appropriate supported distribution in
parameter/coefficient space.
In general, the PDE loss involves computing the PDE operator which in turn involves computing
the partial derivatives of the Fourier Neural Operator ansatz. In general, this is nontrivial. The
key set of innovations in the PINO are the various ways to compute the partial derivatives of the
operator ansatz, viz:
1. Numerical differentiation using a Finite-Difference Method (FDM).
2. Numerical differentiation computed via spectral derivative.
3. Hybrid differentiation based on a combination of first-order “exact” derivatives and second-
order FDM derivatives.
For more details, please refer the Modulus User Documentation.
Now, with this theoretical background, let’s solve the Darcy flow problem using these three ap-
proaches.