Optimizing a Physics-Informed Neural Network to solve the Reynolds Equation
DOI:
https://doi.org/10.31349/RevMexFis.71.020601Keywords:
PINN, PDE solution, Reynolds Equation, Fluid Dynamics, Hyperparameters OptimizationAbstract
This study focuses on the optimization of a Physics-Informed Neural Network (PINN) to address Partial Differential Equation (PDE) problems associated with fluid flow. Specifically, the stationary, one-dimensional classical Reynolds equation is solved using the PINN. Within the conducted studies, a comparison is made between the solutions obtained using the PINN, the numerical Finite Difference Method (FD), and the analytical solution. We study various scenarios with diverse hyper-parameters such as learning rate, epochs, number of training points, etc., for constructing the neural network to identify the optimal setup. The PINN accurately approximated the solution to the Reynolds equation (up to O(10−2 ). This suggests that PINNs can be used to address diverse problems in fluid dynamics. We proposed a PINN configuration that outperformed the PINN presented in the literature. The finite differences method obtains a better approximation than the PINNs, however, the full potential of the PINNs is yet to be determined, as it can include data from the problem, that finite difference method (FD) can not. Further studies are planned to investigate the capabilities of PINNs.
References
Y. Chen et al., Physics-informed neural networks for inverse problems in nano-optics and metamaterials, Optics express 28 (2020) 11618
M. Raissi, P. Perdikaris, and G. E. Karniadakis, Physics informed deep learning (part i): Data-driven solutions of nonlinear partial differential equations, arXiv preprint arXiv:1711.10561 (2017)
M. Raissi, P. Perdikaris, and G. E. Karniadakis, Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations, arXiv preprint arXiv:1711.10566 (2017)
M. Raissi, P. Perdikaris, and G. E. Karniadakis, Physicsinformed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, Journal of Computational physics 378 (2019) 686
A. D. Jagtap, E. Kharazmi, and G. E. Karniadakis, Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems, Computer Methods in Applied Mechanics and Engineering 365 (2020) 113028
X. Jin et al., NSFnets (Navier-Stokes flow nets): Physicsinformed neural networks for the incompressible Navier-Stokes equations, Journal of Computational Physics 426 (2021) 109951
T. T. Garipov et al., Unified thermo-compositional-mechanical framework for reservoir simulation, Computational Geosciences 22 (2018) 1039
J.-L. Wu, H. Xiao, and E. Paterson, Physics-informed machine learning approach for augmenting turbulence models: A comprehensive framework, Physical Review Fluids 3 (2018) 074602
U. binWaheed et al., PINNeik: Eikonal solution using physicsinformed neural networks, Computers & Geosciences 155 (2021) 104833
C. Rao, H. Sun, and Y. Liu, Physics-informed deep learning for incompressible laminar flows, Theoretical and Applied Mechanics Letters 10 (2020) 207
Z. Mao, A. D. Jagtap, and G. E. Karniadakis, Physics-informed neural networks for high-speed flows, Computer Methods in Applied Mechanics and Engineering 360 (2020) 112789
B. Reyes et al., Learning unknown physics of non-Newtonian fluids, Physical Review Fluids 6 (2021) 073301
E. Haghighat et al., A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics, Computer Methods in Applied Mechanics and Engineering 379 (2021) 113741
C. Rao, H. Sun, and Y. Liu, Physics-informed deep learning for computational elastodynamics without labeled data, Journal of Engineering Mechanics 147 (2021) 04021043
E. Haghighat et al., A nonlocal physics-informed deep learning framework using the peridynamic differential operator, Computer Methods in Applied Mechanics and Engineering 385 (2021) 114012
M. Guo and E. Haghighat, Energy-based error bound of physics-informed neural network solutions in elasticity, Journal of Engineering Mechanics 148 (2022) 04022038
S. Cai et al., Physics-informed neural networks for heat transfer problems, Journal of Heat Transfer 143 (2021) 060801
S. A. Niaki et al., Physics-informed neural network for modelling the thermochemical curing process of composite-tool systems during manufacture, Computer Methods in Applied Mechanics and Engineering 384 (2021) 113959
N. Zobeiry and K. D. Humfeld, A physics-informed machine learning approach for solving heat transfer equation in advanced manufacturing and engineering applications, Engineering Applications of Artificial Intelligence 101 (2021) 104232
C. Song, T. Alkhalifah, and U. B. Waheed, Solving the frequency-domain acoustic VTI wave equation using physicsinformed neural networks, Geophysical Journal International 225 (2021) 846
C. Song and T. A. Alkhalifah, Wavefield reconstruction inversion via physics-informed neural networks, IEEE Transactions on Geoscience and Remote Sensing 60 (2021) 1
U. B. Waheed et al., A holistic approach to computing first-arrival traveltimes using neural networks, arXiv preprint arXiv:2101.11840 (2021)
O. Fuks and H. A. Tchelepi, Limitations of physics informed machine learning for nonlinear two-phase transport in porous media, Journal of Machine Learning for Modeling and Computing 1 (2020)
M. M. Almajid and M. O. Abu-Al-Saud, Prediction of porous media fluid flow using physics informed neural networks, Journal of Petroleum Science and Engineering 208 (2022) 109205
Y. W. Bekele, Physics-informed deep learning for onedimensional consolidation, Journal of Rock Mechanics and Geotechnical Engineering 13 (2021) 420
P. Shokouhi et al., Physics-informed deep learning for prediction of CO2 storage site response, Journal of Contaminant Hydrology 241 (2021) 103835
T. Kadeethum, T. M. Jørgensen, and H. M. Nick, Physicsinformed neural networks for solving nonlinear diffusivity and Biot’s equations, PloS one 15 (2020) e0232683
Y. W. Bekele, Physics-informed deep learning for flow and deformation in poroelastic media, arXiv preprint arXiv:2010.15426 (2020)
E. Haghighat, D. Amini, and R. Juanes, Physics-informed neural network simulation of multiphase poroelasticity using stress-split sequential training, Computer Methods in Applied Mechanics and Engineering 397 (2022) 115141
C. Yang, X. Yang, and X. Xiao, Data-driven projection method in fluid simulation, Computer Animation and Virtual Worlds 27 (2016) 415
Y. Zhu and N. Zabaras, Bayesian deep convolutional encoderdecoder networks for surrogate modeling and uncertainty quantification, Journal of Computational Physics 366 (2018) 415
R. K. Tripathy and I. Bilionis, Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification, Journal of computational physics 375 (2018) 565
S. Mo et al., Deep convolutional encoder-decoder networks for uncertainty quantification of dynamic multiphase flow in heterogeneous media, Water Resources Research 55 (2019) 703
J. Ling, A. Kurzawski, and J. Templeton, Reynolds averaged turbulence modelling using deep neural networks with embedded invariance, Journal of Fluid Mechanics 807 (2016) 155
N. Thuerey et al., Deep learning methods for Reynoldsaveraged Navier-Stokes simulations of airfoil flows, AIAA Journal 58 (2020) 25
N. Geneva and N. Zabaras, Quantifying model form uncertainty in Reynolds-averaged turbulence models with Bayesian deep neural networks, Journal of Computational Physics 383 (2019) 125
Y. Zhu et al., Physics-constrained deep learning for highdimensional surrogate modeling and uncertainty quantification without labeled data, Journal of Computational Physics 394 (2019) 56
G. B. Diaz-Cortes and R. Luna-Garcia, A Novel Evolutionary Algorithm: One-Dimensional Subspaces Optimization Algorithm (1D-SOA), Symmetry 15 (2023) 1873, https://doi.org/10.3390/sym15101873
H. Alibrahim and S. A. Ludwig, Hyperparameter Optimization: Comparing Genetic Algorithm against Grid Search and Bayesian Optimization, In 2021 IEEE Congress on Evolutionary Computation (CEC) (2021) pp. 1551-1559, https://doi.org/10.1109/CEC45853.2021.9504761
D. Simon, Evolutionary Optimization Algorithms (John Wiley & Sons, 2013)
C. Coello, D. Van Veldhuizen, and G. Lamont, Evolutionary Algorithms for Solving Multi-Objective Problems, Genetic Algorithms and Evolutionary Computation (Springer US, 2013), https://books.google.com.mx/books?id=VmnTBwAAQBAJ
S. Cai et al., Physics-informed neural networks (PINNs) for fluid mechanics: A review, Acta Mechanica Sinica 37 (2021) 1727
A. Almqvist and F. P. Rafols, Scientific computing with applications in tribology: A course compendium (2022)
D. C. Psichogios and L. H. Ungar, A hybrid neural networkfirst principles approach to process modeling, AIChE Journal 38 (1992) 1499
I. E. Lagaris, A. Likas, and D. I. Fotiadis, Artificial neural networks for solving ordinary and partial differential equations, IEEE transactions on neural networks 9 (1998) 987
G. Cybenko, Mathematics of control, Signals and Systems 2 (1989) 303
K. Hornik, M. Stinchcombe, and H. White, Multilayer feedforward networks are universal approximators, Neural networks 2 (1989) 359
G. Pilania et al., Physics-informed machine learning for inorganic scintillator discovery, The Journal of chemical physics 148 (2018)
S. Liu et al., Physics-informed machine learning for composition-process-property design: Shape memory alloy demonstration, Applied Materials Today 22 (2021) 100898
W. Ji et al., Stiff-pinn: Physics-informed neural network for stiff chemical kinetics, The Journal of Physical Chemistry A 125 (2021) 8098
Z. Fang and J. Zhan, Deep physical informed neural networks for metamaterial design, Ieee Access 8 (2019) 24506
O. Noakoasteen, et al., Physics-informed deep neural networks for transient electromagnetic analysis, IEEE Open Journal of Antennas and Propagation 1 (2020) 404
S. Barry and G. Mercer, Exact solutions for two-dimensional time-dependent flow and deformation within a poroelastic medium, Journal of applied mechanics 66 (1999) 536
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Z. Sánchez López, Berenice Díaz Cortés
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors retain copyright and grant the Revista Mexicana de Física right of first publication with the work simultaneously licensed under a CC BY-NC-ND 4.0 that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
