Self-consistency Reinforced minimal Gated Recurrent Unit for surrogate modeling of history-dependent non-linear problems: Application to history-dependent homogenized response of heterogeneous materials
Wu, Ling; Noels, Ludovic
2024 • In Computer Methods in Applied Mechanics and Engineering, 424, p. 116881
[en] Multi-scale simulations can be accelerated by substituting the meso-scale problem resolution by a surrogate trained from off-line simulations. In the context of history-dependent materials, Recurrent Neural Networks (RNN) have widely been considered to act as such a surrogate, since their hidden variables allow for a memory effect. However, defining a data-set for the training, which virtually covers all the possible strainstress state evolution encountered during the online phase, remains a daunting task. This is particularly true in the case in which the strain increment size is expected to vary by several orders of magnitude. Self-Consistent recurrent networks were thus introduced by Bonatti and Mohr (2022) to reinforce the self-consistency of the neural network with respect to the input increment size when acting as a surrogate of an elasto-plastic material model. When designing RNN to act as a surrogate of a meso-scale Boundary Value Problem (BVP) defined by a Representative Volume Element (RVE) of complex micro-structures, the number of learnable parameters required for existing Recurrent Neural Network (RNN) to be accurate could remain high, impeding the training performance. In this work, we revisit and design alternative self-consistent recurrent units in order to limit the number of hidden variables required for the neural network to act as a composite material surrogate in multi-scale simulations. Although the RNNs based on the newly suggested self-consistency reinforced recurrent units have a reduced number of learnable parameters yielding good training performance, they remain accurate in the context of multi-scale simulations considering various strain increment sizes.
Wu, Ling ; Université de Liège - ULiège > Département d'aérospatiale et mécanique > Computational & Multiscale Mechanics of Materials (CM3)
Noels, Ludovic ; Université de Liège - ULiège > Département d'aérospatiale et mécanique > Computational & Multiscale Mechanics of Materials (CM3)
Language :
English
Title :
Self-consistency Reinforced minimal Gated Recurrent Unit for surrogate modeling of history-dependent non-linear problems: Application to history-dependent homogenized response of heterogeneous materials
Publication date :
01 May 2024
Journal title :
Computer Methods in Applied Mechanics and Engineering
ISSN :
0045-7825
eISSN :
1879-2138
Publisher :
Elsevier, Amsterdam, Netherlands
Volume :
424
Pages :
116881
Peer reviewed :
Peer Reviewed verified by ORBi
Development Goals :
9. Industry, innovation and infrastructure
European Projects :
HE - 101056682 - DIDEAROT - Digital Design strategies to certify and mAnufacture Robust cOmposite sTructures
Name of the research project :
DIDEAROT
Funders :
EC - European Commission [BE] Union Européenne [BE]
Funding number :
101056682
Funding text :
This project has received funding from the European Union’s Horizon Europe Framework Programme under grant agreement No. 101056682 for the project ‘‘DIgital DEsign strategies to certify and mAnufacture Robust cOmposite sTructures (DIDEAROT)’’. The contents of this publication are the sole responsibility of ULiege and do not necessarily reflect the opinion of the European Union. Neither the European Union nor the granting authority can be held responsible for them.
NOTICE: this is the author’s version of a work that was accepted for publication in Computer Methods in Applied Mechanics and Engineering. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Computer Methods in Applied Mechanics and Engineering 424 (2024), DOI: 10.1016/j.cma.2024.116881
Wu, L., Noels, L., Data of “Self-consistency reinforced minimal gated recurrent unit for surrogate modeling of history-dependent non-linear problems: Application to history-dependent homogenized response of heterogeneous materials”. 2024, 10.5281/zenodo.10551272 URL: https://gitlab.uliege.be/didearot/didearotPublic/publicationsData/2024_scmru.
Furukawa, T., Yagawa, G., Implicit constitutive modelling for viscoplasticity using neural networks. Internat. J. Numer. Methods Engrg. 43:2 (1998), 195–219.
Stoffel, M., Bamer, F., Markert, B., Neural network based constitutive modeling of nonlinear viscoplastic structural response. Mech. Res. Commun. 95 (2019), 85–88, 10.1016/j.mechrescom.2019.01.004 URL: http://www.sciencedirect.com/science/article/pii/S0093641318305822.
Furukawa, T., Hoffman, M., Accurate cyclic plastic analysis using a neural network material model. Eng. Anal. Bound. Elem. 28:3 (2004), 195–204, 10.1016/S0955-7997(03)00050-X URL: http://www.sciencedirect.com/science/article/pii/S095579970300050X, Inverse Problems.
Wang, K., Sun, W., Meta-modeling game for deriving theory-consistent, microstructure-based traction–separation laws via deep reinforcement learning. Comput. Methods Appl. Mech. Engrg. 346 (2019), 216–241, 10.1016/j.cma.2018.11.026 URL: http://www.sciencedirect.com/science/article/pii/S0045782518305851.
Fernández, M., Rezaei, S., Mianroodi, J.R., Fritzen, F., Reese, S., Application of artificial neural networks for the prediction of interface mechanics: A study on grain boundary constitutive behavior. Adv. Model. Simul. Eng. Sci. 7:1 (2020), 1–27.
Lefik, M., Schrefler, B., Artificial neural network as an incremental non-linear constitutive model for a finite element code. Comput. Methods Appl. Mech. Engrg. 192:28 (2003), 3265–3283, 10.1016/S0045-7825(03)00350-5 URL: http://www.sciencedirect.com/science/article/pii/S0045782503003505. Multiscale Computational Mechanics for Materials and Structures.
Hashash, Y.M.A., Jung, S., Ghaboussi, J., Numerical implementation of a neural network based material model in finite element analysis. Internat. J. Numer. Methods Engrg. 59:7 (2004), 989–1005, 10.1002/nme.905 URL: https://onlinelibrary.wiley.com/doi/abs/10.1002/nme.905.
Lefik, M., Schrefler, B., Artificial neural network for parameter identifications for an elasto-plastic model of superconducting cable under cyclic loading. Comput. Struct. 80:22 (2002), 1699–1713, 10.1016/S0045-7949(02)00162-1 URL: http://www.sciencedirect.com/science/article/pii/S0045794902001621.
Wu, L., Zulueta, K., Major, Z., Arriaga, A., Noels, L., Bayesian inference of non-linear multiscale model parameters accelerated by a deep neural network. Comput. Methods Appl. Mech. Engrg., 360, 2020, 112693, 10.1016/j.cma.2019.112693 URL: http://www.sciencedirect.com/science/article/pii/S004578251930578X.
Wu, L., Noels, L., Recurrent neural networks (RNNs) with dimensionality reduction and break down in computational mechanics; application to multi-scale localization step. Comput. Methods Appl. Mech. Engrg., 390, 2022, 114476, 10.1016/j.cma.2021.114476 URL: https://www.sciencedirect.com/science/article/pii/S0045782521006940.
Ghavamian, F., Simone, A., Accelerating multiscale finite element simulations of history-dependent materials using a recurrent neural network. Comput. Methods Appl. Mech. Engrg., 357, 2019, 112594, 10.1016/j.cma.2019.112594 URL: http://www.sciencedirect.com/science/article/pii/S0045782519304700.
Mozaffar, M., Bostanabad, R., Chen, W., Ehmann, K., Cao, J., Bessa, M.A., Deep learning predicts path-dependent plasticity. Proc. Natl. Acad. Sci. 116:52 (2019), 26414–26420, 10.1073/pnas.1911815116 arXiv:https://www.pnas.org/content/116/52/26414.full.pdf.
Gorji, M.B., Mozaffar, M., Heidenreich, J.N., Cao, J., Mohr, D., On the potential of recurrent neural networks for modeling path dependent plasticity. J. Mech. Phys. Solids, 143, 2020, 103972, 10.1016/j.jmps.2020.103972.
Wu, L., Nguyen, V.-D., Kilingar, N.G., Noels, L., A recurrent neural network-accelerated multi-scale model for elasto-plastic heterogeneous materials subjected to random cyclic and non-proportional loading paths. Comput. Methods Appl. Mech. Engrg., 369, 2020, 113234, 10.1016/j.cma.2020.113234.
Friemann, J., Dashtbozorg, B., Fagerström, M., Mirkhalaf, S.M., A micromechanics-based recurrent neural networks model for path-dependent cyclic deformation of short fiber composites. Internat. J. Numer. Methods Engrg. 124:10 (2023), 2292–2314, 10.1002/nme.7211 URL: https://onlinelibrary.wiley.com/doi/abs/10.1002/nme.7211.
Deng, S., Hosseinmardi, S., Apelian, D., Bostanabad, R., Deep learning for multiscale damage analysis via physics-informed recurrent neural network. 2022 arXiv:2212.01880.
Im, S., Lee, J., Cho, M., Surrogate modeling of elasto-plastic problems via long short-term memory neural networks and proper orthogonal decomposition. Comput. Methods Appl. Mech. Engrg., 385, 2021, 114030, 10.1016/j.cma.2021.114030 URL: https://www.sciencedirect.com/science/article/pii/S0045782521003613.
Vijayaraghavan, S., Wu, L., Noels, L., Bordas, S., Natarajan, S., Beex, L., A data-driven reduced-order surrogate model for entire elastoplastic simulations applied to representative volume elements. Sci. Rep., 13, 2023, 12781, 10.1038/s41598-023-38104-x.
Fetni, S., Pham, T.Q.D., Hoang, T.V., Tran, H.S., Duchêne, L., Tran, X.-V., Habraken, A.M., Capabilities of auto-encoders and Principal Component Analysis of the reduction of microstructural images; Application on the acceleration of Phase-Field simulations. Comput. Mater. Sci., 216, 2023, 111820, 10.1016/j.commatsci.2022.111820 URL: https://www.sciencedirect.com/science/article/pii/S0927025622005316.
Tandale, S.B., Stoffel, M., Recurrent and convolutional neural networks in structural dynamics: A modified attention steered encoder–decoder architecture versus LSTM versus GRU versus TCN topologies to predict the response of shock wave-loaded plates. Comput. Mech. 72 (2023), 765–786, 10.1007/s00466-023-02317-8.
Rocha, I., Kerfriden, P., van der Meer, F.P., Micromechanics-based surrogate models for the response of composites: A critical comparison between a classical mesoscale constitutive model, hyper-reduction and neural networks. Eur. J. Mech. A Solids, 82, 2020, 103995, 10.1016/j.euromechsol.2020.103995.
Kibrete, F., Trzepieciński, T., Gebremedhen, H.S., Woldemichael, D.E., Artificial intelligence in predicting mechanical properties of composite materials. J. Comp. Sci., 7(9), 2023, 10.3390/jcs7090364 URL: https://www.mdpi.com/2504-477X/7/9/364.
Dornheim, J., Morand, L., Nallani, H.J., Helm, D., Neural networks for constitutive modeling: From universal function approximators to advanced models and the integration of physics. Arch. Comput. Methods Eng., 2023, 10.1007/s11831-023-10009-y.
Raissi, M., Perdikaris, P., Karniadakis, G., Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J. Comput. Phys. 378 (2019), 686–707, 10.1016/j.jcp.2018.10.045 URL: https://www.sciencedirect.com/science/article/pii/S0021999118307125.
Tandale, S.B., Bamer, F., Markert, B., Stoffel, M., Physics-based self-learning recurrent neural network enhanced time integration scheme for computing viscoplastic structural finite element response. Comput. Methods Appl. Mech. Engrg., 401, 2022, 115668, 10.1016/j.cma.2022.115668 URL: https://www.sciencedirect.com/science/article/pii/S0045782522006235.
Yuan, Z., Biswas, R., Poh, L.H., Accelerated offline setup of homogenized microscopic model for multi-scale analyses using neural network with knowledge transfer. Internat. J. Numer. Methods Engrg. 124:13 (2023), 3063–3086, 10.1002/nme.7239 URL: https://onlinelibrary.wiley.com/doi/abs/10.1002/nme.7239.
Liu, Z., Wu, C., Exploring the 3D architectures of deep material network in data-driven multiscale mechanics. J. Mech. Phys. Solids 127 (2019), 20–46, 10.1016/j.jmps.2019.03.004.
Nguyen, V.-D., Noels, L., Interaction-based material network: A general framework for (porous) microstructured materials. Comput. Methods Appl. Mech. Engrg., 2021, 114300, 10.1016/j.cma.2021.114300 URL: https://www.sciencedirect.com/science/article/pii/S0045782521005934.
Gajek, S., Schneider, M., Böhlke, T., On the micromechanics of deep material networks. J. Mech. Phys. Solids, 142, 2020, 103984, 10.1016/j.jmps.2020.103984.
Wu, L., Adam, L., Noels, L., Micro-mechanics and data-driven based reduced order models for multi-scale analyses of woven composites. Compos. Struct., 270, 2021, 114058, 10.1016/j.compstruct.2021.114058 URL: https://www.sciencedirect.com/science/article/pii/S0263822321005183.
Masi, F., Stefanou, I., Vannucci, P., Maffi-Berthier, V., Thermodynamics-based artificial neural networks for constitutive modeling. J. Mech. Phys. Solids, 147, 2021, 104277, 10.1016/j.jmps.2020.104277 URL: https://www.sciencedirect.com/science/article/pii/S0022509620304841.
Masi, F., Stefanou, I., Multiscale modeling of inelastic materials with thermodynamics-based Artificial Neural Networks (TANN). Comput. Methods Appl. Mech. Engrg., 398, 2022, 115190, 10.1016/j.cma.2022.115190 URL: https://www.sciencedirect.com/science/article/pii/S0045782522003450.
Maia, M., Rocha, I., Kerfriden, P., van der Meer, F., Physically recurrent neural networks for path-dependent heterogeneous materials: Embedding constitutive models in a data-driven surrogate. Comput. Methods Appl. Mech. Engrg., 407, 2023, 115934, 10.1016/j.cma.2023.115934 URL: https://www.sciencedirect.com/science/article/pii/S0045782523000579.
Bonatti, C., Mohr, D., On the importance of self-consistency in recurrent neural network models representing elasto-plastic solids. J. Mech. Phys. Solids, 158, 2022, 104697, 10.1016/j.jmps.2021.104697 URL: https://www.sciencedirect.com/science/article/pii/S0022509621003161.
Bonatti, C., Berisha, B., Mohr, D., From CP-FFT to CP-RNN: Recurrent neural network surrogate model of crystal plasticity. Int. J. Plast., 158, 2022, 103430, 10.1016/j.ijplas.2022.103430 URL: https://www.sciencedirect.com/science/article/pii/S074964192200208X.
Miehe, C., Schotte, J., Schröder, J., Computational micro-macro transitions and overall moduli in the analysis of polycrystals at large strains. Comput. Mater. Sci. 16:1–4 (1999), 372–382 cited By 88.
Heck, J.C., Salem, F.M., Simplified minimal gated unit variations for recurrent neural networks. 2017 IEEE 60th International Midwest Symposium on Circuits and Systems, MWSCAS, 2017, IEEE, 1593–1596.
Peric, D., de Souza Neto, E.A., Feijóo, R.A., Partovi, M., Molina, A.J.C., On micro-to-macro transitions for multi-scale analysis of non-linear heterogeneous materials: unified variational basis and finite element implementation. Internat. J. Numer. Methods Engrg. 87 (2010), 149–170 URL: http://dx.doi.org/10.1002/nme.3014.
Schröder, J., Labusch, M., Keip, M.-A., Algorithmic two-scale transition for magneto-electro-mechanically coupled problems: FE2-scheme: Localization and homogenization. Comput. Methods Appl. Mech. Engrg. 32 (2016), 253–280, 10.1016/j.cma.2015.10.005 URL: http://www.sciencedirect.com/science/article/pii/S0045782515003242.
Nguyen, V.-D., Wu, L., Noels, L., Unified treatment of microscopic boundary conditions and efficient algorithms for estimating tangent operators of the homogenized behavior in the computational homogenization method. Comput. Mech. 59:3 (2017), 483–505, 10.1007/s00466-016-1358-z.
Zhou, G.-B., Wu, J., Zhang, C.-L., Zhou, Z.-H., Minimal gated unit for recurrent neural networks. Int. J. Autom. Comput. 13:3 (2016), 226–234.
2020. URL: https://pytorch.org/. (Accessed 30 April 2020).
Cuitino, A., Ortiz, M., A material-independent method for extending stress update algorithms from small-strain plasticity to finite plasticity with multiplicative kinematics. Eng. Comput., 9, 1992, 437.