Reduced-order models (ROMs) are widely used in scientific computing to tackle high-dimensional systems. However, traditional ROM methods may only partially capture the intrinsic geometric characteristics of the data. These characteristics encompass the underlying structure, relationships, and essential features crucial for accurate modeling. To overcome this limitation, we propose a novel ROM framework that integrates optimal transport (OT) theory and neural network–based methods. Specifically, we investigate the kernel proper orthogonal decomposition method exploiting the Wasserstein distance as the custom kernel, and we efficiently train the resulting neural network employing the Sinkhorn algorithm. By leveraging an OT-based nonlinear reduction, the presented framework can capture the geometric structure of the data, which is crucial for accurate learning of the reduced solution manifold. When compared with traditional metrics such as mean squared error or cross-entropy, exploiting the Sinkhorn divergence as the loss function enhances stability during training, robustness against overfitting and noise, and accelerates convergence. To showcase the approach’s effectiveness, we conduct experiments on a set of challenging test cases exhibiting a slow decay of the Kolmogorov n-width. The results show that our framework outperforms traditional ROM methods in terms of accuracy and computational efficiency.

Optimal Transport–Inspired Deep Learning Framework for Slow-Decaying Kolmogorov n-Width Problems: Exploiting Sinkhorn Loss and Wasserstein Kernel / Khamlich, Moaad; Pichi, Federico; Rozza, Gianluigi. - In: SIAM JOURNAL ON SCIENTIFIC COMPUTING. - ISSN 1064-8275. - 47:2(2025), pp. C235-C264. [10.1137/23m1604680]

Optimal Transport–Inspired Deep Learning Framework for Slow-Decaying Kolmogorov n-Width Problems: Exploiting Sinkhorn Loss and Wasserstein Kernel

Khamlich, Moaad;Pichi, Federico;Rozza, Gianluigi
2025-01-01

Abstract

Reduced-order models (ROMs) are widely used in scientific computing to tackle high-dimensional systems. However, traditional ROM methods may only partially capture the intrinsic geometric characteristics of the data. These characteristics encompass the underlying structure, relationships, and essential features crucial for accurate modeling. To overcome this limitation, we propose a novel ROM framework that integrates optimal transport (OT) theory and neural network–based methods. Specifically, we investigate the kernel proper orthogonal decomposition method exploiting the Wasserstein distance as the custom kernel, and we efficiently train the resulting neural network employing the Sinkhorn algorithm. By leveraging an OT-based nonlinear reduction, the presented framework can capture the geometric structure of the data, which is crucial for accurate learning of the reduced solution manifold. When compared with traditional metrics such as mean squared error or cross-entropy, exploiting the Sinkhorn divergence as the loss function enhances stability during training, robustness against overfitting and noise, and accelerates convergence. To showcase the approach’s effectiveness, we conduct experiments on a set of challenging test cases exhibiting a slow decay of the Kolmogorov n-width. The results show that our framework outperforms traditional ROM methods in terms of accuracy and computational efficiency.
2025
47
2
C235
C264
https://arxiv.org/abs/2308.13840
Khamlich, Moaad; Pichi, Federico; Rozza, Gianluigi
File in questo prodotto:
File Dimensione Formato  
2025_KhamlichPichi.pdf

non disponibili

Tipologia: Versione Editoriale (PDF)
Licenza: Copyright dell'editore
Dimensione 6.41 MB
Formato Adobe PDF
6.41 MB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11767/145670
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 0
social impact