Statistics > Machine Learning
[Submitted on 5 Dec 2019 (v1), revised 28 Feb 2021 (this version, v6), latest version 28 Dec 2021 (v9)]
Title:Solving Bayesian Inverse Problems via Variational Autoencoders
View PDFAbstract:In recent years, the field of machine learning has made phenomenal progress in the pursuit of simulating real-world data generation processes. One notable example of such success is the variational autoencoder (VAE). In this work, with a small shift in perspective, we leverage and adapt VAEs for a different purpose: uncertainty quantification in scientific inverse problems. We introduce UQ-VAE: a flexible, adaptive, hybrid data/model-informed framework for training neural networks capable of rapid modelling of the posterior distribution representing the unknown parameter of interest. Specifically, from divergence-based variational inference, our framework is derived such that most of the information usually present in scientific inverse problems is fully utilized in the training procedure. Additionally, this framework includes an adjustable hyperparameter that allows selection of the notion of distance between the posterior model and the target distribution. This introduces more flexibility in controlling how optimization directs the learning of the posterior model. Further, this framework possesses an inherent adaptive optimization property that emerges through the learning of the posterior uncertainty.
Submission history
From: Hwan Goh [view email][v1] Thu, 5 Dec 2019 16:33:32 UTC (6,177 KB)
[v2] Wed, 11 Dec 2019 02:09:13 UTC (6,072 KB)
[v3] Mon, 6 Jan 2020 20:44:37 UTC (9,732 KB)
[v4] Mon, 19 Oct 2020 16:51:16 UTC (3,809 KB)
[v5] Sat, 12 Dec 2020 02:39:05 UTC (16,656 KB)
[v6] Sun, 28 Feb 2021 22:44:52 UTC (15,996 KB)
[v7] Sun, 7 Mar 2021 06:42:51 UTC (15,995 KB)
[v8] Wed, 5 May 2021 02:22:11 UTC (16,026 KB)
[v9] Tue, 28 Dec 2021 05:14:14 UTC (16,032 KB)
Current browse context:
stat.ML
References & Citations
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.