(2013. 12) VAE
published in 2013. 12
Kingma, Diederik P., and Max Welling.
Simple Summary
introduce stochastic variational inference and learning algorithm that efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable poesterior distributions, and large dataset.
reparameterization of the variational lower bound yields a lower bound estimator that can be straightforwardly optimized using a standard stochastic gradient methods.
datasets with continuous latent varialbes per datapoint, posterior inference can be made especially efficient by fitting an approximate inference model to the intractable posterior using the proposed lower bound estimator.
Manifold Hypothesis
data is concentrated around a lower dimensional manifold
Linear Regerssion
auto-encoder find the red line
VAE is find the red line and the distribution of data
Algorithms
Reparameterised Trick
Experiments
Results
Last updated