Tag: kullback-leibler

36 KL divergence between two univariate Gaussians 2011-02-21T10:30:18.527

30 Intuition on the Kullback-Leibler (KL) Divergence 2016-01-01T17:03:42.140

28 Kullback–Leibler vs Kolmogorov-Smirnov distance 2011-04-07T11:39:13.870

27 Differences between Bhattacharyya distance and KL divergence 2014-12-27T08:11:10.453

26 An adaptation of the Kullback-Leibler distance? 2011-02-05T13:01:14.260

23 Measures of similarity or distance between two covariance matrices 2011-08-23T02:40:04.457

23 KL divergence between two multivariate Gaussians 2013-06-02T20:50:33.427

20 Kullback-Leibler divergence WITHOUT information theory 2016-11-16T12:22:18.640

18 Why do we use Kullback-Leibler divergence rather than cross entropy in the t-SNE objective function? 2017-03-07T13:26:20.230

16 Kullback-Leibler divergence - interpretation 2011-02-02T15:07:42.593

16 What is the relationship between the GINI score and the log-likelihood ratio 2014-04-23T15:43:26.190

15 Connection between Fisher metric and the relative entropy 2013-03-02T12:06:22.570

14 Questions about KL divergence? 2010-07-30T00:55:20.603

12 Kullback–Leibler divergence between two gamma distributions 2011-06-06T23:39:37.377

12 Calculate the Kullback-Leibler Divergence in practice? 2014-05-16T02:04:47.657

12 Special probability distribution 2015-12-10T22:43:56.563

10 Hypothesis testing and total variation distance vs. Kullback-Leibler divergence 2011-10-20T03:45:15.863

10 Interpretation of Radon-Nikodym derivative between probability measures? 2018-02-01T05:29:38.933

9 How to calculate Kullback-Leibler divergence/distance? 2013-06-01T22:11:49.973

9 Population stability index - division by zero 2013-12-13T11:11:08.677

8 Distance between two Gaussian mixtures to evaluate cluster solutions 2013-10-04T04:03:06.930

7 Estimate the Kullback-Leibler divergence 2011-02-03T09:31:02.100

6 How do I determine how well a dataset approximates a distribution? 2011-07-08T00:14:28.153

6 How to compute the Kullback-Leibler divergence when the PMF contains 0s? 2011-08-11T00:08:36.817

6 Kullback–Leibler divergence between two Wishart distributions 2011-12-22T18:42:33.780

6 Multivariate time series model evaluation with conditional moments 2012-05-29T14:21:19.463

6 Is it possible to apply KL divergence between discrete and continuous distribution? 2013-09-03T23:31:27.150

6 Analysis of Kullback-Leibler divergence 2014-08-11T11:40:13.137

6 KL divergence between a gamma distribution and a lognormal distribution? 2015-01-18T01:55:20.030

6 $\min D_\textrm{KL}(p(x_1,\dots,x_n) \mid\mid q_1(x_1)\cdots q_n(x_n))$ gives the marginals of $p(x_1,\dots,x_n)$? 2016-02-26T14:15:07.873

6 Kullback-Leibler Divergence 2016-05-06T07:26:29.750

6 Choose probability distribution to maximize evaluation function (for CDC flu forecasting contest) 2016-09-16T02:14:28.327

6 textbook example of KL Divergence 2016-11-29T14:58:58.217

6 Estimate the Kullback Leibler (KL) divergence with monte carlo 2017-05-21T20:49:19.153

5 Kullback-Leibler divergence 2012-02-12T20:21:35.693

5 Lomax distributions - Kullback Leibler divergence 2012-08-15T14:19:57.597

5 Kullback-Leibler divergence: negative values? 2012-10-27T12:19:20.127

5 Estimating parameters using Kullback-Leibler or Kolmogorov-Smirnoff via Nelder-Mead 2013-02-15T14:26:40.323

5 Orthogonal intersection in a Riemannian manifold 2013-03-09T07:46:25.327

5 Is the square root of the symmetric Kullback-Leibler divergence a metric? 2013-04-30T17:27:21.667

5 Jensen Shannon Divergence vs Kullback-Leibler Divergence? 2014-09-29T18:23:44.027

5 Asymmetry of the Kullback-Leibler distance in hypothesis testing 2015-01-20T19:27:43.373

5 Hypothesis test based on entropy 2015-08-04T15:19:55.870

5 Algorithm for approximating a density by a mixture density 2015-08-24T07:07:59.653

5 KL divergence and expectations 2015-12-17T21:27:11.827

5 What is the probability that a hypothesis test fails? 2017-04-30T00:00:59.003

5 Where does the Kullback-Leibler come from? 2017-08-22T12:07:53.533

5 Can KL-Divergence ever be greater than 1? 2018-01-14T17:30:54.377

4 Cramer-Rao type bound for Information Gain 2012-04-07T13:27:56.903

4 Maximum entropy sampler 2012-04-17T12:27:36.627

4 Kullback-Leibler divergence of two normal distributions 2013-08-01T15:26:39.077

4 Symmetrised Kullback - Leibler divergence 2013-08-12T03:06:39.917

4 G-test statistic and KL divergence 2013-09-10T02:16:21.517

4 Disadvantages of the Kullback-Leibler divergence 2013-12-02T23:21:14.320

4 Quantify the information lost given by the Kullback-Leibler divergence measure 2014-02-24T18:40:05.940

4 KL divergence between two univariate Poisson distributions 2015-04-11T03:53:29.647

4 variational inference with KL 2015-07-28T15:54:24.130

4 Does the local triangle inequality holds for Kullback-Leibler divergence 2015-11-05T21:55:18.617

4 Use of KL Divergence in practice 2015-12-09T07:37:54.793

4 Minimize $K(p||q)$, when $q$ is not normalizable? 2016-01-13T02:48:55.287

4 Properties of Average Multinomial Likelihood 2016-03-08T11:03:23.650

4 Kullback-Leibler divergence and probability distribution function in MATLAB 2016-08-11T14:36:02.127

4 Chow-Liu trees and Kullback Leibler divergence 2016-10-02T20:04:14.220

4 Comparing two PDFs using Kullback-Leibler divergence 2016-11-12T05:14:42.913

4 How do I compare collections of samples for differences? 2017-03-04T15:03:11.360

4 If KL-divergence's asymmetrical should I minimize KL(P||Q) or KL(Q||P)? 2017-09-17T00:54:45.923

3 Properties of Battacharyya distance vs Kullback-Leibler divergence 2011-01-31T05:39:54.900

3 Similarity / dissimilarity of two large bimodal datasets 2011-09-09T18:20:39.180

3 Property of KL-divergence 2012-01-23T10:57:23.257

3 Markov chain convergence, total variation and KL divergence 2012-04-13T12:54:58.667

3 Sample distribution for Kullback-Leibler distance 2012-09-28T15:30:41.477

3 KL divergence between 2 distributions with unequal cardinalities? 2012-10-15T09:18:38.903

3 Orthogonal intersection of linear family and exponential family 2013-03-03T07:57:46.460

3 Symmetric Kullback-Leibler divergence OR Mutual Information as a metric of distance between two distributions? 2013-05-01T02:51:24.640

3 Select best distance for feature selection 2013-07-11T09:56:50.617

3 KL-divergence between two categorical/multinomial distributions gives negative values? 2013-10-12T10:23:30.670

3 Formal statistical test for comparing likelihood distributions obtained via MCMC 2013-12-07T19:52:33.990

3 KL divergence between an uninformative (?) Gaussian and a Gaussian 2014-05-12T08:46:32.823

3 Under what conditions will Kullback-Leibler divergence/mutual information be infinity? 2014-06-30T18:52:45.983

3 Why KL-Divergence uses "ln" in its formula? 2014-10-13T05:32:17.503

3 Minimizing KL divergence from a given distribution, according to a graph 2015-01-02T16:31:52.407

3 When KL Divergence and KS test will show inconsistent results? 2015-02-09T22:21:54.227

3 Relationship between Poisson generation and generalized Kullback-Leibler divergence 2015-02-10T18:46:26.307

3 Expected ratio of probabilities--is there a term for it? 2015-04-08T18:28:15.420

3 software library to compute KL divergence? 2015-04-17T01:48:31.517

3 Properties of the KL topology [reference request] 2015-08-12T14:29:12.450

3 Quantify Difference/Distance between Lognormal distributions 2015-09-17T21:46:15.683

3 What are the assumptions that we make when we compute KL Divergence between two distributions? 2016-03-26T10:58:55.360

3 What is the intuition behind the Population Stability Index? 2016-06-20T16:03:21.243

3 What is the factor equal to if the true and empirical distribution both are 0 for a configuration? 2016-08-04T13:00:57.750

3 What is the distribution G (with given mean and variance) that has the minimum KL distance from normal distribution F? 2017-05-31T18:16:00.933

3 KL divergence bounds square of L1 norm 2017-06-19T15:19:43.550

3 What is the advantages of Wasserstein metric compared to Kullback-Leibler divergence? 2017-08-01T13:54:23.760

3 KL divergence term in VAEs 2017-11-17T07:53:03.503

3 Does it make sense to directly subtract the entropy values of two distributions instead of using measures such as KL divergence or cross entropy? 2017-11-17T09:58:05.587

3 KL Loss with a unit Gaussian 2017-12-11T11:51:43.983

3 Maximum Likelihood & Bayesian inference minimizing Kullback-Leibler divergence? 2017-12-19T15:41:27.537

2 How to to calculate the topic distribution of a document 2011-07-06T04:16:14.407

2 On the uniform convergence of relative frequencies of events to their probabilities 2013-02-01T10:27:52.117