Entropy-SGD optimizes the prior of a PAC-Bayes bound Generalization properties of Entropy-SGD and data-dependent priors

Entropy-SGDoptimizesthepriorofaPAC-Bayesbound:GeneralizationpropertiesofEntropy-SGDanddata-dependentpriorsGintareKarolinaDziugaite12DanielM.Roy32Abstractstochasticgradientdescent(SGD),oneoftheworkh...