UnderstandingSelf-SupervisedLearningDynamicswithoutContrastivePairsYuandongTian1XinleiChen1SuryaGanguli12Abstractquiringexpensivetargetlabels(Devlinetal.,2018).Manystate-of-the-artSSLmethodsincompu...
TowardsDomain-AgnosticContrastiveLearningVikasVerma12Minh-ThangLuong1KenjiKawaguchi3HieuPham1QuocV.Le1Abstract(Dai&Le,2015;Howard&Ruder,2018;Petersetal.,2018;Radfordetal.,2019;Clarketal.,2020),ands...
Self-DamagingContrastiveLearningZiyuJiang1TianlongChen2BobakMortazavi1ZhangyangWang2Abstractpowerfulvisualrepresentationsfromunlabeleddata.Thestate-of-the-artContrastivelearningframeworksconsistent...
NeighborhoodContrastiveLearningAppliedtoOnlinePatientMonitoringHugoYe`che1GideonDresdner1FrancescoLocatello2MatthiasHu¨ser1GunnarRa¨tsch1Abstractpliedthismethodologytomedicaltime-seriesdata(Cheng...
ImprovedContrastiveDivergenceTrainingofEnergy-BasedModelsYilunDu1ShuangLi1JoshuaTenenbaum1IgorMordatch2AbstractFigure1:(Left)128x128samplesonunconditionalCelebA-HQ.(Right)128x128samplesonunconditio...
GraphContrastiveLearningAutomatedYuningYou1TianlongChen2YangShen1ZhangyangWang2Abstract1.IntroductionSelf-supervisedlearningongraph-structureddataSelf-supervisedlearningongraph-structureddatahasrai...
Large-MarginContrastiveLearningwithDistancePolarizationRegularizerShuoChen1GangNiu1ChenGong2JunLi2JianYang2MasashiSugiyama13AbstractIntra/Inter-ClusterDistanceEnlargementPolarizationContrastivelear...
FunctionContrastiveLearningofTransferableMeta-RepresentationsMuhammadWaleedGondal1ShrutiJoshi1NasimRahaman12StefanBauer13ManuelWu¨thrich1BernhardScho¨lkopf1AbstractrelyonthenumberofsamplesNbeingl...
DecomposedMutualInformationEstimationforContrastiveRepresentationLearningAlessandroSordoni1NouhaDziri2HannesSchulz1GeoffGordon1PhilBachman1RemiTachet1Abstractsupervisedrepresentationlearningapproac...
CLOCS:ContrastiveLearningofCardiacSignalsAcrossSpace,Time,andPatientsDaniKiyasseh1TingtingZhu1DavidA.Clifton12Abstractsharesomecontext.Bycapturingthishigh-levelsharedcontext(e.g.,medicaldiagnosis),...
ContrastiveLearningInvertstheDataGeneratingProcessRolandS.Zimmermann12YashSharma12SteffenSchneider123MatthiasBethge†1WielandBrendel†1AbstractInanutshell,Contrastivemethodsaimtolearnrepresenta-tio...
UnderstandingContrastiveRepresentationLearningthroughAlignmentandUniformityontheHypersphereTongzhouWang1PhillipIsola1AbstractContrastiverepresentationlearninghasbeenout-Alignment:Similarsampleshave...
OnContrastiveLearningforLikelihood-freeInferenceConorDurkan1IainMurray1GeorgePapamakarios2Abstractbasedonneuralnetworkshavereducedthenumberofsim-ulationsneededtoperformeffectiveinferencebyordersLik...
InfoGAN-CRandModelCentrality:Self-supervisedModelTrainingandSelectionforDisentanglingGANsZinanLin1KiranK.Thekumparampil2GiuliaFanti1SewoongOh3Abstract1.IntroductionDisentangledgenerativemodelsmapal...
Data-EfficientImageRecognitionwithContrastivePredictiveCodingOlivierJ.He´naff1AravindSrinivas2JeffreyDeFauw1AliRazavi1CarlDoersch1S.M.AliEslami1AaronvandenOord1Abstract2xfewerlabelsHumanobserversc...
CURL:ContrastiveUnsupervisedRepresentationsforReinforcementLearningMichaelLaskin⇤1AravindSrinivas⇤1PieterAbbeel1AbstractFigure1.ContrastiveUnsupervisedRepresentationsforReinforcementLearning(CURL...
ContrastiveMulti-ViewRepresentationLearningonGraphsKavehHassani1AmirHoseinKhasahmadi12Abstractworks(Kipf&Welling,2017),molecules(Duvenaudetal.,2015),andknowledgegraphs(Vivona&Hassani,2019).Weintrod...
CLUB:AContrastiveLog-ratioUpperBoundofMutualInformationPengyuCheng1WeituoHao1ShuyangDai1JiachangLiu1ZheGan2LawrenceCarin1Abstract2015),andmachinelearning(Chenetal.,2016;Alemietal.,2016;Hjelmetal.,2...
ASimpleFrameworkforContrastiveLearningofVisualRepresentationsTingChen1SimonKornblith1MohammadNorouzi1GeoffreyHinton1AbstractFigure1.ImageNetTop-1accuracyoflinearclassifierstrainedonrepresentationsl...
ATheoreticalAnalysisofContrastiveUnsupervisedRepresentationLearningSanjeevArora12HrishikeshKhandeparkar1MikhailKhodak3OrestisPlevrakis1NikunjSaunshi1AbstractForimages,aproofofexistenceforbroadlyuse...