当前位置 : 首页 > 学术报告 > 正文

顾险峰:A Geometric Understanding of Deep Learning(时间3.3)

发布日期:2021-03-02  作者:刘敏  浏览数:

报告人:顾险峰 美国纽约州立大学教授

报告时间:3月3日8:30

报告地点:Zoom ID:210 089 8623 密码: 123456

主办单位:数学与统计学院

欢迎光临!

  报告摘要:This work introduces an optimal transportation (OT) view of generative adversarial networks (GANs). Natural datasets have intrinsic patterns, which can be summarized as the manifold distribution principle: the distribution of a class of data is close to a low-dimensional manifold. GANs mainly accomplish two tasks: manifold learning and probability distribution transformation. The latter can be carried out using the classical OT method. From the OT perspective, the generator computes the OT map, while the discriminator computes the Wasserstein distance between the generated data distribution and the real data distribution; both can be reduced to a convex geometric optimization process. Furthermore, OT theory discovers the intrinsic collaborative—instead of competitive—relation between the generator and the discriminator, and the fundamental reason for mode collapse. We also propose a novel generative model, which uses an autoencoder (AE) for manifold learning and OT map for probability distribution transformation. This AE–OT model improves the theoretical rigor and transparency, as well as the computational stability and efficiency; in particular, it eliminates the mode collapse. The experimental results validate our hypothesis, and demonstrate the advantages of our proposed model.

  顾险峰,美国纽约州立大学石溪分校计算机系帝国创新教授,美国哈佛大学数学与应用中心客座教授,清华大学丘成桐数学中心客座教授。师从微分几何大师丘成桐先生,与丘先生共同创立了跨领域学科“计算共形几何”,将现代拓扑与几何应用于工程和医疗等领域。曾获美国国家自然科学基金CAREER奖、中国国家自然科学基金海外杰出青年奖、“华人菲尔茨奖”:晨兴应用数学金奖。