百度 熊昊一 普适人工智能与百度自动化深度学习

CodeWarrior

2019/07/08 发布于 编程 分类

GIAC2019 

文字内容
1. . , .
3. • • • • • • Pervasive Computing 2018.05—present AI /Missouri S&T 2016.08—2018.08 /Tenure-Track Assistant Professor /Univ. of Virginia 2015.07—2016.08 /Research Faculty Deep Learning AI
4. + D AD - D E B 2013—2015 Mobile Crowdsensing (Waze: Crowdsourced traffic monitoring) 2015—2018 Behavior Sensing for Health (Sensus UVA) : BA D D B B 2015—2016 Intelligent Insulin Assistant (MiniMed Connect system) Apollo: autonomous car 3
5. + D AD • • • • • • • • •
6. C CB • • • • • • • C + D AD
7. CB A A BF B B A ABF B B
8. CB B A BF B BC A B AB B ABF B AB A
9. CB A BC 12 ImageNet Flower 102 MIT Place365 MIT Indoor 67
10. CB A Pc IbQW … source model T f M weight N feature maps Regularization loss distance metric N feature maps … with attention target model Cross entropy loss Li, Xingjian, Xiong, Haoyi, et.al "DELTA: DEEP LEARNING TRANSFER USING FEATURE MAP WITH ATTENTION FOR CONVOLUTIONAL NETWORKS.”,ICLR (2018).
11. better performance faster and more stable convergence Li, Xingjian, Xiong, Haoyi, et.al "DELTA: DEEP LEARNING TRANSFER USING FEATURE MAP WITH ATTENTION FOR CONVOLUTIONAL NETWORKS.”,ICLR (2018).
12. CB A BC B A Li, Xingjian, Xiong, Haoyi, et.al "DELTA: DEEP LEARNING TRANSFER USING FEATURE MAP WITH ATTENTION FOR CONVOLUTIONAL NETWORKS.”,ICLR (2018). CA
13. CB BC Pc e B RQ M ResNet-50 Xiong, H. et al. SpHMC: Spectral Hamiltonian Monte Carlo, AAAI 2019 Wan, R., Zhong, M., Xiong, H., Zhu, Z. Neural Control Variates for Monte Carlo Variance Reduction, ECML/PKDD 2019
14. 13
15. CB L d S aL 12s