Xin (Eric) WangIncoming Assistant ProfessorDepartment of Computer Science and Engineering Jack Baskin School of Engineering University of California, Santa Cruz Email: xwang366 [at] ucsc [dot] edu
|
|
Bio
I am joining UC Santa Cruz as an Assistant Professor in the Department of Computer Science and Engineering this summer. I obtained my Ph.D. degree in computer science at UC Santa Barbara and B.Eng. degree in computer science and technology at Zhejiang University. My research interests include natural language processing, computer vision, and machine learning, with an emphasis on building multimodal embodied agents that can communicate with humans using natural language to perform real-world tasks. I worked at Google AI, Facebook AI Research, Microsoft Research, and Adobe Research. I received the CVPR Best Student Paper Award in 2019.I am looking for highly-motivated students, so feel free to drop me an email if you are interested in working with me on natural language processing, computer vision, robotics, and machine learning (due to the high volumn I may not be able to reply to every email).
News
| [NEW!] | I successfully defended my Ph.D. Thesis "Closing the Loop Between Language and Vision for Embodied Agents". Thanks to the committee and everyone who has helped me along the Ph.D. journey! |
| [NEW!] | I am serving as an Area Chair for EMNLP 2020. |
| [NEW!] | Organizing the workshop on Advances in Language and Vision Research (ALVR) at ACL 2020. Welcome to participate on July 9th! |
| [03/2020] | Invited panelist at the GPU Technology Conference (GTC) 2020. |
| [11/2019] | Organizer of the workshop on Language & Vision with applications to Video Understanding at CVPR 2020. |
| [11/2019] | Organizer of the tutorial on Self-Supervised Deep Learning for NLP at AACL-IJCNLP 2020. |
| [10/2019] | Invited speaker at the ICCV 2019 Workshop on Person In Context. |
| [06/2019] | Recipient of the CVPR 2019 Best Student Paper Award. |
| [06/2019] | Co-Organizer of the workshop on Closing the Loop Between Vision and Language at ICCV 2019. |
| [06/2019] | Invited talk at Facebook AI. |
| [01/2019] | Session Chair for AAAI 2019 (natural language processing). |
Experience
|
Google AI, Mountain View, US Research Intern, Summer 2019 Mentors: Sujith Ravi, Zornitsa Kozareva |
|
|
Facebook AI Research (FAIR), Menlo Park, US Graduate Researcher, Spring 2019 Mentors: Xinlei Chen, Marcus Rohrbach, Dhruv Batra |
|
|
Microsoft Research AI, Redmond, US Research Intern, Summer 2018 Mentors: Lei Zhang, Asli Celikyilmaz, Jianfeng Gao |
|
|
Adobe Research, San Francisco, US Research Intern, Summer 2017 Mentors: Geoffrey Oxholm, Oliver Wang, Eli Shechtman, Mike Lukac |
|
|
Adobe Research, San Francisco, US Research Intern, Summer 2016 Mentor: Geoffrey Oxholm |
|
|
Exacloud Inc., Hangzhou, China Software Engineer Intern, 12. 2014 - 03. 2015 |
|
|
HCI, Graphics and Computer Vision Group, HKU Research Assistant, Summer 2014 Advisor: Yizhou Yu |
|
Selected Publications
Preprint
|
Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation |
|
Cross-Lingual Vision-Language Navigation |
2020
|
Environment-agnostic Multitask Learning for Natural Language Grounded Navigation |
|
Counterfactual Vision-and-Language Navigation via Adversarial Path Sampling |
|
REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environments |
|
Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigation |
|
Vision-Language Navigation Policy Learning and Adaptation
|
|
Generative Adversarial Zero-Shot Relational Learning for Knowledge Graphs |
2019
|
TIGEr: Text-to-Image Grounding for Image Caption Evaluation |
|
VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Research |
|
Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation |
|
MAN: Moment Alignment Network for Natural Language Moment Retrieval via Iterative Graph Adjustment |
|
Self-Supervised Dialogue Learning |
|
Self-Supervised Learning for Contextualized Extractive Summarization |
|
Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models |
|
Extract and Edit: An Alternative to Back-Translation for Unsupervised Neural Machine Translation |
|
Learning to Compose Topic-Aware Mixture of Experts for Zero-Shot Video Captioning |
2018
|
Look Before You Leap: Bridging Model-Free and Model-Based Reinforcement Learning for Planned-Ahead Vision-and-Language Navigation |
|
XL-NBT: A Cross-lingual Neural Belief Tracking Framework |
|
No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling |
|
S3D: Single Shot multi-Span Detector via Fully 3D Convolutional Network |
|
Video Captioning via Hierarchical Reinforcement Learning |
|
Watch, Listen, and Describe: Globally and Locally Aligned Cross-Modal Attentions for Video Captioning |
2017
|
Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer |
|
Deep Reinforcement Learning for Visual Object Tracking in Videos |
Products
|
ProjectCloak: Remove Unwanted Objects in Video |
|
ArtisticEye: A Real-time Application for High-resolution Artistic Style Transfer |
Teaching
| 2018 | Winter | Guest Lecturer | CS281b: Computer Vision and Image Analysis |
| 2017 | Winter | Teaching Assistant | CS190I: Introduction to Natual Language Processing |
| 2016 | Fall | Teaching Assistant | CS180: Computer Graphics |
| 2016 | Winter | Teaching Assistant | CS48: Computer Science Project |
| 2015 | Fall | Teaching Assistant | CS16: Problem Solving with C++ |
Service
- Workshop on Advances in Language and Vision Research (ALVR), ACL 2020
- Workshop on Language & Vision with applications to Video Understanding, CVPR 2020
- Tutorial on Self-Supervised Deep Learning for NLP, AACL-IJCNLP 2020
- First VATEX Challenge for Multilingual Video Captioning
- Workshop on Closing the Loop Between Vision and Language (CLVL), ICCV 2019
- EMNLP 2020 (Interpretability and Analysis of Models for NLP)
- AAAI 2019 (Natural Language Processing)