prof_pic.jpg

Ting-Yao 'Edward' Hsu (許庭耀)


Ph.D. Student
School of Electrical Engineering and Computer Science
Penn State University




Hello! I am a final-year Ph.D. candidate at Penn State University working across Vision-to-Language, NLP, and HCI. I am fortunate to be advised by Dr. Ting-hao (Kenneth) Huang and Dr. C. Lee Giles. Prior to Penn State, I received B.S. in CS from National Tsing Hua University. Before Ph.D., I spent great time working with Dr. Shang-Hong Lai in CVLAB and Dr. Yuan-Hao Chang (Johnson Chang) in Academia Sinica.

My research goal is to develop interactive and intelligent systems that enhance everyday human activities. Currently, I am focusing on tasks that integrate vision and language, involving understanding, generation, and evaluation through multimodal learning and Large Language Models (LLMs). I am also interested in improving multimodal/LLM agents and alignment to optimize human-machine interactions.

I am currently on the job market and looking for full-time industry positions..



news

2023-Jul Our paper, Summaries as Captions: Generating Figure Captions for Scientific Documents with Automated Text Summarization is accepted by INLG 2023! See you in Prague.
2023-Jul I’ll attend ACL 2023 in person @Toronto during July 9-14. I’m excited to meet my old and new NLP friends again, and feel free to DM if you’d like to chat!
2023-May We’re launching the 1st Scientific Figure Captioning (SciCap) Challenge ! We invite AI/NLP/CV researchers to build systems that caption all types of figures in arXiv papers. The challenge will be hosted at the CLVL workshop at #ICCV2023.