prof_pic.jpg

Ting-Yao 'Edward' Hsu (許庭耀)


Ph.D. Student
School of Electrical Engineering and Computer Science
Penn State University




Hello! I am a final-year Ph.D. candidate at Penn State University working across Vision-to-Language, NLP, and HCI. I am fortunate to be advised by Dr. Ting-hao (Kenneth) Huang and Dr. C. Lee Giles. Prior to Penn State, I received B.S. in CS from National Tsing Hua University. Before Ph.D., I spent great time working with Dr. Shang-Hong Lai in CVLAB and Dr. Yuan-Hao Chang (Johnson Chang) in Academia Sinica.

My research interests lie in vision-language models (VLMs) and large language models (LLMs) for a wide range of downstream applications, with a particular emphasis on improving text generation, refining evaluation methodologies, and exploring post-training techniques. I am also dedicated to developing LLM-based agents that are aligned with human preferences.

I am currently on the job market and looking for full-time industry positions..



news

2023-Jul Our paper, Summaries as Captions: Generating Figure Captions for Scientific Documents with Automated Text Summarization is accepted by INLG 2023! See you in Prague.
2023-Jul I’ll attend ACL 2023 in person @Toronto during July 9-14. I’m excited to meet my old and new NLP friends again, and feel free to DM if you’d like to chat!
2023-May We’re launching the 1st Scientific Figure Captioning (SciCap) Challenge ! We invite AI/NLP/CV researchers to build systems that caption all types of figures in arXiv papers. The challenge will be hosted at the CLVL workshop at #ICCV2023.