Jyoti Aneja

I am a Senior Researcher in the Physics of AGI group led by Sébastien Bubeck at Microsoft Research, Redmond.

I graduated with a PhD from the University of Illinois at Urbana-Champaign where I worked with Alex Schwing and also closely collaborated with David Forsyth.

My research interests lie at the intersection of Computer Vision, Deep Learning and Natural Language Processing.

In my (not so) past life, I was a physicist. I have a MS in Physics from UIUC.

If you're interested in working with me, get in touch via email.

E-Mail | CV | Google Scholar | Github | Twitter

Publications

Textbooks Are All You Need
Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio C´esar Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, S´ebastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Yin Tat Lee, Yuanzhi Li
pdf

Explaining Patterns in Data with Language Models via Interpretable Autoprompting
Chandan Singh, John X. Morris, Jyoti Aneja, Alexander M. Rush, Jianfeng Gao
under submission
pdf

ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Models
Chunyuan Li, Haotian Liu, Liunian Harold Li, Pengchuan Zhang, Jyoti Aneja, Jianwei Yang, Ping Jin, Houdong Hu, Zicheng Liu, Yong Jae Lee, Jianfeng Gao
Conference on Neural Information Processing Systems (NeurIPS) (Datasets and Benchmarks Track), 2022
pdf

A Contrastive Learning Approach for Training Variational Autoencoder Priors
Jyoti Aneja, Alexander Schwing, Jan Kautz, Arash Vahdat
Conference on Neural Information Processing Systems (NeurIPS), 2021
pdf

	Image Captioning Diversity under the Radar Xiaoming Zhao, Jyoti Aneja, Harsh Agrawal, Alexander Schwing Under Submission pdf
	Sequential Latent Spaces for Modeling the Intention During Diverse Image Captioning Jyoti Aneja, Harsh Agrawal, Dhruv Batra, Alexander Schwing International Conference on Computer Vision (ICCV), 2019 pdf
	Fast, Diverse and Accurate Image Captioning Guided By Part-of-Speech Aditya Deshpande, Jyoti Aneja*, Liwei Wang, Alexander Schwing, David Forsyth Computer Vision and Pattern Recognition (CVPR), 2019 (Oral presentation)* pdf
	Convolutional Image Captioning Jyoti Aneja, Aditya Deshpande, Alexander Schwing Computer Vision and Pattern Recognition (CVPR), 2018 video(CSL Student Conference-2018) \| pdf \| code

Affiliations

News

Sept 2021	One Paper accepted at NeurIPS 2021!
Sept 2021	Successfully defended my PhD thesis!
May 2021	Recognized as an "outstanding reviewer" at CVPR 2021
Dec 2020	Passed my Preliminary Exam! Thanks commitee members: Alex, Lana, David, Ben and Lance
June 2020	Starting Internship at NVIDIA Research, Santa Clara, California. I will be working with Arash Vahdat and Jan Kautz .
July 2019	Paper accepted at ICCV 2019.
June 2019	Our Team Schwail came 2nd in the TextVQA Challenge hosted at the VQA Workshop at CVPR 2019.
May 2019	Starting Internship at Microsoft Research, Redmond.
May 2019	Received Student Volunteer Award from CVF for CVPR 2019.
Feb 2019	Paper accepted at CVPR 2019 as oral presentation.
Feb 2019	Session chair, Artificial Intelligence in Action Session at CSL Student Conference 2019.
May 2018	Spending the Summer at Snap Research, LA.
April 2018	Awarded UIUC travel grant to present our paper at CVPR 2018.
Feb 2018	Paper accepted at CVPR 2018.

Template credits: Deepak, Jon, Saurabh, Unnat, Abhishek and Jeff