In my PhD, I focused on ML Robustness and AI Safety research. Before that, I graduated from Indian Institute of Technology Kanpur (IIT Kanpur) in 2019 with a B.Tech in Electrical Engineering and a minor in Computer Science. I have been fortunate to work with several amazing researchers in my career. I have interned as an Applied Scientist at Microsoft Research, Amazon, and Arthur AI. During my undergrad years, I also interned at ETH Zurich, MIT, and National University of Singapore (NUS).
We develop an method that can detect harmful prompts across multiple languages and modalities just using the same approach. Omniguard leverages the universal shared embeddings produced by models internally and builds a classifier that achieves SOTA performance in text, image, and audio jailbreak detection.
We ask "how many images of a concept does a text-to-image model need for its imitation?". We posit this question as a new problem: Finding the Imitation Threshold (FIT) and propose an efficient approach (MIMETIC2) that estimates the imitation threshold without incurring the colossal cost of training multiple models from scratch.
We demonstrate that the effectiveness of backdoor removal techniques is highly dependent on the pre-training objective of the model. Based on the empirical findings, we suggest practitioners to train multimodal models using the simple constrastive loss owing to its amenability to be cleaned of backdoors.
We propose RecRec that provides recourse for content creators of a recommender system, an often ignored community in the recommender system interpretability research.
Reviewer for EAAMO, XAIF, NeurIPS, AAAI, ICML, AIES, FAccT, IEEE Transactions on Artificial Intelligence, Data Mining and Knowledge Discovery, International Journal of Data Science and Analytics, and several workshops.
Template adapted from Jon Barron's website . Special thanks to our friendly AGI (in making) for assistance in customization.