Siddartha Devic

@sid_devic

Member of Technical Staff @bespokelabsai. PhD @CSatUSC in trustworthy AI/ML, previously intern @apple @amazon, ug @UT_Dallas

sid.devic.us

Joined August 2017

Replies Reposts Media

Pinned
Siddartha Devic
@sid_devic
Aug 3
Like (nearly) everyone else who worked on theory at some point in their academic career, I have some thoughts on the recent developments in AI and how it may impact the way that we perform and evaluate theoretical research.
1
Siddartha Devic
@sid_devic
Sep 9
check out our new autoresearch benchmark!
Alex Dimakis
@AlexGDimakis
Sep 9
We are releasing AutoResearchExam, a benchmark on open-ended machine learning and engineering tasks. Our benchmark covers seven research areas including model training, data curation, AI safety and interpretability. benchmarks.bespokelabs.ai/autoresearchex… In each task, we give agents 24 hours
00:00
Siddartha Devic
@sid_devic
Feb 17
Looks like a super useful tool for practitioners looking to apply multi calibration techniques!!
Lorenzo Perini
@LorenzoPerini95
Feb 16
1/6 🧵 Calibration is hard. Multicalibration—fixing errors across every possible subgroup—is usually impossible at scale. Until now. Introducing MCGrad: A production-ready multicalibration library from Meta, accepted at KDD 2026. 🚀 github.com/facebookincuba…
Siddartha Devic
@sid_devic
Oct 14, 2025
@iclr_conf we only get two weeks to submit five reviews? Surely this is a more accelerated timeline than usual, no?
Siddartha Devic
@sid_devic
Aug 20, 2025
Cursor made me a chrome extension which redirects any html arxiv links that you stumble across on the internet to the pdf version of the arxiv paper instead. Could be useful for some others, but use at your own risk!
GitHub - sid-devic/arxiv_redirect
From github.com
1