Talha Oz

@tozCSS

Applied Scientist @Amazon PhD from @CSS_GMU Founder of @Twlets Alumnus of @bogazici_cmpe & @izmirfenlise

San Jose, CA

Talha Oz
@tozCSS
Oct 29, 2025
A fascinating paper by OpenAI Eval team on their new benchmark, GDPval, measuring AI performance on real-world knowledge work tasks. Here are the most interesting highlights for me: * Blinded expert-eval. Top model's (Claude) win-rate over humans: 47.6%. It means …
1
Talha Oz
@tozCSS
Oct 4, 2025
33% of scientific findings would be incorrect had researchers used LLMs instead of humans for labeling: says arxiv.org/abs/2509.08825 This paper sparked an idea: creation of SocSciBench, a leaderboard, ranking LLMs’ annotation quality for social science hypotheses testing. WDYT?
arxiv.org
Large Language Model Hacking: Quantifying the Hidden Risks of...
Large language models are rapidly transforming social science research by enabling the automation of labor-intensive tasks like data annotation and text analysis. However, LLM outputs vary...
Talha Oz
@tozCSS
Jul 11, 2024
@skyzone we have been trying to reach you via "contact us", email, and phone in the past three months, nobody is responding. Please cancel our elite membership and refund us the last two months.
1
Talha Oz
@tozCSS
Jun 24, 2024
When assigned a task on JIRA, an AI Worker will soon be able to finish the task assigned to it just as a human employee would do. It will create a roadmap, read the company docs, implement code, send PRs, communicate with others over Slack, join Zoom +
2
Talha Oz
@tozCSS
Mar 1, 2024
An interesting first sentence for an LLM paper... arxiv.org/abs/2402.18157
2