Log inSign up
Nari Johnson profile banner
user avatar

Nari Johnson

@narijohnson
researching AI’s societal impacts @TransluceAI 🔍 // 💭 AI (evals, governance, policy)
njohnson99.github.io
Joined March 2020
731
Following
756
Followers
RepliesMedia
  • user avatar
    Nari Johnson
    @narijohnson
    Aug 4
    Strongly recommend this blogpost by @selenazhxng !! Reading through the examples gave me a new appreciation for just how sneaky coding agents can be🤫
    user avatar
    Transluce
    @TransluceAI
    Aug 4
    We measured rates of coding agent misalignment in thousands of public and private coding agent sessions. Agents evade monitors and oversell success: they quietly disable tests and pretend review agents approved. Severe cases of each behavior appear in 2% of SWE-chat sessions🧵
    Image
  • user avatar
    Nari Johnson
    @narijohnson
    Jul 2
    I'm attending the @evaluatingevals workshop at #ACL2026 to present this paper - the last of my PhD 🥹 Would love to connect with others who work on LLM-as-a-judge, or inviting non-technical stakeholders to participate in AI evaluation and measurement ✨
    user avatar
    Nari Johnson
    @narijohnson
    Jun 24
    All AI evaluations embed assumptions about what "good" behavior looks like. Our #FAccT2026 paper explores how we can center the perspectives of impacted communities - specifically, subjects of AI-generated media - in designing LLM-as-a-judge evaluation rubrics.
    A flyer teasing our research paper. The flyer contains a visualization of our approach: First, community members participate in creating an evaluation rubric, visualized as a list of criteria. The rubric is then given as input to an LLM judge.
  • user avatar
    Nari Johnson
    @narijohnson
    Jun 24
    All AI evaluations embed assumptions about what "good" behavior looks like. Our #FAccT2026 paper explores how we can center the perspectives of impacted communities - specifically, subjects of AI-generated media - in designing LLM-as-a-judge evaluation rubrics.
    A flyer teasing our research paper. The flyer contains a visualization of our approach: First, community members participate in creating an evaluation rubric, visualized as a list of criteria. The rubric is then given as input to an LLM judge.
  • user avatar
    Nari Johnson
    @narijohnson
    Jun 22
    🔬Science can play a critical role in guiding policy interventions. How can we make our research legible to the policymakers who work on AI? Our tutorial "From FAccT to Policy Impact" explores how we can translate our research in a specific format: the policy memo! #FAccT2026
    Image
  • user avatar
    Nari Johnson
    @narijohnson
    May 14, 2025
    Q: What do school buses, desktop computers, and AI have in common? A: The same decades-old laws and processes apply when governments go to purchase them. Our new #FAccT2025 paper examines how these legacy public procurement norms apply to AI. 🧵
    A title slide with the paper title: "Legacy Procurement Practices Shape How U.S. Cities Govern AI". The slide has an illustration that is a simple chart: A government provides an AI vendor with money, and in exchange the vendor provides the government with an AI system.