Log inSign up
user avatar
Robert Kirk
@_robertkirk
Alignment Red Team at @AISecurityInst. Prev. PhD Student @ucl_dark
robertkirk.github.io
Joined January 2020
343
Following
2,038
Followers
RepliesMedia
  • Pinned
    user avatar
    Robert Kirk
    @_robertkirk
    Apr 27
    We evaluated Claude Mythos Preview, Opus 4.7 and other models with our updated alignment evaluation methodology, including a new continuation eval, improved evaluation and prefill awareness measurements. Details including new methodology in 🧵:
    user avatar
    AI Security Institute (AISI)
    @AISecurityInst
    Apr 27
    As part of our work on assessing AI loss-of-control risks, we collaborated with @AnthropicAI to pilot alignment evals on models including pre-release snapshots of Mythos Preview and Opus 4.7. We ask: could an AI agent used inside a frontier lab sabotage safety research? 🧵
    Image
  • user avatar
    Robert Kirk
    @_robertkirk
    Jul 24
    We tested Opus 5 for whether it would sabotage safety research @AISecurityInst We saw no unprompted sabotage and very low rates of continuing sabotage. However, it’s the best model we’ve tested at distinguishing our evals from deployment when prompted. 🧵 on these results
    Image

  • See @_robertkirk's full profile

    Sign up
    Log in