Evaluating AI agent guardrails
Joint research with a major AI lab.
Research
SysAdmin benchmark
Measuring the propensities that could lead to loss of control, inside an open-world Linux sandbox.
Power-seeking agents in Moltbook
How power-seeking behavior plays out among agents in the wild, and what changes when humans pose as agents.
Power seeking under system administration
An early benchmark testing power-seeking behavior in models given simple system administration work.
Open-model propensity evaluations
Evaluations of the most downloaded open-source models, on the propensities HuggingFace users asked us to test.