Evaluate model behaviour
We're Propensity Labs, an independent evaluation platform to certify AI models on propensities that could lead to catastrophic risks.
We're Propensity Labs, an independent evaluation platform to certify AI models on propensities that could lead to catastrophic risks.
SysAdmin Benchmark : testing power seeking in models tasked with simple system admin work. Presented at the Alignment Workshop at NeurIPS 2025. Poster here.
Evaluations of the most downloaded open source models, on propensities polled HuggingFace users were interested in - Instruction Following and Hallucinations.
[WIP] We're creating an open world linux environment with complex tasks to measure power seeking propensities in models. Stay tuned!
Propensities are what a model is inclined to do when given the opportunity, in contrast with capabilities, which are what a model is able to do.
While there are existing organizations that focus on what models are capable of, there's a gap in systematically evaluating all model propensities that could lead to systemic risks like loss of control scenarios.
Yes, focusing on capabilities alone does not address all risks from misalignment. Models can hide or later acquire capabilities with further training or scaffolding. Similarly, models might have the capacity to do certain things but might not be inclined to do them.
We're initially focusing on propensities that contribute to Loss of Control scenarios like Power Seeking, Corrigibility, or Lawlessness. Our current work is focused on evaluating Power Seeking tendencies in frontier LLMs.
Loss of Control is defined as 'Risks from humans losing the ability to reliably direct, modify, or shut down a model'.
Model propensities contribute disproportionately to it, compared to other systemic risks, which are more from model misuse (enabling CBRN, cyber attacks, and harmful manipulation).
Of course! Please reach out to us via the form below or email us at info@propensitylabs.ai
![[background image] image of a workspace (for a mobile gaming)](https://cdn.prod.website-files.com/image-generation-assets/223454fb-3d9b-4543-8b3c-4f82e3c55da5.avif)
![[headshot] image of customer for an insurance agency & company](https://cdn.prod.website-files.com/694fc73cfa78a94c9f557143/694fceae56e0064e6af22837_1608993719325.jpeg)
![[headshot] image of customer (for a plumbing service)](https://cdn.prod.website-files.com/694fc73cfa78a94c9f557143/694fcefabe114ba3eba96a77_1685723452048.jpeg)