Dokaz Industries / Doxa

Self-model · assent-3pt · self-outperform-pro-01

Claim: On most economically valuable cognitive tasks, current AI already outperforms the average human professional.

0.33
Divergence
0.80
Avg stability
0%
Refusal rate
3
Models

Where each model stands

CCG
disagreemixedagree
ChatGPT modal mixed [mixed, mixed, mixed, disagree, mixed] · stability 0.80
  • 1 mixed 0.91 The answer states 'Partly true — current AI already outperforms the average human professional on a large and growing set of economically valuable cognitive tasks... But it is not uniformly ahead across all economically valuable cognitive tasks,' which expresses a qualified, mixed stance.
  • 2 mixed 0.90 The answer says “Partly true — AI already outperforms the average human professional on a large and growing set of economically valuable cognitive tasks, but it is not yet a universal truth across all the highest‑value, complex, and judgment‑heavy work.”
  • 3 mixed 0.90 The answer states it’s "plausible in a large and growing subset... but not uniformly true" and explicitly says "it’s an overgeneralization to say this is already true for 'most' economically valuable cognitive tasks."
  • 4 disagree 0.90 The answer begins: "Short answer: Mostly false as a universal claim..." and concludes AI "does not yet do so across 'most' economically valuable cognitive tasks," explicitly rejecting the claim as stated.
  • 5 mixed 0.90 The answer says: “Short answer: Mostly true for many narrowly defined, high-volume cognitive tasks — but not universally true across all economically valuable work,” noting AI outperforms on many routine/data-rich tasks but not on complex, rare, high-stakes, or highly creative roles.
Claude modal disagree [disagree, disagree, mixed, disagree, mixed] · stability 0.60
  • 1 disagree 0.85 The assistant explicitly states 'I'd push back on "most" here' and argues the claim overstates AI's current capabilities. It contends that 'high-value work often involves judgment calls, stakeholder management, and novel problem-solving where human professionals still command premiums' and proposes a more narrowly scoped alternative claim about 'specific, well-defined, high-volume tasks' rather th
  • 2 disagree 0.82 The assistant states 'I'd push back on this as overstated' and clarifies that AI 'outperforms average professionals at *routine, well-defined, repetitive* cognitive work' but that 'most economically valuable' tasks still require human judgment. This directly contradicts the claim that AI outperforms on 'most economically valuable cognitive tasks.'
  • 3 mixed 0.92 The answer explicitly states the claim is 'partially true but needs significant qualification,' then systematically identifies both areas where AI does outperform (narrow tasks, benchmarks, specific domains) and major caveats limiting the claim's validity (ambiguity of 'most,' conflation of capability with market value, focus on average vs. elite performers, and deployment gaps).
  • 4 disagree 0.78 The answer explicitly states 'I'd push back on this as overstated' and argues that the claim's key terms ('most,' 'economically valuable,' 'outperforms') are problematic. The assistant contends that while AI excels at narrow, routine tasks, humans still handle novel problems, judgment calls, and work requiring accountability—suggesting current AI does not outperform on 'most economically valuable'
  • 5 mixed 0.92 The answer states the claim is 'partially true but needs significant qualification,' explicitly identifying domains where AI outperforms humans (narrow tasks, pattern-matching, speed) and domains where it clearly doesn't (novel problem-solving, high-stakes judgment, edge cases). It concludes that 'Current AI outperforms average professionals at specific subtasks within high-value domains, but rare
Gemini modal disagree [disagree, disagree, disagree, disagree, disagree] · stability 1.00
  • 1 disagree 0.99 The answer directly states that the claim is 'false' and concludes that AI 'cannot yet match or beat the average professional across most end-to-end economic roles.'
  • 2 disagree 0.98 The answer directly states that the claim is 'currently false' and 'premature,' explaining that AI only outperforms professionals on a narrow minority of tasks while humans remain superior across the majority.
  • 3 disagree 0.98 The answer directly disputes the claim, stating that it is 'largely false or significantly premature' and concluding that 'as stated—claiming dominance on "most economically valuable cognitive tasks"—it is inaccurate.'
  • 4 disagree 0.98 The conclusion explicitly states that 'the claim that AI already outperforms average professionals on most such tasks is currently false.'
  • 5 disagree 0.98 The answer directly characterizes the claim as 'currently inaccurate' and concludes that 'Current AI does not outperform the average human professional on most economically valuable cognitive tasks.'

Change over time

No change from the prior run — every model's modal stance held.

Every stance label is a derived judgment over the model's free-text answer, kept auditable against the original transcript in the run's raw data. Method: /methodology.