A Framework for Producing an Integrated Argument Audit That Combines Frame-Audit (Lakoff/Goffman/Entman Frame-Surfacing) with Coherence-Audit (Toulmin Reconstruction + Fallacy Taxonomy) Plus Cross-Cutting Integration Surfacing Issues Neither Component Pass Would Catch Alone — Including Frame-Coherence Interactions and Multi-Claim Structural Moves.
Version 1.0
Bridge Strip: [AAA — Argument Audit]
Architectural Note
This framework supports the argument-audit mode, the depth-molecular operation in T1 (argumentative artifact examination). The mode file at Modes/argument-audit.md carries the locked spec — molecular_spec.components, critical_questions, output_contract.required_sections — sufficient for the orchestrator to dispatch the two component modes (frame-audit, coherence-audit) and the three synthesis stages (frame-coherence-merge, cross-cutting-integration, integrated-audit-document). This framework adds the procedural detail the spec does not carry: the elicitation prompts the orchestrator uses, the intermediate output formats, the per-stage quality gates, the worked example showing the framework operating end-to-end, and Debate D2 (motte-and-bailey: fallacy or doctrine?) which this mode carries.
The framework sits in T1’s depth ladder above coherence-audit (T1-light + neutral-stance, atomic, internal-consistency check) and frame-audit (T1-light + suspending-stance, atomic, frame-surfacing) and beside propaganda-audit (T1 specificity-specialized + adversarial-stance variant). It composes coherence-audit and frame-audit into a cross-cutting integration that catches issues neither pass detects alone — most notably: arguments whose coherence depends on contested frame-imports, coherence-failures that track frame-substitutions across claims, and motte-and-bailey-style structures that require multi-claim tracking. The territory framework is Framework — Argumentative Artifact Examination.md. AAA is the heaviest analytical mode in T1’s depth ladder.
How to Use This File
This framework runs when the user has an argumentative artifact (article, op-ed, paper, ad, manifesto, policy document, debate transcript) and wants an integrated audit — both whether the argument coheres internally (Toulmin reconstruction + fallacy check) AND what frame the argument imports (Lakoff metaphor, Goffman frames, Entman functions). AAA’s value is in the synthesis stage: cross-cutting issues that single-component passes miss — for example, an argument whose internal coherence is sound but only because contested frame-imports are doing analytical work that pure inferential check would not catch.
AAA differs from coherence-audit (atomic internal-consistency) and from frame-audit (atomic frame-surfacing). Use AAA when the argument is substantial enough to warrant integrated treatment, when the user suspects both inferential and framing-level issues are at play, and when the time investment for molecular pass is warranted.
Three invocation paths supported:
User invocation: the user invokes argument-audit directly with an argumentative artifact. The framework opens with brief progressive questioning to elicit audit focus (which conclusion or claim cluster to audit support for).
Pipeline-dispatched: the four-stage pre-routing pipeline classifies the user’s prompt as T1, depth-molecular, and dispatches AAA.
Handoff from another mode: coherence-audit or frame-audit has surfaced that the audit warrants integrated treatment (e.g., coherence findings depend on contested frame-imports that the coherence pass identified but didn’t audit). The handoff package includes the prior analysis; AAA inherits it as a starting position.
INPUT CONTRACT
AAA requires:
- Argumentative artifact — the text being audited (article, op-ed, paper, ad, manifesto, policy document, debate transcript, etc.). Elicit if missing: “Could you paste or describe the argument you want audited?”
AAA optionally accepts:
- Audit focus — which conclusion or claim cluster to audit support for. If not provided, infer from the artifact and the user’s reason-for-audit. Elicit: “Which claim or conclusion’s support do you want audited?”
- Why audit — what the user suspects is off (frame manipulation / coherence failure / both / general structural sweep).
- Genre context — academic paper / op-ed / ad / policy document / debate / political speech (informs Walton dialogue type and frame-typology selection).
- Prior audits — if other audits have been performed on the same artifact, the framework integrates rather than regenerates.
- Contextual background — surrounding discourse, related artifacts with competing frames, source inventory.
STAGE PROTOCOL
Stage 1 — Frame Audit (runs: full)
Purpose: Surface the operative frame(s) the argument deploys — Lakoff metaphor inventory, Goffman primary framework and keyings, Entman four functions per frame (problem definition / causal interpretation / moral evaluation / treatment recommendation), selection-and-salience inventory (what included, what excluded), presupposition and nominalization audit, counterframe construction. This is stance-suspending: surface the frame without endorsing or attacking it.
Elicitation prompt (orchestrator → model):
“You are running the
frame-auditmode (full) as Stage 1 of an Argument Audit pass. The argumentative artifact is: [artifact]. Audit focus: [focal_question]. Produce the full frame-audit output per the mode’s contract: operative frames named in alternative-comparable vocabulary (not the artifact’s own naturalized terms — frame-naturalization is a failure mode), Lakoff metaphor inventory (with quoted text and source-domain → target-domain mappings), Goffman primary framework and keyings, Entman four functions per frame (problem definition / causal interpretation / moral evaluation / treatment recommendation — populated per frame), selection and salience inventory (both what’s included AND what’s excluded — silence-blindness is a failure mode), presupposition and nominalization audit (with quoted text), counterframe (what would the issue look like under an alternative frame). Stance: suspending — surface the frame and show its costs, but do not slide into rejection (that’s propaganda-audit territory).”
Intermediate output format:
stage_1_output:
operative_frames:
- frame_name: "<named in alternative-comparable vocabulary>"
one_sentence_characterization: "<>"
lakoff_metaphor_inventory:
- metaphor: "<source-domain → target-domain>"
quoted_text: "<from artifact>"
inferential_entailments: "<what the metaphor licenses>"
goffman_primary_framework: natural | social
goffman_keying: make-believe | contests | ceremonials | technical-redoings | regroundings | none
goffman_fabrication: true | false (with explanation if true)
entman_four_functions:
problem_definition: "<from artifact, quoted or paraphrased>"
causal_interpretation: "<>"
moral_evaluation: "<>"
treatment_recommendation: "<>"
selection_and_salience_inventory:
included_and_emphasized: "<list>"
excluded_or_downplayed: "<list — what's silent>"
presupposition_and_nominalization_audit:
- presupposition: "<the claim presupposed>"
quoted_text: "<from artifact>"
mechanism: presupposition | nominalization | passivization | lexicalization
counterframes:
- counterframe_name: "<>"
what_issue_looks_like_under: "<one paragraph>"
Quality gates:
- Operative frames named in alternative-comparable vocabulary (CQ1 of frame-audit: frame-naturalization).
- Entman four functions populated per frame (CQ2: function-collapse).
- Selection-and-silence inventory has entries in both columns (CQ3: silence-blindness).
- Lexical/grammatical mechanisms cited with quoted text (CQ4: macro-frame-only-reading).
- At least one counterframe constructed (CQ5: counterframe-omission).
Hand-off to Stage 2: Stage 2 receives the artifact and Stage 1’s frame findings. Coherence-audit will assess the inferential structure independently; the synthesis stage will integrate.
Stage 2 — Coherence Audit (runs: full)
Purpose: Audit the argument’s inferential structure — charitable reconstruction (surfacing implicit premises), Toulmin breakdown per inferential move (claim, data, warrant, backing, qualifier, rebuttal), named fallacies with quoted text + identified inferential move + violated principle + reason-it-fails-here, structural coherence failures not in the named-fallacy taxonomy (premise smuggling, scope shift, definitional drift, enthymeme failure), argument-soundness vs. conclusion-truth separation. Stance: neutral.
Elicitation prompt (orchestrator → model):
“You are running the
coherence-auditmode (full) as Stage 2 of an Argument Audit pass. The argumentative artifact is: [artifact]. Audit focus: [focal_claim]. Produce the full coherence-audit output per the mode’s contract: charitable reconstruction (the strongest version of the argument actually present in the text, with implicit premises surfaced — uncharitable-reconstruction is a failure mode), Toulmin breakdown per inferential move (claim / data / warrant / backing / qualifier / rebuttal — surface the warrants explicitly; warrant-blindness is a failure mode), named fallacies with full structural specification (quoted text + inferential move + violated principle + reason-it-fails-here; name-without-structure is a failure mode), structural coherence failures beyond the named-fallacy taxonomy (premise smuggling, scope shift, definitional drift, unstated load-bearing assumptions, enthymeme failure — named-fallacy-only-reading is a failure mode), argument-holds-or-fails per inferential move, argument-wrong vs. conclusion-wrong separation. Stance: neutral. The verdict is conclusion-agnostic — ‘this argument as given does not establish its conclusion; the conclusion may still be true.’”
Intermediate output format:
stage_2_output:
charitable_reconstruction: "<strongest version of argument with implicit premises surfaced>"
toulmin_breakdown:
- move_id: M1
claim: "<>"
data: "<>"
warrant: "<surfaced explicitly — the inferential rule connecting data to claim>"
backing: "<support for the warrant>"
qualifier: "<modal — 'usually', 'in most cases'>"
rebuttal: "<conditions under which warrant doesn't apply>"
move_holds_or_fails: holds | fails | partial
reasoning: "<one-line>"
named_fallacies:
- fallacy_name: "<canonical name>"
quoted_text: "<from artifact>"
inferential_move: "<which Toulmin move this involves>"
violated_principle: "<what the move violates>"
reason_it_fails_here: "<context-specific — not just abstract definition>"
structural_coherence_failures_not_named_fallacies:
- failure_id: SF1
failure_type: premise-smuggling | scope-shift | definitional-drift | unstated-load-bearing-assumption | enthymeme-failure
description: "<>"
quoted_text: "<from artifact>"
argument_wrong_vs_conclusion_wrong:
argument_assessment: "this argument as given establishes / does not establish its conclusion"
conclusion_independent_assessment: "the conclusion may still be true / false; that is independent of this audit"
Quality gates:
- Charitable reconstruction precedes any fallacy claim (CQ1 of coherence-audit: uncharitable-reconstruction).
- Toulmin warrants surfaced per inferential move (CQ2: warrant-blindness).
- Every named fallacy substantiated with quoted text + violated principle + reason-it-fails-here (CQ3: name-without-structure).
- Argument-wrong explicitly separated from conclusion-wrong (CQ4: argument-conclusion-conflation).
- Structural-failure sweep performed beyond named fallacies (CQ5: named-fallacy-only-reading).
- Severity grading symmetric across artifact (no asymmetric-rigor).
Hand-off to Synthesis Stage 1: the frame-coherence-merge stage receives Stage 1’s frame findings and Stage 2’s coherence findings.
Synthesis Stage 1 — Frame-Coherence Merge
Type: parallel-merge
Inputs: Stage 1 (frame-audit), Stage 2 (coherence-audit)
Synthesis prompt (orchestrator → model):
“Merge the frame-audit and coherence-audit findings. For each inferential move from Stage 2’s Toulmin breakdown, identify whether Stage 1’s frame findings bear on it: does a warrant depend on a frame-import (a metaphor or presupposition that smuggles in framing-level commitments)? Does a claim’s data sit at a level of generality where the frame’s selection-and-salience matters (some data included, other data excluded)? For each frame-import in Stage 1, identify which inferential moves in Stage 2 it influences. The output is a merged audit: per-claim coherence findings paired with frame-surfacing findings, with explicit identification of where frame-imports are doing analytical work that coherence-audit alone would miss. Resist concatenation — the integration produces pairings, not parallel sections.”
Output format:
frame_coherence_merge:
per_inferential_move_with_frame:
- move_id: M_n
coherence_finding: holds | fails | partial
frame_imports_bearing_on_move:
- frame_import: "<from Stage 1>"
how_it_bears_on_move: "<one-line>"
analytical_work_done: "<what the frame-import lets the move conclude that pure inference would not>"
frame_imports_doing_analytical_work:
- frame_import: "<>"
inferential_moves_influenced: "<list of move_ids>"
coherence_finding_dependence: "<would the move hold if the frame-import were challenged?>"
Quality gates:
- Output integrates rather than concatenates.
- Per-move pairings of coherence-finding × frame-import are explicit.
- Frame-imports doing analytical work are surfaced (this is the integration’s unique product).
Synthesis Stage 2 — Cross-Cutting Integration
Type: contradiction-surfacing
Inputs: Synthesis Stage 1 (frame-coherence merge)
Synthesis prompt (orchestrator → model):
“Identify cross-cutting issues that NEITHER component pass alone would catch. Three classes of cross-cutting issue: (1) where the argument’s coherence depends on frame-imports that are themselves contested (the argument is internally consistent within the frame; the frame is doing load-bearing work that the coherence pass treated as background); (2) where coherence-failures track frame-substitutions across claims (the argument shifts from one frame to another between claims, and the apparent coherence-failure is actually frame-shifting masquerading as inference); (3) where motte-and-bailey-style structure operates across multiple claims (an arguer alternates between a defensible ‘motte’ claim and a desirable ‘bailey’ claim — see Caveats and Open Debates §D2 on the Shackel doctrinal usage vs. wider fallacy-label usage). Integration-failure (concatenating findings rather than integrating them) is a failure mode (CQ1 of argument-audit). Where a cross-cutting issue is identified, name it specifically: which inferential moves are involved, which frame-imports, what structural pattern.”
Output format:
cross_cutting_integration:
coherence_depends_on_contested_frame_imports:
- issue_id: CI1
inferential_moves_involved: "<list>"
frame_imports_involved: "<list>"
description: "<one paragraph — argument is consistent within frame but frame is doing load-bearing work>"
what_the_audit_neither_pass_caught_alone: "<the cross-cutting insight>"
coherence_failures_tracking_frame_substitutions:
- issue_id: CI2
claims_involved: "<list>"
frame_substitution_pattern: "<from frame F1 to frame F2 between claims>"
apparent_coherence_failure: "<what coherence-audit flagged>"
reframed_as_frame_shifting: "<what the integration reveals>"
multi_claim_structural_moves:
- issue_id: CI3
structural_move_name: "<motte-and-bailey | other multi-claim move>"
motte_claim: "<defensible — what the arguer retreats to>"
bailey_claim: "<desirable — what the arguer wants to establish>"
alternation_observed: "<where in the artifact the alternation occurs>"
shackel_or_wider_label: "<see Caveats §D2 — note doctrinal vs. fallacy-label usage>"
warranted_or_label_only: "<is the structural claim warranted with multi-claim evidence, or label-slapped on a single move>"
Quality gates:
- At least one cross-cutting issue surfaced (CQ1: integration-failure means none surfaced).
- Cross-cutting issues are integrative (require both frame and coherence findings to detect).
- Where motte-and-bailey is invoked, the structural move is named with multi-claim evidence (Shackel doctrinal usage), not slapped as a label on a single move (CQ4: fallacy-labeling-without-warrant).
Synthesis Stage 3 — Integrated Audit Document
Type: dialectical-resolution
Inputs: Synthesis Stage 1 (frame-coherence merge), Synthesis Stage 2 (cross-cutting integration)
Synthesis prompt (orchestrator → model):
“Produce the final integrated Argument Audit Report. Structure: (1) argument summary (the artifact’s claims and structure, charitably reconstructed). (2) Per-claim coherence findings (from Stage 2 + Synthesis Stage 1). (3) Frame-surfacing findings (from Stage 1 + Synthesis Stage 1). (4) Cross-cutting issues (from Synthesis Stage 2 — the unique product of the molecular pass). (5) Named fallacies and argumentative moves (from Stage 2; for motte-and-bailey or other multi-claim moves, integrate Synthesis Stage 2’s structural specification with debate notes per §D2). (6) Overall argument-soundness assessment (argument-wrong vs. conclusion-wrong honored; the audit is conclusion-agnostic). (7) Residual uncertainties (what would change the assessment). (8) Confidence map per finding. The audit’s verdict integrates both lenses — sliding into stance-bearing evaluation (advocacy or rejection) is out of scope for this mode. Stop at the audit; do not announce, flag, or recommend stance-bearing follow-up in the output.”
Output format: see OUTPUT CONTRACT below.
Quality gates:
- Audit integrates four sections, not parallel concatenations.
- Cross-cutting issues are featured (these are what AAA delivers beyond single-component passes).
- Argument-wrong vs. conclusion-wrong honored.
- Stance-bearing follow-up flagged but not performed (mode is neutral).
- Confidence map per finding.
- Where Debate D2 is invoked (motte-and-bailey), the relevant Caveat is referenced.
OUTPUT CONTRACT — Final Artifact Template
[AAA — Argument Audit]
# Argument Audit for <artifact title or one-line description>
## Executive Summary
- **Artifact:** <one-sentence — what's being audited>
- **Audit focus:** <focal claim or conclusion>
- **Operative frame(s):** <named in alternative-comparable vocabulary>
- **Argument soundness assessment:** <argument-as-given establishes / does not establish its conclusion>
- **Cross-cutting issue highlight:** <one-sentence — the unique molecular finding>
- **What this audit does NOT do:** Stance-bearing evaluation (steelman or the red-team modes) is out of scope.
## 1. Argument Summary
[Charitable reconstruction of the argument with implicit premises surfaced. Toulmin-structured per inferential move.]
## 2. Per-Claim Coherence Findings
[For each inferential move:]
- **Move M_n:**
- Claim: <>
- Data: <>
- Warrant (surfaced): <>
- Backing: <>
- Qualifier: <>
- Rebuttal: <>
- Holds or fails: <>
- Reasoning: <>
- Frame imports bearing on this move: <from Synthesis 1 — which frame imports are doing analytical work here>
## 3. Frame-Surfacing Findings
- **Operative frame(s):** <named with one-sentence characterizations>
- **Lakoff metaphor inventory:** <quoted text + source-domain → target-domain mappings + entailments>
- **Goffman primary framework and keyings:** <natural/social; keying type; fabrication if applicable>
- **Entman four functions per frame:**
| Frame | Problem Definition | Causal Interpretation | Moral Evaluation | Treatment Recommendation |
|-------|---------------------|----------------------|------------------|--------------------------|
| A | ... | ... | ... | ... |
- **Selection and salience inventory:**
- Included and emphasized: <list>
- Excluded or downplayed: <list — what's silent>
- **Presupposition and nominalization audit:** <quoted text per finding>
- **Counterframe:** <what would the issue look like under an alternative frame>
## 4. Cross-Cutting Issues
[The unique product of the molecular pass — issues neither component alone would catch:]
### 4a. Coherence Depends on Contested Frame Imports
- **Issue CI1:** <description — argument is internally consistent within the frame; the frame is doing load-bearing work>
- Inferential moves involved: <list>
- Frame imports involved: <list>
- What this means: the argument's soundness is conditional on accepting the frame; under a counterframe the argument may not hold.
### 4b. Coherence Failures Tracking Frame Substitutions
- **Issue CI2:** <description — argument shifts from frame F1 to frame F2 between claims; apparent coherence-failure is actually frame-shifting>
- Claims involved: <list>
- Frame substitution pattern: <>
### 4c. Multi-Claim Structural Moves
- **Issue CI3:** <if motte-and-bailey or other multi-claim move detected — see §6 Caveats §D2>
- Motte claim (defensible): <>
- Bailey claim (desirable): <>
- Alternation observed: <where in the artifact>
- Doctrinal (Shackel) vs. fallacy-label usage: <which fits this case>
## 5. Named Fallacies and Argumentative Moves
[Each fallacy with full structural specification:]
- **<Fallacy name>:** quoted text / inferential move / violated principle / reason-it-fails-here
- For motte-and-bailey: see §4c and Caveats §D2.
## 6. Overall Argument Soundness Assessment
- **Argument-as-given assessment:** establishes / does not establish its conclusion because <structural reason>.
- **Conclusion-truth (independent of audit):** the conclusion may still be true; this audit does not adjudicate truth.
## 7. Residual Uncertainties
- <empirical questions whose answers would shift findings>
- <interpretive questions about what the artifact intends>
- <where the audit's confidence is bounded>
## 8. Confidence Map
| Finding | Confidence | Reason |
|---------|------------|--------|
| Operative frame identification | high / medium / low | <whether frame-imports are explicit in artifact> |
| Toulmin warrant for Move M2 | ... | <whether warrant is explicit or reconstructed> |
| Cross-cutting Issue CI1 | ... | <whether load-bearing claim about frame is well-supported> |
| Motte-and-bailey invocation | ... | <whether multi-claim evidence supports doctrinal claim or only single-move label> |
WORKED EXAMPLE WALKTHROUGH
Opening prompt (user): “I keep encountering arguments in tech policy debates that ‘AI is just statistics’ to defuse safety concerns about powerful systems. Audit one such argument: [op-ed text where author repeatedly says ‘these models are just curve-fitting on patterns’ and ‘predictions of catastrophe rest on confused metaphysics about computation’].”*
Stage 1 output (frame-audit, full):
- Operative frames:
- Frame A: “Models-as-statistics” — characterized as a deflationary frame: AI capabilities are the natural and expected consequence of large-scale curve-fitting, with no qualitative novelty requiring new safety frameworks.
- Frame B (counterframe surfaced for comparison): “Models-as-cognitive-systems” — emergent behaviors warrant analysis at the level of cognitive processes, not just statistical machinery.
- Lakoff metaphor inventory: “MODELS ARE CURVE-FITTERS” (source domain: regression analysis; target domain: AI inference); “PREDICTIONS OF CATASTROPHE ARE METAPHYSICS” (source domain: confused philosophical speculation; target domain: empirical safety arguments).
- Goffman primary framework: technical-redoing — the argument re-keys safety discourse into the technical-statistical frame, treating safety claims as confused category errors when stated in cognitive vocabulary.
- Entman four functions for Frame A:
- Problem definition: confused public discourse about AI capabilities.
- Causal interpretation: poor public understanding of how ML actually works.
- Moral evaluation: clarity is good; speculation is bad.
- Treatment recommendation: educate the public that “it’s just statistics.”
- Selection and salience: included = curve-fitting metaphor, references to training data, statistical interpretation of outputs. Excluded = emergent capabilities not predicted by training objective; in-context learning behavior; capability gains from scaling that surprised researchers.
- Presupposition audit: “models are just X” presupposes there is a stable nature of “the model” independent of capability scaling; “confused metaphysics” presupposes safety arguments rest on metaphysical claims rather than empirical observations of model behavior.
- Counterframe: “Models-as-cognitive-systems” — under this frame, the same systems are described in terms of capabilities, generalization, in-context reasoning, and the safety question becomes empirical: do these capabilities scale to dangerous regimes?
Stage 2 output (coherence-audit, full):
- Charitable reconstruction: the argument’s strongest version: “Concerns about AI catastrophe rest on attributing cognition to systems whose actual operation is statistical pattern-matching; recognizing this dissolves the apparent threat.”
- Toulmin breakdown:
- Move M1: Claim “AI capabilities are statistical pattern-matching.” Data: training process is gradient descent on loss function. Warrant: training mechanism determines the nature of the system. Backing: standard ML textbook treatments. Qualifier: implicit (claim is universal). Rebuttal: implicit (none acknowledged). Move holds within frame; warrant is contestable (training mechanism does not necessarily exhaust system properties — the warrant assumes a level-collapse).
- Move M2: Claim “Catastrophe predictions rest on confused metaphysics about computation.” Data: critics use cognitive vocabulary. Warrant: cognitive vocabulary applied to statistical systems is category error. Backing: appeals to common technical understanding. Move fails: the warrant smuggles in the conclusion (that the systems are not appropriately described in cognitive terms is precisely what’s at issue).
- Move M3: Claim “Therefore safety concerns are misplaced.” Data: M1 + M2. Warrant: clarifying the nature of systems dissolves safety concerns about them. Move fails partially: even granting M1 and M2, safety-relevant capabilities can exist independent of how the underlying mechanism is characterized.
- Named fallacies:
- Begging the question (Move M2): the warrant (“cognitive vocabulary applied to statistical systems is category error”) presupposes the conclusion (the systems are not cognitive in any safety-relevant sense).
- Genetic fallacy (implicit across moves): inferring properties of the system from properties of the training process; the system’s properties at inference time are not exhaustively determined by the training mechanism.
- Structural coherence failures not in named-fallacy taxonomy:
- Premise smuggling: the implicit premise “if a system can be described statistically, it cannot have cognitive capabilities” is load-bearing but unstated.
- Scope shift: between Move M1 (technical claim about mechanism) and Move M3 (safety claim about consequences) the scope shifts from mechanism to capability without acknowledgment.
- Argument-wrong vs. conclusion-wrong: this argument does not establish its conclusion (safety concerns are misplaced); the conclusion may still be true (perhaps safety concerns ARE misplaced for independent reasons), but this argument’s structure does not warrant the conclusion.
Synthesis Stage 1 (frame-coherence merge):
- Move M1’s warrant (“training mechanism determines nature of system”) is doing analytical work that the “models-as-statistics” frame supports but is not independently justified. Under the counterframe (“models-as-cognitive-systems”), the same data (training is gradient descent) does not warrant the same claim (capabilities are nothing but pattern-matching).
- Move M2’s warrant (“cognitive vocabulary is category error”) is the frame itself, deployed inside the argument to defeat the alternative frame.
- Frame import “MODELS ARE CURVE-FITTERS” influences M1, M2, M3 — it is the load-bearing frame doing most of the argumentative work; the inferential moves are largely vehicles for frame-deployment rather than independent inferences.
Synthesis Stage 2 (cross-cutting integration):
- CI1: Coherence depends on contested frame import. Argument’s internal consistency holds within the “models-as-statistics” frame; under the counterframe, M1’s warrant fails and the argument collapses. The coherence-audit alone would flag M2 and M3 as fallacious; it would not articulate that M1’s apparent soundness is frame-conditional.
- CI2: No clear frame-substitution across claims in this artifact (the frame is consistent throughout); this cross-cutting issue does not apply here.
- CI3: Motte-and-bailey-style structure detected.
- Motte claim (defensible): “Training is gradient descent on a loss function” (true; uncontroversial; technical).
- Bailey claim (desirable): “Therefore safety concerns about advanced model capabilities are confused metaphysics” (substantive; contested; carries policy implications).
- Alternation observed: when challenged on the bailey, the argument retreats to the motte (“we’re just describing how the systems work”); when extending the argument’s reach, it advances to the bailey (“therefore safety concerns are misplaced”).
- Per Caveats §D2: this fits Shackel’s doctrinal usage — the argumentative position is a structure of motte-and-bailey, not a single inferential move. Multi-claim evidence (the alternation pattern across the op-ed) supports the doctrinal characterization. The wider fallacy-label usage would also apply to a single-move retreat under challenge, but that is not the analysis here.
Synthesis Stage 3 (integrated audit document):
[Final Argument Audit Report follows OUTPUT CONTRACT template.]
Key integrated findings:
- The argument’s coherence is frame-conditional — it holds within the “models-as-statistics” frame but does not hold under the “models-as-cognitive-systems” counterframe. This is the central cross-cutting issue.
- The argument exhibits motte-and-bailey doctrinal structure (per Shackel) — the defensible motte (training is gradient descent) is repeatedly used to defend the substantive bailey (safety concerns are confused metaphysics).
- Specific named fallacies (begging the question on M2, genetic fallacy across moves) are real but secondary to the cross-cutting frame-coherence issue.
- Argument-as-given does not establish its conclusion. Conclusion-truth (whether safety concerns are well-founded) is independent of this audit.
CAVEATS AND OPEN DEBATES
D2 — Motte-and-Bailey: Fallacy or Doctrine? (Mode-Carried Debate)
Shackel (2005, “The Vacuity of Postmodernist Methodology”) introduced the term motte-and-bailey as a doctrinal characterization — a structural feature of certain argumentative positions in which an arguer alternates between a defensible “motte” (modest claim) and a desirable “bailey” (ambitious claim) when challenged. Shackel’s preferred usage frames motte-and-bailey as a characterization of a doctrine’s structure, not as a fallacy committed in a single inferential step.
In wider usage (online discourse, popular argumentation guides), the term has come to function as a fallacy label applied to single moves where an arguer retreats from an ambitious claim under pressure.
This mode operates without adjudicating the debate. When motte-and-bailey is invoked by AAA:
- The audit names the structural move in the argument’s terms — which claim is motte, which is bailey, where the alternation occurs (if observed across multiple claims).
- The audit notes whether Shackel’s doctrinal usage (multi-claim alternation pattern) or the wider fallacy-label usage (single-move retreat) best fits the case.
- Consumers seeking a stricter Shackel-aligned reading should treat motte-and-bailey invocations as doctrinal characterizations requiring multi-claim evidence; consumers using the wider sense may accept single-move applications.
The framework’s CQ4 (fallacy-labeling-without-warrant) requires that any motte-and-bailey invocation specify the structural move, not just attach the label. When multi-claim evidence is available, the doctrinal usage is preferred; when only single-move evidence is available, the audit should explicitly note that the wider fallacy-label usage is being applied and that the doctrinal usage would require additional evidence.
Citations: Shackel 2005; cf. wider discussion in popular argumentation literature.
Composition limit — stance integrity
AAA is stance-suspending (frame-audit) + stance-neutral (coherence-audit). Sliding into stance-bearing evaluation (advocacy, attack, recommendation) is out of scope. The audit stops at structural diagnosis. It does not announce, flag, or recommend stance-bearing follow-up — that adds noise and reads as gatekeeping. If a reader wants advocacy, rejection, or red-team analysis, they invoke a T15 mode separately.
Composition limit — propaganda boundary
Where the artifact is propaganda or persuasion-engineered (Stanley-style strategic deployment of frames + intentional inferential trickery), AAA’s stance-suspending posture may be insufficient. The escalation_signals.sideways in the mode spec routes such cases to propaganda-audit, the T1 specificity-specialized + adversarial-stance variant. AAA should flag the routing recommendation when propaganda indicators are present rather than producing a stance-suspending audit on a stance-bearing object.
When to escalate sideways or de-escalate
- Sideways to propaganda-audit: artifact is propaganda or persuasion-engineered; Stanley-influenced specialized variant applies.
- Sideways to T9 modes: if the audit reveals the dispute is really about which paradigm is correct (rather than which argument coheres), route to frame-comparison or worldview-cartography.
- Downward to coherence-audit or frame-audit: if user has time pressure or the audit can be productively narrowed (internal-consistency only or frame-surfacing only).
QUALITY GATES (overall)
- Both component passes ran (frame-audit and coherence-audit).
- Cross-cutting integration surfaces issues neither component caught alone (CQ1: integration-failure prevented).
- Frame-imports identified concretely with which premise carries which import (CQ2: frame-import-vagueness prevented).
- Coherence findings grounded in specific claim-pairs and inference steps (CQ3: coherence-impressionism prevented).
- Named fallacies (especially motte-and-bailey) warranted with structural specificity (CQ4: fallacy-labeling-without-warrant prevented; debate D2 referenced where applicable).
- Argument-wrong vs. conclusion-wrong honored.
- Stance-bearing follow-up flagged but not performed.
- Confidence map populated per finding.
- The four critical questions of
argument-auditare addressed.
RELATED MODES AND CROSS-REFERENCES
- Paired mode file:
Modes/argument-audit.md - Component mode files:
Modes/frame-audit.md(Stage 1)Modes/coherence-audit.md(Stage 2)
- Sibling Wave 4 modes:
Modes/decision-architecture.md(T3),Modes/worldview-cartography.md(T9) — share the depth-molecular composition pattern. - Sideways escalation target:
Modes/propaganda-audit.md(T1 specificity-specialized + adversarial-stance). - Stance-bearing follow-up modes (T15): steelman, balanced-critique, the red-team modes (for evaluation downstream of AAA).
- Territory framework:
Framework — Argumentative Artifact Examination.md - Lens dependencies: walton-argumentation-schemes (required), lakoff-framing (optional), shackel-motte-and-bailey (optional, when motte-and-bailey is in play; carries Debate D2), toulmin-model (via coherence-audit), entman-framing-functions (via frame-audit), goffman-frame-analysis (via frame-audit), kahneman-tversky-bias-catalog (foundational).
End of Argument Audit Analysis Framework.