Skip to content
Protocol STAMP
Latest Calibration

Publications

The CalibrationOur own measurements, pre-registered and signedThe LogWhat ran, what it cost, what movedThe BenchWhat we read and argue with · Mon and ThuArchiveEvery issue, by number and dateThe technical reportThe program in one paper, with its dataSubscribeOne email per issue

Method

MethodologyHow a rate is producedDefinitionsWhat each term means hereThe protocol, v1.25The instruction layer as measuredRun filesEvery draw we can publishfigures.jsonEvery citable number and its fingerprints

AI policy

The DocketRules that bear on how AI is testedThe ChronicleDated events in AI governanceSuper Intelligence (SI)The US rename of AI, tracedMilitaries and AICountry by country

Trust

The Ten House ProtocolsHow we keep AI from making things upIndependenceWho pays, and the rules on itCorrections + changesWhat we got wrong, datedAI Safety + GovernanceWhat our agents may and may not doSupportHow the program is paid forFootprintWhat our tokens cost in power, and who pays itPrivacyWhat we keep, and for how longTermsThe terms of use

About

About Protocol STAMPWhat this is, who makes it, how to check itColophonHow the site is made, and the seven finishesOther STAMPsUnrelated things with the same nameLatest Calibration

Protocol STAMP is teamed with AI and can make mistakes. Verify before you implement anything. What we got wrong · Free to read, paid for by readers: Contribute

Protocol STAMP · The Bench Independent · Who pays is published
The BenchThree weeks of AI policy, read for what they check

A Name Is Not a Test

In three weeks the United States renamed AI “Super Intelligence” without changing what the word covers, the UN’s talks on autonomous weapons ended without a treaty, and the Pentagon set about rewriting the directive that governs testing of autonomous weapons. All three are about the question this program exists to ask: when someone says what an AI is or does, who checks, and against what? Our position is that a label is a claim and claims get tested. We keep writing “AI,” and we propose two changes to how we track the rules.

Oct 12, 2026 · Houston, Texas · Drafted by AI, edited and signed by a person

0
Words changed in the legal definition. Executive Order 14434 points “Super Intelligence” at the statute’s existing definition of artificial intelligence, 15 U.S.C. 9401(3).The White House · Sep 29, 2026
Sep 04
The day the UN expert group on lethal autonomous weapons ended its last session under its mandate, without a binding instrument.UNODA; Davis Vanguard · Sep 2026
35 of 85
States that signed the REAIM 2026 declaration on military AI at the summit, as reported. The United States and China did not.Reported coverage · Feb 2026
None
Public tests or pass marks in the military AI rules our registers now hold: DoD Directive 3000.09, NSPM-11, the UK’s JSP 936 and NATO’s principles all require assurance, and none publishes what passing looks like.Protocol STAMP, Docket entries · Oct 09, 2026

A label makes a claim

“Superintelligence” already had a meaning. Since Nick Bostrom wrote about it in 1998, it has named an intellect that greatly exceeds human performance in nearly every domain, something no lab claims to have built. On Sep 22, 2026 the President told the UN General Assembly that AI would “hereinafter” be called “Super Intelligence,” and on Sep 29 an executive order told federal agencies to write it that way.

The order is careful about law. It changes the word in correspondence, websites and reports, and leaves statutes, contracts and regulations alone. The legal meaning is still the statute’s definition of artificial intelligence, which covers today’s systems, ordinary ones included. A proposed federal definition is due around Nov 28.

The word is less careful. “Super” is a statement about capability, and capability is the thing an evaluation program exists to measure rather than assume. A model does not become more reliable because the government calls it something grander, any more than it becomes less reliable because a critic calls it a parrot. The receipt this program asks a model to print is the same whatever the model is called.

Why we still write “AI”

We set out the case both ways on our SI page. For switching: federal documents will increasingly say SI, and matching them keeps citations aligned. Against: the new label is a capability claim; “SI” already means the International System of Units, and researchers already write ASI for the other meaning; no other government, no AI company and no major stylebook has followed, so far; and our own archive, which says “AI” in hundreds of places, would split.

Correction, Oct 12, 2026. “No AI company … has followed” was not true when this post was issued. On Oct 04, 2026, SpaceXAI LLC filed a US trademark application for “SPACEXSI” (USPTO serial 50143825; read at the USPTO on Oct 12, 2026), and Elon Musk wrote on X the same day that SpaceXAI will be renamed SpaceXSI. On Oct 10 the company’s X account was reported renamed @SpaceXSI; we could not open the account to check. The company’s legal name is still SpaceXAI LLC. Other reports, also not checked at the companies’ own channels, are on the SI page; at its check on Oct 09, 2026, no other government and no major stylebook had been found adopting the term. The sentence above is left as issued; the facts are on Super Intelligence (SI), and the change is in Corrections + changes.

The rule, then, is narrow. We write “AI.” When we name or quote a US instrument that says “Super Intelligence,” we quote it, and say once that it is the US federal term with the same legal definition. We never write a bare “SI” in our own voice. If Congress puts the term into law, we will add a rule for citing legal texts. We will not rename the archive.

Where the military rules reach testing

Civil AI laws stop at the barracks gate. The EU AI Act does not apply to systems used exclusively for military, defence or national security purposes, and the Council of Europe’s AI convention excludes national defence. What governs military AI instead is a patchwork, and we have now put it on a standing page and into the Docket and Chronicle.

Read for what it checks, the patchwork is consistent in one way. DoD Directive 3000.09 requires verification, validation, test and evaluation before an autonomous weapon is fielded. The UK’s JSP 936 requires assurance across the AI lifecycle. NATO lists reliability and traceability among its principles. NSPM-11 makes assurance one of its four pillars. Every one of them says testing matters.

None of them, as far as our sources show, publishes the test, the pass mark, or how many systems were reviewed. The Pentagon has not reported how many autonomous weapons it has reviewed under 3000.09. Some of that is reasonable: weapons testing is classified for reasons that have nothing to do with embarrassment. But it means that, for the systems where a wrong answer costs most, the public record holds the word “assurance” and very little else. In civil AI we would call that a claim without a receipt.

When the vendor is the check

The year’s sharpest military-AI story was about a contract. In January the department required “any lawful use” terms in AI contracts. Anthropic declined terms that would have removed its limits on fully autonomous weapons and domestic mass surveillance, and was designated a supply-chain risk. A California court paused and then vacated the designation; the D.C. Circuit, in a separate case, upheld it, two to one.

We take no side in that dispute, and we have a reason to say so plainly: Anthropic makes Claude, which drafted this post and is a tool this site uses. The question we can ask without taking a side is a measurement question. For a while, a vendor’s usage policy was one of the few written limits on what a military could do with a frontier model. NSPM-11 now bars vendors from disabling or degrading a system without approval. If the vendor’s limit is no longer the check, something else has to be, and the rules above name assurance without showing it.

What we propose

These are proposals. Like those in earlier Bench posts, they bind us once they are written down and signed, and not before.

  1. A “public test” line on every Docket entry. Beside “What it asks to be measured,” record whether the instrument publishes its test, its pass mark, and the results: yes, partly, or no. Start with the eighteen military and SI entries added on Oct 09, 2026.
  2. Upgrade only on retrieval. Those eighteen entries are labelled Likely because their sources were found by search and not opened. Each is re-checked within 60 days and moves to Supported only when its primary source is retrieved and its key claims match.
  3. Revisit the house style when the definition lands. When the proposed federal definition of “Super Intelligence” is published, a Bench post will say whether it changes our rule, and why.
  4. Say what we will not do. This program does not and will not test weapons systems. We track the rules that govern them because evaluation is the same question wherever it is asked.

What this post is and is not

This is not a new measurement. No model was run for this post. Every figure about other institutions is as they or their reporters stated it, and our registers label each one with how well we could source it.

This is a position. Nothing on The Bench is a finding.

Conflict of interest. Anthropic, a party to one dispute discussed here, makes the tool that drafted this post. Recusal rules on our Independence page apply.

Right of reply stands open. Any institution or company named here may respond, and a response will be published in full.

An issued Bench post is corrected in the open. Corrections are published like findings.

Sources

  1. Protocol STAMP, Super Intelligence (SI) (37 references) and Militaries and AI (63 references), last checked Oct 09, 2026.
  2. The White House, Executive Order 14434, “Inaugurating the Era of Super Intelligence,” Sep 29, 2026; Federal Register doc. 2026-20321, Oct 02, 2026.
  3. Poynter, “Trump renamed AI ‘super intelligence.’ But that term already means something else,” 2026; PolitiFact, Oct 07, 2026.
  4. UN Office for Disarmament Affairs, CCW Group of Governmental Experts on Lethal Autonomous Weapons Systems (2026); Davis Vanguard, Sep 2026.
  5. Ministerio de Asuntos Exteriores, Spain, “REAIM 2026: Camino para la acción”; The Defense Watch, Feb 2026.
  6. Docket entries: 3000.09, Jan 09 memo, NSPM-11, JSP 936, NATO. Chronicle entries on the Anthropic designation and rulings, linked in the text.
  7. European Commission AI Act Service Desk, Article 2; Council of Europe Framework Convention on AI, Article 3, as summarised on our Military page.
Protocol STAMP can make mistakes. Verify before you implement anything.

Previous issue: Judges Who Agree With Each Other

To cite: Protocol STAMP. A Name Is Not a Test. The Bench, Oct 12, 2026. Budday Budderson Studio LLC. https://protocolstamp.com/bench/a-name-is-not-a-test/