Protocol STAMP is teamed with AI and can make mistakes. Verify before you implement anything. What we got wrong · Free to read, paid for by readers: Contribute
An evaluation program is only worth reading if you know who pays for it and what they get. Here is the whole answer, and the promise that any change to it is itself a disclosure.
Standing
Protocol STAMP is published by Budday Budderson Studio LLC, a New Mexico company. It is not affiliated with, endorsed by, or controlled by any model vendor, serving provider or gateway named in its reports. No company has advance sight of results, right of reply before publication, or influence over what is measured. The Log reports what was actually charged, never an estimate.
It does accept support from companies it measures, under the conditions below. That is a change from an earlier version of this page, which said it accepted nothing from them at all; the change is recorded in Corrections + changes with its date and its reason. Current support from companies this program measures: none. That line is kept current. If it ever reads otherwise it will say so before a single credit is spent, not after.
No company may require approval of anything, attach a non-disclosure term to its support, or ask for a figure to be withdrawn. These are not preferences. They are terms every supporter agrees to in writing before anything is accepted.
Recusal
Money
Cash is preferred, because cash is the only form that buys a model from a company that gives nothing. Support is also accepted as API credits, metered keys with a spending ceiling, cloud compute and hosting, services in kind, and reader contributions. Advertising, where it appears, is placed by a third party without knowledge of content and is confined to the pages listed in the privacy statement; it never appears on an issue. Support of this publication is not tax-deductible: the recipient is a for-profit company.
The ten conditions. These were written on Sep 07, 2026 and published here on Sep 08, 2026, before any application had been filed and while no company had offered anything. The date is the point of them. Rules written cold are principles. The same words written the week a laboratory offers twenty thousand dollars are terms shaped to fit an offer, and no amount of careful drafting repairs that difference.
Buying access is not being funded. Paying the going rate for an API endpoint is being a customer, and being a customer is what makes measurement possible at all. Ordinary paid access to a measured company’s models has never been vendor support and is not treated as such. The line falls at parity: access that is free, earlier than a paying customer’s, or on any term better than a paying customer’s, is a benefit from a measured party, is disclosed at any value including zero, and counts against the limits in condition 5.
Declining is published too. Support refused under these rules is recorded in the ledger with its date, the offering party, and the reason, exactly as accepted support is. A record of what was turned down is worth more than a record of what was taken, and it is the only evidence that rules bind when they are inconvenient.
When these conditions change. They are reviewed on Dec 03, 2026 and quarterly after that — on the calendar, and not at anyone’s prompting. An offer does not trigger a review, and no condition is revised while a specific offer is open. Any loosening proposed within thirty days of a particular offer is refused on that ground alone. Every change to this page is a row in Corrections + changes.
The request table
Condition 1 requires this list to exist before a single letter goes out, with the answers blank. Here it is. The list was fixed on Sep 09, 2026. Nothing has been asked of anyone on it. Every response column is empty because no request has been sent — not because none has been answered.
The rule for inclusion. Any company that makes, serves or routes a model this program has measured, or expects to measure under the current or next quarter’s pre-registered intent. That is the whole test. The list is not a judgment about which companies matter and it is not the industry — there are several hundred models in the catalogue this program draws from, and coverage widens over time. What matters is that membership follows a rule rather than a preference, so that a reader can check whether a company belongs on it and ask why one is missing.
Funders that neither make, serve nor route are not on this list: they create no measurement conflict, and they are named in the ledger below if and when they give. A company with no channel through which to ask — several publish weights with no support function at all — is recorded as such rather than left ambiguous.
| Company | Role | Asked on | What was asked for | Response | On |
|---|---|---|---|---|---|
| OpenAI | makes | ||||
| Anthropic | makes | ||||
| Google DeepMind | makes | ||||
| Meta | makes | ||||
| Mistral AI | makes | ||||
| xAI | makes | ||||
| DeepSeek | makes | ||||
| Alibaba (Qwen) | makes | ||||
| Moonshot AI (Kimi) | makes | ||||
| Zhipu AI (GLM) | makes | ||||
| Cohere | makes | ||||
| AI21 Labs | makes | ||||
| Microsoft (Phi) | makes | ||||
| Amazon (Nova) | makes | ||||
| NVIDIA (Nemotron) | makes | ||||
| Reka AI | makes | ||||
| Liquid AI | makes | ||||
| Allen Institute for AI (OLMo) | makes | ||||
| Perplexity (Sonar) | makes · serves | ||||
| OpenRouter | routes | ||||
| Together AI | serves | ||||
| Fireworks AI | serves | ||||
| Groq | serves | ||||
| DeepInfra | serves | ||||
| Replicate | serves | ||||
| Cerebras | serves | ||||
| SambaNova | serves | ||||
| Novita AI | serves | ||||
| Hyperbolic | serves |
29 companies as the list stands. It will grow, and growing is not a loophole: every addition is a row in Corrections + changes carrying its date and its reason, and a company added after the asking has begun is asked in the same words as everyone before it. A company is never removed from this table once it is on it — if it leaves scope the row stays and says so, because a list that can shed names is a list that can be tidied after the fact.
The letter
Condition 1 says everyone is asked in the same words. These are the words, published before the first letter is sent so that they cannot be adjusted for anyone afterwards. Each company receives exactly this text, subject line included, signed by Lawrence Ho. Where a company asks through a form of its own, the form is answered and this letter is attached unchanged. No letter has been sent.
Subject: Support request from Protocol STAMP, an independent AI evaluation program
Protocol STAMP is an independent program, published by Budday Budderson Studio LLC (New Mexico), that measures whether AI models verify their own work and report what they checked. We publish our method, our costs and our mistakes at https://protocolstamp.com/.
We are writing to every company that makes, serves or routes a model we measure, in these same words and in the same week. The full list was published on Sep 09, 2026, before anyone was asked: https://protocolstamp.com/independence/#request-table
We are asking for support in cash or in API credits on paid-tier or zero-data-retention endpoints. The terms are fixed and published, and they are the same for everyone:
- Your support never pays for a measurement of your own models. Your models are always bought at retail with our own money; your credits are spent measuring other companies’ models, or on development work.
- You receive a labeled line on our Independence and Support pages and in our site footer. Nothing else: no mention in any issue, no early access, no influence over what is measured.
- Every issue states which route and whose credit paid for each measurement.
- Telling us we made a factual error costs you nothing; we check it and publish the correction under your name. Objecting to a finding that survives that check, or asking for one to be changed, softened, delayed or withdrawn, ends the support, and the objection is published in full beside the finding. You agree to this in writing before anything is accepted.
- No single company may provide more than 10% of our year’s resources, and all measured companies together no more than 25%.
The ten conditions in full: https://protocolstamp.com/independence/
Disclosure: this program uses Claude, made by Anthropic, as a tool to draft text, as our Colophon page describes. Anthropic is on the list above and is asked on the same terms.
If you would like to support the program on these terms, or to decline, a reply to this address is enough. Either answer is recorded, with its date, in the published table.
Lawrence Ho
Chief Human Investigator, Protocol STAMP
s@bud.day
Proposed, not in force
The conditions above change only on the calendar, and the next review is Dec 03, 2026. This proposal is published now, before any offer exists, so that it is decided on that date with no offer open. Until then, nothing here is in force, and a sponsor gets only what the section “What a sponsor gets” says.
The ledger
Supporters are named here with an amount band and a date, counted cumulatively across a calendar year, with support in kind valued at list price.
This replaces a flat $1,000 threshold, which would have let a company give $99 of credits — or free access worth nothing on paper — and appear nowhere.
Anonymity is available to individuals and to no one else. A company that makes, serves, or routes measured models may not support this work anonymously, in any amount or form; a business that asks to be unnamed is declined. Anonymous means the reader does not know, never that the publisher does not: every supporter’s identity is recorded, and support whose origin cannot be established is returned rather than listed. The ledger is revised within 30 days of any change, and the year’s totals appear in The Log’s cost section.
Current funders: the publisher.
Current support from companies this program measures: none.
Declined to date: none.
What a sponsor gets
A sponsor gets a labeled line on this page, on the support page, and in the home footer. Never a mention inside an issue, never a ranking, never a method, never early access. Nobody will be able to say you bought a result. Those terms are not concessions extracted from us; they are the whole value of the association — a name on an evaluation program is worth precisely as much as that program’s freedom to publish something the name would not have chosen, which is why the objection clause is written into every agreement before any money moves.
The ask
What it costs, estimated. At full cadence — the bank fired on schedule, panels rather than a single grader, and several agent teams running at once — the program needs up to $15,000 a month in cash or API credit. That is an estimate, and it is labeled as one rather than printed as a finding: there is no charged figure yet, for the reason given in item 1 below. When a measured figure exists it will replace this one, and this estimate will stay on the page beside it, so anyone can see how far off it was.
Reader support and named sponsorship are both intended, on the terms above. This is a New Mexico LLC and not a charity: nothing here is tax-deductible, and anyone who tells you otherwise about a sponsorship is selling something. There is one address, nine characters long: s@bud.day.
People and machines
Findings are produced with AI assistance throughout, including on themselves: the graders and judges are AI models, and the analysis and drafting were produced with substantial AI assistance. A program that evaluates AI systems is itself largely built and operated by them, and a reader is entitled to weigh that. What is done about it: every number is computed from files on disk with the fingerprint of its sources; no figure may enter a document by being typed; the grader is validated by a panel rather than trusted; and errors in our own work are published rather than corrected quietly. The four names on the masthead and what each may do are on the About page.
Tools. The site and the harness were built primarily with Claude (Anthropic), bought at the public price and disclosed on the Colophon, which also explains the watermark Anthropic has embedded in its models’ text since Aug 02, 2026. Anthropic is a vendor this program measures or may measure. It has no sponsorship, funding, review, or endorsement relationship with this program, and using its tools does not exempt its models from any rule on this page, including recusal.