AI Verification: We Verified It, and We Already Had It

Three checks came back clean this week: a regulator's compliance figure, a standards timeline, and a polling result, each run against its own primary source, each confirmed true, correctly dated, and correctly scoped. Nothing about any of the three was wrong.

All three were already sitting in this project's own research file, in two cases carrying more detail than the fresh check would have produced. The sharp case leads. A direct check of a New Zealand regulator's own media release this week recovered a spoken rounding: ninety per cent. The file already held ninety one, read from the regulator's own two underlying notices, with the reason the ninety should not be used attached to the entry.

Every figure checked out, so this is a missing-question story, not a carelessness one: nobody asked, before running the check, "is this already ours, and is our version better", only "is this true". A web search answers that second question cleanly, every time. It cannot answer the first, and a confirmation from a primary source feels exactly like a finding, whether it is one or not.

The sharpest instance is the Office of the Privacy Commissioner's own compliance notices to Manage My Health and Health NZ, issued under section 123 of the Privacy Act 2020 after a breach affecting approximately 99,416 people [1]. The Commissioner's own media release, fetched directly this week, states the Northland share of affected individuals as "90% of affected individuals", in the release's own words [1]. That is true. It is also, verbatim, the exact spoken rounding this project's own file had already flagged and instructed against using, because both underlying notices, read in full by an earlier pass, say 91 per cent.

The file did not just hold the better number. It held the reason the worse one circulates: the release rounds a figure the notices state precisely, and the rounding reads plausibly on its own, which is exactly why it is dangerous. The file also carried detail the release never states: the specific power under which the notices issued, the two notice dates, four interim compliance deadlines, and the computed intervals between breach and notice. A fresh check of the release would have recovered the weaker figure and lost the rest.

The second instance runs the identical shape. New Zealand's National Cyber Security Centre publishes ten minimum cyber security standards, commenced 30 October 2025, for agencies mandated under the Protective Security Requirements framework [2]. A direct fetch of the NCSC's own page this week confirms the ten standards and the date, and confirms, just as usefully, what the page does not say: no October 2026 deadline appears anywhere in it. A circulating account had read the standards as approaching an October 2026 compliance date. They are not. The file already held that correction, plus two figures this week's fetch could not independently reproduce, the number of mandated agencies and an assurance reporting date, both carried from an earlier reading and disclosed here as unverified again rather than quietly assumed current.

The third instance is the cleanest, and the least dramatic, which is its own kind of evidence. Gallup's own polling page states that 39 per cent of Americans now say artificial intelligence does more harm than good, up from 31 per cent a year earlier, rising to 47 per cent among adults aged 18 to 29, alongside a fall in trust in businesses to use AI responsibly from 31 to 27 per cent [3]. Every figure matches the file exactly. The file also carried something the fresh check alone could not: this figure set had already circulated once before as a "new" report built on numbers Gallup had itself published months earlier. This week's own clean verification would have been the third arrival of the same set, not the first.

Put together, these three findings describe something more precise than a near miss. Web verification answers "is this true." It cannot answer "is this already in our own record," and a clean confirmation from a primary source carries exactly the feeling of a genuine finding while it happens. The fix is an ordering, not a fourth check layered onto the three that already exist for date, scope, and subject: search what is already known before verifying what is new, a step this project's own working method already states. This week performed the two steps in the wrong order, and was saved from shipping all three as new only by the accident of needing to open the file in order to write this week's additions into it. A session that filed its notes elsewhere would have carried every one of these forward as a discovery. That is the honest cost of catching it this time, not proof that the method is sound.

Call this, for now, the verified re-arrival: a working name for a pattern, not a settled addition to the taxonomy. It sits apart from the two shapes this series has already named. A stream that gets the date wrong is one failure; a figure correctly dated but measuring the wrong population, task, or counting convention is a second, distinct one. The verified re-arrival is neither: the fact is true, the date is right, the scope is right, and the only thing wrong is a claim of novelty the evidence never supports. Checking the date will not catch it. Checking the population will not catch it either. The only question that does is whether this project has already said the same thing, somewhere, more precisely.

A second strand closes a question left open last week: whether a figure can pass an existence check and a date check and still fail, for a third reason entirely. Last week's package proposed Scope Substitution, a correctly sourced, correctly dated figure read against a population, task, or counting convention it was never measured against, and set a test for whether the idea survives a second week on new material. It does, across three further instances, and the third does the real work.

The first is a straightforward mix-up between a ceiling and an average. Coverage of Amazon's satellite manufacturing facility in Kirkland, Washington converges on a stated capacity of up to five satellites a day [4]. The project's own file holds a different, equally correct figure: the plant now produces about 27 a week, roughly 3.9 a day on average. Five a day is a peak the line can hit. 3.9 a day is what it has sustained. Neither number is wrong; comparing them without naming which is which manufactures a contradiction that does not exist.

The second is a single word doing a great deal of damage. Reporting on a breach affecting more than a million people across Australia and New Zealand lists the exposed fields as including dates of birth [5]. The verified field list, checked this week against independent coverage of the same incident, contains date joined, not date of birth [5]. "Joined" and "of birth" differ by one word and move the record from low-sensitivity account metadata to a regulated identity attribute. Nothing about the underlying reporting is dishonest; the population the claim describes is simply not the population the headline implies.

The third instance turns the method on this project's own earlier work rather than on an external report. An industry benchmark places one well-covered model at a score of 58 against a close competitor's 56, reported in both places as a loss [6]. Read in full, the same scoreboard shows the 56 tying a second frontier model on the identical measure, and shows the 58 recorded specifically at the model's maximum reasoning effort, a configuration choice rather than a fixed property [6]. Nothing about either company's own figures is false. What was incomplete was this project's own earlier choice of which comparison to repeat, and the absence of a word, "maximum effort," that would have told a reader the 58 was not what that model does, but what it can be pushed to do once. A reader told only "56 lost to 58" receives a more lopsided picture than one told the fuller version.

Three instances, verified independently this week, none of them a date error, satisfy the test set a week ago. The widening worth stating plainly is that a choice of comparator, and the effort setting at which it is measured, is itself a form of scope, not a separate problem. Whether this becomes a permanent name alongside the two already in use is a call I will make deliberately, not a verdict this article reaches on its own; I record it here as load-bearing for this week's argument and nothing more.

This week supplies a sharp reminder that the project's own past work sits inside all three failure shapes this series now tracks. A boundary worth stating without softening: none of the organisations named in any of this week's findings, not the Privacy Commissioner, the National Cyber Security Centre, Gallup, Amazon, the education technology company behind the breach, or the companies behind the benchmark, is shown by this week's evidence to have misrepresented its own work anywhere. Every correction traces to this project's own earlier framing or sourcing choices. The claim is narrower and more uncomfortable than institutional error: a process careful at every individual step can still fail at the step above all of them, checking whether it has already said this.

A third strand, briefer, returns to the discipline this series opened with two weeks ago: a date is a claim about an entity in its own right, needing the same check as the headline figure next to it. Six further instances this week, each checked independently. A federal order excluding a named AI vendor's products from government systems was signed in July and only reached public visibility through its Federal Register publication in October, a gap some accounts have collapsed into one recent-sounding date [7]. A change in leadership at New Zealand's National Cyber Security Centre took effect in March, not this week, as one circulating account implied [8]. Two competing aerospace companies' satellite data centre filings, read by some as the same week's escalation, were in fact filed roughly two months apart [9]. A thirty-two-country attitudes survey carries a fieldwork window two months earlier than a secondary summary implied [10]. A national cyber threat report has now arrived for a third consecutive cycle wrongly dated, when its own file name states the month it was actually published [11]. And the month's largest software patch release, more than 1,400 vulnerabilities including an actively exploited Windows Shell flaw, was issued on a date one circulating account moved forward by a single day [12]. None of these gaps is large. A weekly research cycle works inside a window exactly as wide as a single day, which is enough to move a release from outside it to inside, or the reverse.

The fourth and closing strand holds a line this series has held for four cycles running, against the strongest instrument yet to market language adjacent to its own. A major technology company's new manuscript-review system, launched this month after a pilot across more than sixteen thousand submissions to leading computer science and machine learning venues, segments a document, assigns computational effort by section, runs reasoning agents over each section in parallel, and finishes by checking the resulting claims against retrieved references [13]. That is a genuinely capable instrument, addressing a real, shared problem: the cost of checking has not fallen as fast as the cost of generating. It is, nonetheless, a system criticising prose against retrieved references. The verification this series documents asks whether a named entity exists and whether a claim actually holds of it, independent of how much supporting text sits in a context window, and it has never been run against this week's findings, any more than against any prior week's. No vendor has yet marketed its own tool in this series' own vocabulary; this boundary is stated in advance of that happening, not in response to it.

A closing example, at a higher evidentiary tier, makes the same bottleneck visible in a different domain. An independent AI-detection research firm found that approximately one fifth of peer reviews submitted to a major 2026 machine learning conference were fully AI-generated, with partial involvement pushing total exposure past half, against roughly one in six two years earlier, and found dozens of hallucinated citations inside a few hundred sampled reviews [14]. Two cautions travel with that figure. The finding belongs to the detection firm, not to the conference or any technology company this article has named. And the review count this figure rests on is reported inconsistently across sources, so the honest practice cites the percentage and the two-year comparison, never a headcount pulled from whichever source states it most confidently.

An open, numbered registry does some of this project's own work for it. The breach reported above carries a public identifier, CVE-2026-72898, assigned under the Common Vulnerabilities and Exposures system precisely so a claim about a flaw does not have to be taken on anyone's word; anyone can look the number up without asking a vendor's account to be believed first. That is the same discipline this week's own near miss argues for in a different register: an open, checkable record outlasts any one session's memory of what it already found. V.E.R.A.'s own codebase carries the identical commitment under the GNU General Public Licence version 3, published on GitHub rather than asserted in a brief, distinct from the other systems sharing its acronym. The implication on the sovereignty side is what the next paragraph takes up, under worse stakes.

Article 36 of the 1977 Additional Protocol I requires a legal review of a specific weapon, means, or method of warfare, not a general class, and that bound exists for this week's own reason: a review completed once does not stay current simply because the system it covered once passed. The Group of Governmental Experts convened under the Convention on Certain Conventional Weapons applies the same discipline one level further down, treating a system's own determination that an object is a lawful target as an independently checkable claim, not an account to be trusted because it was checked before. Neither instrument asks whether a prior finding was once true. Both ask whether it still applies to the system standing in front of the reviewer today, a question a clean re-confirmation cannot answer by itself, in a weapons review any more than in a research file.

The fix here was never a fourth check. It was an order this project's own working method already states and this week performed in reverse: search what is already known before confirming what is new. The catch happened only because writing this week's new entries required opening the same file the old ones were already sitting in, not because the discipline held. A team that filed its notes somewhere else, or ran its web checks before its own search, would have carried every one of these forward as a discovery, and nothing downstream would have disagreed. Every organisation named this week did its own part correctly: the release was accurate, the standards page was current, the poll was exactly what it said. The failure, each time, sat on this side of the work, in the order the checking happened.

Where has your own team found something true, correctly dated, and already sitting in a file nobody thought to open first?

If your board or legal team needs a technical verification of an AI system's runtime logic or retrieval pipeline, message me and I will send the scope and the fixed fee.

• • •

The views expressed in this article are entirely my own, informed by more than 30 years of professional experience in architecture, security, and technology leadership in New Zealand. I write as director of Te Pono Limited; the views are personal and do not represent the position of any client, any government agency, or the New Zealand government. My commentary on legislation and policy is analytical, drawing on publicly available sources and my professional expertise in architecture, security, and AI governance, and it is politically neutral.

• • •

About the Author: Andreas Hamberger is a New Zealand leader in Architecture & Security and Associate Member of the Institute of Directors. V.E.R.A. (Verified Existence & Reason Architecture) is an open-source logic engine available on GitHub. Through Te Pono he provides technical verification of AI runtime logic and retrieval pipelines for boards and legal teams; contact andreas@thehambergerreport.com for the scope and fixed fee.


This article was produced with AI assistance under my direction. Research, drafting and images pass through a pipeline I built and govern: automated gates for source verification, forbidden language and political neutrality, and my own review before anything is published. The tools include Claude, Gemini and Openart. The frameworks, arguments and editorial judgements are mine and are the same discipline I apply to the AI systems I audit for clients. AI accelerated the work; the thinking, and the responsibility for it, are mine.


[1] Office of the Privacy Commissioner (New Zealand). "Privacy Commissioner issues compliance notices to Manage My Health and Health NZ." 2026. https://www.privacy.org.nz/tuhono-connect/statements-media-releases/privacy-commissioner-issues-compliance-notices-to-manage-my-health-and-health-nz/

[2] National Cyber Security Centre (New Zealand). "Minimum Cyber Security Standards." 2026. https://www.ncsc.govt.nz/protect-your-organisation/minimum-standards/

[3] Gallup. "Americans Cool Toward AI's Growing Role in Society." 28 July 2026. https://news.gallup.com/poll/712751/americans-cool-toward.aspx

[4] Lightreading. "Amazon Leo still tracking for 2026 service launch as satellite production ramps." 2026. https://www.lightreading.com/satellite/amazon-leo-still-tracking-for-2026-service-launch-as-satellite-production-ramps

[5] SecurityWeek. "Mathspace Data Breach Exposes Over 1 Million People." 2026. https://www.securityweek.com/mathspace-data-breach-exposes-over-1-million-people/

[6] VentureBeat. "Meta's new Muse Wonder and Muse Wonder Full models achieve frontier performance, but only the weaker one is available via API." 2026. https://venturebeat.com/technology/metas-new-muse-wonder-and-muse-wonder-full-models-achieve-frontier-performance-but-only-the-weaker-one-is-available-via-api

[7] CNBC. "U.S. bans DeepSeek from government agency systems amid AI rift with China." 20 October 2026. https://www.cnbc.com/2026/10/20/us-deepseek-federal-agency-ban.html

[8] Reseller (New Zealand). "Catriona Robinson to lead National Cyber Security Centre." 2026. https://www.reseller.co.nz/article/4142691/catriona-robinson-to-lead-national-cyber-security-centre.html

[9] DataCenterDynamics. "Project Sunrise: Bezos-backed Blue Origin files for approval to put 51,600 data centers in space." 2026. https://www.datacenterdynamics.com/en/news/bezos-backed-blue-origin-files-for-approval-to-put-data-centers-in-space/

[10] Ipsos. "The Ipsos AI Monitor 2026." June 2026. https://www.ipsos.com/sites/default/files/ct/news/documents/2026-06/Ipsos-AI-Monitor-2026.pdf

[11] National Cyber Security Centre (New Zealand). "Cyber Threat Report 2026." 18 September 2026. https://www.ncsc.govt.nz/assets/insights/Documents/NCSC-CyberReport_2026-RGB-18092026.pdf

[12] Tech Times. "Microsoft Patch Tuesday October 2026: Record 1,413 CVEs, One Already Under Attack." 15 October 2026. https://www.techtimes.com/articles/329061/20261015/microsoft-patch-tuesday-october-2026-record-1413-cves-one-already-under-attack.htm

[13] Google Research. "Analyzing technical documents with Deep Review." 14 October 2026. https://research.google/blog/analyzing-technical-documents-with-deep-review/

[14] Pebblous AI. "ICLR 2026 AI Peer Review Crisis." 2026. https://blog.pebblous.ai/report/iclr-2026-ai-peer-review-crisis/en/

Next
Next

AI Verification: Right Number, Right Date, Wrong Population