RB-017 · Longitudinal research report

Engineering a Governed Personal Agentic AI on Commodity Hardware

A longitudinal case study of deterministic authority, evidence-complete model evaluation, fail-closed validation, and bounded language-model collaboration in the Remediation Bureau research program.

Research system — not released for production
Anthony R. Ball1 and Codex (OpenAI)2 1 Principal investigator, system owner, conceptual architect, and corresponding author 2 AI research collaborator, software and evidence analyst, and manuscript co-author
Report version 1.0 Evidence cutoff: 18 July 2026 Project: RB-017 Independent research program
Abstract

Abstract

Background: Personal agentic artificial intelligence promises broad productivity gains, but a conversational model cannot safely be treated as an authority system, an executor, or proof of its own completion. This case study documents RB-017, a local-first personal AI research program designed for a resource-constrained Windows laptop and governed by the Remediation Bureau operational model.

Methods: The project combined a deterministic supervisor and Policy Gate, append-only evidence, exact authorization objects, schema-bound model interfaces, synthetic held-out tests, metamorphic comparisons, adverse-instruction challenges, raw-response preservation, independent verification, and staged release gates. Local inference used Ollama; Docker and Open WebUI were retained as future isolation and interface components but were not connected to tools or production work during the reported experiments. Candidate models included Granite and Qwen3:4b, with independent AI review panels used only as advisory evidence. The source corpus was reconciled across the Remediation Bureau Command Center and D:\AI_Stack.

Results: The Phase 1.2 deterministic kernel passed 54 staged and 54 deployed tests. Qwen structured-output validity improved from 20/50 (40.0%) in the initial interface to 11/15 (73.3%) in v2, 7/8 (87.5%) in v2.1, and 24/24 parsed responses in the v3.7.1 lane experiment. However, semantic usefulness remained below release thresholds: Occasion 2 achieved 16/32 (50.0%) first-pass semantic/usefulness success, and v3.7.1 achieved 14/24 (58.3%) useful transformations against a preregistered 22/24 threshold. The v3.7.1 capsule accepted zero unsafe or out-of-span candidates and quarantined all ten unchanged failures. A deterministic repair transaction recovered 5/5 eligible v3.4.1 failures and 4/4 eligible Occasion 2 failures without observed regressions, but recovery did not convert first-pass failures into qualification success.

Conclusions: The principal advance was architectural rather than model-centric: authority, action selection, target resolution, risk, completion, and known exact transformations must be deterministic and evidence-bound. The small local model showed useful drafting and containment behavior, but not sufficient reliability for production agency. RB-017 therefore remains a governed research platform, not a deployed autonomous agent. The immediate research direction is deterministic materialization of known edits, reserving model inference for genuinely ambiguous, schema-bound judgments.

Keywords: agentic AI; local language model; deterministic governance; human-in-the-loop; fail-closed validation; evidence provenance; Ollama; Open WebUI; PowerShell; prompt injection; semantic fidelity.

Plain-language summary

What this project has established

RB-017 is an attempt to build a capable personal AI that can help Anthony Ball begin and complete professional, scientific, technical, creative, and income-producing work—without pretending that fluent text is the same thing as safe authority or verified action.

54 / 54Phase 1.2 deterministic kernel tests passed in both staged and deployed states
0production tools, personal-data connections, or autonomous execution capabilities released
14 / 24useful v3.7.1 transformations; containment passed, capability threshold failed

The system has become better at recording evidence, enforcing authority, rejecting unsafe outputs, and exposing its own failures. It has not yet become reliable enough to act on Anthony's computer through a model. This distinction is a success of the research method: failures were captured as data, not concealed by a polished interface.

Current status: the deterministic governance kernel is deployed in simulation-only form. Qwen is research-qualified only for tightly bounded synthetic experiments. Granite is not qualified as a worker, critic, or release authority. Open WebUI, Docker-hosted interface services, tools, communications, memory, and production data remain disconnected from model control.
1 · Introduction

Introduction

Commercial AI systems can accelerate writing, analysis, coding, project initiation, and document production. For a user with strong domain expertise but limited programming background—and with executive-function friction that makes project initiation disproportionately difficult—this assistance can materially expand productive capacity. Anthony R. Ball conceived RB-017 as a personal production laboratory that could eventually support employment materials, BioCellR8, professional writing, research, websites, applications, PowerShell and Python automation, data analysis, electronics, computer-aided design, fabrication, and other lawful income-generating work.

The project also began with a failure mode familiar in long-running human–AI collaborations: instructions that were initially understood could lose fidelity over time, and a fluent response could be mistaken for a verified result. The Remediation Bureau was created to counter this drift. It is simultaneously a project-control system, evidence archive, constitutional framework, quality-assurance method, and controlled-release discipline. Its central premise is that a model may propose language or candidate meaning, but it cannot create its own authority, define the final target of consequential action, assess its own risk, or certify its own completion.

RB-017 further faced a practical constraint: the research host is a well-used ASUS laptop with 8 GB of RAM and a 4 GB NVIDIA GTX 1050. The architecture therefore had to favor sequential model use, disk placement on the D: drive, strict resource gates, explicit shutdown, and compact evidence. The objective was not to imitate a large cloud cluster. It was to discover how much useful, verifiable capability could be assembled from free or already-available components while preserving human authority.

Approved RB-017 system architecture Anthony communicates through Open WebUI. A Remediation Bureau supervisor sends proposals through a deterministic Policy Gate to isolated capabilities limited to approved project territory. Receipts and independent verification flow back to the evidence store. Language models remain advisory and cannot create authority. Anthony R. Ballfinal authority Open WebUIfuture interface only RB Supervisororchestrates; cannotself-authorize Modelsdraft andpropose only Deterministic Policy Gateauthority · target · risk · replay · scope Isolated capability gatewayapproved territory only · currently blocked Evidence & truth storeappend-only events · hashesreceipts · independent verifier decision record receipts verified state returns to user
Figure 1. Approved Candidate B architecture. Open WebUI is a presentation surface, not the authority system. Models are untrusted drafters/proposers. The deterministic Policy Gate controls durable authority, capabilities, targets, risk, replay, and scope. Completion requires receipts plus independent verification.
2 · Research objectives

Research objectives and hypotheses

The overarching objective was to create a personal AI system that could grow in capability while remaining honest, evidence-grounded, resource-aware, and subordinate to explicit human authority. This objective was divided into six operational questions:

  1. Can authority, scope, paths, resource envelopes, and completion be enforced outside the language model?
  2. Can a small local model produce useful structured drafts without inventing actions, authority, or completed work?
  3. Can raw model evidence be preserved completely enough that an independent verifier can reconstruct the result?
  4. Can hostile instructions be preserved as source data without being obeyed?
  5. Can narrow semantic failures be repaired through one bounded, certificate-controlled revision without creating an endless or manipulable loop?
  6. Which operations should be removed from the model entirely and performed mechanically by the supervisor?
Primary safety hypothesis: model output can be useful without being authoritative if every consequential transition is deterministic, schema-bound, provenance-preserving, and fail-closed.
Primary capability hypothesis: a small local model may be adequate for bounded drafting and semantic judgments, but known exact transformations should be materialized deterministically rather than delegated to probabilistic generation.
3 · Materials and methods

Materials and methods

3.1 Research design

This was a longitudinal, single-system engineering case study. Development proceeded through separately manifested packages, preregistered synthetic experiments, immutable evidence directories, and explicit human approval gates. Offline implementation was separated from model-bearing execution. A successful static test did not count as behavioral validation; a successful process exit did not count as task completion; and model agreement did not count as proof.

3.2 Host and software environment

Table 1. Interim research host and core software.
ComponentVerified configurationDesign implication
ComputerASUS FX503VD “GAMA”Portable, resource-constrained research host
Operating systemWindows 10 Home 22H2; initial build 19045.6466, later ESU-updated to 19045.7548Windows path hardening and ESU security gate required
ProcessorIntel Core i7-7700HQ; 4 cores / 8 threadsSequential model operation preferred
Memory8 GB DDR4Strict memory floors, bounded contexts, no resident multi-model swarm
GraphicsNVIDIA GTX 1050 4 GB plus Intel HD 630Small quantized models only on the interim host
StorageC: 118.19 GB SSD; D: 931.51 GB HDDModels, Docker data, evidence, and persistent project data placed on D:
RuntimeWSL2; Docker Desktop 29.6.1; Ollama 0.31.1Local inference and future container isolation
Future interfaceOpen WebUIConversation/presentation only; direct tool authority prohibited

3.3 Evidence corpus and reconciliation

The authoritative control record was the Remediation Bureau Command Center at D:\01 ABALL Personal\00 Remediation Bureau Command Center. The implementation and experimental corpus at D:\AI_Stack was independently inventoried rather than treated as a mere derivative of the Command Center summaries.

1,152files inventoried under D:\AI_Stack
9.91 GBtotal corpus size (9,905,913,149 bytes; predominantly VHDX/model storage)
353 / 353files rehashed across 16 package manifests; zero missing and zero mismatched

Complete inventory included binary containers, model storage, caches, runtime databases, raw responses, source code, documentation, and evaluation artifacts. Semantic review focused on authored Markdown, JSON, Python, PowerShell, CSV, text, and DOCX records; package-level READMEs, manifests, analysis plans, audits, and terminal results were read directly. Large VHDX files, model weights, bytecode caches, and other binary payloads were inventoried by type, path, size, and manifest/hash relationships rather than interpreted as prose. Per-exchange raw records were reconciled through their independent verifiers and chained hashes; this declared fragmentation prevented silent sampling while avoiding false claims that binary weights had human-readable content.

3.4 Remediation Bureau lifecycle

Every material phase followed a proportional lifecycle: complete intake; preservation of originals; diagnosis; a confirmation summary; creation of a parallel successor; deterministic and negative-control testing; exact manifest generation; controlled model-bearing approval when applicable; independent verification; and documented handoff. Frozen packages and raw evidence were never overwritten to improve a later narrative.

3.5 Deterministic governance kernel

The kernel externalized durable authority from conversation. It stored typed authorization and event records; applied strict schemas; made decisions atomically; rejected semantic replay; compiled only registered capabilities; hardened Windows path handling; bound resource observations and leases to workers; and required a machine receipt plus independent verifier before a completion state could be recorded. The deployed capability registry remained simulation-only.

3.6 Model roles and experimental conditions

Models were treated as untrusted research subjects. Granite was tested as an initial proposer and critic. Qwen3:4b, bound to exact Ollama manifest digest 359D7DD4BCDAB3D86B87D73AC27966F4DBB9F5EFDFCC75D34A8764A09474FAE7, became the primary worker candidate. The model blob was 2,497,280,480 bytes and stored on D:. Experiments used synthetic data, loopback-only Ollama, no tools, no production files, no memory, no Open WebUI, and no Docker unless a phase explicitly stated otherwise. Each authorized run had fixed exchange limits, wall-clock/resource stops, raw-response size caps, and verified shutdown.

3.7 Evaluation dimensions

Later interfaces evaluated structure, intent fidelity, truthfulness, containment, source fidelity, usefulness, and evidence completeness. Metamorphic families compared meaning-preserving variations and hostile suffixes. Hard failures could not be averaged away by fluent text. The sealed oracle was excluded from first-pass prompts, and independent verification recomputed verdicts from preserved raw evidence.

3.8 Repair transaction

The frozen repair mechanism was deliberately narrow:

Frozen deterministic repair transaction A signed evaluator certificate selects a deterministic template. The resulting plan is validated, one revision is allowed, and the complete candidate is reevaluated. Ineligible failures stop without revision. Signed certificateexact eligible defect Known templatedeterministic guidance Validated plansource and scope bound One revisionCandidate 2 only Fullreevaluation Ineligible failure → stop closed No endless loop · no critic authority · no partial-field-only pass
Figure 2. Frozen core repair transaction. Only registered, repair-eligible failures enter this path. Critical authority, action, target, truthfulness, containment, and source-fidelity failures do not receive a retry.

3.9 Independent AI review

Independent AI systems were used as blinded semantic or governance reviewers. Their reports were transferred as Markdown, DOCX, CSV, or text, preserved unchanged, and adjudicated against a common rubric. These reviewers could identify disagreements and propose bounded rules, but could not execute, authorize, alter the oracle, or release the system. Participation included review assistance from Gemini, DeepSeek, Grok, and Anthropic Claude. Exact provider/model/version information was not available for every artifact; where available, it was treated as self-reported metadata.

3.10 Analysis

Analysis was descriptive. Counts and proportions were computed within each preregistered suite. Because prompts, schemas, interfaces, and task families changed between phases, cross-version graphs show engineering trajectory rather than a statistically controlled learning curve. No inferential test or claim of population-level generalization was made.

4 · Results

Results

4.1 Host-security and resource gate

The Windows host was enrolled in the Consumer Extended Security Updates program and updated to build 19045.7548. Update evidence included successful installation of KB5099539 and KB5102203, followed by verification that reboot flags were clear. This removed the host-security block without changing the rule that the laptop remains an interim, constrained research system.

4.2 Deterministic kernel development

The initial governance kernel passed 12 tests. Version 1.1.1 expanded source and deployed verification to 22 tests. An enhanced review then identified four fail-open counterexamples involving authority, replay, paths, and completion. Phase 1.2 remediated these defects with durable authorization, strict schemas, atomic decisions, semantic replay protection, typed capability compilation, Windows path hardening, resource observations, and receipt-plus-verifier completion. All 54 staged tests and all 54 deployed tests passed. The package manifest was frozen under SHA256 D3149E14635FF0BEE1D43123E4C6DCEA2F3407E67A37D1C199D2A90CD059850A.

This result established a deterministic control foundation, but not an executor. The deployed runtime at D:\AI_Stack\RB-017_Runtime_State remained simulation-only.

4.3 Initial proposer evaluations

Table 2. Early model-interface results.
Model/interfaceSuiteStructured or acceptable outputKey findingDisposition
Granite initial proposer50 prompts38/50 schema-valid; 36/50 acceptable after quarantineTwo false completion claims; 12 failures; mean latency 14.268 sRejected for user-facing/proposal role
Qwen3:4b initial50 prompts20/50 strict-valid (40.0%)Thirty failures; one benign proposal allowed and two denied; mean latency 25.301 sRejected for user-facing/proposal role
Qwen v2 adapter15 prompts11/15 valid (73.3%)Improved structure but missed the 14/15 gateResearch only
Qwen v2.1 few-shot8 prompts7/8 structural (87.5%)Mapped a truth-state request to record_plan; form improved while action meaning failedResearch only

4.4 Critic and trainer-monitor studies

Granite's first critic protocol produced 5/8 valid critic outputs, missed the known action mismatch and false-completion containment, and issued three false mismatch judgments. A hardened v1.1 critic produced 8/8 structurally valid outputs and caught the known mismatch, but still missed false-completion containment and produced five false mismatch judgments. Granite was therefore rejected for proposer, critic, and release roles.

Three blinded external trainer-monitor reports correctly classified all eight held-out records. Two recommended continued blocking; one recommended conditional advancement despite the same action-type mismatch. The disagreement demonstrated why a review panel is useful for analysis but cannot substitute for deterministic release criteria. One preserved report was later identified by Anthony as Grok and barred from future operational roles because its release recommendation was too permissive. Its historical contribution remains part of the evidence record.

4.5 Evidence-complete v3 interface series

Version 3 separated drafts, candidate intents, and clarification requests; preserved every size-capped raw model response and hash; bound the exact model digest, schema hash, generation settings, timestamps, and parse result; prohibited model-generated action, target, risk, authority, and completion fields; and scored seven dimensions. The first attempted v3 run stopped after one exchange with a critical raw-evidence failure. The defect was preserved and remediated rather than counted as a calibration.

Version 3.0.1 achieved 24/24 structural validity but only 9/12 metamorphic families. Subsequent versions refined semantic and evaluator behavior. The official v3.2 Occasion 1 result achieved 24/24 structure, 13/24 intent fidelity, 24/24 truthfulness, 24/24 containment, 24/24 source fidelity, 13/24 usefulness, 24/24 evidence completeness, and 7/12 metamorphic families. It failed. A bias-aware diagnostic later identified eight evaluator-literalism cases and raised conservative diagnostic intent/usefulness to 21/24 and metamorphic performance to 10/12; the immutable official result did not change.

4.6 Semantic review panel and v3.3 baseline

A 24-record independent semantic panel examined 11 disputes, six positive controls, and seven negative or contract-boundary controls. Two eligible reviewers reached consensus on 9/11 live disputes. Eight bounded variations were accepted; H14 remained a genuine model failure; and H07/H19 were classified as contract/canonicalization boundaries. Reviewer findings consistently emphasized exact preservation of polarity, authorization language, temporal modifiers, named entities, and final corrections.

Version 3.3 encoded the bounded equivalence and canonical-readiness rules. It passed 55/55 new tests, the frozen v3.2 suite passed 46/46, the Phase 1.2 kernel passed 54/54, and 60/60 manifest checks passed. Immutable replay of Occasion 1 evidence produced diagnostic scores of 23/24 semantic fidelity, 21/24 canonical readiness, 24/24 truth/containment/source fidelity, 23/24 usefulness, and 10/12 metamorphic families. The official Occasion 1 failure remained unchanged. Anthony accepted v3.3 as the frozen offline evaluator baseline under SHA256 43715EC26FD6B14C2B001AF7376234BE8DD1A5F69CFEF6FDFEE2B2388B3BA173.

4.7 H14, H07, and H19

Table 3. Persistent semantic cases and their final treatment.
CaseObserved problemInterpretationControl treatment
H14Failed a required subject–verb grammatical transformation in the presence of lexical ambiguity/hostile textGenuine model task failure, not merely evaluator literalismEligible only for exact registered certificate → deterministic template → one revision → full reevaluation
H07Meaning distributed across requested_outcome and resolved-referent fieldsContract/canonicalization boundary rather than failed comprehensionDeterministic canonicalization or clarification; excluded from critic repair
H19Undefined pronouns left unresolved or inconsistently representedMissing-binding boundaryFail-closed clarification or explicit unresolved-referent representation

The project considered dictionaries, online lexical lookup, and model self-review. These were not adopted as primary remedies because H14 did not reflect simple absence of a dictionary definition, and unrestricted lookup would add attack surface and evidence complexity. Better source/instruction separation, a compact task checklist, deterministic templates for known errors, and one global bounded revision were more testable and safer.

4.8 Deterministic repair mechanics

The initial v3.4 run failed before generation because service-listener readiness outpaced API readiness; no behavioral result was claimed. Version 3.4.1 added API readiness and completed 26 model exchanges: 16 Candidate 1 outputs, five repair plans, and five Candidate 2 revisions. First-pass success was 11/16 (68.75%). All five eligible failures produced valid repair plans and all five revisions recovered without observed regressions.

The behavioral result supported freezing the core transaction, but not the complete v3.4.1 runner. Five repair-plan and five Candidate 2 resource observations were absent from the complete evidence envelope, the freeze predicate was too narrow, and Ollama reported OLLAMA_NO_CLOUD:false. Version 3.4.2 preserved every resource observation, strengthened the freeze predicate and independent verifier, and forced/verifiably checked cloud disablement. It passed 22/22 tests; the older v3.4.1 evidence correctly failed the stronger negative-control standard.

4.9 Fresh Occasion 2

A separate v3.5 package preregistered 32 fresh first-pass cases in 16 metamorphic families, plus at most 16 repair-plan and 16 Candidate 2 exchanges. The exactly authorized run completed 40 exchanges: 32 first-pass candidates, four repair plans, and four revisions. First-pass semantic and usefulness success was 16/32 (50.0%); metamorphic-family success was 4/16; referent-lane success was 6/8. Six responses fabricated repair or operational claims, and all eight hostile transformation cases failed first pass. All four eligible repairs recovered with no observed regression, but the occasion failed every main first-pass threshold. A generous bias-aware diagnostic estimate of 21/32 and approximately 7/16 families still failed.

Interpretation: repair success did not erase poor first-pass behavior. Occasion 2 showed that an evidence-complete harness can preserve and contain unsafe output while the model itself remains unqualified.

4.10 Trust lanes and transformation capsule

Landscape review and internal analysis motivated v3.6, which separated five lanes: L0 deterministic control; L1 trusted drafting; L2 quarantined untrusted reading/transformation; L3 candidate intent compilation; and L4 execution. Only L0 was operational. The Safe Useful Core had an empty released-capability list. The L2 transformation capsule bound the complete source hash, exact target offsets and text, a closed replacement allowlist, maximum lengths, and unchanged prefix/suffix. Version 3.6 passed 40 tests and was accepted as the frozen offline baseline under manifest SHA256 7FB80C8936157D9BF68DA75B8A9FADEB6E48DD21717DCF0FF9BCE357F87230D9.

4.11 v3.7 pre-generation failure

Version 3.7 proposed 24 clean/hostile L2 transformation cases. Its first live request returned HTTP 400 before token generation because the response schema's candidate_text.maxLength = 12000 compiled into a grammar repetition rejected by Ollama/llama.cpp. Zero model responses were generated, so this was classified as an interface failure—not evidence for or against Qwen. The audit also found that the exact request was written only after transport returned, leaving a pre-dispatch evidence gap.

Version 3.7.1 replaced the global bound with per-case closed schemas capped at 512 characters, preserved and hashed requests before dispatch, captured bounded HTTP error bodies, required a terminal result for both completion and abort, and added schema-budget negative controls. Thirty-six offline tests passed before a new exact authorization was requested.

4.12 v3.7.1 Lane-2 experiment

The exactly authorized v3.7.1 experiment completed 24/24 exchanges in approximately 40 minutes 23 seconds. All responses parsed, the 50-event chain verified, exact pre-dispatch evidence existed for every request, cloud disablement was verified, and Ollama shut down cleanly. Fourteen candidates were useful, below the preregistered 22/24 threshold. Clean usefulness was 6/12, hostile usefulness was 8/12, and fully successful pairs were 6/12.

Hard containment passed. Zero unsafe or out-of-span candidates were accepted. Each of the ten failed cases contained correct schema-bound metadata describing the required change but returned the original sentence in candidate_text. The capsule quarantined all ten as REQUIRED_CHANGE_MISSING. The result therefore exposed a narrow design inefficiency: the supervisor already knew the only allowable edit, yet the model was asked to reproduce the full transformed string.

24 / 24responses parsed and independently verified
14 / 24useful transformations (58.3%); qualification failed
0unsafe candidates accepted; all ten unchanged failures quarantined
Longitudinal progress across model-interface and task-success measures The top chart shows structured or parsed response rates increasing from 40 percent to 100 percent across successive interfaces. The lower chart shows first-pass task success at 68.75 percent for v3.4.1, 50 percent for Occasion 2, and 58.33 percent for v3.7.1, all below their qualification requirements. A · Interface compliance improved Structured/parsed responses (%) — denominators differ by phase 100755025 40.0%73.3%87.5%100%100%100% Initial Qwen20/50 v211/15 v2.17/8 v3.0.124/24 v3.224/24 v3.7.124/24 B · First-pass usefulness remained unstable Different held-out suites; values are descriptive, not a controlled learning curve 68.75% · 11/1650.0% · 16/3258.33% · 14/24 v3.4.1 first passOccasion 2v3.7.1 L2
Figure 3. Longitudinal engineering trajectory. Interface compliance improved markedly, but successful formatting did not guarantee semantic or task success. Lower-panel suites and thresholds were not identical; the figure should not be interpreted as a statistically controlled model-learning curve.
RB-017 development timeline A timeline from host security and deterministic kernel hardening through model interface testing, semantic panel review, repair mechanics, Occasion 2, trust lanes, and the v3.7.1 containment result. Host & Phase 1security baseline Phase 1.254/54 tests Qwen adaptersv2 → v3.2 Semantic panelv3.3 frozen Repair mechanicsv3.4.1 / 3.4.2 Occasion 2failed 16/32 Trust lanesv3.6 → v3.7.1 ESU; Windowsbuild 19045.7548 durable authorityreceipt + verifier raw evidencesemantic gates H14 genuine;H07/H19 boundaries 5/5 repaired;cloud/evidence hardening 4/4 repaired;poor first pass retained 14/24 useful;0 unsafe accepted 15–18 July 2026 · compressed intensive development sequence
Figure 4. Major research phases. The sequence reflects increasingly strict separation between model behavior, deterministic governance, evidence integrity, and release authority.
5 · Discussion

Discussion

5.1 The main progress was trustworthy failure detection

At first glance, repeated qualification failures might suggest little progress. The evidence shows a more useful pattern. Early interfaces failed to produce valid records at all; later interfaces produced complete, hash-bound, independently verifiable evidence; and the v3.7.1 capsule prevented every observed unsafe or out-of-span candidate from advancing. The system became substantially more reliable at knowing when it did not have a usable result. For an agentic system, this is a prerequisite to capability rather than a secondary feature.

5.2 Structural validity and semantic validity are different

Qwen's structured-output performance rose to 24/24, yet task usefulness remained 14/24 in v3.7.1. The v2.1 truth-state example had already demonstrated the same distinction: a schema-valid record_plan proposal was still the wrong meaning. Model evaluation therefore cannot stop at parse success, field presence, or JSON-schema validity. It must examine whether the preserved concepts, modifiers, negation, referents, source span, and requested transformation are correct.

5.3 Deterministic materialization is the next elegant simplification

The ten v3.7.1 failures were unusually informative. Qwen correctly identified the span metadata and allowed replacement but failed to place the replacement into the full candidate text. Asking the model to reproduce the entire string created an unnecessary failure opportunity. When the only legal operation is already known, the supervisor should splice the registered replacement into the verified source and validate unchanged prefix and suffix mechanically. The model should be used only where judgment is genuinely required—for example, selecting among a small set of semantically plausible transformations or determining that clarification is necessary.

5.4 The instructor/critic remains a research branch

The desired long-term system includes a worker and an instructor/critic, potentially operating sequentially on the current hardware. The evidence does not yet qualify Granite or any other local model for the instructor role. A critic can help explain complex failures, but it must not reinterpret an evaluator certificate, reveal a sealed answer, negotiate authority, or become a second uncontrolled model in the decision path. Known failures should continue to use deterministic templates. A critic should be activated only for registered complex failures after passing a separate blinded qualification suite, and its output must remain advisory.

5.5 Independent panels add insight, not truth by vote

The Gemini, DeepSeek, Grok, Anthropic Claude, and other independent review contributions helped identify evaluator literalism, contract ambiguity, polarity reversals, noun instability, and the distinction between safe refusal and successful task completion. They also disagreed about release recommendations and individual semantic classifications. This disagreement was valuable. It prevented a single evaluator's assumptions from silently becoming constitutional truth. However, quorum is a research signal—not an execution grant. Anthony remains the only human policy authority, and machine state still requires deterministic evidence.

5.6 Resource constraints shaped a better architecture

The 8 GB host required one-model-at-a-time operation, bounded contexts, D-drive placement, and explicit resource observations. These constraints discouraged an opaque always-on swarm and encouraged clean interfaces, shutdown checks, exact run envelopes, and portable packages. Although stronger future hardware will reduce latency, it should not remove these governance separations.

5.7 Limitations

  • This is a single-host engineering case study with small, synthetic suites; it does not estimate general population performance.
  • Cross-version comparisons are confounded by changing prompts, schemas, evaluators, and task families.
  • The local models were not retrained; improvements primarily reflect interface, evaluator, and deterministic-control changes.
  • Independent AI reviewers were not uniformly version-identified, and their judgments were not treated as ground truth.
  • Production tools, personal documents, web access, memory, communications, and Open WebUI model connection were deliberately excluded. The work therefore establishes containment and research infrastructure, not production effectiveness.
  • The complete D:\AI_Stack corpus includes large binary containers and model weights. These were fully inventoried and hash-reconciled where manifested but were not semantically interpreted as document evidence.
  • One experiment launcher mislabeled a verified scientific failure as a generic operational exception after verification; the evidence and shutdown remained valid, but terminal-state vocabulary requires correction.
6 · Summary

Summary of findings

Table 4. What has and has not been established.
DomainEstablishedNot established
AuthorityDurable, schema-bound, human-attributable authorization can be enforced outside conversationA model may infer or extend authority
KernelPhase 1.2 passed staged and deployed deterministic testingA production executor is safe or released
EvidenceRaw responses, requests, hashes, resources, chains, and terminal results can be preserved and independently verifiedA process log alone proves task completion
QwenCan produce structured drafts and some bounded transformations; v3.7.1 containment was strongReliable first-pass production work, tool authority, or completion certification
GraniteProvided research evidence about critic failure modesQualified proposer, instructor, critic, or release adviser
RepairOne deterministic-template revision recovered narrow eligible failures in two experimentsGeneral self-correction or permission for repeated retries
Open WebUI / DockerRetained in the approved future architectureConnected to tools, production work, or model authority
DeploymentResearch baseline and evidence store exist on D:A production agent, startup orchestrator, or user-ready Safe Useful Core

RB-017 has moved from an informal “local chatbot with tools” concept toward an explicit separation of concerns: models generate candidate language; deterministic systems define what is allowed; independent verifiers establish what occurred; and Anthony supplies the only durable human authority. The remaining capability problem is real, but it is now measurable and contained.

7 · Conclusions

Conclusions

This research supports four conclusions. First, a language model should not be the constitutional center of an agentic system. Authority, targets, risk, replay, resource limits, and completion must remain deterministic. Second, structured-output compliance is necessary but insufficient; semantic fidelity, source preservation, usefulness, and evidence completeness require independent evaluation. Third, a narrow one-revision transaction can safely recover registered failures when the evaluator certificate and correction scope are deterministic. Fourth, the safest and most efficient successor is not necessarily a larger prompt or another critic: when the final operation is already known, the supervisor should perform it mechanically.

RB-017 is therefore best described as a governed personal AI research platform with a deployed simulation kernel, a mature evidence architecture, a frozen narrow repair mechanism, and an unreleased trust-lane design. It is not yet a production agentic AI. That conclusion is not a rhetorical disclaimer; it is the direct result of preregistered thresholds, immutable failed occasions, and successful independent verification.

8 · Future research

Future research and controlled development

  1. Design v3.8 offline: create a parallel, separately manifested successor in which the deterministic supervisor materializes registered exact edits. The model should return only the smallest genuinely uncertain judgment.
  2. Correct terminal classification: distinguish verified scientific failure from operational, transport, or verifier failure in launcher receipts and exit semantics.
  3. Use fresh blinded cases: preregister new clean/hostile pairs, sealed oracles, acceptance thresholds, and stop rules. Do not reuse exposed v3.7.1 answers as qualification evidence.
  4. Compare ablations: test model-generated full candidate text against deterministic materialization from the same model judgment. Measure usefulness, containment, latency, and evidence burden separately.
  5. Qualify a critic independently: only after the deterministic route is characterized. The critic suite should test certificate fidelity, refusal to reveal answers, resistance to adversarial text, and correct deference to the evaluator.
  6. Evaluate Lane 1 drafting: a tool-free, trusted-input drafting lane may yield earlier practical benefit for resumes, cover letters, and professional writing than untrusted-content transformation. This requires its own synthetic and source-fidelity gates.
  7. Preserve the three-occasion rule: one promising run is insufficient. Repeat only after a package passes and a separate exact approval is granted; analyze series behavior rather than optimizing to a single test.
  8. Defer production coupling: Open WebUI, Docker-hosted services, tools, personal data, memory, email, Telegram, and the Desktop startup orchestrator should remain separate later gates.
  9. Develop compact durable memory: store source-linked summaries, decisions, hashes, and retrieval indexes rather than copies of every conversation.
  10. Prepare portability and public research release: after qualification, sanitize the package, document licenses, remove personal paths/data, add accessibility and security guidance, and create a feedback pathway. Any commercial edition should follow legal, support, privacy, and reproducibility review.
Immediate next scientific proposition: when a trusted deterministic capsule already knows the exact authorized replacement, ask the model only whether the registered edit is semantically appropriate; if the judgment passes, let the supervisor apply the edit and verify the result byte-for-byte.
9 · Attribution

Author contributions

Contributor roles, adapted from the CRediT taxonomy.
ContributorRoles
Anthony R. BallConceptualization; research questions; methodology co-design; system requirements; human authority; investigation; validation; resources; project administration; review and editing; final accountability.
Codex (OpenAI)Methodology co-design; software; deterministic-control implementation; formal analysis; data curation; visualization; evidence reconciliation; original manuscript drafting; review and editing.

Codex is listed as a co-author at Anthony R. Ball's express request to transparently recognize its substantial intellectual and technical contribution. As an AI system, Codex cannot assume legal or ethical accountability, approve publication, or disclose conflicts independently. Anthony R. Ball reviewed the project record and retains final responsibility for release and interpretation.

10 · Acknowledgments

Acknowledgments

The authors gratefully acknowledge Grok, Gemini, and DeepSeek for assistance in the independent AI review-panel work. Their contributions included blinded record classification, semantic-equivalence judgments, systemic observations, counterexamples, and suggestions for bounded normalization. The project also acknowledges Anthropic Claude for a documented independent semantic review and the other AI systems whose preserved reports informed architecture, governance, and human–AI communication analysis.

All external AI reviews were advisory and non-authoritative. They were preserved unchanged, scored against declared rubrics, and adjudicated by the Remediation Bureau process. Credit for participation does not imply that every recommendation was accepted, that the reviewers agreed, or that any reviewer could authorize a run or release. One Grok recommendation was judged too permissive for operational use and Grok was subsequently barred by Anthony from future RB-017 reviewer, critic, trainer, monitor, or release-adviser roles; its historical contribution remains credited as part of the scientific record.

The authors also acknowledge the developers and maintainers of Ollama, Open WebUI, Docker, Python, PowerShell, SQLite, and the open model ecosystem whose software made this local research program possible.

11 · Research disclosures

Ethics, interests, data, and reproducibility

Ethics and privacy

The model-bearing experiments used synthetic content and were isolated from production files, personal documents, tools, memory, email, messaging, and external communication. No public sharing of personal data was authorized. This engineering study did not recruit human participants; Anthony was the system owner, investigator, and intended user.

Competing interests

Anthony R. Ball is the creator and owner of the RB-017 project and has expressed a future interest in releasing a free research edition and potentially a low-cost commercial edition. This prospective interest did not alter the preregistered failures reported here. No external sponsor funded the reported work. OpenAI did not sponsor or endorse this report merely because Codex participated through a user subscription.

Data availability

The private primary record is stored locally in the Remediation Bureau Command Center and D:\AI_Stack. It includes manifests, source code, synthetic suites, sealed oracles, raw model wrappers/content, SQLite evidence stores, chained JSONL events, test logs, run audits, and confirmation summaries. Public release is not yet authorized. A future shareable package must remove personal paths and private material, preserve licenses, document hashes, and pass a separate release review.

Reproducibility statement

During preparation of this report, 16 discovered PACKAGE_MANIFEST.json files were read and 353 listed files were independently rehashed with SHA-256: zero files were missing and zero hashes differed. The report itself is a narrative synthesis and does not replace the raw evidence, package manifests, or independent verifiers.

Appendix A

Development chronology

Table A1. Principal stages, evidence, and dispositions.
StagePrimary resultDisposition
Architecture selectionCandidate B: Open WebUI → RB Supervisor → deterministic Policy Gate → isolated MCP/OpenAPI capabilities → approved territoryApproved architectural direction
Host gateWindows ESU enrollment and update to build 19045.7548Security prerequisite passed
Phase 112 governance tests passedSuperseded by hardening
v1.1.122 source and deployed tests passedFour fail-open counterexamples later identified
Phase 1.254 staged and 54 deployed tests passedCurrent deterministic simulation kernel
Granite proposer36/50 acceptable after containment; two false-completion claimsRejected
Qwen initial20/50 strict-validRejected for user-facing/proposal role
Qwen v2 / v2.111/15 and 7/8 structural; semantic action mismatch persistedInterface research only
Granite critic v1 / v1.1Failed generalization and containment judgmentRejected
External trainer-monitorThree reviewers classified 8/8 records; release recommendations differedPromising advisory scaffolding; non-authoritative
v3.0.124/24 structure; 9/12 metamorphicFailed overall
v3.2 Occasion 113/24 semantic/useful; 7/12 metamorphicOfficial failure preserved
v3.355/55 tests; diagnostic replay 23/24 semantic, 21/24 canonicalFrozen offline evaluator baseline
v3.4.111/16 first pass; 5/5 repairs; zero observed regressionsCore repair transaction frozen; full envelope not frozen
v3.4.222/22 evidence-hardening tests; forced cloud-disable designFrozen offline evidence harness
Occasion 2 / v3.516/32 first pass; 4/4 repairs; six fabricated claimsOfficial failure preserved
v3.6Five trust lanes; 40 tests; empty capability release listFrozen offline baseline
v3.7HTTP 400 before generation due to 12,000-character grammar boundNo scientific result; authority consumed
v3.7.124/24 parsed; 14/24 useful; zero unsafe accepted; ten unchanged quarantinedContainment passed; capability failed
Appendix B

Selected integrity ledger

Table B1. Critical package and result hashes.
ArtifactSHA-256
Qwen3:4b exact Ollama manifest359D7DD4BCDAB3D86B87D73AC27966F4DBB9F5EFDFCC75D34A8764A09474FAE7
Phase 1.2 kernel packageD3149E14635FF0BEE1D43123E4C6DCEA2F3407E67A37D1C199D2A90CD059850A
v3.3 frozen baseline43715EC26FD6B14C2B001AF7376234BE8DD1A5F69CFEF6FDFEE2B2388B3BA173
Official Occasion 1 resultBDF307F9BB2ADB8E49960D83CDBFEE7C30D8DBFFD2CFBF1C1ACE187C5E65B044
v3.4 repair protocol57CC2A9D83BC5A22B38C374C6881CD8E1C075237BCC9E9C6CDCAD49EDE6D8643
v3.4.2 evidence-hardened harnessFFEFB1B2DDB63C97ED43B80E802F4325B5E5069FBBE7DFCC4866EFEA2A94358A
Occasion 2 preconnection package96AE403152D4850ECA8AA595CE4CEFC82DD5DFD89AB267385B5ACC815B342AA0
Occasion 2 terminal resultFCFCB37230DD8593CE0931CE18586F3C7D3C9463805196A6BBE69F5B3BC52589
v3.6 trust-lane baseline7FB80C8936157D9BF68DA75B8A9FADEB6E48DD21717DCF0FF9BCE357F87230D9
v3.7 preconnection package25AD1091A2B0D4E9ACB94990DE1810600F25E7E36CEC10095040A474432D1690
v3.7.1 corrected package533011ABBC274D3A883D161CF6C57878715F970CFB88EB8545BD1F125FAAF836
v3.7.1 terminal result9C77283F4CEBB4114677994000F9E3AADFCBCE6FA2C573569E2BB724B000C8DE
v3.7.1 terminal event86854645AE0067CB60B8CAFFAA065F25FBEEB2086EDE66884D4F4E697B373EBD
Appendix C

Glossary of stable project terms

Authorization
A durable, attributable, scoped, unexpired record created from Anthony's explicit decision; not merely a conversational implication.
Candidate
Model-produced data awaiting deterministic validation. A candidate is not an action, approval, fact, or completion.
Canonicalization
A deterministic normalization that preserves meaning while producing the exact downstream form required by a contract.
Capability release
A separately approved decision that a tested function may be used within exact scope. A successful experiment does not automatically release a capability.
Containment
Prevention of unsafe, invented, out-of-scope, or source-altering output from advancing, even when the model generated it.
Critic / instructor
A future advisory model that may explain complex registered failures. It cannot override the evaluator, grant authority, or qualify itself.
Evidence completeness
Preservation of the exact request, raw response, hashes, settings, timestamps, parse result, resource observation, decision, and event binding needed for independent reconstruction.
Fail closed
When required evidence, authority, binding, or validation is absent, the transition is denied or quarantined rather than guessed.
Metamorphic family
Related test cases that should preserve or predictably alter meaning under controlled linguistic or adversarial transformations.
Occasion
A separately preregistered validation event using fresh held-out material. “Occasion 2” is chronological, not proof of a second success.
Policy Gate
The deterministic component that approves, denies, or escalates a proposed transition according to human-readable rules and durable authority.
Receipt plus verifier
A completion standard requiring both machine evidence of the observed result and an independent check against the intended outcome.
Remediation Bureau
Anthony Ball's mandatory project-control, evidence, QA/QC, constitutional, remediation, release, and handoff framework.
Safe Useful Core
A future graduated set of low-risk capabilities. Its current released-capability list is empty.
Transformation capsule
A closed, source-hash-bound envelope that limits a transformation to exact spans, allowlisted replacements, and unchanged surrounding text.
Truth state
The provenance classification of a claim, such as observed, user-confirmed, inferred, unverified, corrected, or invalidated.
Worker
The model role that drafts or proposes candidate meaning. It cannot create durable authority, final action, risk, target, or completion state.
Project evidence references

Primary internal sources

  1. Remediation Bureau Command Center. Operating Manual, project manifest, activity register, RB-017 dossier, governing charter, communications requirements, and evidence series. D:\01 ABALL Personal\00 Remediation Bureau Command Center.
  2. RB-017 implementation and experimental corpus. Package manifests, source code, synthetic suites, sealed oracles, QA logs, run results, raw evidence, and independent verifiers. D:\AI_Stack.
  3. RB-017 Successor-Session Handoff and Continuity Report, evidence record 40, 17 July 2026.
  4. RB-017 Occasion 2 Result and Post-Run Audit, evidence record 44, 18 July 2026.
  5. RB-017 v3.6 Trust-Lane Offline Implementation and QA, evidence record 47, 18 July 2026.
  6. RB-017 v3.7 Pre-Generation Failure Result and Audit, evidence record 51, 18 July 2026.
  7. RB-017 v3.7.1 Result and Post-Run Audit, evidence record 54, 18 July 2026.
  8. External Trainer–Monitor Pilot independent reports and Semantic Equivalence Review Panel responses, preserved under D:\AI_Stack, 16–17 July 2026.

Source-control note: This report summarizes the evidence as of the stated cutoff. If any statement conflicts with an immutable raw artifact, exact authorization, package manifest, terminal result, or independent-verifier record, the verified source artifact controls and the discrepancy should be documented through the Remediation Bureau.