Self-hosted models · Agent harness · You own the stack

Own your AI.
I design the stack, you keep it.

Open-weight models on hardware you own, an agent harness, retrieval over your own data, and guardrails that hold. Orchest AI is an architecture practice, not a vendor: I design it, prove it on your box, hand it over, and do not become a dependency.

Request an Architecture Review → See what you own
Regulated firmsHealthcare and financeProfessional servicesData that cannot leave the building
$ ollama ps
model › qwen3.6:27b · 64K ctx · local GPU · 0 external calls
harness › → loop "weekly-close" armed · schedule Mon 06:00 · memory: 14 runs
harness › → retrieval: 3 passages from your policy docs, cited by line
harness › → guardrail: draft over approval threshold · paused for a human
audit › ✓ every step logged on your box · nothing left the building (illustrative session)

The stack you end up owning · all open, all replaceable

OOllamaVvLLMCOpenClawQQwenGGLMCClaudeCChromaWOpen WebUIDDockerSSlackTTeamsAAzureOOllamaVvLLMCOpenClawQQwenGGLMCClaudeCChromaWOpen WebUIDDockerSSlackTTeamsAAzure
The agentic framework

How the workspace gets wired up.

A supervisor plans, sub-agents specialize, agentic RAG gives them memory. Every node is observable, every edge is governed. This is the blueprint I design for your business, on models you host, tuned to your data and your policies. The diagram is the proof: it shows where data can and cannot go.

Orchestration

A supervisor breaks work into steps, routes to specialists, and holds the plan until the goal is met.

Agentic RAG

Retrieval that reasons, agents decide what to fetch, re-query on gaps, and ground every answer in your data.

Memory

Short-term working memory per task and long-term memory per account, so context compounds instead of resetting.

Governance

Approval gates, spend caps, tool allow-lists, and a full audit trail across every sub-agent action.

Cost & token efficiency

Intelligence per dollar, on hardware you own.

Most AI systems burn money by feeding the model everything, every turn, through a metered API. The framework is engineered so the model only sees what it needs, and when it runs on your own hardware the bill stops scaling with usage. The honest numbers: a self-hosted model on an entry server pays for itself in months at moderate volume; below that, an API is cheaper and I will say so.

Less

Context per call, by design

Context engineering, sub-agent delegation, and disciplined session architecture cut the bulk of tokens most systems waste on re-reading history they don't need.

Chat history reread per turn −88%
Sub-agents and targeted summaries replace re-feeding the whole transcript on every call.
Document context sent to the model −72%
Agentic RAG retrieves only the passages the agent actually reasons over.
Repeated tool-output bloat −63%
Raw tool results get summarized and cached before they hit the model's working memory.
Retrieval quality drop from long sessions −45%
Session chaining and checkpointed handoffs keep agents sharp instead of drifting.

Sub-agent delegation

Heavy research runs in a specialist's own context window and only the distilled answer comes back, so the main session never bloats.

Context discipline

Skills, prompts, and reference data are loaded on demand, not stuffed into every call. Fewer tokens in, more attention on the task.

Markdown-first pipelines

Inputs are normalized before the model sees them, so dense source material arrives in a fraction of the original token weight.

Right model, right step

Smaller models handle triage and summarization. Frontier models run only where reasoning depth actually moves the outcome.

Manual compaction & handoffs

Long-running work is chained across focused sessions with structured handoffs, never one runaway chat that spirals out of control.

Observability built-in

Every run is logged with tokens, latency, and cost per agent, so you can see exactly where spend goes and where to tune.

Built for any scale

Sovereignty is a spectrum. You choose the starting point.

You do not have to leave your API vendor on day one. Ownership of the stack has four parts: models, compute, harness, data. Every engagement moves one or more of them onto your side of the line, without a rebuild later.

Hybrid · Keep the API, own the harness

Own the harness, the memory and the data first.

The model can stay on a frontier API for now. The harness, the retrieval index, the audit log and the runbooks are yours from the first week, so switching the model later is a config change, not a migration.

  • One workflow live first, as a pipeline or a loop, not an agent by default
  • Retrieval over your documents with citations to the source line
  • Approval gates, spend caps and an audit log from day one
  • Fixed scope, written down, so you know the cost before you start
Fits firms under 50 people with a workflow that repeats and data they would rather not paste into a public chatbot.
Sovereign · Models on your hardware

Open-weight models, your GPUs, your building.

For teams whose data cannot leave: healthcare, finance, legal, anyone under HIPAA, GLBA or a client confidentiality duty. Local serving, a governed agent harness, and evidence a second-line reviewer can read.

  • Sizing and hardware spec you can hand to procurement
  • Ollama or vLLM serving, a 27B to 32B model with 64K context as the floor
  • SSO, role-based access, spend caps and a tamper-evident audit log
  • A limits page: the jobs where a frontier API is still the right call
Fits operations, compliance, clinical and finance teams in regulated or data-sensitive environments.
The ownership manifest

What you own when we are done.

A vendor lists features. An architect lists what you keep. This is the list, and it goes into the scope document before any build starts.

01

The repos

Every line of code, in your GitHub or GitLab, under a licence that lets you keep running it after I am gone.

02

The model weights

Open-weight models pulled to your hardware. No key of mine in the path. Swap the model with a config change.

03

The hardware

A sizing spec you own outright: what to buy, what it costs, what it can and cannot run. Bought in your name.

04

The harness

The agent runtime, the loop definitions, the skills, the memory store. Plain files you can grep, back up and delete.

05

The retrieval index

Your documents, embedded on your box, cited by source line in every answer. Rebuildable from your files alone.

06

The audit log and guardrails

Approval gates, spend caps and a tamper-evident log of every action. The evidence a reviewer asks for.

07

The runbooks and the trained team

How to operate it, upgrade it, and roll it back. Your people run it without hiring an AI person.

08

The exit

What you keep if you end the engagement next month: everything above. Written into the scope before we start.

The reference stack

Published, because the stack is the credential.

Opinionated defaults, all open, all replaceable. The limits are published with them: models under 14B do not hold an agent loop; 30B and above with 64K context is the real floor; below moderate volume an API is cheaper and I will say so.

Harness

OpenClaw-style local agent runtime, skills and memory as Markdown and YAML on disk

Serving

Ollama for a single box, vLLM when throughput matters

Models

Qwen3.6 27B or GLM-4.7 class open weights, 64K context; a frontier API where reasoning depth moves the outcome

Retrieval

Chroma or Weaviate with nomic-embed, citations to the source line

Interface

Open WebUI, Slack or Teams, or your own UI

Controls

Approval gates, spend caps, role-based access, hash-chained audit log

Why this practice exists

The models arrived. The adoption went the other way.

19% → 11%
Enterprise open-source share
fell in a year, in the same year open-weight models reached parity on code. Not a capability gap: an architecture and operations gap.
44%
cite privacy and security
as the top barrier to LLM adoption (Kong, Enterprise AI report). For regulated teams the cloud option was never really on the table.
Months
to break even
for a self-hosted model on an entry server at moderate volume. Published as a range with the assumptions, never as a promise.
How it works

Pipelines, loops, agents. In that order.

The question operators ask now is not whether to use agents. It is what agentic adoption actually yields, and what to do when an agent is the wrong tool. Three shapes cover most real work. A pipeline: deterministic steps with a model inside one or two of them, easiest to audit. A loop: a recurring goal with memory that runs on a schedule and pauses at a guardrail. An agent: open-ended planning over tools, reserved for problems where the path genuinely cannot be written down. Start with the pipeline. Promote to a loop when the job recurs. Promote to an agent only with evidence. Harness engineering, the discipline around context, logging, delegation, compaction and gates, is what makes any of the three survive a real workflow.

01 · Co-Pilot

Text-to-resolution, in your workflow.

Talk to your agents in plain English, inside Slack, Teams, or your own UI. They pull context, take action, and close the loop.

  • Natural language commands across connected tools
  • Context from your docs, CRM, and inbox in one place
  • Full audit trail of every action taken
Draft a follow-up for the 8 leads that ghosted this week.
Pulled 8 contacts from HubSpot. Drafted personalized follow-ups referencing each last-touch. Ready for your review →
Send them.
Sent. I'll watch for replies and book any calls directly.
02 · Learning

Every process becomes a reusable skill.

When an agent handles a workflow once, it's codified as a repeatable skill. The library grows with your business, and so does what the team can hand off.

  • Skills shared across your agent roster
  • Versioned, reviewable, and reversible
  • Custom skills authored in days, not quarters
Skill Library · 14 active
lead-qualify-v3 invoice-chase proposal-draft meeting-prep inbox-triage weekly-digest support-tier-1 contract-redline crm-hygiene
+ new skill drafted
onboarding-kickoff, authored from last Tuesday's walkthrough.
03 · Agentic Automation

Runs autonomously. Stops at the guardrails.

Agents execute multi-step work without supervision, but only within the policies you set. Spend limits, approval steps, and sensitive-action gates are built in.

  • Policy-enforced autonomous execution
  • Human-in-the-loop for anything that matters
  • Deterministic tool use with full observability
Enriched 14 new leads09:02
Sent 8 follow-ups09:14
Booked 3 meetings09:31
!Proposal over $25k, awaiting approval10:02
Closed 5 resolved support tickets10:18
04 · Helpdesk

Where your team already works.

No new tool to log into. Your agents live in Slack, Teams, and the inbox, pulling from your knowledge base so every answer is grounded in your docs.

  • Native Slack and Teams integration
  • Retrieval over your own knowledge sources
  • Zero context-switching for the team
#ops-help, Can you pull Q3 revenue by region for the board deck?
Fetched from Snowflake. Q3 total: $4.82M · NA 61% · EU 28% · APAC 11%. Dropped the chart in your deck, slide 6.
@ops, what's our refund policy again?
From Handbook v4.2: 14 days, full refund; 15–30 days, credit only. Linked source →
The AI Worker OS

Harness engineering: the part that is not a trend.

Builds on Claude, on open weights, or on both. The harness decides what each step sees, what gets logged, how work is delegated to sub-agents, how long sessions are compacted and handed off, and where the spend caps and approval gates sit. It is the same discipline whether the model is local or remote.

Multi-agent orchestration

Specialist agents hand work to each other. Long tasks run overnight. Nothing drops between teams.

Prebuilt action agents

The common work, email, CRM, calendar, docs, ticketing, already wired up and battle-tested.

Continuous learning

Every correction teaches the system. Agents get sharper at your business every week they run.

Skill Studio

A custom skill goes from demo to live in days, with the same rigor as your core platform.

Advanced reasoning & agentic RAG

Claude-powered planning across multi-step work, grounded in retrieval that reasons over your data.

Governance & controls

Role-based access, spend caps, approval gates, and full action logs. Auditable from day one.

Loop engineering · 2026

A prompt stops when you stop typing. A loop doesn't.

The shift this year isn't a better prompt, it's a different unit of work. One message gives you one output and waits on you. A loop is a recurring goal with memory: it remembers the context, watches for what changed, and acts on a schedule, all the way to the guardrail where it hands back to a human.

The prompt

One request, one answer

"Make me a packing list for the school trip."
  • Runs once, then forgets
  • You re-check, copy, and paste between apps
  • Stops the moment you walk away
VS
The loop

A recurring job with memory

Remembers the trip, checks the forecast, watches the school schedule, and reconciles the list against what's already at home, every morning.
  • Runs unattended on a schedule
  • Connects your apps so you don't have to
  • Pauses at the guardrail and asks you

Every loop we ship runs on the same lifecycle, PAL, so it stays observable and reversible end to end.

P

Plan

Break the recurring goal into steps the loop can run on its own.

A

Apply

Act against your live tools, email, CRM, calendar, data.

U

Unify

Reconcile results into shared state and memory.

L

Loop

Re-arm on schedule, or stop at the guardrail for a human.

Open the live Agentic OS →

A working, white-label loop console, reskin it, define a loop, watch it persist.

Who you'll work with

Umair Tareen. Architect, and the person who installs it.

12 years in enterprise data, a decade across banks, six years of it at MUFG, then Citi. Before that, onsite implementations of a governance, risk and compliance platform for regulated clients at Nasdaq BWise: install, configure, train, own the outcome. The systems I built lived under audit, which is where the habits come from: append-only logs, evidence that survives review, and a refusal to ship a control that cannot prove it ran. Every engagement is personally led. My own operating stack, agents, loops, handoffs and all, runs the way this page describes.

Builds on Claude and open weights Microsoft Azure AI Certified MSc Artificial Intelligence, in progress Anthropic Claude certification, in progress
12 yrsin enterprise data, a decade across banks
Ledgerproofa self-hosted governed-AI gateway I built and ship: redaction, policy as code, hash-chained audit log
Writtenscope, ownership manifest and exit clause before any build starts
Yoursrepos, weights, hardware, runbooks. I do not become a dependency
Field notes

One email when there is something worth sending.

Notes from running local models and agent loops in real workflows: what held, what broke, what I would not do again, and where the frontier API still wins. No hype, no headline dumps, no schedule.

When there is a note ~5 min read No spam, unsubscribe anytime

Subscribe for free

Join the list and get the next issue in your inbox.

By subscribing you agree to receive the newsletter. We never share your email.

How the engagement works

One paid review, then a retainer. No free calls, no open-ended proposals.

Every engagement starts with a written Architecture Review: $3,500, five business days. Hire me on a retainer within 60 days and the full $3,500 comes off your first month, so the review costs you nothing. If the honest answer is that you should stay on a commercial API, I will say so in writing, refund the $3,500 in full, and you keep the review.

Step one · $3,500 · one week

Architecture Review

Your workflows, data constraints and volume, and the honest answer on local versus API, pipeline versus loop versus agent.

  • Target architecture for models you host, with the ownership manifest
  • Model and hardware selection with the cost math against your API spend
  • Data-boundary and evaluation plan a reviewer can read
  • A 90-day build sequence you can run with or without me
Paid before kickoff by invoice (card or bank transfer). Credited in full to month one of any retainer started within 60 days. Refunded in full if the review says stay on the API.
Then · monthly · 90 days, then rolling

Retainer, three shapes

Scoped on what I own for you, not on days per week. Billed monthly with a 90-day initial commitment, then month to month. You keep every model, prompt, eval and line of infrastructure code on every tier.

  • Advisory, $6,000/mo. I own the architecture: model and version decisions, the eval suite, cost per token tracking, a written monthly architecture note, same-day answers for named people on your side.
  • Embedded, $10,000/mo. Advisory plus hands-on ownership of the model and inference stack, the eval harness, and the migration off the API: pipelines and loops shipped weekly, eval regressions run, inference tuned. At least a day a week in your environment.
  • Operate, $18,000/mo. I run it. Named on-call for the inference and agent tiers, incidents acknowledged within two business hours and a restore target agreed in writing, model and version upgrades owned end to end, capacity and cost managed, a monthly reliability report, quarterly data-boundary review. At least two days a week as the floor, not the product.
  • Not included on any tier: your GPU or cloud spend (your accounts, pay per use), general app development, data labelling.
Terms 90 days initial, billed monthly, then rolling; quarterly billing available at a preferred rate after the first term.
Request an Architecture Review

Six questions. If it is a fit, you get a link to start. If it is not, you get a straight answer.

Not every request is accepted. A review is worth paying for only when a real constraint is forcing the decision and there is a team on your side to hand the stack to. The questions below are how I tell.

Reply within two business days No call before the review Nothing shared, ever

Tell me the constraint

Short answers are fine. The specifics matter more than the length.

1. What is forcing you off hosted APIs: data residency, cost at volume, latency, lock-in, a regulator? Who owns it internally?

2. Monthly inference spend today, and the monthly budget for someone to own the architecture

3. What hardware and models run today, and who operates the stack after handoff?

4. By what date does something need to be in production, and what happens if it slips?

5. Closest stage: nothing built / prototype on an API / self-hosted but unstable / running, needs scale

6. The one workflow you would put on a loop first

You will hear back within two business days with either a link to start the $3,500 review or a straight no and the reason.