OH

Provider-agnostic AI Gateway

Console for AI administrators and security: provider profiles, routing policies by capability / data class / region / cost / latency / health, fallback order, quotas and data-boundary rules. Modules only call internal capability contracts — never vendor-specific APIs.

AI-01AI-08
Provider health Model registry
Requests today
12,483
▲ 6.2% vs 7-day avg
Fallback activations (24h)
34
31 provider swap · 3 deterministic path
Circuit breakers
1 half-open
PRV-VTX-03 · probing every 60s
p95 latency (generation)
1.9 s
SLO ≤ 3.0 s
Spend MTD
AED 18,540
of AED 25,000 budget · 74%
All capabilities Generation Extraction Embeddings Translation Tools
Provider profiles Adapter configuration
ProfileCapabilitiesRegion / residencyMax data classp95 latencyError rate 24hCircuitHealthStatus
PRV-AZO-01 · Azure OpenAI
UAE North · pinned snapshots only
Generation, embeddingsUAE (in-country)Confidential 780 ms0.4% ClosedHealthyActive
PRV-BED-02 · AWS Bedrock (Claude)
me-central-1 · zero-retention agreement
Generation, tool useUAE (me-central-1)Confidential 1,120 ms0.7% ClosedHealthyActive
PRV-VTX-03 · Google Vertex AI
europe-west4 · translation models
Translation, generationEU (cross-border)Internal 2,940 ms3.8% Half-openDegradedActive
PRV-OCR-04 · Self-hosted OCR/IDP
On-prem · Dubai HQ datacenter
Extraction, classificationOn-prem (no egress)Restricted-PII 3,410 ms1.1% ClosedHealthyActive
PRV-EMB-05 · In-cluster embeddings
bge-m3 · on-prem GPU pool
EmbeddingsOn-prem (no egress)Restricted-PII 95 ms0.1% ClosedHealthyActive
PRV-SBX-06 · Sandbox provider
Synthetic data only · test env binding
GenerationUAESynthetic only 640 ms0.2% ClosedHealthyTest only
PRV-DET-00 · Deterministic engine
Non-AI fallback: rules, templates, manual queues
Fallback for all routesOn-prem (no egress)Restricted-PII 12 ms0.0% n/aAlways availableActive
7 provider profiles · production scope
Routing policies & fallback order Routed by capability · data class · region · cost · latency · health
RouteCapability · use caseData classPrimaryFallback 1Fallback 2Non-AI fallback (mandatory)Timeout / retry
RT-GEN-LSTGeneration · listing copy EN/ARInternal PRV-AZO-01PRV-BED-02Approved template library8 s · 2× backoff
RT-EXT-INVExtraction · invoices & vouchersRestricted-PII PRV-OCR-04None — data boundaryManual keying queue (Finance)30 s · 1×
RT-EXT-KYCExtraction · KYC documentsRestricted-PII PRV-OCR-04None — data boundaryMaker-checker manual entry30 s · 1×
RT-EMB-KBEmbeddings · knowledge baseConfidential PRV-EMB-05PRV-AZO-01Defer & queue re-index5 s · 3×
RT-TRN-LSTTranslation · listing AR variantsPublic PRV-VTX-03PRV-AZO-01Human translation queue10 s · 2×
RT-TOOL-CPTool use · staff copilotInternal PRV-BED-02PRV-AZO-01Decline with explanation15 s · 1×
RT-GEN-SUMGeneration · lead & call summariesConfidential PRV-AZO-01PRV-BED-02PRV-DET-00Show raw activity timeline8 s · 2×
Data-boundary rulesPrivacy & classification
Data classAllowed providersRetention eligibilityRedaction before send
PublicAny active profileProvider defaultNone
InternalUAE + approved EU routesZero-retention preferredParty contact details masked
ConfidentialUAE-resident profiles onlyZero-retention requiredIBAN, TRN, salary masked
Restricted-PIIOn-prem only (PRV-OCR-04, PRV-EMB-05)No provider retentionEmirates ID 784-19●●-●●●●●●●-●, passport masked in logs
Client money / trustNot routable — deterministic onlyn/an/a — see client money
AML case materialNot routable — excluded at indexn/an/a — see exclusion list
Quotas & budgets (per environment · tenant · use case)Cost observability
ScopeMonthly budgetUsed MTDUtilizationRate limitState
prod · Al Manara · document extractionAED 9,000.00AED 6,120.40
120 rpmOK · 68%
prod · Al Manara · listing copy & translationAED 4,500.00AED 3,890.15
60 rpmWarning · 86%
prod · Al Manara · campaign draftingAED 2,000.00AED 2,000.00
30 rpmCapped — fallback path
prod · Al Manara · lead & call summariesAED 5,500.00AED 3,214.90
90 rpmOK · 58%
prod · Al Manara · staff copilot toolsAED 3,000.00AED 2,145.65
40 rpmOK · 72%
staging · all use casesAED 1,000.00AED 168.20
20 rpmOK · 17%
Total (production)AED 24,000.00AED 17,371.10AI-08: at cap, noncritical requests use the lower-cost/fallback path or are deferred with an explanation
Spend by provider — July MTD
ProviderSpend MTD (AED)RequestsAvg cost / request
PRV-AZO-01 Azure OpenAI8,420.00148,2100.057
PRV-BED-02 AWS Bedrock5,315.0061,8820.086
PRV-OCR-04 Self-hosted OCR3,180.009,4120.338
PRV-VTX-03 Google Vertex1,140.0012,0670.094
PRV-EMB-05 In-cluster embeddings485.00402,1160.001
Total18,540.00633,687
Fallback & circuit events (last 24h)Audit explorer
  • 17 Jul 2026 · 10:41 · RUN-88412 · corr. c9f2-4a
    PRV-VTX-03 timeout ×3 → circuit opened, now half-open
    Advisory translation request (RT-TRN-LST, Public) permitted fallback → rerouted to PRV-AZO-01. Approved alternative used and recorded. Recovered
  • 17 Jul 2026 · 09:12 · RUN-88231 · corr. b7e1-9d
    Campaign drafting quota capped (100%)
    Noncritical request deferred with explanation shown to Layla Hassan; queued for 01 Aug window. Deferred
  • 16 Jul 2026 · 22:03 · RUN-87914 · corr. a1c8-2f
    PRV-OCR-04 nightly maintenance window
    RT-EXT-INV has no external fallback (data boundary) → 42 documents routed to manual keying queue. Deterministic path
  • 16 Jul 2026 · 15:47 · RUN-87655 · corr. e4d0-7b
    PRV-AZO-01 HTTP 429 burst
    Retry with backoff succeeded on attempt 2; no fallback needed. Recovered
  • 16 Jul 2026 · 11:20 · corr. f2a9-1c
    Kill switch drill — staging
    Vikram Nair executed quarterly kill-switch test on staging copilot; all routes declined with explanation in 1.2 s. Drill
Risky action — disable provider profile

Approval route: AI administrator (maker) → Security officer (checker). Segregation of duties enforced — Vikram Nair cannot approve his own change. Recovery: re-enable is a new approved activation, see version lifecycle.

Static render mockup — no live data. Source: ERP Modern Development Specification v2.0 · Covers: AI-01 (provider-agnostic gateway, routing, fallback, data boundaries), AI-08 (budgets, rate limits) · §12.3 provider abstraction and controls.