EULLM Engine: EU-Hosted Ollama-Compatible Local Inference — AGICY Stack Examination
Engine ready as local OpenAI/Ollama peer; Forge + Hub early — not CapEx peer.
Local GGUF Engine with Ollama + OpenAI APIs and local audit JSONL — Watch until dated eng SOW.
Key Facts
- Tier C Watch — Engine usable today; Forge/Hub early (vendor status).
- Apache 2.0; permissive-base models (Qwen/Mistral); Meta Llama excluded per their policy.
- Drop-in Ollama port 11434 + OpenAI /v1 on the same binary.
- Local audit trail JSONL — diligence input, not legal certification.
- No public Tenstorrent Galaxy COD SOW — do not underwrite tok/s or Z2 pricing against EULLM demos.
What EULLM actually does
EULLM Engine is a Rust binary wrapping llama.cpp: run any GGUF, serve Ollama-compatible routes on :11434 plus OpenAI /v1/chat/completions, optional embedded chat UI on :11435, and a default local JSONL audit trail under ~/.eullm/audit/. Forge (Python prune→distill→quantize→LoRA→GGUF) and Hub (EU model registry) are documented but still early. Infrastructure claims point at Hetzner DE / OVH FR; zero telemetry outside the EU (vendor claim).
AGICY partner posture
Tier C Watch (Engine only). Treat as a possible Copperway BYO upstream or staff demo runtime via OpenAI SDK base_url=http://localhost:11434/v1 — not a Galaxy / Tenstorrent COD path and not CapEx LOCK substitution. Do not retcon ‘AI Act-ready’ badge language into a conformity assessment; a local request ledger is transparency-adjacent only. Forge/Hub stay out of COD shortlist until dated production distribution.
What they are NOT
Not a Cyprus sovereignty campus; not SRA issuer; not Copperway; not Moreh-class Galaxy serving; Forge/Hub not production distribution; audit JSONL ≠ certification.
Latest news angles (2025–2026)
| When | Signal | Source |
|---|---|---|
| 2026 | EULLM — repository and Engine releases | GitHub |
| 2026 | EULLM architecture — Engine, Forge, Hub | EULLM docs |
FAQ
Does AGICY ship EULLM?
No. EULLM is a third-party Apache 2.0 project. AGICY may document it as a self-hosted OpenAI-compatible upstream. Copperway remains the gateway product; the campus remains pre-construction.
Is a local audit trail EU AI Act compliance?
No. Append-only request/response logs support operator transparency work. They are not a notified-body conformity assessment or high-risk system certification.
Can we use EULLM numbers for Galaxy pricing?
No. Consumer/ARM demos and GGUF benches are not AGICY measured COD tok/s or Z2 Unit Economics.
Related intelligence
Official & primary sources
- github.com/eullm/eullm
- Getting started
- GitHub: EULLM — repository and Engine releases
- EULLM docs: EULLM architecture — Engine, Forge, Hub
- AGICY shortlist posture — Partner Shortlist Moreh-class (internal research archive).
Explore the Stack Partners category
Moreh-class serving, tenancy, assurance, and orchestration examinations for AGICY's Cyprus Galaxy campus — separate from CapEx campus peers.
View all Stack Partners