Multi-tenant from day one
One deployment serves many teams. Each entity gets isolated config and data: its own webhook secrets, platform tokens, LLM keys and review rules.
Case study · AI tooling
Hyoka (評価, “evaluation”) reviews every pull request with an LLM and leaves inline suggestions the author can apply in one click. I took an early code-review prototype and rebuilt it into a multi-tenant product that whole teams can share.
hyoka-bot suggested a change · src/billing/invoice.ts
Medium total can be undefined when the invoice has no line items, and toFixed will throw.
How it works
Tap any step, or let it play. The key decision: the API never waits on the LLM. Webhooks get an answer in milliseconds, and the slow work happens on a queue.
Step 1 / 6
GitHub or GitLab fires a webhook at Hyoka. Each team (an entity) has its own webhook secret, platform token and review rules.
The hard part
Most bad AI reviews come from missing context: the model can't see the helper you imported, so it tells you to write one. Hyoka lets each project choose how much surrounding code to send. Try the four modes:
Adds related unchanged code outside the diff window, like the tests and siblings of the changed file. The best balance for most teams.
File names are illustrative.
One deployment serves many teams. Each entity gets isolated config and data: its own webhook secrets, platform tokens, LLM keys and review rules.
OpenAI, Anthropic Claude, Google Gemini and DeepSeek through the Vercel AI SDK, with a default per entity and an override per project.
Tokens and API keys are encrypted at rest with AES-256-GCM, using a key derived per entity with HKDF-SHA256.
Extra file context outside the diff, plus a deterministic filter that drops self-contradicting “missing import” and “missing null-guard” findings.
Line and role validation rejects broken suggestions before they reach the PR, so what's posted applies in one click.
Token cost, request counts and model breakdown by month, quarter or year, so teams know what reviews cost.
Node.js 24
Fastify 5
JWT auth
BullMQ
Redis
PostgreSQL
Prisma
Vercel AI SDK
4 providers
React 19
Vite
Mantine
Turborepo
pnpm
Docker Compose
GitLab CI