all templates
AI & Agents

AI Agent Service

A Claude-powered agent behind a typed API — tools, streaming, and memory included.

A production agent service, not a chat demo. Streaming responses, a tool-use loop with typed tool definitions, conversation persistence and retrieval memory sit behind a small Hono API you can put in front of any product.

What's inside

  • Streaming chat endpoint (SSE) with backpressure
  • Tool-use loop with typed, validated tool definitions
  • Conversation persistence + retrieval memory
  • Versioned system prompts
  • Per-key rate limiting and token budgets
  • Eval harness scaffold for regression testing

Quickstart

$ git clone git@github.com:devai-io/agent-api.git my-agent$ cd my-agent && bun install$ cp .env.example .env   # add ANTHROPIC_API_KEY$ bun dev

from production

Extracted from the enrichment agents that keep a production data platform clean around the clock.