Files
llm-multiverse/implementation-plans/issue-038.md
2026-03-10 13:43:50 +01:00

1.7 KiB

Implementation Plan — Issue #38: Scaffold Model Gateway Rust project

Metadata

Field Value
Issue #38
Title Scaffold Model Gateway Rust project
Milestone Phase 5: Model Gateway
Labels
Status COMPLETED
Language Rust
Related Plans issue-018.md, issue-022.md, issue-027.md
Blocked by #16 (completed)

Acceptance Criteria

  • Cargo workspace member created (services/model-gateway/)
  • Dependency on proto-gen crate
  • Tonic gRPC server boilerplate compiles
  • Configuration loading (address, port, Ollama URL, model routing config)
  • Health check endpoint responds

Implementation Steps

  1. Add workspace member to root Cargo.toml
  2. Create services/model-gateway/Cargo.toml with proto-gen dependency
  3. Create src/lib.rs with module exports
  4. Create src/config.rs with Config + ModelRoutingConfig (TOML loading, serde defaults)
  5. Create src/service.rs with ModelGatewayService trait impl (IsModelReady + stubs)
  6. Create src/main.rs with tonic server entry point
  7. Unit tests for config

Files to Create/Modify

File Action Purpose
Cargo.toml Modify Add workspace member
services/model-gateway/Cargo.toml Create Crate manifest
services/model-gateway/src/lib.rs Create Module exports
services/model-gateway/src/main.rs Create Server entry point
services/model-gateway/src/config.rs Create Configuration with TOML loading
services/model-gateway/src/service.rs Create gRPC service impl

Deviation Log

Deviation Reason