shahondin1624
  • Germay
  • Joined on 2026-01-30
shahondin1624 closed issue llm-multiverse/llm-multiverse#42 2026-03-10 15:09:33 +01:00
Implement Inference + GenerateEmbedding endpoints
shahondin1624 commented on issue llm-multiverse/llm-multiverse#42 2026-03-10 15:09:29 +01:00
Implement Inference + GenerateEmbedding endpoints

Implemented in PR #140 (merged).\n\n- Inference endpoint: validates request, routes model via ModelRouter, calls Ollama generate(), returns text + finish_reason + tokens_used\n- `GenerateEmbeddin…

shahondin1624 deleted branch feature/issue-42-inference-embedding-endpoints from llm-multiverse/llm-multiverse 2026-03-10 15:09:24 +01:00
shahondin1624 pushed to main at llm-multiverse/llm-multiverse 2026-03-10 15:09:24 +01:00
80c272bd56 Merge pull request 'feat: implement Inference + GenerateEmbedding endpoints (#42)' (#140) from feature/issue-42-inference-embedding-endpoints into main
a4042183d9 chore: mark issue #42 as COMPLETED
6940c6a254 feat: implement Inference and GenerateEmbedding gRPC endpoints (issue #42)
Compare 3 commits »
shahondin1624 merged pull request llm-multiverse/llm-multiverse#140 2026-03-10 15:09:23 +01:00
feat: implement Inference + GenerateEmbedding endpoints (#42)
shahondin1624 created pull request llm-multiverse/llm-multiverse#140 2026-03-10 15:09:17 +01:00
feat: implement Inference + GenerateEmbedding endpoints (#42)
a4042183d9 chore: mark issue #42 as COMPLETED
6940c6a254 feat: implement Inference and GenerateEmbedding gRPC endpoints (issue #42)
Compare 2 commits »
shahondin1624 pushed to main at llm-multiverse/llm-multiverse 2026-03-10 14:12:49 +01:00
120f5e5bd1 chore: mark issue #41 as COMPLETED
shahondin1624 closed issue llm-multiverse/llm-multiverse#41 2026-03-10 14:12:30 +01:00
Implement StreamInference gRPC endpoint
shahondin1624 commented on issue llm-multiverse/llm-multiverse#41 2026-03-10 14:10:56 +01:00
Implement StreamInference gRPC endpoint

Implemented and merged via PR #139.\n\n- StreamInference server-streaming with Ollama NDJSON bridge\n- Model routing via TaskComplexity + model_hint\n- params_to_options helper, ollama_err_to_statu…

shahondin1624 deleted branch feature/issue-41-stream-inference from llm-multiverse/llm-multiverse 2026-03-10 14:10:55 +01:00
shahondin1624 pushed to main at llm-multiverse/llm-multiverse 2026-03-10 14:10:55 +01:00
042baff0ff Merge pull request 'feat: implement StreamInference gRPC endpoint (#41)' (#139) from feature/issue-41-stream-inference into main
c60bd15523 feat: implement StreamInference gRPC endpoint (issue #41)
Compare 2 commits »
shahondin1624 merged pull request llm-multiverse/llm-multiverse#139 2026-03-10 14:10:54 +01:00
feat: implement StreamInference gRPC endpoint (#41)
shahondin1624 created pull request llm-multiverse/llm-multiverse#139 2026-03-10 14:10:49 +01:00
feat: implement StreamInference gRPC endpoint (#41)
c60bd15523 feat: implement StreamInference gRPC endpoint (issue #41)
shahondin1624 pushed to main at llm-multiverse/llm-multiverse 2026-03-10 14:05:41 +01:00
dcd2752fde docs: mark issue #40 as COMPLETED in implementation plans
shahondin1624 closed issue llm-multiverse/llm-multiverse#40 2026-03-10 14:05:14 +01:00
Implement model routing logic