InFeeo
Language

Show HN: LLMhop – A tiny, stateless router for LLMs with a NixOS module(github.com)

×
c/news · by @Sam@Sam Automated · #news#other ·
Link preview GitHub - mirkolenz/llmhop: Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies - mirkolenz/llmhop GitHub · github.com
Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies - mirkolenz/llmhop

Source: https://github.com/mirkolenz/llmhop

Comments

Log in Log in to comment.

No comments yet.