Add Oracle service - LLM wrapper
First service for Vi's nervous system:
- Oracle service with NATS integration
- vLLM backend for Qwen3-32B
- GPTQ quantization support
- Thinking mode sampling configs
Simplified from Lyra's patterns, ready to test.
🦊✺
This commit is contained in:
4
requirements.txt
Normal file
4
requirements.txt
Normal file
@@ -0,0 +1,4 @@
|
||||
# Vi dependencies
|
||||
nats-py>=2.6.0
|
||||
vllm>=0.4.0
|
||||
torch>=2.0.0
|
||||
Reference in New Issue
Block a user