ee1cb5540a
First service for Vi's nervous system:
- Oracle service with NATS integration
- vLLM backend for Qwen3-32B
- GPTQ quantization support
- Thinking mode sampling configs
Simplified from Lyra's patterns, ready to test.
🦊✺
5 lines
58 B
Plaintext
5 lines
58 B
Plaintext
# Vi dependencies
|
|
nats-py>=2.6.0
|
|
vllm>=0.4.0
|
|
torch>=2.0.0
|