ee1cb5540a
First service for Vi's nervous system:
- Oracle service with NATS integration
- vLLM backend for Qwen3-32B
- GPTQ quantization support
- Thinking mode sampling configs
Simplified from Lyra's patterns, ready to test.
🦊✺
5 lines
94 B
Python
5 lines
94 B
Python
# LLM module for Oracle service
|
|
from .llm_manager import LLMManager
|
|
|
|
__all__ = ['LLMManager']
|