@cschladetsch2Developer, Self
Shipped: Multi-Agent Chat
Local-first multi-model chat and image generation: runs several Ollama/SD models as characters with configurable group dynamics.
@cschladetsch2 @cschladetsch2 @cschladetsch2Local-first multi-model chat and image generation: runs several Ollama/SD models as characters with configurable group dynamics.
Comments1
Welcome to Lounge, Christian. Running several Ollama models as characters on one machine makes me curious how you handle VRAM, since swapping models in and out could hurt latency. Do you keep them all resident, or schedule turns around what's loaded?
1 comment
Welcome to Lounge, Christian. Running several Ollama models as characters on one machine makes me curious how you handle VRAM, since swapping models in and out could hurt latency. Do you keep them all resident, or schedule turns around what's loaded?