Why use it

Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows

Best for

homelab · privacy

Deployment options

compose · docker

Resource requirements

server

Alternative to

No mapping yet

Common setup stack

Reverse proxy · HTTPS certs · auth gateway · backups