madiator-docker-runpod/official-templates/better-ai-launcher/README.md

99 lines
2.4 KiB
Markdown
Raw Normal View History

# madiator-docker-runpod
RunPod Docker Containers for RunPod
**Better AI Launcher Container for RunPod and local develoment**
### Build Vars ###
IMAGE_BASE=madiator2011/better-launcher
IMAGE_TAG=dev
### Github: ###
https://github.com/kodxana/madiator-docker-runpod
### ENV Vars ###
These ENV vars go into the docker container to support local debugging:
see also explanantion in ".vscode/tasks.json" or "docker-compose.debug.yml"
LOCAL_DEBUG=True
change app to localhost Urls and local Websockets (unsecured)
FLASK_ENV=development
changed from "production" (default)
GEVENT_SUPPORT=True
gevent monkey-patching is being used, enable gevent support in the debugger
FLASK_DEBUG=0
"1" allows debugging in Chrome, but then VSCode debugger not works
*User ENV Vars for Production:*
### APP specific Vars ###
DISABLE_PULLBACK_MODELS=False
the default is, that app model files, which are found locally (in only one app),
get automatically "pulled-back" into the '/workspace/shared_models' folder.
From there they will be re-linked back not only to their own "pulled-back" model-type folder,
but also will be linked back into all other corresponding app model-type folders.
So the "pulled-back" model is automatically shared to all installed apps.
If you NOT want this behaviour, then set DISABLE_PULLBACK_MODELS=True
### USER specific Vars and Secrets (Tokens) - TODO: adjust this for your personal settings ###
PUBLIC_KEY=ssh-ed25519 xxx...xxx usermail@domain.com
HF_TOKEN=hf_xxx...xxx
CIVITAI_API_TOKEN=xxx.xxx
**SECURITY TIP:**
These 3 security sensitive environment vars should be stored as RUNPOD **SECRETS** and referenced directly in your POD Template in the format {{ RUNPOD_SECRET_MYENVVAR }}
From https://docs.runpod.io/pods/templates/secrets
You can reference your Secret directly in the Environment Variables section of your Pod template. To reference your Secret, reference it's key appended to the "RUNPOD_SECRET_" prefix.
That mean, for this template/image, you should use these formats:
{{ RUNPOD_SECRET_PUBLIC_KEY}}
{{ RUNPOD_SECRET_HF_TOKEN }}
{{ RUNPOD_SECRET_CIVITAI_API_TOKEN }}
### Ports: ###
SSH-Port
22:22/tcp
App-Manager
7222:7222/http
VSCode-Server
7777:7777/http
File-Browser
8181:8181/http
### Apps: ###
ComfyUI
3000:3000/http
Forge (Stable-Diffiusion-WebUI-Forge)
7862:7862/http
A1111 (Stable-Diffiusion-WebUI)
7863:7863/http
*coming soon*
Kohya-ss
7864:7864/http