Chatbot
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
Hendrik Langer 0486055628 remove compatibility version of asyncio 1 year ago
matrix_pygmalion_bot add prompt ideas 1 year ago
runpod remote worker 1 year ago
.gitignore complete rewrite 1 year ago
Dockerfile working single login 2 years ago
LICENSE working single login 2 years ago
README.md set up quart (flask) webui 1 year ago
bot.conf.sample sample config file 1 year ago
requirements.txt remove compatibility version of asyncio 1 year ago
run.py complete rewrite 1 year ago
setup.py working single login 2 years ago

README.md

matrix-pygmalion-bot

Setup

# install dependencies
apt install libolm-dev
pipenv install --dev

pipenv shell
python3 run.py

Other

python3 -m venv env
source env/bin/activate
pip install -r requirements.txt

Install KoboldCpp

git clone https://github.com/LostRuins/koboldcpp.git
apt update && apt-get install libopenblas-dev libclblast-dev libmkl-dev
cd koboldcpp && make LLAMA_CLBLAST=1 LLAMA_OPENBLAS=1
cd models && wget https://huggingface.co/concedo/pygmalion-6bv3-ggml-ggjt/resolve/main/pygmalion-6b-v3-ggml-ggjt-q4_0.bin
python3 koboldcpp.py --unbantokens --smartcontext --stream models/pygmalion-6b-v3-ggml-ggjt-q4_0.bin

Cloud services

  • runpod.io
  • vast.ai
  • stablehorde.net

ToDo: