hendrik
/
matrix-pygmalion-bot
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
Chatbot
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
146 Commits
1 Branch
0 Tags
1.0 MiB
 
 
 
 
Tree: 104ace0c61
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '104ace0c61'
${ noResults }
Hendrik Langer 104ace0c61
tweak llm parameters 		1 year ago
matrix_pygmalion_bot tweak llm parameters 1 year ago
runpod remote worker 2 years ago
.gitignore complete rewrite 2 years ago
Dockerfile working single login 2 years ago
LICENSE working single login 2 years ago
README.md set up quart (flask) webui 1 year ago
bot.conf.sample sample config file 2 years ago
requirements.txt set up quart (flask) webui 1 year ago
run.py complete rewrite 2 years ago
setup.py working single login 2 years ago

README.md

matrix-pygmalion-bot

Setup

# install dependencies
apt install libolm-dev
pipenv install --dev

pipenv shell
python3 run.py

Other

python3 -m venv env
source env/bin/activate
pip install -r requirements.txt

Install KoboldCpp

git clone https://github.com/LostRuins/koboldcpp.git
apt update && apt-get install libopenblas-dev libclblast-dev libmkl-dev
cd koboldcpp && make LLAMA_CLBLAST=1 LLAMA_OPENBLAS=1
cd models && wget https://huggingface.co/concedo/pygmalion-6bv3-ggml-ggjt/resolve/main/pygmalion-6b-v3-ggml-ggjt-q4_0.bin
python3 koboldcpp.py --unbantokens --smartcontext --stream models/pygmalion-6b-v3-ggml-ggjt-q4_0.bin

Cloud services

  • runpod.io
  • vast.ai
  • stablehorde.net

ToDo: