You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Hendrik Langer
0486055628
|
1 year ago | |
---|---|---|
matrix_pygmalion_bot | 1 year ago | |
runpod | 1 year ago | |
.gitignore | 1 year ago | |
Dockerfile | 2 years ago | |
LICENSE | 2 years ago | |
README.md | 1 year ago | |
bot.conf.sample | 1 year ago | |
requirements.txt | 1 year ago | |
run.py | 1 year ago | |
setup.py | 2 years ago |
README.md
matrix-pygmalion-bot
Setup
# install dependencies
apt install libolm-dev
pipenv install --dev
pipenv shell
python3 run.py
Other
python3 -m venv env
source env/bin/activate
pip install -r requirements.txt
Install KoboldCpp
git clone https://github.com/LostRuins/koboldcpp.git
apt update && apt-get install libopenblas-dev libclblast-dev libmkl-dev
cd koboldcpp && make LLAMA_CLBLAST=1 LLAMA_OPENBLAS=1
cd models && wget https://huggingface.co/concedo/pygmalion-6bv3-ggml-ggjt/resolve/main/pygmalion-6b-v3-ggml-ggjt-q4_0.bin
python3 koboldcpp.py --unbantokens --smartcontext --stream models/pygmalion-6b-v3-ggml-ggjt-q4_0.bin
Cloud services
- runpod.io
- vast.ai
- stablehorde.net