1. Install
- Git clone alpaca.cpp github repository
git clone [email protected]:antimatter15/alpaca.cpp
-
Download the
ggml-alpaca-7b-q4.bin
from huggingface https://huggingface.co/Sosaka/Alpaca-native-4bit-ggml/tree/main -
Build
make chat
git clone [email protected]:antimatter15/alpaca.cpp
Download the ggml-alpaca-7b-q4.bin
from huggingface
https://huggingface.co/Sosaka/Alpaca-native-4bit-ggml/tree/main
Build
make chat