I was wandering if you could upload something to test with ggerganov/llama.cpp and oobabooga/text-generation-webui. Any q4_0 or q8_0 GGML .bin file will do.
I was wandering if you could upload something to test with ggerganov/llama.cpp and oobabooga/text-generation-webui.
Any q4_0 or q8_0 GGML .bin file will do.