py660/Replit-v2-CodeInstruct-3b-ggml

YOUR PERSONAL REPLIT GHOSTWRITER

ABOUT

This project is an attempt to run the GGML 4 bit quantized version of the 'Replit-v2-CodeInstruct-3b' model on a CPU (i.e., a free HuggingFace Space).

Checkout the website that I built on top of this model - https://personal-replit-ghostwriter.sixftone-mlh.repl.co/

CREDITS

The 4 bit quantized model was provided by https://huggingface.co/abacaj