Modelpublic

AMKCode/gemma-2-2b-jpn-it-q4f32_1-MLC

sourceHugging Facegemmaupdated 2y agoView on Hugging Face

0likes

Model Card

This model was compiled using MLC-LLM with q4f32_1 quantization from google/gemma-2-2b-jpn-it. The conversion was done using the MLC-Weight-Conversion space.

To run this model, please first install MLC-LLM.

To chat with the model on your terminal:

bash

mlc_llm chat HF://AMKCode/gemma-2-2b-jpn-it-q4f32_1-MLC

For more information on how to use MLC-LLM, please visit the MLC-LLM documentation.