Modelpublic

jamesliu1/sglang-EAGLE3-Llama-3.1-Instruct-8B

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

3likes3.1kdownloads

Model Card

This model is copied from https://huggingface.co/yuhuili/EAGLE3-LLaMA3.1-Instruct-8B with the following modifications to make it compatible with SGLang:

—Modify the architecture in config.json to LlamaForCausalLMEagle3