city96/umt5-xxl-encoder-gguf

1---2base_model: google/umt5-xxl3library_name: gguf4license: apache-2.05quantized_by: city966language: en7---8 9This is a GGUF conversion of [Google's UMT5 xxl model](https://huggingface.co/google/umt5-xxl), specifically the encoder part.10 11The weights can be used with [`./llama-embedding`](https://github.com/ggerganov/llama.cpp/tree/master/examples/embedding) or with the [ComfyUI-GGUF](https://github.com/city96/ComfyUI-GGUF) custom node together with image/video generation models.12 13This is a **non imatrix** quant as llama.cpp doesn't support imatrix creation for T5 models at the time of writing. It's therefore recommended to use **Q5_K_M or larger** for the best results, although smaller models may also still provide decent results in resource constrained scenarios.14