LocalLLaMA/local-model-explorer-data

Local Model Explorer Data An anonymous record of what people try to run locally, gathered by Local Model Explorer: the hardware they plan for (GPU memory, number of cards, system or unified memory), the models and context lengths they look at, which GGUF quants they open and copy commands for, and the llama-bench results and reports they choose to share. The question it answers: what hardware do local LLM users have, what do they try to run on it, and how fast does it actually… See the full description on the dataset page: https://huggingface.co/datasets/LocalLLaMA/local-model-explorer-data.