datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
blind-spots-for-frontier-models
Qwen Model Tasks For Fellowship
Note: view 'final_results_hf.json' for model results. For some reason hf is only showing 'test.json' in preview which doesnt contain models response.
Model Loading
The model was loaded using the transformers library from Hugging Face. The following code snippet was used to load the Qwen model and tokenizer:
from transformers import AutoModelForCausalLM, AutoTokenizer
# Define the model name
model_name = "Qwen/Qwen3-4B-Base"
# Load the… See the full description on the dataset page: https://huggingface.co/datasets/Izzi1/blind-spots-for-frontier-models.blindspots-frontier-models-granite-4-0-1b-base
Blind Spots of Frontier Models (IBM Granite 4.0 1B Base)
Model tested: ibm-granite/granite-4.0-1b-baseModel card: https://huggingface.co/ibm-granite/granite-4.0-1b-base
For inference, I ran this model locally, though I also experimented with free models from OpenRouter.
This dataset contains 10 evaluation rows with:
input
expected_output
model_output
notes
is_correct
I loaded the model with transformers and evaluated it using strict concise-answer prompts.
from transformers… See the full description on the dataset page: https://huggingface.co/datasets/Tomodovodoo/blindspots-frontier-models-granite-4-0-1b-base.