datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Blind_Spots_of_Frontier_Model-Qwen3.5_4B_base
Blind_Spots_of_Frontier_Model-Qwen3.5_4B_base
This is a submission to the Technical challenge: Blind Spots of Frontier Models for Fatima Fellowship 2026 application
Model Link: Qwen/Qwen3.5-4B-base
Code
Code link: https://gist.github.com/NachtSpyder04/8b1ccd5a29b37f7a82083c93b4f518c8
The model was loaded using the Hugging Face transformers library, and evaluated using deterministic decoding (temperature set to 0). I intentionally disabled sampling so that the outputs… See the full description on the dataset page: https://huggingface.co/datasets/NachtSpyder04/Blind_Spots_of_Frontier_Model-Qwen3.5_4B_base.blind-spots-for-frontier-models
Qwen Model Tasks For Fellowship
Note: view 'final_results_hf.json' for model results. For some reason hf is only showing 'test.json' in preview which doesnt contain models response.
Model Loading
The model was loaded using the transformers library from Hugging Face. The following code snippet was used to load the Qwen model and tokenizer:
from transformers import AutoModelForCausalLM, AutoTokenizer
# Define the model name
model_name = "Qwen/Qwen3-4B-Base"
# Load the… See the full description on the dataset page: https://huggingface.co/datasets/Izzi1/blind-spots-for-frontier-models.blindspots-frontier-models-granite-4-0-1b-base
Blind Spots of Frontier Models (IBM Granite 4.0 1B Base)
Model tested: ibm-granite/granite-4.0-1b-baseModel card: https://huggingface.co/ibm-granite/granite-4.0-1b-base
For inference, I ran this model locally, though I also experimented with free models from OpenRouter.
This dataset contains 10 evaluation rows with:
input
expected_output
model_output
notes
is_correct
I loaded the model with transformers and evaluated it using strict concise-answer prompts.
from transformers… See the full description on the dataset page: https://huggingface.co/datasets/Tomodovodoo/blindspots-frontier-models-granite-4-0-1b-base.