serialization
graph-serialization-invariance
Serialization-invariance audit of LLM graph code generation
Does an LLM that solves a graph problem by writing code return the same answer under
equivalent serializations of the same graph -- and if not, does the fragility enter when it
transcribes the graph into its program, when it constructs a structure from that
copy, or in the solution logic?
Produced by ml_graphs at commit 2f43c6f.
Design
Each instance (one graph + one task + one query) is rendered into… See the full description on the dataset page: https://huggingface.co/datasets/Dolevabudi/graph-serialization-invariance.graph-serialization-invariance
Serialization-invariance audit of LLM graph code generation
Does an LLM that solves a graph problem by writing code return the same answer under
equivalent serializations of the same graph -- and if not, does the fragility enter when it
transcribes the graph into its program, when it constructs a structure from that
copy, or in the solution logic?
Produced by ml_graphs at commit 73f956e.
Design
Each instance (one graph + one task + one query) is rendered into… See the full description on the dataset page: https://huggingface.co/datasets/Yonibarel/graph-serialization-invariance.