Datasetpublic

znhoughton/babylm-150m-ablated

znhoughton/babylm-150m-v3 — binomial-ablated This dataset is a copy of znhoughton/babylm-150m-v3 with sentences containing specific novel N-and-N binomial pairs removed. Ablation details Source corpus: znhoughton/babylm-150m-v3 Exclusion list: novel_binomials_curated.csv (431 pairs) Sentences removed: 47 Date: 2026-04-12 Matching rule A sentence is removed if it contains both words of an excluded pair and the word and, with and appearing between… See the full description on the dataset page: https://huggingface.co/datasets/znhoughton/babylm-150m-ablated.

sourceHugging Faceotherupdated 6mo agoView on Hugging Face

0likes20downloads

Dataset Card

znhoughton/babylm-150m-v3 — binomial-ablated

This dataset is a copy of znhoughton/babylm-150m-v3 with sentences containing specific novel N-and-N binomial pairs removed.

Ablation details

—Source corpus: znhoughton/babylm-150m-v3
—Exclusion list: novel_binomials_curated.csv (431 pairs)
—Sentences removed: 47
—Date: 2026-04-12

Matching rule

A sentence is removed if it contains both words of an excluded pair and the word and, with and appearing between the two words in either order (any number of intervening words allowed).

Example: "cold bread and small butter" is removed for the pair (bread, butter). Sentences containing only one of the two words, or lacking and, are retained.

Domains and sentence-splitting

Domain	Structure	Ablation method
`bnc_spoken`	sentence-per-line	line-wise
`childes`	sentence-per-line	line-wise
`open_subtitles`	sentence-per-line	line-wise
`switchboard`	sentence-per-line	line-wise
`gutenberg`	multi-sentence/line	join → sentence-tokenise → filter
`simple_wiki`	multi-sentence/line	join → sentence-tokenise → filter

Excluded pairs

—abashed / sorry
—abbots / acolytes
—abysses / puddles
—acorns / boulders
—acorns / goblets
—acorns / lions
—acorns / tigers
—acorns / valleys
—actresses / lumberjacks
—admirals / deckhands
—admirals / flowers
—admirals / knitting
—admirals / paupers
—admirals / ribbons
—admirals / weavers
—allergic / unaccustomed
—amber / gravel
—amethysts / pebbles
—amphitheaters / gazebos
—annoying / teal
—anthills / volcanoes
—ants / giraffes
—ants / stars
—anvils / coins
—aprons / swords
—archbishops / millers
—archdukes / tanners
—archdukes / vagrants
—archipelagos / sandbars
—arenas / sheds
—arrows / flowers
—asteroids / pebbles
—avalanches / feathers
—avalanches / murmurs
—avalanches / snowballs
—axes / flowers
—axes / petals
—axes / ribbons
—bacteria / candy
—ballrooms / cellars
—banners / rags
—banquets / crumbs
—banyans / ferns
—barns / marbles
—barons / fishermen
—barons / paupers
—barons / weavers
—bassoons / kazoos
—battleaxes / penknives
—battlements / cobwebs
—bears / buttons
—bears / kettles
—bears / ribbons
—bears / seeds
—bears / teacups
—beautiful / stinky
—beetles / hills
—beetles / mammoths
—beetles / mastodons
—beetles / moons
—beggars / captains
—beggars / dukes
—bicycles / robots
—birdhouses / cathedrals
—birdhouses / skyscrapers
—birdhouses / turrets
—bishops / blacksmiths
—bishops / potters
—bishops / seamstresses
—bishops / vagabonds
—bison / sparrows
—bitter / purple
—blacksmiths / lawyers
—blankets / kittens
—blizzards / butterflies
—blizzards / flurries
—blizzards / mists
—bogs / tundras
—bombs / pebbles
—bonnets / cannons
—bonnets / shields
—bonnets / swords
—bonnets / wolves
—books / owls
—boulders / butterflies
—boulders / feathers
—boulders / marbles
—bowls / sharks
—breezes / tornadoes
—breezes / typhoons
—bridges / needles
—buffaloes / sparrows
—burlap / cashmere
—burlap / velvet
—butterflies / comets
—butterflies / earthquakes
—butterflies / floods
—butterflies / squalls
—butterflies / tempests
—buttons / castles
—buttons / deer
—buttons / foxes
—buttons / lions
—buttons / mountains
—buttons / seas
—buttons / whales
—cabins / citadels
—campfires / wildfires
—candles / foxes
—candles / galaxies
—candles / gales
—candles / hurricanes
—candles / nebulae
—cannons / darts
—cannons / needles
—cannons / slingshots
—canyons / marbles
—captains / flowers
—cardinals / novices
—carracks / skiffs
—cashmere / flannel
—catapults / slingshots
—cathedrals / outhouses
—cathedrals / sheds
—cauldrons / thimbles
—cedars / mosses
—cellos / kazoos
—cellos / triangles
—chalices / thimbles
—chalk / diamonds
—chalk / tanzanite
—champagne / vinegar
—chandeliers / torches
—chanting / enchanting
—chasms / puddles
—chauffeurs / stewardesses
—cherries / llamas
—chestnuts / ferns
—chickens / fences
—chipmunks / gorillas
—churches / pebbles
—civilizations / homesteads
—clarinets / kazoos
—clay / emeralds
—claymores / penknives
—clearings / plateaus
—clearings / prairies
—cliffs / cobwebs
—cliffs / moths
—clocks / deer
—closets / dungeons
—cobblers / colonels
—cobblers / deacons
—cobblers / judges
—cobblers / marquesses
—cobblers / monks
—cobblers / privateers
—cobras / mice
—cobwebs / storms
—coins / eagles
—coins / forests
—coins / ravens
—comets / sparks
—condors / sparrows
—conscripts / generals
—coroners / senators
—corsairs / drapers
—cottages / dynasties
—counts / shepherds
—counts / tanners
—counts / vagabonds
—crabs / walruses
—crates / warehouses
—crayfish / otters
—crocodiles / tadpoles
—crossbows / slingshots
—crowbars / tweezers
—crowns / nightcaps
—crumbs / feasts
—cudgels / maces
—cutlasses / needles
—cyclones / gusts
—cyclones / zephyrs
—cypresses / mosses
—daggers / flowers
—daggers / thimbles
—deltas / puddles
—deserts / raindrops
—determined / forgettable
—dewdrops / forests
—dewdrops / glaciers
—dewdrops / planets
—dewdrops / tsunamis
—dewdrops / waterfalls
—disheveled / dreary
—ditches / fjords
—doctors / shepherds
—donates / provides
—dreadnoughts / rowboats
—drips / geysers
—dukes / flowers
—dukes / millers
—dukes / shepherds
—dukes / vagrants
—dungeons / spiders
—eagles / plates
—eagles / ribbons
—eagles / thimbles
—earls / gravediggers
—earls / paupers
—earls / tanners
—earthquakes / teardrops
—earthquakes / whimpers
—elephants / gnats
—elephants / pins
—elms / mushrooms
—embers / thunderbolts
—emperors / flowers
—eons / heartbeats
—eruptions / sparks
—falcons / wrens
—farmers / princes
—farmers / shoguns
—feasts / morsels
—feasts / scraps
—feathers / floods
—feathers / lightning
—feathers / mountains
—feathers / rivers
—feathers / spears
—feathers / storms
—feathers / thunderstorms
—feathers / tsunamis
—feathers / volcanoes
—felines / quails
—ferns / larches
—ferns / sequoias
—ferns / spruces
—ferns / walnuts
—finches / vultures
—fireflies / galaxies
—fireflies / moons
—fireflies / supernovas
—first / ninety-eighth
—fishermen / generals
—flails / switches
—flint / opals
—flintlocks / slingshots
—floods / puddles
—flowers / generals
—flowers / knights
—flowers / knives
—flowers / lances
—flowers / lords
—flowers / monarchs
—flowers / pharaohs
—flowers / princes
—flowers / warriors
—flowers / zinnias
—flutes / kazoos
—footmen / marshals
—fortresses / tents
—foxes / thimbles
—friars / tanners
—fuming / mad
—gales / sparks
—galleons / kayaks
—garnets / slate
—gazelles / leopards
—gelatin / lard
—generals / knitters
—generals / lace
—generals / riflemen
—gerbils / pythons
—glaciers / raindrops
—gnats / gorillas
—gnats / hippopotamuses
—gnats / mammoths
—gnats / rhinoceroses
—goblets / puddles
—gorillas / sparrows
—gravediggers / kings
—gravel / moonstone
—gravel / onyx
—gravel / sapphires
—gravel / turquoise
—groundskeeper / superintendent
—hailstones / icebergs
—hairpins / sabres
—hairpins / tiaras
—halberds / knives
—hammers / lace
—happily / rudely
—harpooners / knitters
—harps / kazoos
—harpsichords / kazoos
—hawks / thimbles
—hawks / voles
—helmets / nightcaps
—helmets / ribbons
—herrings / seals
—herrings / sharks
—hesitate / readjust
—hippopotamuses / mice
—horses / mirrors
—horses / thimbles
—hurricanes / petals
—hurricanes / zephyrs
—huts / monasteries
—icebergs / snowflakes
—jacket / phone
—jaguars / rabbits
—kaisers / peasants
—kale / vegetables
—kazoos / lutes
—kazoos / organs
—kazoos / pianos
—kazoos / saxophones
—kazoos / trumpets
—kazoos / violas
—kazoos / violins
—khans / weavers
—lace / twine
—lances / scarves
—lanterns / ravens
—laundresses / queens
—leopards / rabbits
—leviathans / minnows
—lightning / moths
—lions / needles
—lions / teacups
—lizards / tyrannosaurs
—looms / trebuchets
—lords / shepherds
—maelstroms / ripples
—majors / spinners
—mansions / pigsties
—mantles / rags
—marbles / orbs
—marooned / missing
—masculine / undignified
—mastodons / moths
—mausoleums / shacks
—meadows / tundras
—meteors / raindrops
—mice / tigers
—mice / wolves
—millers / priests
—millstones / pebbles
—minnows / orcas
—moles / polecats
—monarchs / serfs
—monks / tanners
—monks / telescopes
—moths / seas
—moths / suns
—mountains / petals
—mud / platinum
—mudslides / puddles
—mushrooms / oaks
—mushrooms / pines
—muskets / slingshots
—nebulae / sparks
—nectar / swill
—needles / ravens
—needles / sledgehammers
—needles / tigers
—nurses / patriarchs
—oboes / tambourines
—organs / whistles
—owls / pennies
—owls / thimbles
—paintbrushes / sailors
—palaces / pigsties
—pearls / silt
—peasants / sultans
—pebbles / volcanoes
—pelicans / sardines
—pennies / wolves
—petals / tornadoes
—pharaohs / potters
—pianos / triangles
—pickaxes / pins
—pikes / slingshots
—pinnacles / vales
—pins / tigers
—pins / walls
—planets / sparks
—priests / tanners
—priors / scullions
—pterodactyls / sparrows
—puddles / straits
—puppies / tigers
—pyramids / sandcastles
—queens / serfs
—rags / tapestries
—rapiers / thimbles
—rats / sharks
—redwoods / toadstools
—rhinoceroses / voles
—ribbons / sharks
—ribbons / shields
—ripples / waterspouts
—rivers / seeds
—rubies / sandstone
—rustles / tempests
—sackcloth / velvet
—sardines / whales
—saxophones / whistles
—scepters / twigs
—scissors / scythes
—seeds / sharks
—serfs / tsars
—sharks / teacups
—showers / typhoons
—slings / trebuchets
—soldiers / spools
—sparks / thunderbolts
—sparrows / wolves
—spears / tablecloths
—spoons / wolves
—tablecloths / tigers
—teacups / wolves
—therapy / vacations
—thimbles / towers
—thimbles / wolves
—thunderclaps / whispers
—trombones / whistles
—tsars / vagrants
—tubas / whistles
—vocabulary / vowels