pictograph/lvis-20k


 

[View on Pictograph](https://pictograph.io/datasets/pictograph-research/lvis-20k) · Pictograph Research · Creative Commons Attribution 4.0

About

LVIS-20k is a computer-vision dataset curated and annotated on Pictograph. The most common detected objects are person, child, bus, train, cat, giraffe. On Pictograph you can browse every annotated image, fork it into your own workspace in one click, export it in a dozen formats, or train a model on it directly.

At a glance

Quick start

Load it in one line with the datasets library, then read each record's boxes and class names:

from datasets import load_dataset
from PIL import ImageDraw

ds = load_dataset("pictograph/lvis-20k", split="train")
example = ds[0]
image = example["image"]            # a PIL image
objects = example["objects"]        # {bbox, categories, category_names}

# draw every bounding box with its class name
draw = ImageDraw.Draw(image)
for (x, y, w, h), name in zip(objects["bbox"], objects["category_names"]):
    draw.rectangle([x, y, x + w, y + h], outline="red", width=3)
    draw.text((x, y - 12), name, fill="red")

# polygon masks live under example["segmentation"]:
#   [{"label": name, "category": idx, "points": [[x, y], ...]}, ...]
image.show()

Prefer a full annotation editor, one-click fork, multi-format export, and one-click training? Open this dataset on Pictograph.

Dataset structure

This dataset uses the Hugging Face imagefolder layout: each split directory holds the images plus a metadata.jsonl that links every image to its annotations by file_name.

Data instance

One record (bounding boxes are [x, y, width, height] in pixels; the class index maps into the class list below):

{
  "image": <PIL.Image (RGB)>,
  "objects": {
    "bbox": [[172.0, 192.0, 249.4, 152.7]],
    "categories": [0],
    "category_names": ["person"]
  },
  "segmentation": [
    {"label": "person", "category": 0, "points": [[176.9, 207.2], [259.0, 274.1], ...]}
  ]
}

Classes

Class index matches objects.categories in metadata.jsonl.

All 1,203 classes, in index order: BandAid, Bible, CDplayer, Christmastree, Dixiecup, Ferriswheel, Frenchtoast, Lego, Rollerblade, Sharpie, Tabascosauce, aerosolcan, airconditioner, airplane, alarmclock, alcohol, alligator, almond, ambulance, amplifier, anklet, antenna, apple, applesauce, apricot, apron, aquarium, arctic(typeofshoe), armband, armchair, armoire, armor, armytank, artichoke, ashtray, asparagus, atomizer, automaticwasher, avocado, award, awning, ax, baboon, babybuggy, backpack, bagel, bagpipe, baguet, bait, ball, balletskirt, balloon, bamboo, banana, bandage, bandanna, banjo, banner, barbell, barge, barrel, barrette, barrow, baseball, baseballbase, baseballbat, baseballcap, baseballglove, basket, basketball, basketballbackboard, basshorn, bat(animal), bathmat, bathtowel, bathrobe, bathtub, batter(food), battery, beachball, bead, beancurd, beanbag, beanie, bear, bed, bedpan, bedspread, beef(food), beeper, beerbottle, beercan, beetle, bell, bellpepper, belt, beltbuckle, bench, beret, bib, bicycle, billboard, binder, binoculars, bird, birdbath, birdcage, birdfeeder, birdhouse, birthdaycake, birthdaycard, blacksheep, blackberry, blackboard, blanket, blazer, blender, blimp, blinder(forhorses), blinker, blouse, blueberry, boat, bob, bobbin, bobbypin, boiledegg, bolotie, bolt, bonnet, book, bookcase, booklet, bookmark, boommicrophone, boot, bottle, bottlecap, bottleopener, bouquet, bow-tie, bow(decorativeribbons), bow(weapon), bowl, bowlerhat, bowlingball, box, boxingglove, bracelet, brakelight, brassplaque, brassiere, bread, bread-bin, breechcloth, bridalgown, briefcase, broach, broccoli, broom, brownie, brusselssprouts, bubblegum, bucket, bull, bulldog, bulldozer, bullettrain, bulletinboard, bulletproofvest, bullhorn, bun, bunkbed, buoy, burrito, bus(vehicle), businesscard, butter, butterfly, button, cab(taxi), cabana, cabincar, cabinet, cake, calculator, calendar, calf, camcorder, camel, camera, cameralens, camper(vehicle), can, canopener, candle, candleholder, candybar, candycane, canister, canoe, cantaloup, canteen, cap(headwear), cape, cappuccino, car(automobile), carbattery, card, cardigan, cargoship, carnation, carrot, cart, carton, cashregister, casserole, cassette, cast, cat, cauliflower, cayenne(spice), celery, cellulartelephone, chainmail, chair, chaiselongue, chalice, chandelier, chap, checkbook, checkerboard, cherry, chessboard, chicken(animal), chickpea, chili(vegetable), chime, chinaware, chocolatebar, chocolatecake, chocolatemilk, chocolatemousse, choker, choppingboard, chopstick, cider, cigarbox, cigarette, cigarettecase, cincture, cistern, clarinet, clasp, cleansingagent, cleat(forsecuringrope), clementine, clip, clipboard, clippers(forplants), cloak, clock, clocktower, clotheshamper, clothespin, clutchbag, coaster, coat, coathanger, coatrack, cock, cockroach, cocoa(beverage), coconut, coffeemaker, coffeetable, coffeepot, coil, coin, colander, coleslaw, coloringmaterial, combinationlock, comicbook, compass, computerkeyboard, condiment, cone, control, convertible(automobile), cooker, cookie, cookingutensil, cooler(forfood), cork(bottleplug), corkboard, corkscrew, cornbread, cornet, cornice, cornmeal, corset, costume, cougar, cover, coverall, cow, cowbell, cowboyhat, crab(animal), crabmeat, cracker, crape, crate, crawfish, crayon, creampitcher, crescentroll, crib, crisp(potatochip), crockpot, crossbar, crouton, crow, crowbar, crown, crucifix, cruiseship, crumb, crutch, cub(animal), cube, cucumber, cufflink, cup, cupboard, cupcake, curlingiron, curtain, cushion, cylinder, cymbal, dagger, dalmatian, dartboard, date(fruit), deadbolt, deckchair, deer, dentalfloss, desk, detergent, diaper, diary, die, dinghy, diningtable, dirtbike, dish, dishantenna, dishrag, dishtowel, dishwasher, dishwasherdetergent, dispenser, divingboard, dog, dogcollar, doll, dollar, dollhouse, dolphin, domesticass, doorknob, doormat, doughnut, dove, dragonfly, drawer, dress, dresshat, dresssuit, dresser, drill, drone, dropper, drum(musicalinstrument), drumstick, duck, duckling, ducttape, duffelbag, dumbbell, dumpster, dustpan, eagle, earphone, earplug, earring, easel, eclair, ediblecorn, eel, egg, eggroll, eggyolk, eggbeater, eggplant, electricchair, elephant, elevatorcar, elk, envelope, eraser, escargot, eyepatch, falcon, fan, faucet, fedora, ferret, ferry, fig(fruit), fighterjet, figurine, file(tool), filecabinet, firealarm, fireengine, fireextinguisher, firehose, fireplace, fireplug, first-aidkit, fish, fish(food), fishbowl, fishingrod, flag, flagpole, flamingo, flannel, flap, flash, flashlight, fleece, flip-flop(sandal), flipper(footwear), flowerarrangement, flowerpot, fluteglass, foal, foldingchair, foodprocessor, football(American), footballhelmet, footstool, fork, forklift, freightcar, freshener, frisbee, frog, fruitjuice, fryingpan, fudge, fumehood, funnel, futon, gag, gameboard, garbage, garbagetruck, gardenhose, gargle, gargoyle, garlic, gasmask, gazelle, gelatin, gemstone, generator, giantpanda, giftwrap, ginger, giraffe, glass(drinkcontainer), globe, glove, goat, goggles, goldfish, golfclub, golfcart, gondola(boat), goose, gorilla, gourd, grape, grater, gravestone, gravyboat, greenbean, greenonion, griddle, grill, grits, grizzly, grocerybag, guitar, gull, gun, haircurler, hairdryer, hairbrush, hairnet, hairpin, haltertop, ham, hamburger, hammer, hammock, hamper, hamster, handglass, handtowel, handbag, handcart, handcuff, handkerchief, handle, handsaw, hardbackbook, harmonium, hat, hatbox, headband, headboard, headlight, headscarf, headset, headstall(forhorses), heart, heater, helicopter, helmet, heron, highchair, hinge, hippopotamus, hockeystick, hog, homeplate(baseball), honey, hook, hookah, hornet, horse, horsebuggy, horsecarriage, hose, hot-airballoon, hotsauce, hotplate, hourglass, houseboat, hummingbird, hummus, iPod, icemaker, icepack, iceskate, icecream, identitycard, igniter, inhaler, inkpad, iron(forclothing), ironingboard, jacket, jam, jar, jean, jeep, jellybean, jersey, jetplane, jewel, jewelry, joystick, jumpsuit, kayak, keg, kennel, kettle, key, keycard, kilt, kimono, kitchensink, kitchentable, kite, kitten, kiwifruit, kneepad, knife, knittingneedle, knob, knocker(onadoor), koala, labcoat, ladder, ladle, ladybug, lamb-chop, lamb(animal), lamp, lamppost, lampshade, lantern, lanyard, laptopcomputer, lasagna, latch, lawnmower, leather, legging(clothing), legume, lemon, lemonade, lettuce, licenseplate, lifebuoy, lifejacket, lightbulb, lightningrod, lime, limousine, lion, lipbalm, liquor, lizard, locker, log, lollipop, loveseat, machinegun, magazine, magnet, mailslot, mailbox(athome), mallard, mallet, mammoth, manatee, mandarinorange, manger, manhole, map, marker, martini, mascot, mashedpotato, masher, mask, mast, mat(gymequipment), matchbox, mattress, measuringcup, measuringstick, meatball, medicine, melon, microphone, microscope, microwaveoven, milestone, milk, milkcan, milkshake, minivan, mintcandy, mirror, mitten, mixer(kitchentool), money, monitor(computerequipment) computermonitor, monkey, mop, motor, motorscooter, motorvehicle, motorcycle, mound(baseball), mouse(computerequipment), mousepad, muffin, mug, mushroom, musicstool, musicalinstrument, nailfile, napkin, neckerchief, necklace, necktie, needle, nest, newspaper, newsstand, nightshirt, nosebag(foranimals), noseband(foranimals), notebook, notepad, nut, nutcracker, oar, octopus(animal), octopus(food), oillamp, oliveoil, omelet, onion, orange(fruit), orangejuice, ostrich, ottoman, oven, overalls(clothing), owl, pacifier, packet, pad, paddle, padlock, paintbrush, painting, pajamas, palette, pan(forcooking), pan(metalcontainer), pancake, pantyhose, papaya, paperplate, papertowel, paperbackbook, paperweight, parachute, parakeet, parasail(sports), parasol, parchment, parka, parkingmeter, parrot, passengercar(partofatrain), passengership, passport, pastry, patty(food), pea(food), peach, peanutbutter, pear, peeler(toolforfruitandvegetables), pegboard, pelican, pen, pencil, pencilbox, pencilsharpener, pendulum, penguin, pennant, penny(coin), pepper, peppermill, perfume, persimmon, person, pet, pew(churchbench), phonebook, phonographrecord, piano, pickle, pickuptruck, pie, pigeon, piggybank, pillow, pin(nonjewelry), pineapple, pinecone, ping-pongball, pinwheel, pipe, pipebowl, pirateflag, pistol, pita(bread), pitcher(vesselforliquid), pitchfork, pizza, placemat, plasticbag, plate, platter, playpen, pliers, plow(farmequipment), plume, pocketwatch, pocketknife, poker(firestirringtool), pokerchip, polarbear, pole, policecruiser, poloshirt, poncho, pony, pooltable, pop(soda), popsicle, postbox(public), postcard, poster, pot, potato, potholder, pottery, pouch, powershovel, prawn, pretzel, printer, projectile(weapon), projector, propeller, prune, pudding, puffer(fish), puffin, pug-dog, pumpkin, puncher, puppet, puppy, quesadilla, quiche, quilt, rabbit, racecar, racket, radar, radiator, radioreceiver, radish, raft, ragdoll, railcar(partofatrain), raincoat, ram(animal), raspberry, rat, razorblade, reamer(juicer), rearviewmirror, receipt, recliner, recordplayer, reflector, refrigerator, remotecontrol, rhinoceros, rib(food), rifle, ring, riverboat, roadmap, robe, rockingchair, rodent, rollerskate, rollingpin, rootbeer, router(computerequipment), rubberband, runner(carpet), saddle(onananimal), saddleblanket, saddlebag, safetypin, sail, salad, saladplate, salami, salmon(fish), salmon(food), salsa, saltshaker, sandal(typeofshoe), sandwich, satchel, saucepan, saucer, sausage, sawhorse, saxophone, scale(measuringinstrument), scarecrow, scarf, schoolbus, scissors, scoreboard, scraper, screwdriver, scrubbingbrush, sculpture, seabird, seahorse, seaplane, seashell, sewingmachine, shaker, shampoo, shark, sharpener, shaver(electric), shavingcream, shawl, shears, sheep, shepherddog, sherbert, shield, shirt, shoe, shoppingbag, shoppingcart, shortpants, shotglass, shoulderbag, shovel, showercap, showercurtain, showerhead, shredder(forpaper), signboard, silo, sink, skateboard, skewer, ski, skiboot, skiparka, skipole, skirt, skullcap, sled, sleepingbag, slide, sling(bandage), slipper(footwear), smoothie, snake, snowboard, snowman, snowmobile, soap, soccerball, sock, sofa, sofabed, softball, solararray, sombrero, soup, soupbowl, soupspoon, sourcream, soyamilk, spaceshuttle, sparkler(fireworks), spatula, speaker(steroequipment), spear, spectacles, spicerack, spider, sponge, spoon, sportswear, spotlight, squid(food), squirrel, stagecoach, stapler(staplingmachine), starfish, statue(sculpture), steak(food), steakknife, steeringwheel, stepstool, stepladder, stereo(soundsystem), stew, stirrer, stirrup, stool, stopsign, stove, strainer, strap, straw(fordrinking), strawberry, streetsign, streetlight, stringcheese, stylus, subwoofer, sugarbowl, sugarcane(plant), suit(clothing), suitcase, sunflower, sunglasses, sunhat, surfboard, sushi, suspenders, sweatpants, sweatband, sweater, sweatshirt, sweetpotato, swimsuit, sword, syringe, table, table-tennistable, tablelamp, tablecloth, tachometer, taco, tag, taillight, tambourine, tank(storagevessel), tanktop(clothing), tape(stickyclothorpaper), tapemeasure, tapestry, tarp, tartan, tassel, teabag, teacup, teakettle, teapot, teddybear, telephone, telephonebooth, telephonepole, telephotolens, televisioncamera, televisionset, tennisball, tennisracket, tequila, thermometer, thermosbottle, thermostat, thimble, thread, thumbtack, tiara, tiger, tights(clothing), timer, tinfoil, tinsel, tissuepaper, toast(food), toaster, toasteroven, tobaccopipe, toilet, toilettissue, tomato, tongs, toolbox, toothbrush, toothpaste, toothpick, tortilla, totebag, towtruck, towel, towelrack, toy, tractor(farmequipment), trafficlight, trailertruck, train(railroadvehicle), trampoline, trashcan, tray, trenchcoat, triangle(musicalinstrument), tricycle, tripod, trophycup, trousers, truck, truffle(chocolate), trunk, turban, turkey(food), turnip, turtle, turtleneck(clothing), tux, typewriter, umbrella, underdrawers, underwear, unicycle, urinal, urn, vacuumcleaner, vase, vat, veil, vendingmachine, vent, vest, videotape, vinegar, violin, visor, vodka, volleyball, vulture, waffle, waffleiron, wagon, wagonwheel, walkingcane, walkingstick, wallclock, wallsocket, wallet, walrus, wardrobe, washbasin, watch, waterbottle, watercooler, waterfaucet, watergun, waterheater, waterjug, waterscooter, waterski, watertower, wateringcan, watermelon, weathervane, webcam, weddingcake, weddingring, wetsuit, wheel, wheelchair, whippedcream, whistle, wig, windchime, windmill, windowbox(forplants), windshieldwiper, windsock, winebottle, winebucket, wineglass, wok, wolf, woodenleg, woodenspoon, wreath, wrench, wristband, wristlet, yacht, yogurt, yoke(animal_equipment), zebra, zucchini.

License

Released under Creative Commons Attribution 4.0. When you use this data, please credit Gupta, Dollar, Girshick (CVPR 2019).

Source and attribution

This dataset is derived from LVIS, created by Gupta, Dollar, Girshick (CVPR 2019), originally licensed cc-by-4.0. We are grateful to the original authors. If you use this data, please cite the original source above.

Citation

@inproceedings{gupta2019lvis,
  title={LVIS: A Dataset for Large Vocabulary Instance Segmentation},
  author={Gupta, Agrim and Dollar, Piotr and Girshick, Ross},
  booktitle={CVPR},
  year={2019}
}

Published from [Pictograph](https://pictograph.io/datasets/pictograph-research/lvis-20k) - annotate, train, and deploy from one API.