Apppublic

build-small-hackathon/visual-lineage

sourceHugging Faceopenrail++updated 3mo agoView on Hugging Face

2likes

App README

Visual Lineage

A 23andMe for imagined instruments.

Blend culturally-sourced instrument LoRAs trained on FLUX.2 klein (4B), generate hybrid instrument images with full provenance tracking, and convert them to 3D meshes for printing.

How it works

1.Harvest — We source legally-clear (CC0/CC-BY/Public domain) images of culturally specific instruments from Wikimedia Commons and Openverse.
2.Train LoRAs — Each instrument gets its own LoRA (350MB) trained on FLUX.2 klein via Modal (A10G GPU).
3.Compose — In this Gradio app, pick any two instruments, set a blend ratio, and describe your imagined hybrid.
4.Prove ancestry — Every generation shows a provenance record: which LoRAs were blended, at what weights, with what prompt and seed.
5.Convert to 3D — Download the image and use the included ComfyUI workflows (Tripo API / TripoSR) to generate a 3D mesh for CAD → 3D printing.

Published LoRAs

Instrument	Trigger	HF Hub
Eritrean krar (bowl lyre)	`ERTRN_KRAR`	build-small-hackathon/visual-lineage-eritrean_krar_v1
Korean gayageum (zither)	`KR_GAYAGEUM`	build-small-hackathon/visual-lineage-korean_gayageum_v1
Berimbau (capoeira bow)	`BR_BERIMBAU`	build-small-hackathon/visual-lineage-berimbau_v1

Tech Stack

Layer	Tool	Notes
Base model	FLUX.2 klein (4B)	Under 32B cap
LoRA training	ai-toolkit on Modal	A10G GPU, ~2h per LoRA
Dataset curation	Wikimedia Commons + Openverse APIs	Automated harvest pipeline
Inference	HF Spaces (zero-a10g) + diffusers	Live generation
UI	Gradio 6	Sage/cream design
3D conversion	ComfyUI + Tripo API / TripoSR	Workflows included in repo
Code repo	github.com/projectmehari/visual-lineage	Private
Demo video	youtu.be/N_8F6Zqfll0
Social post	x.com/verymehari/status/2066638252161859695
Agent instructions	`curl https://huggingface.co/spaces/build-small-hackathon/visual-lineage/raw/main/agents.md`

ComfyUI 3D Workflows

Located in comfy_workflows/ of the repo:

—tripo_api_image_to_3d.json — Tripo cloud API (bring your own API key)
—triposr_image_to_3d.json — Local TripoSR (experimental, requires full VAE)

Build Small Hackathon

This project was built for the Build Small hackathon (June 2026).

Track: Backyard AI — practical, problem-solving apps built to improve daily life.

What it does: Allows musicians, instrument makers, and tinkerers to visually explore hybrid instrument designs by blending the visual DNA of culturally significant instruments, then export those designs toward 3D printing — bridging AI generation with physical fabrication.

Sustainability: Each LoRA is only 350MB. The base model (FLUX.2 klein at 4B parameters) runs well on consumer GPUs. The entire pipeline from dataset harvest to training to inference uses open-source tools and runs on accessible hardware.