Datasetpublic

Hula0401/test_bench

CAD Synthesis Benchmark — test_bench Small-scale benchmark for image → CadQuery code generation. Task: Given rendered views of an industrial part, generate CadQuery code that reproduces it. Evaluation: Execute code → export STEP → compute IoU vs GT STEP. Splits Split Families Description test-iid 54 train families, XY plane In-distribution test test-ood-family 19 held-out families Family generalization test-ood-plane 54 train families, XZ/YZ View… See the full description on the dataset page: https://huggingface.co/datasets/Hula0401/test_bench.

sourceHugging Facecc-by-4.0updated 5mo agoView on Hugging Face

0likes37downloads

rootREADME.md

README.md66 linesDownload Raw Back to root

1---2license: cc-by-4.03task_categories:4- image-to-3d5- text-generation6tags:7- cad8- cadquery9- synthetic10- benchmark11size_categories:12- 1K<n<10K13---14 15# CAD Synthesis Benchmark — test_bench16 17Small-scale benchmark for **image → CadQuery code** generation.18 19**Task**: Given rendered views of an industrial part, generate CadQuery code that reproduces it.20 21**Evaluation**: Execute code → export STEP → compute IoU vs GT STEP.22 23## Splits24 25| Split | Families | Description |26|-------|----------|-------------|27| `test-iid` | 54 train families, XY plane | In-distribution test |28| `test-ood-family` | 19 held-out families | Family generalization |29| `test-ood-plane` | 54 train families, XZ/YZ | View generalization |30 31OOD families: `bellows`, `worm_screw`, `torus_link`, `impeller`, `propeller`,32`chair`, `table`, `snap_clip`, `waffle_plate`, `wire_grid`, `mesh_panel`,33`t_pipe_fitting`, `pipe_elbow`, `duct_elbow`, `dome_cap`, `capsule`,34`coil_spring`, `bucket`, `nozzle`35 36## Sample Fields (bench_manifest.jsonl)37 38```json39{40  "stem": "synth_handwheel_000042_s9999",41  "family": "handwheel",42  "difficulty": "easy",43  "base_plane": "XY",44  "split": "test-iid",45  "feature_tags": {"has_hole": true, "has_fillet": false, "has_chamfer": false},46  "feature_count": 1,47  "ops_used": ["circle", "extrude", "union", "cut"],48  "gt_code_path": "data/test-iid/synth_handwheel_000042_s9999/code.py",49  "gt_step_path": "data/test-iid/synth_handwheel_000042_s9999/gen.step",50  "composite_png": "data/test-iid/synth_handwheel_000042_s9999/views/composite.png"51}52```53 54## Metrics55 56- `exec_ok`: code executes (0/1)57- `iou`: voxel IoU vs GT STEP58- `feature_f1`: F1 of feature_tags (hole/fillet/chamfer/slot)59- `detail_score`: `0.4 × iou + 0.6 × feature_f1` (primary ranking metric)60 61## Generation62 63- Pipeline: `cad_synth` (73 families, parametric, multi-plane)64- Seed: 9999 (held out from training seed 1337)65- Rendered: 4-view normalized PNGs + 2×2 composite66