X-Humanoid/ArtVIP

ArtVIP dataset card

    

🎉🎉🎉 ArtVIP is accepted by ICLR 2026

Key Features

✅ 476 high-quality digital-twin articulated objects. [image]

<div align="center" style="display: grid; grid-template-columns: repeat(2, 1fr); gap: 20px; margin: 2rem 0;">

<!-- Digital Twin Scenes --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="./assets/digitaltwinscences.gif" width="100%" alt="Digital Twin Scenes"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> ✅ 6 pre-configured digital-twin scenes, 6 user-defined scenes </p> </div>

<!-- Reusable Modular Interaction --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="./assets/Magnetic_attraction.gif" width="100%" alt="Modular Interaction"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> ✅ Reusable Modular interaction </p> </div>

<!-- Physics Fidelity --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="assets/chair.gif" width="100%" alt="Physics Fidelity"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> ✅ Physics fidelity </p> </div>

<!-- Pixel-level Affordance Annotations --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="assets/Seg_chair.gif" width="100%" alt="Affordance Annotations"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> ✅ Pixel-level affordance annotations </p> </div>

</div>****

Version History

Click here to view historical versions

Dataset Information

Description

Click here for a detailed dataset description and full video introduction.

Dataset Structure

1. 1.Articulated objects

Click here for the introduction to Articulated objects. The specific modular-interaction types:

<div align="center" style="display: grid; grid-template-columns: repeat(3, 1fr); gap: 20px; margin: 2rem 0;"> <!-- Modular Interaction GIF 1 --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="assets/modular-interaction/DampingEffectcabinet.gif" width="100%" alt="Modular Interaction 1"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> DampingEffectcabinet </p> </div>

<!-- Modular Interaction GIF 2 --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="assets/modular-interaction/MagneticEffectdishwasher.gif" width="100%" alt="Modular Interaction 2"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> MagneticEffectdishwasher </p> </div>

<!-- Modular Interaction GIF 3 --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="assets/modular-interaction/TriggerInteractionstable2.gif" width="100%" alt="Modular Interaction 3"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> TriggerInteractions_table </p> </div>

<!-- Modular Interaction GIF 4 --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="assets/modular-interaction/DampingEffectcabint2.gif" width="100%" alt="Modular Interaction 4"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> DampingEffect_cabint </p> </div>

<!-- Modular Interaction GIF 5 --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="assets/modular-interaction/MagneticEffectrefrigerator.gif" width="100%" alt="Modular Interaction 5"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> MagneticEffectrefrigerator </p> </div>

<!-- Modular Interaction GIF 6 --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="assets/modular-interaction/TriggerInteractionstrashcan.gif" width="100%" alt="Modular Interaction 6"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> TriggerInteractionstrashcan </p> </div> </div>

1. 1.Scenes

2.1 Digital Twin Scenes

📁 `ArtVIP/Secenes` contains 6 user-defined digital-twin scenes.

• —📘 Introduction to Digital-Twin Scenes

2.2 Interactive_scene

📁 `ArtVIP/Interactive_scene` contains 6 pre-configured Interactive scenes.

• —📘 Introduction to Interactive scenes

<div align="center" style="display: grid; grid-template-columns: repeat(2, 1fr); gap: 20px; margin: 2rem 0;">

<!-- Kitchen Scene --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="./assets/kitchen-open.gif" width="100%" alt="Kitchen Scene"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> 🔪 Kitchen Scene Interaction </p> </div> <!-- Small Living Room Scene --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="./assets/smalllivingroom_open.gif" width="100%" alt="Small Living Room Scene"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> 📺 Small Living Room Interaction </p> </div>

<!-- Kitchenwithparlor Scene --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="./assets/parloropen.gif" width="100%" alt="Parlor Scene"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> 🛋️ Parlor Scene Interaction </p> </div> <!-- Bedroom Scene --> <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);"> <img src="./assets/bedroomopen.gif" width="100%" alt="Bedroom Scene"> <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;"> 🛏️ Bedroom Scene Interaction </p> </div>

</div>

How to use

• —This version is compatible with Isaac-Sim 5.0

1. 1.Install Isaac Sim 5.0

• —Official Documentation: https://docs.isaacsim.omniverse.nvidia.com/latest/installation/quick-install.html

• —Linux Version Download: https://download.isaacsim.omniverse.nvidia.com/isaac-sim-standalone-5.0.0-linux-x86_64.zip

• —Installation steps:

   # Create installation directory
   mkdir ~/isaacsim
   
   # Unzip package (assuming downloaded to ~/Downloads)
   cd ~/Downloads
   unzip "isaac-sim-standalone-5.0.0-linux-x86_64.zip" -d ~/isaacsim
   
   # Run post-installation setup
   cd ~/isaacsim
   ./post_install.sh
   
   # Launch Isaac Sim
   ./isaac-sim.selector.sh

### Examples

**Interaction Demo**:

1. Locate the scene file: `/Interactive_scene/kitchen/Interactive_kitchen.usd`

2. Open in Isaac Sim and click ▶️ PLAY
  
3. **Force Application**:
  
   - Hold `SHIFT + Left Click` and drag to apply external forces (highlighted in green in the demonstration image)
 <!-- ![Oven Articulation](./assets/open_oven.png)  -->

<div align="center" style="display: grid; grid-template-columns: repeat(2, 1fr); gap: 20px; margin: 2rem 0;">

  <!-- Door Opening -->
  <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);">
    <video controls muted playsinline width="100%">
      <source src="https://huggingface.co/datasets/x-humanoid-robomind/ArtVIP/resolve/main/assets/open_door.mp4" type="video/mp4">
    </video>
    <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;">
      🚪 Door Operation
    </p>
  </div>

  <!-- Light Switch -->
  <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);">
    <video controls muted playsinline width="100%">
      <source src="https://huggingface.co/datasets/x-humanoid-robomind/ArtVIP/resolve/main/assets/turn_on.mp4" type="video/mp4">
    </video>
    <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;">
      💡 Light Switch Activation
    </p>
  </div>

  <!-- Oven Operation -->
  <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);">
    <video controls muted playsinline width="100%">
      <source src="https://huggingface.co/datasets/x-humanoid-robomind/ArtVIP/resolve/main/assets/oven_open.mp4" type="video/mp4">
    </video>
    <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;">
      🔥 Microwave Interaction
    </p>
  </div>

  <!-- Refrigerator Demo -->
  <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);">
    <video controls muted playsinline width="100%">
      <source src="https://huggingface.co/datasets/x-humanoid-robomind/ArtVIP/resolve/main/assets/open_fridge.mp4" type="video/mp4">
    </video>
    <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;">
      ❄️ Refrigerator Interaction
    </p>
  </div>
</div>

 **Full Object Interactivity**:

 <div align="center" style="display: grid; grid-template-columns: repeat(2, 1fr); gap: 20px; margin: 2rem 0;">
  <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);">
    <img src="./assets/Kitchen_interactive.gif" width="100%" alt="Kitchen Scene Example">
    <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;">
      🍳 Kitchen Interaction Showcase
    </p>
  </div>
  <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);">
    <img src="./assets/interactive_largelivingroom.gif" width="100%" alt="Bedroom Scene Example">
    <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;">
      🛋️ livingroom Interaction Showcase
    </p>
  </div>
    <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);">
    <img src="./assets/interactive_childrenroom.gif" width="100%" alt="childrenroom Scene Example">
    <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;">
      🧸 childrenroom Interaction Showcase
    </p>
  </div>
    <div style="border-radius: 8px; overflow: hidden; box-shadow: 0 4px 12px rgba(0,0,0,0.1);">
    <img src="./assets/Interactive_kitchen_with_parlor.gif" width="100%" alt="Bedroom Scene Example">
    <p style="text-align: center; margin: 8px 0; font-size: 0.9em; color: #666;">
      🍽️ kitchen_with_parlor Interaction Showcase
    </p>
  </div>
</div>