CoolFace
Apppublic

vaibhavmalhotra-ai/yoga-pose-recognition

sourceHugging Facemitupdated 3mo agoView on Hugging Face
0likes
App README

๐Ÿง˜ Yoga Pose Recognition

Powered by CNN, Transfer Learning & Explainable AI.

Upload a yoga pose image and the model identifies the posture, then optionally reveals how it made that decision using Grad-CAM.

What it does

  • โ€”Pose prediction โ€” a fine-tuned ResNet50 classifies the uploaded image into one of the trained yoga pose classes, with a confidence score.
  • โ€”Explainability (Grad-CAM) โ€” click "Yes, Show Me!" to see which regions of the image the model focused on, via a Grad-CAM heatmap and a blended focus overlay.

Color guide for the heatmap

  • โ€”๐Ÿ”ด Red โ†’ strongest attention
  • โ€”๐ŸŸก Yellow โ†’ important region
  • โ€”๐Ÿ”ต Blue โ†’ less important region

Tech stack

  • โ€”Model: ResNet50 (transfer learning) saved as resnet50_best.keras
  • โ€”Explainability: Grad-CAM (Gradient-weighted Class Activation Mapping)
  • โ€”Interface: Gradio
  • โ€”Image processing: OpenCV, Pillow, NumPy

Author

Vaibhav Malhotra