dvinix/navora
0
๐งญ Navora - AI Navigation Assistant for the Blind
Real-time assistive vision system providing navigation guidance for blind and visually impaired users.
โจ Features
AI-Powered Detection
- YOLOv8 โ Real-time object detection
- BLIP-2 โ Scene understanding and description
- MiDaS โ Depth estimation (GPU only)
Accessibility Features
- ๐ฏ Visual Feedback โ Thin bounding boxes around detected objects
- ๐ฃ๏ธ Voice Guidance โ Clear audio navigation instructions
- ๐ข Scene Description โ Automatic description when standing still
- ๐ณ Haptic Feedback โ Vibration patterns for different obstacles
- ๐จ Smart Alerts โ Context-aware, non-repetitive announcements
๐ How to Use
On Mobile Device
- Open this Space on your mobile browser
- Allow camera access (uses back camera)
- Point camera at your path
- Receive real-time guidance:
- Voice: Spoken navigation instructions
- Vibration: Tactile feedback for obstacles
- Visual: Bounding boxes (for sighted assistants)
Navigation Actions
- Forward โฌ๏ธ โ Path is clear, move forward
- Stop ๐ โ Obstacle directly ahead
- Left โฌ ๏ธ โ Obstacle on right, move left
- Right โก๏ธ โ Obstacle on left, move right
Scene Description
- Stand still for 5 seconds
- System automatically describes surroundings
- Example: "5 objects detected: 2 persons, 1 car, 1 bicycle"
๐ฏ Obstacle Detection
The system prioritizes obstacles based on:
- Position โ Center obstacles are highest priority
- Confidence โ Higher confidence = more reliable
- Type โ People, vehicles prioritized over static objects
- Size โ Larger objects get more attention
๐ง Technical Details
Architecture
Camera โ YOLOv8 Detection โ Priority Analysis โ Navigation Guidance
โ
Voice + Vibration + VisualPerformance
- Inference: ~1-2 seconds per frame (CPU)
- Frame Rate: ~1-2 FPS (optimized for battery)
- Model Size: 6MB (YOLOv8n)
- Accuracy: 45%+ confidence threshold
Optimizations
- CPU-optimized model selection
- Adaptive frame rate
- Smart alert deduplication
- Low battery mode support
๐ฑ Mobile Compatibility
Works on:
- โ iOS Safari (iPhone/iPad)
- โ Android Chrome
- โ Android Firefox
- โ ๏ธ Requires HTTPS for camera access
๐ Privacy
- All processing happens on server
- No video storage
- No user tracking
- Session data cleared after 2 minutes
๐ง Limitations
- Requires internet connection
- Works best in good lighting
- May struggle with:
- Very dark environments
- Fast movement
- Very crowded scenes
- Reflective surfaces
๐ฎ Future Enhancements
- ๐ฑ Mobile app with offline capability
- ๐ Night vision mode
- ๐บ๏ธ Landmark recognition
- ๐จ Emergency SOS feature
- ๐ค Voice commands
- ๐ Spatial audio (3D sound)
๐ Documentation
- Accessibility Features
- Implementation Guide
- Mobile Edge Deployment
๐ค Contributing
Feedback from blind users is invaluable! Please test and share your experience.
๐ License
MIT License - Free to use and modify
