RosettaDecoder/Rosetta-Decoder
0
1---2title: Rosetta Decoder3emoji: π4colorFrom: gray5colorTo: yellow6sdk: gradio7sdk_version: 6.0.18app_file: app.py9pinned: false10short_description: Detect & Translate hieroglyphics11tags:12 - building-mcp-track-creative13 - building-mcp-track-consumer14 - mcp-in-action-track-creative15 - mcp-in-action-track-consumer16 - mcp-server17---18 19 20# π Egyptian Hieroglyph Detector (MCP Server)21 22This project bridges the gap between ancient history and modern AI Agents. It provides an **MCP Server** that allows Ai Agents to "see" and identify Hieroglyphs in any image.23 24## π₯ Team25 26- **[youkii-xr](https://huggingface.co/youkii-xr)** β XR Developer, did the MCP and Gradio part<br> [](https://www.linkedin.com/in/youkii-xr/)27- **[MariamEssam204](https://huggingface.co/MariamEssam204)** β AI Engineer, did the AI model part <br> [](https://www.linkedin.com/in/mariam-essam-ai-engineer/)28 29## π₯ Demo Video30 31| Gradio App V2 | Mobile Camera Test | MCP Server |32| :---: | :---: | :---: |33| [](https://youtu.be/nnQnNfJtSWM) | [](https://youtu.be/wZKBVYAZwZ4) | [](https://youtu.be/Vvlu6sDzsBE) |34 35 36π **Social Media Post:** 37[[Gradio App - V2](https://www.linkedin.com/posts/youkii-xr_our-hieroglyphic-ai-detector-just-got-a-major-activity-7400855950632411136-5Z9Y?utm_source=social_share_send&utm_medium=member_desktop_web&rcm=ACoAADSn0yMBo1MdVldbeoL5OxUZo2-CMJKUKOM)]<br>38[[Mobile camera test](https://www.linkedin.com/posts/mariam-essam-ai-engineer_productdevelopment-dataaugmentation-realtimeai-activity-7400635609570205696-a9JN?utm_source=social_share_send&utm_medium=member_desktop_web&rcm=ACoAADSn0yMBo1MdVldbeoL5OxUZo2-CMJKUKOM)]<br>39[[Gradio App - V1](https://www.linkedin.com/posts/mariam-essam-ai-engineer_machinelearning-computervision-ai-activity-7400193629241143296-sWvC?utm_source=social_share_send&utm_medium=member_desktop_web&rcm=ACoAADSn0yMBo1MdVldbeoL5OxUZo2-CMJKUKOM)]<br>40[[MCP Server - V1](https://www.linkedin.com/posts/youkii-xr_huggingface-mcp-ai-activity-7400474001891819520-tTa3?utm_source=social_share_send&utm_medium=member_desktop_web&rcm=ACoAADSn0yMBo1MdVldbeoL5OxUZo2-CMJKUKOM)]41 42## ποΈ Capabilities & Tools43 44#### Hieroglyphs Detection:45* trained on 400+ different glyphs46* able to detect with high confidence47 48#### Translation49* **Mystical prophecy** : translates for tourists and non-academics as a story50* **Academic Translation** : a linguistics breakdown of symbols and their meaning and how they fit together51 52#### Analytics53* **Spatial Heatmaps** : visualizes where glyphs are clustered on the wall / papyrus54* **Confidence Charts** : Shows how sure the AI is about every symbol55* **Frequency Analysis** : Counts the occurrence of distinguished symbols56 57#### Digital Encyclopedia58* Includes a searchable database of supported Gardiner Codes with descriptions and transliteration59 60#### Downloadable Results61* Download the detection result with bounding boxes surrounding each glyph on the wall / papyrus62* Download glyphs gallery as a zip containing all glyphs detected individually cropped63 64## πAvailable MCP Tools65When connected to Claude Desktop, this server exposes **4 specific tools** that allow the Agent to perform the full archaeological pipeline:66 67#### `detect glyphs`68* **Description:** Scans an input image to find hieroglyphs.69* **Returns:** A path to the annotated image (boxes drawn) and a JSON object containing the list of found codes and confidence scores.70 71#### `translate story`72* **Description:** Takes a list of Gardiner codes or keywords and interprets them.73* **Returns:** Two distinct texts: a "Mystical Story" (creative interpretation) and an "Academic Translation" (scientific interpretation).74 75#### `get stats`76* **Description:** Takes the detection data and generates visual reports.77* **Returns:** A path to an image file containing charts for Symbol Frequency, Confidence Levels, and Spatial Heatmaps.78 79#### `list codes`80* **Description:** Provides access to the full internal database of Egyptian hieroglyphs.81* **Returns:** The complete dictionary of supported Gardiner codes, descriptions, and categories.82 83## π How to Use (Claude Desktop)84 85You can connect this tool to your own Claude Desktop right now!86 87### Prerequisites88 89- **Claude Desktop** installed.90- **Node.js** & **Python** installed.91- **Gradio MCP:** Run `pip install "gradio[mcp]"`β92 93### Configuration94 95Add this to your `%APPDATA%\Claude\claude_desktop_config.json` (Windows) or `~/Library/Application Support/Claude/claude_desktop_config.json` (Mac):96 97```98{99 "mcpServers": {100 "gradio": {101 "command": "npx",102 "args": [103 "mcp-remote",104 "https://mcp-1st-birthday-rosetta-decoder.hf.space/gradio_api/mcp/",105 "--transport",106 "streamable-http"107 ]108 },109 "upload_helper": {110 "command": "C:\\Python313\\python.exe",111 "args": [112 "-m",113 "gradio",114 "upload-mcp",115 "https://mcp-1st-birthday-rosetta-decoder.hf.space/",116 "C:\\Claude_Work"117 ]118 }119 }120}121```122 123 *(Note: Change* *β`C:\\Claude_Work`β*β *to the actual folder where you keep your images)*124 125## 𧩠Technical Architecture126 127- **Framework:** Gradio 6.0.0 (with native MCP support)128- **Model:** Ultralytics YOLOv8 (Private Weights)129- **Storage:** Hugging Face Hub 130- **Protocol:** Model Context Protocol (MCP) via SSE (Server-Sent Events)131 132 133 134*Built with β€οΈ for the Hugging Face MCP Hackathon 2025*135