CoolFace
Modelpublic

qualcomm/DETR-ResNet101

sourceHugging Faceapache-2.0updated 11d agoView on Hugging Face
0likes1.9kdownloads
Model Card

DETR-ResNet101: Optimized for Qualcomm Devices

DETR is a machine learning model that can detect objects (trained on COCO dataset).

This is based on the implementation of DETR-ResNet101 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

RuntimePrecisionChipsetSDK VersionsDownload
ONNXfloatUniversalQAIRT 2.45, ONNX Runtime 1.27.1Download
ONNXw8a16mixedint16UniversalQAIRT 2.45, ONNX Runtime 1.27.1Download
QNN_DLCfloatUniversalQAIRT 2.45Download
QNN_DLCw8a16mixedint16UniversalQAIRT 2.45Download
TFLITEfloatUniversalQAIRT 2.45Download

For more device-specific assets and performance metrics, visit [DETR-ResNet101 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/detr_resnet101).

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for DETR-ResNet101 on GitHub for usage instructions.

Model Details

Model Type: Modelusecase.object_detection

Model Stats:

  • Input resolution: 480x480
  • Model checkpoint: ResNet101
  • Model size (float): 230 MB
  • Number of parameters: 60.3M

Performance Summary

ModelRuntimePrecisionChipsetInference Time (ms)Peak Memory Range (MB)Primary Compute Unit
DETR-ResNet101ONNXfloatSnapdragon® X2 Elite12.64 ms5 - 5 MBNPU
DETR-ResNet101ONNXfloatSnapdragon® X Elite24.808 ms115 - 115 MBNPU
DETR-ResNet101ONNXfloatSnapdragon® 8 Gen 3 Mobile18.38 ms0 - 453 MBNPU
DETR-ResNet101ONNXfloatSnapdragon® 8 Gen 1 Mobile49.626 ms1 - 362 MBNPU
DETR-ResNet101ONNXfloatQualcomm® Dragonwing™ IQ-827542.973 ms5 - 13 MBNPU
DETR-ResNet101ONNXfloatQualcomm® Dragonwing™ QCS8550 (Proxy)24.775 ms0 - 126 MBNPU
DETR-ResNet101ONNXfloatQualcomm® QCS845049.626 ms1 - 362 MBNPU
DETR-ResNet101ONNXfloatQualcomm® Dragonwing™ IQ-907539.121 ms5 - 12 MBNPU
DETR-ResNet101ONNXfloatQualcomm® Dragonwing™ IQ-X718124.808 ms115 - 115 MBNPU
DETR-ResNet101ONNXfloatQualcomm® Dragonwing™ Q-875014.546 ms3 - 330 MBNPU
DETR-ResNet101ONNXfloatSnapdragon® 8 Elite Mobile14.546 ms3 - 330 MBNPU
DETR-ResNet101ONNXfloatSnapdragon® 8 Elite Gen 5 Mobile11.804 ms3 - 342 MBNPU
DETR-ResNet101ONNXw8a16mixedint16Snapdragon® 8 Gen 3 Mobile48.287 ms13 - 464 MBNPU
DETR-ResNet101ONNXw8a16mixedint16Qualcomm® Dragonwing™ QCS8550 (Proxy)56.86 ms0 - 97 MBNPU
DETR-ResNet101ONNXw8a16mixedint16Qualcomm® Dragonwing™ Q-875042.265 ms13 - 314 MBNPU
DETR-ResNet101ONNXw8a16mixedint16Snapdragon® 8 Elite Mobile42.265 ms13 - 314 MBNPU
DETR-ResNet101ONNXw8a16mixedint16Snapdragon® 8 Elite Gen 5 Mobile34.07 ms13 - 362 MBNPU
DETR-ResNet101QNN_DLCfloatSnapdragon® X2 Elite12.699 ms5 - 5 MBNPU
DETR-ResNet101QNN_DLCfloatSnapdragon® X Elite27.048 ms5 - 5 MBNPU
DETR-ResNet101QNN_DLCfloatSnapdragon® 8 Gen 3 Mobile19.766 ms0 - 435 MBNPU
DETR-ResNet101QNN_DLCfloatSnapdragon® 8 Gen 1 Mobile54.73 ms3 - 342 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® Dragonwing™ IQ-827544.211 ms5 - 12 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® Dragonwing™ QCS8550 (Proxy)26.587 ms5 - 7 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® SA8775P41.148 ms1 - 318 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® SA8650P41.148 ms1 - 318 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® SA8255P41.148 ms1 - 318 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® QCS845054.73 ms3 - 342 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® Dragonwing™ IQ-907541.517 ms5 - 11 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® Dragonwing™ IQ-X718127.048 ms5 - 5 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® Dragonwing™ Q-875015.271 ms0 - 323 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® SA7255P138.019 ms0 - 317 MBNPU
DETR-ResNet101QNN_DLCfloatQualcomm® SA8295P43.204 ms0 - 233 MBNPU
DETR-ResNet101QNN_DLCfloatSnapdragon® 8 Elite Mobile15.271 ms0 - 323 MBNPU
DETR-ResNet101QNN_DLCfloatSnapdragon® 8 Elite Gen 5 Mobile11.052 ms5 - 345 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Snapdragon® X2 Elite14.161 ms2 - 2 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Snapdragon® X Elite26.067 ms2 - 2 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Snapdragon® 8 Gen 3 Mobile19.996 ms2 - 501 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ IQ-827525.76 ms2 - 7 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ QCS8550 (Proxy)25.163 ms2 - 381 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® SA8775P25.919 ms0 - 364 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® SA8650P25.919 ms0 - 364 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® SA8255P25.919 ms0 - 364 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ IQ-907526.292 ms2 - 6 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ IQ-X718126.067 ms2 - 2 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ Q-6690426.074 ms3 - 470 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ Q-779038.735 ms2 - 434 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ Q-875015.504 ms0 - 349 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Qualcomm® SA7255P65.653 ms2 - 366 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Snapdragon® 8 Elite Mobile15.504 ms0 - 349 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Snapdragon® 8 Elite Gen 5 Mobile11.846 ms2 - 446 MBNPU
DETR-ResNet101QNN_DLCw8a16mixedint16Snapdragon® 7 Gen 4 Mobile38.735 ms2 - 434 MBNPU
DETR-ResNet101TFLITEfloatSnapdragon® 8 Gen 3 Mobile19.822 ms0 - 497 MBNPU
DETR-ResNet101TFLITEfloatSnapdragon® 8 Gen 1 Mobile55.584 ms0 - 387 MBNPU
DETR-ResNet101TFLITEfloatQualcomm® Dragonwing™ IQ-827544.201 ms0 - 126 MBNPU
DETR-ResNet101TFLITEfloatQualcomm® Dragonwing™ QCS8550 (Proxy)26.458 ms0 - 3 MBNPU
DETR-ResNet101TFLITEfloatQualcomm® SA8775P41.253 ms0 - 367 MBNPU
DETR-ResNet101TFLITEfloatQualcomm® SA8650P41.253 ms0 - 367 MBNPU
DETR-ResNet101TFLITEfloatQualcomm® SA8255P41.253 ms0 - 367 MBNPU
DETR-ResNet101TFLITEfloatQualcomm® QCS845055.584 ms0 - 387 MBNPU
DETR-ResNet101TFLITEfloatQualcomm® Dragonwing™ IQ-907541.399 ms0 - 125 MBNPU
DETR-ResNet101TFLITEfloatQualcomm® Dragonwing™ Q-875015.296 ms0 - 375 MBNPU
DETR-ResNet101TFLITEfloatQualcomm® SA7255P138.144 ms0 - 367 MBNPU
DETR-ResNet101TFLITEfloatQualcomm® SA8295P43.292 ms0 - 275 MBNPU
DETR-ResNet101TFLITEfloatSnapdragon® 8 Elite Mobile15.296 ms0 - 375 MBNPU
DETR-ResNet101TFLITEfloatSnapdragon® 8 Elite Gen 5 Mobile11.095 ms0 - 392 MBNPU

License

  • The license for the original implementation of DETR-ResNet101 can be found here.

References

Community