CoolFace
Modelpublic

qualcomm/DETR-ResNet50

sourceHugging Faceapache-2.0updated 10d agoView on Hugging Face
1likes1.6kdownloads
Model Card

DETR-ResNet50: Optimized for Qualcomm Devices

DETR is a machine learning model that can detect objects (trained on COCO dataset).

This is based on the implementation of DETR-ResNet50 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

RuntimePrecisionChipsetSDK VersionsDownload
ONNXfloatUniversalQAIRT 2.45, ONNX Runtime 1.27.1Download
ONNXw8a16mixedfp16UniversalQAIRT 2.45, ONNX Runtime 1.27.1Download
QNN_DLCfloatUniversalQAIRT 2.45Download
TFLITEfloatUniversalQAIRT 2.45Download

For more device-specific assets and performance metrics, visit [DETR-ResNet50 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/detr_resnet50).

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for DETR-ResNet50 on GitHub for usage instructions.

Model Details

Model Type: Modelusecase.object_detection

Model Stats:

  • Input resolution: 480x480
  • Model checkpoint: ResNet50
  • Model size (float): 158 MB
  • Number of parameters: 41.4M

Performance Summary

ModelRuntimePrecisionChipsetInference Time (ms)Peak Memory Range (MB)Primary Compute Unit
DETR-ResNet50ONNXfloatSnapdragon® X2 Elite8.242 ms5 - 5 MBNPU
DETR-ResNet50ONNXfloatSnapdragon® X Elite17.971 ms78 - 78 MBNPU
DETR-ResNet50ONNXfloatSnapdragon® 8 Gen 3 Mobile13.419 ms5 - 374 MBNPU
DETR-ResNet50ONNXfloatSnapdragon® 8 Gen 1 Mobile36.007 ms1 - 318 MBNPU
DETR-ResNet50ONNXfloatQualcomm® Dragonwing™ IQ-827529.042 ms5 - 13 MBNPU
DETR-ResNet50ONNXfloatQualcomm® Dragonwing™ QCS8550 (Proxy)17.775 ms0 - 94 MBNPU
DETR-ResNet50ONNXfloatQualcomm® QCS845036.007 ms1 - 318 MBNPU
DETR-ResNet50ONNXfloatQualcomm® Dragonwing™ IQ-907527.57 ms4 - 12 MBNPU
DETR-ResNet50ONNXfloatQualcomm® Dragonwing™ IQ-X718117.971 ms78 - 78 MBNPU
DETR-ResNet50ONNXfloatQualcomm® Dragonwing™ Q-87509.975 ms3 - 271 MBNPU
DETR-ResNet50ONNXfloatSnapdragon® 8 Elite Mobile9.975 ms3 - 271 MBNPU
DETR-ResNet50ONNXfloatSnapdragon® 8 Elite Gen 5 Mobile7.436 ms2 - 317 MBNPU
DETR-ResNet50ONNXw8a16mixedfp16Snapdragon® 8 Gen 3 Mobile39.415 ms6 - 351 MBNPU
DETR-ResNet50ONNXw8a16mixedfp16Qualcomm® Dragonwing™ IQ-827568.232 ms16 - 19 MBNPU
DETR-ResNet50ONNXw8a16mixedfp16Qualcomm® Dragonwing™ QCS8550 (Proxy)50.417 ms16 - 21 MBNPU
DETR-ResNet50ONNXw8a16mixedfp16Qualcomm® QCS845097.068 ms7 - 466 MBNPU
DETR-ResNet50ONNXw8a16mixedfp16Qualcomm® Dragonwing™ IQ-907551.175 ms16 - 19 MBNPU
DETR-ResNet50ONNXw8a16mixedfp16Qualcomm® Dragonwing™ Q-875033.662 ms15 - 275 MBNPU
DETR-ResNet50ONNXw8a16mixedfp16Snapdragon® 8 Elite Mobile33.662 ms15 - 275 MBNPU
DETR-ResNet50ONNXw8a16mixedfp16Snapdragon® 8 Elite Gen 5 Mobile28.229 ms15 - 283 MBNPU
DETR-ResNet50QNN_DLCfloatSnapdragon® X2 Elite8.917 ms5 - 5 MBNPU
DETR-ResNet50QNN_DLCfloatSnapdragon® X Elite19.561 ms5 - 5 MBNPU
DETR-ResNet50QNN_DLCfloatSnapdragon® 8 Gen 3 Mobile13.7 ms2 - 357 MBNPU
DETR-ResNet50QNN_DLCfloatSnapdragon® 8 Gen 1 Mobile41.417 ms5 - 303 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® Dragonwing™ IQ-827527.712 ms5 - 12 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® Dragonwing™ QCS8550 (Proxy)19.181 ms5 - 7 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® SA8775P26.853 ms1 - 300 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® SA8650P26.853 ms1 - 300 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® SA8255P26.853 ms1 - 300 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® QCS845041.417 ms5 - 303 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® Dragonwing™ IQ-907527.178 ms7 - 13 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® Dragonwing™ IQ-X718119.561 ms5 - 5 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® Dragonwing™ Q-875010.448 ms0 - 273 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® SA7255P86.011 ms1 - 268 MBNPU
DETR-ResNet50QNN_DLCfloatQualcomm® SA8295P31.185 ms0 - 224 MBNPU
DETR-ResNet50QNN_DLCfloatSnapdragon® 8 Elite Mobile10.448 ms0 - 273 MBNPU
DETR-ResNet50QNN_DLCfloatSnapdragon® 8 Elite Gen 5 Mobile7.898 ms5 - 290 MBNPU
DETR-ResNet50TFLITEfloatSnapdragon® 8 Gen 3 Mobile13.771 ms0 - 390 MBNPU
DETR-ResNet50TFLITEfloatSnapdragon® 8 Gen 1 Mobile41.717 ms0 - 327 MBNPU
DETR-ResNet50TFLITEfloatQualcomm® Dragonwing™ IQ-827527.739 ms0 - 89 MBNPU
DETR-ResNet50TFLITEfloatQualcomm® Dragonwing™ QCS8550 (Proxy)19.235 ms0 - 2 MBNPU
DETR-ResNet50TFLITEfloatQualcomm® SA8775P26.917 ms0 - 323 MBNPU
DETR-ResNet50TFLITEfloatQualcomm® SA8650P26.917 ms0 - 323 MBNPU
DETR-ResNet50TFLITEfloatQualcomm® SA8255P26.917 ms0 - 323 MBNPU
DETR-ResNet50TFLITEfloatQualcomm® QCS845041.717 ms0 - 327 MBNPU
DETR-ResNet50TFLITEfloatQualcomm® Dragonwing™ IQ-907527.256 ms0 - 88 MBNPU
DETR-ResNet50TFLITEfloatQualcomm® Dragonwing™ Q-875010.497 ms0 - 302 MBNPU
DETR-ResNet50TFLITEfloatQualcomm® SA7255P86.011 ms0 - 293 MBNPU
DETR-ResNet50TFLITEfloatQualcomm® SA8295P31.092 ms0 - 247 MBNPU
DETR-ResNet50TFLITEfloatSnapdragon® 8 Elite Mobile10.497 ms0 - 302 MBNPU
DETR-ResNet50TFLITEfloatSnapdragon® 8 Elite Gen 5 Mobile8.047 ms0 - 313 MBNPU

License

  • The license for the original implementation of DETR-ResNet50 can be found here.

References

Community