CoolFace
Modelpublic

qualcomm/FFNet-40S

sourceHugging Facebsd-3-clauseupdated 21h agoView on Hugging Face
5likes763downloads
Model Card

FFNet-40S: Optimized for Qualcomm Devices

FFNet-40S is a "fuss-free network" that segments street scene images with per-pixel classes like road, sidewalk, and pedestrian. Trained on the Cityscapes dataset.

This is based on the implementation of FFNet-40S found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

RuntimePrecisionChipsetSDK VersionsDownload
ONNXfloatUniversalQAIRT 2.50, ONNX Runtime 1.27.1Download
ONNXw8a8UniversalQAIRT 2.50, ONNX Runtime 1.27.1Download
QNN_DLCfloatUniversalQAIRT 2.50Download
QNN_DLCw8a8UniversalQAIRT 2.50Download
TFLITEfloatUniversalQAIRT 2.50Download
TFLITEw8a8UniversalQAIRT 2.50Download

For more device-specific assets and performance metrics, visit [FFNet-40S on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/ffnet_40s).

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • —Custom weights (e.g., fine-tuned checkpoints)
  • —Custom input shapes
  • —Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for FFNet-40S on GitHub for usage instructions.

Model Details

Model Type: Modelusecase.semantic_segmentation

Model Stats:

  • —Input resolution: 2048x1024
  • —Model checkpoint: ffnet40SdBBBcityscapesstatedict_quarts
  • —Model size (float): 53.1 MB
  • —Model size (w8a8): 13.5 MB
  • —Number of output classes: 19
  • —Number of parameters: 13.9M

Performance Summary

ModelRuntimePrecisionChipsetInference Time (ms)Peak Memory Range (MB)Primary Compute Unit
FFNet-40SONNXfloatSnapdragon® 8 Elite Gen 5 For Galaxy Mobile13.141 ms5 - 205 MBNPU
FFNet-40SONNXfloatSnapdragon® 8 Elite For Galaxy Mobile16.96 ms6 - 184 MBNPU
FFNet-40SONNXfloatSnapdragon® X2 Elite13.99 ms24 - 24 MBNPU
FFNet-40SONNXfloatSnapdragon® X Elite30.337 ms24 - 24 MBNPU
FFNet-40SONNXfloatSnapdragon® 8 Gen 3 Mobile25.16 ms31 - 288 MBNPU
FFNet-40SONNXfloatSnapdragon® 8 Gen 1 Mobile46.781 ms0 - 251 MBNPU
FFNet-40SONNXfloatQualcomm® Dragonwing™ IQ-827543.562 ms24 - 28 MBNPU
FFNet-40SONNXfloatQualcomm® Dragonwing™ QCS8550 (Proxy)31.418 ms24 - 340 MBNPU
FFNet-40SONNXfloatQualcomm® QCS845046.781 ms0 - 251 MBNPU
FFNet-40SONNXfloatQualcomm® Dragonwing™ IQ-907544.382 ms24 - 27 MBNPU
FFNet-40SONNXfloatQualcomm® Dragonwing™ IQ-X718130.337 ms24 - 24 MBNPU
FFNet-40SONNXfloatQualcomm® Dragonwing™ Q-875016.96 ms6 - 184 MBNPU
FFNet-40SONNXw8a8Snapdragon® 8 Elite Gen 5 For Galaxy Mobile3.535 ms1 - 190 MBNPU
FFNet-40SONNXw8a8Snapdragon® 8 Elite For Galaxy Mobile4.92 ms2 - 185 MBNPU
FFNet-40SONNXw8a8Snapdragon® X2 Elite3.897 ms7 - 7 MBNPU
FFNet-40SONNXw8a8Snapdragon® X Elite10.632 ms8 - 8 MBNPU
FFNet-40SONNXw8a8Snapdragon® 8 Gen 3 Mobile7.142 ms7 - 244 MBNPU
FFNet-40SONNXw8a8Snapdragon® 8 Gen 1 Mobile13.992 ms7 - 246 MBNPU
FFNet-40SONNXw8a8Qualcomm® Dragonwing™ QCS649043.023 ms6 - 9 MBNPU
FFNet-40SONNXw8a8Qualcomm® Dragonwing™ IQ-827510.439 ms6 - 10 MBNPU
FFNet-40SONNXw8a8Qualcomm® Dragonwing™ QCS8550 (Proxy)10.001 ms0 - 11 MBNPU
FFNet-40SONNXw8a8Qualcomm® QCS845013.992 ms7 - 246 MBNPU
FFNet-40SONNXw8a8Qualcomm® Dragonwing™ IQ-907511.63 ms6 - 9 MBNPU
FFNet-40SONNXw8a8Qualcomm® Dragonwing™ IQ-X718110.632 ms8 - 8 MBNPU
FFNet-40SONNXw8a8Qualcomm® Dragonwing™ Q-6690115.809 ms6 - 200 MBNPU
FFNet-40SONNXw8a8Qualcomm® Dragonwing™ Q-779014.667 ms7 - 204 MBNPU
FFNet-40SONNXw8a8Qualcomm® Dragonwing™ Q-87504.92 ms2 - 185 MBNPU
FFNet-40SONNXw8a8Snapdragon® 7 Gen 4 Mobile14.667 ms7 - 204 MBNPU
FFNet-40SQNN_DLCfloatSnapdragon® 8 Elite Gen 5 For Galaxy Mobile12.458 ms24 - 242 MBNPU
FFNet-40SQNN_DLCfloatSnapdragon® 8 Elite For Galaxy Mobile18.195 ms23 - 226 MBNPU
FFNet-40SQNN_DLCfloatSnapdragon® X2 Elite14.714 ms24 - 24 MBNPU
FFNet-40SQNN_DLCfloatSnapdragon® X Elite37.888 ms24 - 24 MBNPU
FFNet-40SQNN_DLCfloatSnapdragon® 8 Gen 3 Mobile25.889 ms24 - 282 MBNPU
FFNet-40SQNN_DLCfloatSnapdragon® 8 Gen 1 Mobile50.29 ms24 - 279 MBNPU
FFNet-40SQNN_DLCfloatQualcomm® Dragonwing™ IQ-827548.881 ms24 - 53 MBNPU
FFNet-40SQNN_DLCfloatQualcomm® Dragonwing™ QCS8550 (Proxy)36.545 ms24 - 256 MBNPU
FFNet-40SQNN_DLCfloatQualcomm® SA8775P49.213 ms24 - 210 MBNPU
FFNet-40SQNN_DLCfloatQualcomm® SA8650P49.213 ms24 - 210 MBNPU
FFNet-40SQNN_DLCfloatQualcomm® SA8255P49.213 ms24 - 210 MBNPU
FFNet-40SQNN_DLCfloatQualcomm® QCS845050.29 ms24 - 279 MBNPU
FFNet-40SQNN_DLCfloatQualcomm® Dragonwing™ IQ-907550.21 ms24 - 53 MBNPU
FFNet-40SQNN_DLCfloatQualcomm® Dragonwing™ IQ-X718137.888 ms24 - 24 MBNPU
FFNet-40SQNN_DLCfloatQualcomm® Dragonwing™ Q-875018.195 ms23 - 226 MBNPU
FFNet-40SQNN_DLCfloatQualcomm® SA8295P53.71 ms24 - 212 MBNPU
FFNet-40SQNN_DLCw8a8Snapdragon® 8 Elite Gen 5 For Galaxy Mobile5.382 ms6 - 222 MBNPU
FFNet-40SQNN_DLCw8a8Snapdragon® 8 Elite For Galaxy Mobile7.187 ms6 - 208 MBNPU
FFNet-40SQNN_DLCw8a8Snapdragon® X2 Elite6.286 ms6 - 6 MBNPU
FFNet-40SQNN_DLCw8a8Snapdragon® X Elite16.15 ms6 - 6 MBNPU
FFNet-40SQNN_DLCw8a8Snapdragon® 8 Gen 3 Mobile10.512 ms6 - 240 MBNPU
FFNet-40SQNN_DLCw8a8Snapdragon® 8 Gen 1 Mobile17.874 ms6 - 243 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® Dragonwing™ QCS649049.245 ms1 - 10 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® Dragonwing™ IQ-827515.011 ms1 - 11 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® Dragonwing™ QCS8550 (Proxy)15.184 ms6 - 8 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® SA8650P15.675 ms6 - 203 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® SA8255P15.675 ms6 - 203 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® QCS845017.874 ms6 - 243 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® Dragonwing™ IQ-907515.809 ms6 - 15 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® Dragonwing™ IQ-X718116.15 ms6 - 6 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® Dragonwing™ Q-6690127.295 ms6 - 194 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® Dragonwing™ Q-779019.129 ms6 - 206 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® Dragonwing™ Q-87507.187 ms6 - 208 MBNPU
FFNet-40SQNN_DLCw8a8Qualcomm® SA8295P20.138 ms6 - 196 MBNPU
FFNet-40SQNN_DLCw8a8Snapdragon® 7 Gen 4 Mobile19.129 ms6 - 206 MBNPU
FFNet-40STFLITEfloatSnapdragon® 8 Elite Gen 5 For Galaxy Mobile12.382 ms2 - 231 MBNPU
FFNet-40STFLITEfloatSnapdragon® 8 Elite For Galaxy Mobile18.086 ms1 - 216 MBNPU
FFNet-40STFLITEfloatSnapdragon® 8 Gen 3 Mobile26.184 ms2 - 297 MBNPU
FFNet-40STFLITEfloatSnapdragon® 8 Gen 1 Mobile49.909 ms2 - 294 MBNPU
FFNet-40STFLITEfloatQualcomm® Dragonwing™ IQ-827549.082 ms0 - 57 MBNPU
FFNet-40STFLITEfloatQualcomm® Dragonwing™ QCS8550 (Proxy)36.26 ms3 - 278 MBNPU
FFNet-40STFLITEfloatQualcomm® SA8775P49.221 ms2 - 202 MBNPU
FFNet-40STFLITEfloatQualcomm® SA8650P49.221 ms2 - 202 MBNPU
FFNet-40STFLITEfloatQualcomm® SA8255P49.221 ms2 - 202 MBNPU
FFNet-40STFLITEfloatQualcomm® QCS845049.909 ms2 - 294 MBNPU
FFNet-40STFLITEfloatQualcomm® Dragonwing™ IQ-907550.144 ms0 - 56 MBNPU
FFNet-40STFLITEfloatQualcomm® Dragonwing™ Q-875018.086 ms1 - 216 MBNPU
FFNet-40STFLITEfloatQualcomm® SA8295P53.94 ms0 - 201 MBNPU
FFNet-40STFLITEw8a8Snapdragon® 8 Elite Gen 5 For Galaxy Mobile3.06 ms1 - 214 MBNPU
FFNet-40STFLITEw8a8Snapdragon® 8 Elite For Galaxy Mobile4.018 ms0 - 202 MBNPU
FFNet-40STFLITEw8a8Snapdragon® 8 Gen 3 Mobile5.337 ms0 - 238 MBNPU
FFNet-40STFLITEw8a8Snapdragon® 8 Gen 1 Mobile9.417 ms1 - 239 MBNPU
FFNet-40STFLITEw8a8Qualcomm® Dragonwing™ QCS649033.14 ms1 - 24 MBNPU
FFNet-40STFLITEw8a8Qualcomm® Dragonwing™ IQ-82758.094 ms1 - 24 MBNPU
FFNet-40STFLITEw8a8Qualcomm® Dragonwing™ QCS8550 (Proxy)7.496 ms1 - 3 MBNPU
FFNet-40STFLITEw8a8Qualcomm® SA8650P8.267 ms1 - 197 MBNPU
FFNet-40STFLITEw8a8Qualcomm® SA8255P8.267 ms1 - 197 MBNPU
FFNet-40STFLITEw8a8Qualcomm® QCS84509.417 ms1 - 239 MBNPU
FFNet-40STFLITEw8a8Qualcomm® Dragonwing™ IQ-90758.045 ms1 - 24 MBNPU
FFNet-40STFLITEw8a8Qualcomm® Dragonwing™ Q-6690105.39 ms0 - 186 MBNPU
FFNet-40STFLITEw8a8Qualcomm® Dragonwing™ Q-779011.359 ms1 - 200 MBNPU
FFNet-40STFLITEw8a8Qualcomm® Dragonwing™ Q-87504.018 ms0 - 202 MBNPU
FFNet-40STFLITEw8a8Qualcomm® SA8295P11.725 ms0 - 190 MBNPU
FFNet-40STFLITEw8a8Snapdragon® 7 Gen 4 Mobile11.359 ms1 - 200 MBNPU

License

  • —The license for the original implementation of FFNet-40S can be found here.

References

Community