CoolFace
Modelpublic

qualcomm/FastSam-S

sourceHugging Faceagpl-3.0updated 11d agoView on Hugging Face
10likes1.2kdownloads
Model Card

FastSam-S: Optimized for Qualcomm Devices

The Fast Segment Anything Model (FastSAM) is a novel, real-time CNN-based solution for the Segment Anything task. This task is designed to segment any object within an image based on various possible user interaction prompts. The model performs competitively despite significantly reduced computation, making it a practical choice for a variety of vision tasks.

This is based on the implementation of FastSam-S found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for FastSam-S on GitHub for usage instructions.

Model Details

Model Type: Modelusecase.semantic_segmentation

Model Stats:

  • Inference latency: RealTime
  • Input resolution: 640x640
  • Model checkpoint: fastsam-s.pt
  • Model size (float): 45.1 MB
  • Number of parameters: 11.8M

Performance Summary

ModelRuntimePrecisionChipsetInference Time (ms)Peak Memory Range (MB)Primary Compute Unit
FastSam-SONNXfloatSnapdragon® X2 Elite4.561 ms17 - 17 MBNPU
FastSam-SONNXfloatSnapdragon® X Elite8.469 ms20 - 20 MBNPU
FastSam-SONNXfloatSnapdragon® 8 Gen 3 Mobile5.983 ms17 - 246 MBNPU
FastSam-SONNXfloatSnapdragon® 8 Gen 1 Mobile16.649 ms17 - 239 MBNPU
FastSam-SONNXfloatQualcomm® Dragonwing™ IQ-827513.231 ms15 - 19 MBNPU
FastSam-SONNXfloatQualcomm® Dragonwing™ QCS8550 (Proxy)8.193 ms0 - 26 MBNPU
FastSam-SONNXfloatQualcomm® QCS845016.649 ms17 - 239 MBNPU
FastSam-SONNXfloatQualcomm® Dragonwing™ IQ-907511.971 ms15 - 18 MBNPU
FastSam-SONNXfloatQualcomm® Dragonwing™ IQ-X71818.469 ms20 - 20 MBNPU
FastSam-SONNXfloatQualcomm® Dragonwing™ Q-87504.682 ms13 - 214 MBNPU
FastSam-SONNXfloatSnapdragon® 8 Elite Mobile4.682 ms13 - 214 MBNPU
FastSam-SONNXfloatSnapdragon® 8 Elite Gen 5 Mobile3.645 ms3 - 212 MBNPU
FastSam-SONNXw8a16Snapdragon® X2 Elite3.138 ms9 - 9 MBNPU
FastSam-SONNXw8a16Snapdragon® X Elite7.096 ms10 - 10 MBNPU
FastSam-SONNXw8a16Snapdragon® 8 Gen 3 Mobile4.383 ms8 - 264 MBNPU
FastSam-SONNXw8a16Snapdragon® 8 Gen 1 Mobile11.616 ms0 - 256 MBNPU
FastSam-SONNXw8a16Qualcomm® Dragonwing™ QCS649028.302 ms8 - 10 MBNPU
FastSam-SONNXw8a16Qualcomm® Dragonwing™ IQ-82756.446 ms8 - 11 MBNPU
FastSam-SONNXw8a16Qualcomm® Dragonwing™ QCS8550 (Proxy)6.654 ms0 - 15 MBNPU
FastSam-SONNXw8a16Qualcomm® QCS845011.616 ms0 - 256 MBNPU
FastSam-SONNXw8a16Qualcomm® Dragonwing™ IQ-90757.056 ms8 - 11 MBNPU
FastSam-SONNXw8a16Qualcomm® Dragonwing™ IQ-X71817.096 ms10 - 10 MBNPU
FastSam-SONNXw8a16Qualcomm® Dragonwing™ Q-669070.156 ms8 - 266 MBNPU
FastSam-SONNXw8a16Qualcomm® Dragonwing™ Q-77909.135 ms8 - 229 MBNPU
FastSam-SONNXw8a16Qualcomm® Dragonwing™ Q-87503.298 ms0 - 217 MBNPU
FastSam-SONNXw8a16Snapdragon® 8 Elite Mobile3.298 ms0 - 217 MBNPU
FastSam-SONNXw8a16Snapdragon® 8 Elite Gen 5 Mobile2.686 ms0 - 223 MBNPU
FastSam-SONNXw8a16Snapdragon® 7 Gen 4 Mobile9.135 ms8 - 229 MBNPU
FastSam-SONNXw8a16mixedint16Snapdragon® X2 Elite4.434 ms9 - 9 MBNPU
FastSam-SONNXw8a16mixedint16Snapdragon® X Elite9.069 ms21 - 21 MBNPU
FastSam-SONNXw8a16mixedint16Snapdragon® 8 Gen 3 Mobile5.807 ms8 - 270 MBNPU
FastSam-SONNXw8a16mixedint16Qualcomm® Dragonwing™ IQ-82758.411 ms8 - 11 MBNPU
FastSam-SONNXw8a16mixedint16Qualcomm® Dragonwing™ QCS8550 (Proxy)8.6 ms0 - 24 MBNPU
FastSam-SONNXw8a16mixedint16Qualcomm® Dragonwing™ IQ-90758.773 ms8 - 10 MBNPU
FastSam-SONNXw8a16mixedint16Qualcomm® Dragonwing™ IQ-X71819.069 ms21 - 21 MBNPU
FastSam-SONNXw8a16mixedint16Qualcomm® Dragonwing™ Q-6690108.165 ms10 - 269 MBNPU
FastSam-SONNXw8a16mixedint16Qualcomm® Dragonwing™ Q-779013.022 ms8 - 234 MBNPU
FastSam-SONNXw8a16mixedint16Qualcomm® Dragonwing™ Q-87504.769 ms6 - 226 MBNPU
FastSam-SONNXw8a16mixedint16Snapdragon® 8 Elite Mobile4.769 ms6 - 226 MBNPU
FastSam-SONNXw8a16mixedint16Snapdragon® 8 Elite Gen 5 Mobile3.635 ms2 - 230 MBNPU
FastSam-SONNXw8a16mixedint16Snapdragon® 7 Gen 4 Mobile13.022 ms8 - 234 MBNPU
FastSam-SQNN_DLCfloatSnapdragon® X2 Elite4.595 ms5 - 5 MBNPU
FastSam-SQNN_DLCfloatSnapdragon® X Elite8.443 ms5 - 5 MBNPU
FastSam-SQNN_DLCfloatSnapdragon® 8 Gen 3 Mobile5.841 ms0 - 211 MBNPU
FastSam-SQNN_DLCfloatSnapdragon® 8 Gen 1 Mobile16.156 ms5 - 212 MBNPU
FastSam-SQNN_DLCfloatQualcomm® Dragonwing™ IQ-827512.875 ms5 - 16 MBNPU
FastSam-SQNN_DLCfloatQualcomm® Dragonwing™ QCS8550 (Proxy)7.705 ms5 - 11 MBNPU
FastSam-SQNN_DLCfloatQualcomm® SA8775P11.593 ms1 - 182 MBNPU
FastSam-SQNN_DLCfloatQualcomm® SA8650P11.593 ms1 - 182 MBNPU
FastSam-SQNN_DLCfloatQualcomm® SA8255P11.593 ms1 - 182 MBNPU
FastSam-SQNN_DLCfloatQualcomm® QCS845016.156 ms5 - 212 MBNPU
FastSam-SQNN_DLCfloatQualcomm® Dragonwing™ IQ-907511.56 ms5 - 15 MBNPU
FastSam-SQNN_DLCfloatQualcomm® Dragonwing™ IQ-X71818.443 ms5 - 5 MBNPU
FastSam-SQNN_DLCfloatQualcomm® Dragonwing™ Q-87504.457 ms5 - 195 MBNPU
FastSam-SQNN_DLCfloatQualcomm® SA7255P39.219 ms0 - 186 MBNPU
FastSam-SQNN_DLCfloatQualcomm® SA8295P13.764 ms0 - 178 MBNPU
FastSam-SQNN_DLCfloatSnapdragon® 8 Elite Mobile4.457 ms5 - 195 MBNPU
FastSam-SQNN_DLCfloatSnapdragon® 8 Elite Gen 5 Mobile3.257 ms4 - 195 MBNPU
FastSam-SQNN_DLCw8a16Snapdragon® X2 Elite2.883 ms2 - 2 MBNPU
FastSam-SQNN_DLCw8a16Snapdragon® X Elite6.126 ms2 - 2 MBNPU
FastSam-SQNN_DLCw8a16Snapdragon® 8 Gen 3 Mobile3.784 ms2 - 233 MBNPU
FastSam-SQNN_DLCw8a16Snapdragon® 8 Gen 1 Mobile8.478 ms2 - 234 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® Dragonwing™ QCS649023.707 ms2 - 8 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® Dragonwing™ IQ-82755.57 ms1 - 8 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® Dragonwing™ QCS8550 (Proxy)5.476 ms2 - 4 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® SA8775P5.994 ms1 - 195 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® SA8650P5.994 ms1 - 195 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® SA8255P5.994 ms1 - 195 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® QCS84508.478 ms2 - 234 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® Dragonwing™ IQ-90755.784 ms2 - 8 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® Dragonwing™ IQ-X71816.126 ms2 - 2 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® Dragonwing™ Q-669065.604 ms2 - 203 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® Dragonwing™ Q-77907.64 ms2 - 200 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® Dragonwing™ Q-87502.666 ms0 - 198 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® SA7255P13.396 ms1 - 194 MBNPU
FastSam-SQNN_DLCw8a16Qualcomm® SA8295P7.918 ms0 - 192 MBNPU
FastSam-SQNN_DLCw8a16Snapdragon® 8 Elite Mobile2.666 ms0 - 198 MBNPU
FastSam-SQNN_DLCw8a16Snapdragon® 8 Elite Gen 5 Mobile2.106 ms2 - 205 MBNPU
FastSam-SQNN_DLCw8a16Snapdragon® 7 Gen 4 Mobile7.64 ms2 - 200 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Snapdragon® X2 Elite4.284 ms2 - 2 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Snapdragon® X Elite8.173 ms2 - 2 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Snapdragon® 8 Gen 3 Mobile5.199 ms2 - 242 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ IQ-82757.451 ms0 - 7 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ QCS8550 (Proxy)7.408 ms2 - 4 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® SA8775P7.678 ms1 - 200 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® SA8650P7.678 ms1 - 200 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® SA8255P7.678 ms1 - 200 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ IQ-90757.426 ms0 - 6 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ IQ-X71818.173 ms2 - 2 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ Q-6690112.443 ms2 - 219 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ Q-779010.827 ms2 - 211 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® Dragonwing™ Q-87504.16 ms2 - 202 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Qualcomm® SA7255P20.652 ms2 - 199 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Snapdragon® 8 Elite Mobile4.16 ms2 - 202 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Snapdragon® 8 Elite Gen 5 Mobile3.114 ms2 - 207 MBNPU
FastSam-SQNN_DLCw8a16mixedint16Snapdragon® 7 Gen 4 Mobile10.827 ms2 - 211 MBNPU
FastSam-STFLITEfloatSnapdragon® 8 Gen 3 Mobile5.174 ms0 - 113 MBNPU
FastSam-STFLITEfloatSnapdragon® 8 Gen 1 Mobile14.125 ms4 - 233 MBNPU
FastSam-STFLITEfloatQualcomm® Dragonwing™ IQ-827511.943 ms4 - 40 MBNPU
FastSam-STFLITEfloatQualcomm® Dragonwing™ QCS8550 (Proxy)6.972 ms0 - 3 MBNPU
FastSam-STFLITEfloatQualcomm® SA8775P10.703 ms4 - 90 MBNPU
FastSam-STFLITEfloatQualcomm® SA8650P10.703 ms4 - 90 MBNPU
FastSam-STFLITEfloatQualcomm® SA8255P10.703 ms4 - 90 MBNPU
FastSam-STFLITEfloatQualcomm® QCS845014.125 ms4 - 233 MBNPU
FastSam-STFLITEfloatQualcomm® Dragonwing™ IQ-907510.473 ms4 - 39 MBNPU
FastSam-STFLITEfloatQualcomm® Dragonwing™ Q-87503.959 ms3 - 100 MBNPU
FastSam-STFLITEfloatQualcomm® SA7255P37.806 ms4 - 86 MBNPU
FastSam-STFLITEfloatQualcomm® SA8295P13.042 ms4 - 195 MBNPU
FastSam-STFLITEfloatSnapdragon® 8 Elite Mobile3.959 ms3 - 100 MBNPU
FastSam-STFLITEfloatSnapdragon® 8 Elite Gen 5 Mobile3.121 ms0 - 90 MBNPU

License

  • The license for the original implementation of FastSam-S can be found here.

References

Community