Other
PyTorch
bu_auto
android

BEVDet: Optimized for Qualcomm Devices

BEVDet is a machine learning model for generating a birds eye view represenation from the sensors(cameras) mounted on a vehicle.

This is based on the implementation of BEVDet found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.50, ONNX Runtime 1.27.1 Download
ONNX mixed_with_float Universal QAIRT 2.50, ONNX Runtime 1.27.1 Download
QNN_DLC float Universal QAIRT 2.50 Download
QNN_DLC mixed_with_float Universal QAIRT 2.50 Download
TFLITE float Universal QAIRT 2.50 Download

For more device-specific assets and performance metrics, visit BEVDet on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for BEVDet on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.driver_assistance

Model Stats:

  • Input resolution: 1 x 6 x 3 x 256 x 704
  • Model checkpoint: bevdet-r50.pth
  • Model size: 171 MB
  • Number of parameters: 44M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
decoder ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 5.112 ms 3 - 148 MB NPU
decoder ONNX float Snapdragon® 8 Elite For Galaxy Mobile 7.258 ms 3 - 146 MB NPU
decoder ONNX float Snapdragon® X2 Elite 6.262 ms 4 - 4 MB NPU
decoder ONNX float Snapdragon® X Elite 11.898 ms 34 - 34 MB NPU
decoder ONNX float Snapdragon® 8 Gen 3 Mobile 8.763 ms 0 - 169 MB NPU
decoder ONNX float Snapdragon® 8 Gen 1 Mobile 22.474 ms 0 - 166 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ IQ-8275 25.601 ms 4 - 12 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.531 ms 0 - 37 MB NPU
decoder ONNX float Qualcomm® QCS8450 22.474 ms 0 - 166 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ IQ-9075 23.009 ms 4 - 11 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ IQ-X7181 11.898 ms 34 - 34 MB NPU
decoder ONNX float Qualcomm® Dragonwing™ Q-8750 7.258 ms 3 - 146 MB NPU
decoder ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 2.857 ms 3 - 156 MB NPU
decoder ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 3.829 ms 4 - 154 MB NPU
decoder ONNX mixed_with_float Snapdragon® X2 Elite 3.715 ms 8 - 8 MB NPU
decoder ONNX mixed_with_float Snapdragon® X Elite 6.212 ms 16 - 16 MB NPU
decoder ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 4.652 ms 0 - 195 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-8275 8.145 ms 5 - 9 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.982 ms 5 - 7 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-9075 7.007 ms 5 - 8 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 6.212 ms 16 - 16 MB NPU
decoder ONNX mixed_with_float Qualcomm® Dragonwing™ Q-8750 3.829 ms 4 - 154 MB NPU
decoder QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 5.102 ms 4 - 150 MB NPU
decoder QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 7.196 ms 4 - 146 MB NPU
decoder QNN_DLC float Snapdragon® X2 Elite 6.64 ms 4 - 4 MB NPU
decoder QNN_DLC float Snapdragon® X Elite 12.156 ms 4 - 4 MB NPU
decoder QNN_DLC float Snapdragon® 8 Gen 3 Mobile 8.746 ms 4 - 172 MB NPU
decoder QNN_DLC float Snapdragon® 8 Gen 1 Mobile 22.186 ms 0 - 167 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 25.444 ms 4 - 12 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.484 ms 4 - 13 MB NPU
decoder QNN_DLC float Qualcomm® SA8650P 23.121 ms 1 - 148 MB NPU
decoder QNN_DLC float Qualcomm® SA8255P 23.121 ms 1 - 148 MB NPU
decoder QNN_DLC float Qualcomm® QCS8450 22.186 ms 0 - 167 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 23.596 ms 6 - 13 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 12.156 ms 4 - 4 MB NPU
decoder QNN_DLC float Qualcomm® Dragonwing™ Q-8750 7.196 ms 4 - 146 MB NPU
decoder QNN_DLC float Qualcomm® SA8295P 24.722 ms 0 - 137 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 2.835 ms 4 - 155 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 3.862 ms 0 - 148 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® X2 Elite 4.167 ms 4 - 4 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® X Elite 6.468 ms 4 - 4 MB NPU
decoder QNN_DLC mixed_with_float Snapdragon® 8 Gen 3 Mobile 4.607 ms 0 - 192 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-8275 7.911 ms 4 - 12 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 6.003 ms 4 - 6 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-9075 6.731 ms 4 - 11 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 6.468 ms 4 - 4 MB NPU
decoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ Q-8750 3.862 ms 0 - 148 MB NPU
decoder TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 4.995 ms 1 - 148 MB NPU
decoder TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 7.236 ms 1 - 149 MB NPU
decoder TFLITE float Snapdragon® 8 Gen 3 Mobile 8.754 ms 1 - 204 MB NPU
decoder TFLITE float Snapdragon® 8 Gen 1 Mobile 22.297 ms 1 - 201 MB NPU
decoder TFLITE float Qualcomm® Dragonwing™ IQ-8275 25.643 ms 1 - 47 MB NPU
decoder TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 11.771 ms 1 - 4 MB NPU
decoder TFLITE float Qualcomm® SA8650P 23.126 ms 1 - 153 MB NPU
decoder TFLITE float Qualcomm® SA8255P 23.126 ms 1 - 153 MB NPU
decoder TFLITE float Qualcomm® QCS8450 22.297 ms 1 - 201 MB NPU
decoder TFLITE float Qualcomm® Dragonwing™ IQ-9075 23.414 ms 1 - 46 MB NPU
decoder TFLITE float Qualcomm® Dragonwing™ Q-8750 7.236 ms 1 - 149 MB NPU
decoder TFLITE float Qualcomm® SA7255P 463.717 ms 2 - 33 MB GPU
decoder TFLITE float Qualcomm® SA8295P 24.737 ms 1 - 141 MB NPU
encoder ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 21.013 ms 4 - 309 MB NPU
encoder ONNX float Snapdragon® 8 Elite For Galaxy Mobile 25.39 ms 6 - 298 MB NPU
encoder ONNX float Snapdragon® X2 Elite 23.287 ms 12 - 12 MB NPU
encoder ONNX float Snapdragon® X Elite 41.394 ms 39 - 39 MB NPU
encoder ONNX float Snapdragon® 8 Gen 3 Mobile 30.227 ms 1 - 391 MB NPU
encoder ONNX float Snapdragon® 8 Gen 1 Mobile 71.098 ms 1 - 318 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-8275 67.891 ms 12 - 29 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 42.338 ms 13 - 15 MB NPU
encoder ONNX float Qualcomm® QCS8450 71.098 ms 1 - 318 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-9075 64.359 ms 12 - 28 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ IQ-X7181 41.394 ms 39 - 39 MB NPU
encoder ONNX float Qualcomm® Dragonwing™ Q-8750 25.39 ms 6 - 298 MB NPU
encoder ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 22.289 ms 13 - 888 MB NPU
encoder ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 25.004 ms 13 - 824 MB NPU
encoder ONNX mixed_with_float Snapdragon® X2 Elite 21.324 ms 17 - 17 MB NPU
encoder ONNX mixed_with_float Snapdragon® X Elite 34.037 ms 22 - 22 MB NPU
encoder ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 30.759 ms 26 - 964 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-8275 37.355 ms 12 - 27 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 37.811 ms 18 - 21 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-9075 37.807 ms 12 - 27 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 34.037 ms 22 - 22 MB NPU
encoder ONNX mixed_with_float Qualcomm® Dragonwing™ Q-8750 25.004 ms 13 - 824 MB NPU
encoder QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 19.84 ms 8 - 314 MB NPU
encoder QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 25.346 ms 0 - 289 MB NPU
encoder QNN_DLC float Snapdragon® X2 Elite 22.556 ms 12 - 12 MB NPU
encoder QNN_DLC float Snapdragon® X Elite 42.241 ms 12 - 12 MB NPU
encoder QNN_DLC float Snapdragon® 8 Gen 3 Mobile 33.727 ms 12 - 403 MB NPU
encoder QNN_DLC float Snapdragon® 8 Gen 1 Mobile 70.052 ms 5 - 312 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 67.563 ms 12 - 30 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 42.697 ms 13 - 380 MB NPU
encoder QNN_DLC float Qualcomm® SA8650P 64.989 ms 0 - 306 MB NPU
encoder QNN_DLC float Qualcomm® SA8255P 64.989 ms 0 - 306 MB NPU
encoder QNN_DLC float Qualcomm® QCS8450 70.052 ms 5 - 312 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 64.454 ms 14 - 31 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 42.241 ms 12 - 12 MB NPU
encoder QNN_DLC float Qualcomm® Dragonwing™ Q-8750 25.346 ms 0 - 289 MB NPU
encoder QNN_DLC float Qualcomm® SA8295P 72.112 ms 0 - 210 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 7.119 ms 0 - 254 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 8.796 ms 0 - 221 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® X2 Elite 8.574 ms 12 - 12 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® X Elite 16.301 ms 12 - 12 MB NPU
encoder QNN_DLC mixed_with_float Snapdragon® 8 Gen 3 Mobile 11.235 ms 12 - 305 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-8275 15.512 ms 12 - 30 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 15.775 ms 12 - 14 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-9075 16.661 ms 12 - 29 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 16.301 ms 12 - 12 MB NPU
encoder QNN_DLC mixed_with_float Qualcomm® Dragonwing™ Q-8750 8.796 ms 0 - 221 MB NPU
encoder TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 20.512 ms 24 - 341 MB NPU
encoder TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 25.243 ms 24 - 325 MB NPU
encoder TFLITE float Snapdragon® 8 Gen 3 Mobile 34.584 ms 24 - 448 MB NPU
encoder TFLITE float Snapdragon® 8 Gen 1 Mobile 68.92 ms 25 - 377 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ IQ-8275 68.584 ms 20 - 110 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 41.075 ms 25 - 27 MB NPU
encoder TFLITE float Qualcomm® SA8650P 67.313 ms 25 - 353 MB NPU
encoder TFLITE float Qualcomm® SA8255P 67.313 ms 25 - 353 MB NPU
encoder TFLITE float Qualcomm® QCS8450 68.92 ms 25 - 377 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ IQ-9075 65.056 ms 24 - 113 MB NPU
encoder TFLITE float Qualcomm® Dragonwing™ Q-8750 25.243 ms 24 - 325 MB NPU
encoder TFLITE float Qualcomm® SA7255P 1807.573 ms 25 - 35 MB CPU
encoder TFLITE float Qualcomm® SA8295P 66.616 ms 25 - 253 MB NPU
pooler ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 18.469 ms 278 - 286 MB CPU
pooler ONNX float Snapdragon® 8 Elite For Galaxy Mobile 21.389 ms 277 - 285 MB CPU
pooler ONNX float Snapdragon® X2 Elite 16.57 ms 284 - 284 MB CPU
pooler ONNX float Snapdragon® X Elite 101.801 ms 283 - 283 MB CPU
pooler ONNX float Snapdragon® 8 Gen 3 Mobile 23.994 ms 280 - 289 MB CPU
pooler ONNX float Snapdragon® 8 Gen 1 Mobile 35.323 ms 276 - 291 MB CPU
pooler ONNX float Qualcomm® Dragonwing™ IQ-8275 65.258 ms 274 - 278 MB CPU
pooler ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 27.738 ms 275 - 278 MB CPU
pooler ONNX float Qualcomm® QCS8450 35.323 ms 276 - 291 MB CPU
pooler ONNX float Qualcomm® Dragonwing™ IQ-9075 30.984 ms 277 - 281 MB CPU
pooler ONNX float Qualcomm® Dragonwing™ IQ-X7181 101.801 ms 283 - 283 MB CPU
pooler ONNX float Qualcomm® Dragonwing™ Q-8750 21.389 ms 277 - 285 MB CPU
pooler ONNX mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 18.449 ms 302 - 310 MB CPU
pooler ONNX mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 26.382 ms 279 - 287 MB CPU
pooler ONNX mixed_with_float Snapdragon® X2 Elite 17.817 ms 284 - 284 MB CPU
pooler ONNX mixed_with_float Snapdragon® X Elite 92.307 ms 283 - 283 MB CPU
pooler ONNX mixed_with_float Snapdragon® 8 Gen 3 Mobile 24.449 ms 282 - 293 MB CPU
pooler ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-8275 62.235 ms 274 - 278 MB CPU
pooler ONNX mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 27.234 ms 279 - 282 MB CPU
pooler ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-9075 33.633 ms 277 - 281 MB CPU
pooler ONNX mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 92.307 ms 283 - 283 MB CPU
pooler ONNX mixed_with_float Qualcomm® Dragonwing™ Q-8750 26.382 ms 279 - 287 MB CPU
pooler QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 218.676 ms 4 - 13 MB CPU
pooler QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 184.565 ms 4 - 17 MB CPU
pooler QNN_DLC float Snapdragon® X2 Elite 334.477 ms 3 - 3 MB CPU
pooler QNN_DLC float Snapdragon® X Elite 389.598 ms 4 - 4 MB CPU
pooler QNN_DLC float Snapdragon® 8 Gen 3 Mobile 163.506 ms 4 - 13 MB CPU
pooler QNN_DLC float Snapdragon® 8 Gen 1 Mobile 222.451 ms 3 - 19 MB CPU
pooler QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 369.034 ms 269 - 736 MB CPU
pooler QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 191.997 ms 2 - 6 MB CPU
pooler QNN_DLC float Qualcomm® SA8650P 308.633 ms 4 - 17 MB CPU
pooler QNN_DLC float Qualcomm® SA8255P 308.633 ms 4 - 17 MB CPU
pooler QNN_DLC float Qualcomm® QCS8450 222.451 ms 3 - 19 MB CPU
pooler QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 329.782 ms 270 - 737 MB CPU
pooler QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 389.598 ms 4 - 4 MB CPU
pooler QNN_DLC float Qualcomm® Dragonwing™ Q-8750 184.565 ms 4 - 17 MB CPU
pooler QNN_DLC float Qualcomm® SA8295P 304.737 ms 4 - 16 MB CPU
pooler QNN_DLC mixed_with_float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 218.932 ms 4 - 14 MB CPU
pooler QNN_DLC mixed_with_float Snapdragon® 8 Elite For Galaxy Mobile 184.118 ms 4 - 14 MB CPU
pooler QNN_DLC mixed_with_float Snapdragon® X2 Elite 313.376 ms 3 - 3 MB CPU
pooler QNN_DLC mixed_with_float Snapdragon® X Elite 293.567 ms 3 - 3 MB CPU
pooler QNN_DLC mixed_with_float Snapdragon® 8 Gen 3 Mobile 166.395 ms 4 - 13 MB CPU
pooler QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-8275 373.076 ms 269 - 736 MB CPU
pooler QNN_DLC mixed_with_float Qualcomm® Dragonwing™ QCS8550 (Proxy) 194.376 ms 3 - 7 MB CPU
pooler QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-9075 349.568 ms 270 - 738 MB CPU
pooler QNN_DLC mixed_with_float Qualcomm® Dragonwing™ IQ-X7181 293.567 ms 3 - 3 MB CPU
pooler QNN_DLC mixed_with_float Qualcomm® Dragonwing™ Q-8750 184.118 ms 4 - 14 MB CPU
pooler TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 47.217 ms 127 - 140 MB CPU
pooler TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 52.435 ms 126 - 138 MB CPU
pooler TFLITE float Snapdragon® 8 Gen 3 Mobile 51.333 ms 126 - 137 MB CPU
pooler TFLITE float Snapdragon® 8 Gen 1 Mobile 81.735 ms 129 - 143 MB CPU
pooler TFLITE float Qualcomm® Dragonwing™ IQ-8275 129.85 ms 127 - 321 MB CPU
pooler TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 70.401 ms 128 - 130 MB CPU
pooler TFLITE float Qualcomm® SA8650P 90.951 ms 130 - 136 MB CPU
pooler TFLITE float Qualcomm® SA8255P 90.951 ms 130 - 136 MB CPU
pooler TFLITE float Qualcomm® QCS8450 81.735 ms 129 - 143 MB CPU
pooler TFLITE float Qualcomm® Dragonwing™ IQ-9075 99.299 ms 127 - 320 MB CPU
pooler TFLITE float Qualcomm® Dragonwing™ Q-8750 52.435 ms 126 - 138 MB CPU
pooler TFLITE float Qualcomm® SA7255P 113.04 ms 116 - 125 MB CPU
pooler TFLITE float Qualcomm® SA8295P 93.578 ms 128 - 133 MB CPU

License

  • The license for the original implementation of BEVDet can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Paper for qualcomm/BEVDet