Camera ML pipelines in C++

Detection, tracking and segmentation pipelines in C++ with INT8 quantization and pruning, and ML inside the native camera stack for a voice-controlled camera assistant.

  • Computer vision
  • Qualcomm
  • Sep 2024 – Jan 2025
  • Built
  • short entry

Camera pipelines for detection, tracking and segmentation, built in C++ for mobile, and Android demos of GPU, DSP and NPU delegation. Put ML inference inside the native camera stack for a camera assistant you control by voice.

More in computer vision

  • Reading damaged barcodes on phonesJul 2022 – Aug 2024

    Read 90%+ of damaged barcodes correctly on its damaged test set, where a commercial scanning SDK read 70%, with models trained on 10M+ synthetic images. · Samsung R&D Institute India · Built

  • Recognising many faces at once on edge devicesMar 2023 – Aug 2024

    A multi-face recognition engine at 99.2% accuracy and 30+ FPS on edge devices, with face search cut from 1,200 ms to 87 ms. · Samsung R&D Institute India · Shipped

  • Generative inpainting on a phone's NPU and DSPSep 2024 – Jan 2025

    Redesigned a generative inpainting feature, object removal and image completion, so its models fit NPU and DSP latency budgets for the Snapdragon Summit demo. · Qualcomm · Demo

  • Telling attention from distraction, with emotion recognitionSep 2023 – Nov 2023

    Detects whether a person at a screen is attentive or distracted, at 87% accuracy; checks across frames cut false alarms by 40%. · Samsung R&D Institute India · Shipped