pctablet505
Work / Performance and inference

Faster Exynos NPU inference

Optimized models for the Exynos NPU with TensorFlow Lite, for 2.5x faster inference.

  • Performance and inference
  • Samsung R&D Institute India
  • Built
  • short entry
2.5x
faster inference
○ reported, from my LinkedIn

More in performance and inference

  • Keras on PyTorch: compiled generation 11.6x fasterJul 2026 – Oct 2026

    Traced why Keras on PyTorch ran about 9x slower than plain PyTorch, and merged the fixes upstream, one root cause each. · Google · Merged

  • GLM-5.3-Flash on one GPU2 Sep 2026

    Served a 181 GiB mixture-of-experts LLM from one 96 GiB GPU and took decoding from 10.8 to 15.0 tokens/s shipped, 16.5 at peak. · Independent · Published

  • One call from a Keras model to a phone: LiteRT exportDec 2025 – Jul 2026

    Built the LiteRT export path in Keras and KerasHub: a trained model to a phone-ready file in one call, on TensorFlow and PyTorch. · Google · Merged

  • End-to-end UI tests for XProfAug 2026 – now

    Wrote the end-to-end UI test suite for XProf, the open-source ML profiler, with 107 browser tests and a side-by-side check of two builds. · Google · Shipped