Llama 3.1 in KerasHub, and Gemma 3 fixes
Implemented Llama 3.1 in KerasHub and fixed Gemma 3 bugs, including a preprocessor crash across Gemma 3, 3n and 4.
- Performance and inference
- Apr 2025 – Jul 2026
- Merged
- short entry
Llama 3.1 landed in KerasHub in April 2025; Gemma 3 fixes followed for JAX index types and a preprocessor crash.
More in performance and inference
- Keras on PyTorch: compiled generation 11.6x fasterJul 2026 – Oct 2026
Traced why Keras on PyTorch ran about 9x slower than plain PyTorch, and merged the fixes upstream, one root cause each. · Google · Merged
- GLM-5.3-Flash on one GPU2 Sep 2026
Served a 181 GiB mixture-of-experts LLM from one 96 GiB GPU and took decoding from 10.8 to 15.0 tokens/s shipped, 16.5 at peak. · Independent · Published
- One call from a Keras model to a phone: LiteRT exportDec 2025 – Jul 2026
Built the LiteRT export path in Keras and KerasHub: a trained model to a phone-ready file in one call, on TensorFlow and PyTorch. · Google · Merged
- End-to-end UI tests for XProfAug 2026 – now
Wrote the end-to-end UI test suite for XProf, the open-source ML profiler, with 107 browser tests and a side-by-side check of two builds. · Google · Shipped