Model-parallel layout maps for KerasHub LLMs
Designed model-parallel layout maps for KerasHub LLMs, from Gemma and Qwen to Llama and Mixtral; proposed upstream, not merged.
- Performance and inference
- Jul 2026
- Proposed, not merged
- short entry
Designed, with an offline check of real preset configs against mesh shapes; proposed as pull requests and not merged.
More in performance and inference
- Keras on PyTorch: compiled generation 11.6x fasterJul 2026 – Oct 2026
Traced why Keras on PyTorch ran about 9x slower than plain PyTorch, and merged the fixes upstream, one root cause each. · Google · Merged
- GLM-5.3-Flash on one GPU2 Sep 2026
Served a 181 GiB mixture-of-experts LLM from one 96 GiB GPU and took decoding from 10.8 to 15.0 tokens/s shipped, 16.5 at peak. · Independent · Published
- One call from a Keras model to a phone: LiteRT exportDec 2025 – Jul 2026
Built the LiteRT export path in Keras and KerasHub: a trained model to a phone-ready file in one call, on TensorFlow and PyTorch. · Google · Merged
- End-to-end UI tests for XProfAug 2026 – now
Wrote the end-to-end UI test suite for XProf, the open-source ML profiler, with 107 browser tests and a side-by-side check of two builds. · Google · Shipped