Developer tools
17 updates on Developer tools.
Gemini Nano 4 ships on Samsung foldables with ML Kit Prompt API access
Google says Samsung’s new foldables carry Gemini Nano 4 with support for more than 140 languages, reachable from apps through ML Kit’s Prompt API.
Apple ships Python bindings for the on-device Foundation Models framework
The apple-fm-sdk package calls the on-device Apple Intelligence model from Python on macOS 26, for scripting and batch evaluation outside Swift.
ExecuTorch 1.0 reaches general availability for on-device PyTorch models
The PyTorch edge runtime promotes Core ML, Qualcomm Hexagon, Arm Ethos-U, Vulkan and XNNPACK backends to production status.
lm-Meter times on-device inference and finds prefill, not decode, is the bottleneck
A profiler that runs inside the phone measures each inference phase and reports prefill slowing 158 times as models grow, against 10 times for decode.
Apple opens its on-device model to all apps with the Foundation Models framework
Any app can call the roughly 3-billion-parameter on-device model from Swift, offline and free of charge, with guided generation and tool calling.
Flower Intelligence runs models on device, with remote handoff off by default
Flower Labs released a preview library that runs Llama 3.2 and SmolLM2 locally via WebLLM or MLX Swift, and calls its remote service only if an app enables it.
Meta ships Llama Stack with Swift and Kotlin clients for on-device inference
Meta standardised its Llama APIs so mobile apps can swap a cloud endpoint for an on-device ExecuTorch runtime without changing the calling code.
Google ships an experimental MediaPipe LLM Inference API for web, Android and iOS
The experimental API runs Gemma 2B, Phi 2, Falcon 1B and Stable LM 3B fully on device, with int8 and int4 weights.
Qualcomm AI Hub opens 75 pre-optimised models and profiling on hosted Snapdragon phones
Qualcomm opened a library of more than 75 models tuned for Snapdragon, with compilation and profiling on real phones in its cloud and two 7B chat models listed.
Gemini Nano ships on the Pixel 8 Pro and Android gets AICore
Google put Gemini Nano on the Pixel 8 Pro for Recorder summaries and Gboard Smart Reply, and introduced AICore as the Android service behind it.
Apple publishes MLX, where CPU and GPU share arrays without copies
Apple machine learning research released an array framework for Apple silicon with a unified memory model, lazy evaluation and Swift bindings for iOS.
LLM.swift wraps llama.cpp for on-device text generation in Swift apps
A Swift package that wraps llama.cpp so iOS, macOS, watchOS, tvOS and visionOS apps can load a GGUF file and generate text on the device.