MediaPipe
1 update on MediaPipe.
Google ships an experimental MediaPipe LLM Inference API for web, Android and iOS
The experimental API runs Gemma 2B, Phi 2, Falcon 1B and Stable LM 3B fully on device, with int8 and int4 weights.
Cutting edge on edge devices.
1 update on MediaPipe.
The experimental API runs Gemma 2B, Phi 2, Falcon 1B and Stable LM 3B fully on device, with int8 and int4 weights.