Inference
On-device (edge) AI
Running models directly on phones, laptops or other devices rather than in the cloud.
On-device models respond without a network connection and keep data private, but are limited to small models. Phone keyboards, photo search and offline transcription often use them.
Frequently asked questions
What does On-device (edge) AI mean?
Running models directly on phones, laptops or other devices rather than in the cloud. On-device models respond without a network connection and keep data private, but are limited to small models. Phone keyboards, photo search and offline transcription often use them.