Have you tried Google's Gemma-3n-E4B-IT in their AI Edge Gallery app? It's the first local model that's really blown me away with its power-to-speed ratio on a mobile device.

See: https://github.com/google-ai-edge/gallery/releases/tag/1.0.3