Share
Embed
Empowering modern apps using Android ML Kit, TensorFlow, AutoML & On-Device AI.
Iyke Emmanuel
June 22, 2025
Transcript
26 slides
-
Aba 2025 Building Android Applications That Can See, Hear &
Understand Empowering modern apps using Android ML Kit, TensorFlow, AutoML & On-Device AI." Iyke Emmanuel Android dev, FCMB -
02 “The era of application is over. Welcome to the
era of intelligent applications” -
What today’s session covers: • ML foundations • ML on
mobile • Pretrained models vs custom models • • • • TensorFlow Lite, AutoML, Firebase Kotlin integration Vision, Audio, NLP use cases Practical examples + libraries -
05 What is Machine Learning? ML is a field of
AI where systems learn patterns from data instead of explicit programming. They “predict”, “classify”, “detect”, or “understand” from examples -
06 “Machine Learning is the most dominant and modern way
to integrate AI into your software” -
07 Types of Machine Learning Supervised Learning is the process
you use when you know exactly what the output should be for a given input. It's about learning a function that maps an input to an output based on example input-output pairs -
• Unsupervised Learning is used when you don't have labels.
The model is asked to explore the data and find hidden structures, groupings, or patterns that might not be obvious • Reinforced Learning: agent (the model) that interacts with an environment. It learns the best sequence of actions to maximize a cumulative reward. It learns through trial and error, like training a dog. -
Application of Machine Learning: • Smart camera apps • Speech
transcription • Chat summarization • Fraud detection • Health/fitness tracking • AR experiences • Document scanning -
ML Integration approach in App Pre-trained Models: Think of this
as the easy button. These are models already trained by Google or others on massive, general datasets. If your problem is common—like scanning a barcode, detecting a face, or translating basic text—you use these. They are fast, accurate, and you simply call an API or an SDK function Custom Models: This is the path for unique challenges. If your problem is specific to your region or domain—like identifying local plant species or a custom ID card—you must train the model yourself. This uses tools like TensorFlow Lite and gives you total control over the data and the outcome, but it requires more work -
ML Kit integration on Android with pretrained Models Prefers using
the camera2 or the camera x Library Consider processing image at low resolution to keep the requirement Waiting for the ML kit result before rendering the image -
Text recognition Text recognition allows us to extract text from
images, camera or static images Trained to recognize text in over 100 languages including Latin based script and none latin based script such as china or japanese The text recognise segment text into block element, line and symbols -
Barcode Scanning Read and recognise most popular barcode like Codebar
or QRCode Automatic format detection Run on a device so you can have an internet connection to perform the Scan -
Digital Ink recognition Recognise handwritten text and drawn images and
convert it into unicode text Support 300+ languages and 25+ written system Dynamically download the language asset you want to use -
Text recognition Text recognition allows us to extract text from
images, camera or static images Trained to recognize text in over 100 languages including Latin based script and none latin based script such as china or japanese The text recognise segment text into block element, line and symbols -
Why do we need custom ML Model • Pretrained ML
models can’t solve every problem • You may need domain-specific intelligence • Use cases: 1) Local language classification 2) Nigerian foods recognition 3) Fake ID detection 4) Company-specific predictions -
Training Model with tensorflow • TensorFlow is the most widely-used
ML framework • Used to train image, audio, NLP, and tabular models • Can run on Google Colab (free GPU!) • Export to TensorFlow Lite easily -
Find Dataset to train data: KAGGLE • Kaggle offers thousands
of free ML datasets • You can find datasets for: 1) Images (faces, foods, plants) 2) Audio (speech, noise, accents) 3) Text (sentiment, languages)