What is TinyML?

TinyML is a branch of machine learning that uses small form factor devices attached with sensors including bare metal or RTOS based microcontrollers to execute ML models and algorithms as software.

Good things, like TinyML, come in small packages.

Another way to look at TinyML technology is as a smaller subset of Machine Learning & Deep Learning technology including software, models, algorithms, applications and devices.

TinyML devices include Microcontrollers and in some cases Programmable logic controllers (PLCs). These controllers are ubiquitous with low-power and compact form factor that allows them to be used as edge devices for low-latency, low-power, and low-bandwidth model inference. Current count of these devices exceed over 300 billion globally.

Future of ML is like a Blackhole - Tiny & Mighty

In contrast to a typical CPU's power consumption of 65 to 85 watts and a typical GPU's power consumption of 200 to 500 watts, a typical microcontroller uses power on the order of milliwatts or microwatts. This is over a thousand time power savings and a thousand times less energy. Due to their low power consumption, tinyML devices can run ML applications on the edge while remaining unplugged from internet or electricity for weeks, months, and in some cases, even years.