tinyml

Machine Learning Systems: Foundations, Scaling, Agentic AI, and Physical AI (Vols I–IV) • Harvard CS249r | https://mlsysbook.ai

Sub-50mb agentic, voice and vision intelligence for consumer devices.

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.

[ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment

Z80-μLM is a 2-bit quantized language model small enough to run on an 8-bit Z80 processor. Train conversational models in Python, export them as CP/M .COM binaries, and chat with your vintage computer.

A lightweight header-only library for using Keras (TensorFlow) models in C++.

The Fastest Deep Reinforcement Learning Library

This is a list of interesting papers and projects about TinyML.

[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256KB Memory

Machine Learning inference engine for Microcontrollers and Embedded devices

[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning

vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

Seeed SenseCraft Model Assistant is an open-source project focused on embedded AI. 🔥🔥🔥

Zant simplifies the deployment and optimization of neural networks on microprocessors

Instructions, source code, and misc. resources needed for building a Tiny ML-powered artificial nose.

Neural Networks with low bit weights on low end 32 bit microcontrollers such as the CH32V003 RISC-V Microcontroller and others

Notes on Machine Learning on edge for embedded/sensor/IoT uses

Code for MobiCom paper 'TinyML-CAM: 80 FPS Image Recognition in 1 Kb RAM'

Whistle speech-to-text running fully on an ESP32-S3: hold a button, say a colour in one of 7 languages, the LED does it. No network.

In this repository you will find TinyML course syllabi, assignments/labs, code walkthroughs, links to student projects, and lecture videos (where applicable).