KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#typescript #ai-agents #developer-tools #cli #codex #claude-code #react #mcp #open-source #deepseek-harness #dsh-plugin #ai

UNIFEI-IESTI01-TinyML

★ 69 Open GitHub ↗

No description available.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# UNIFEI-IESTI01-TinyML
## TinyML - Machine Learning for Embedding Devices
**UPDATED to 2026 - 1st Semester**

<img src='images/IESTI_2.jpg'/>
<figcaption><a href='https://unifei.edu.br/iesti/'>Instituto de Engenharia de Sistemas e Tecnologias da Informação – IESTI - Campus de Itajubá</a></figcaption>
<hr>

For the previous versions of IESTI01 courses, please visit: 
+ [1st Semester 2021 - UNIFEI-IESTI01-TinyML-2021.1](https://github.com/Mjrovai/UNIFEI-IESTI01-T01-2021.1)
+ [2nd Semester 2021 - UNIFEI-IESTI01-TinyML-2021.2](https://github.com/Mjrovai/UNIFEI-IESTI01-TinyML-2021.2)
+ [1st Semester 2022 - UNIFEI-IESTI01-TinyML-2022.1](https://github.com/Mjrovai/UNIFEI-IESTI01-TinyML-2022.1)
+ [1st Semester 2023 - UNIFEI-IESTI01-TinyML-2023.1](https://github.com/Mjrovai/UNIFEI-IESTI01-TinyML-2023.1)
<hr>

## Material 
- All materials were uploaded to this repo at the end of last semester's course
  - Slides, Notebooks, Code, and Docs in English 
  - Videos in Portuguese

### Optional pre-course activities:
+ Pre-course:  : [[Suggested readings]](https://github.com/Mjrovai/UNIFEI-IESTI01-T01-2021.1/tree/main/00_Curso_Folder/0_Pre-Course)
+ Pre-course:  : [[Jupyter Notebook, CoLab and Python Review]](https://github.com/Mjrovai/UNIFEI-IESTI01-T01-2021.1/tree/main/00_Curso_Folder/1_Fundamentals/Class_4)

### Parte 1: Fundamentals 
+ Class 1 - About the Course and Syllabus [[Slides]](00_Curse_Folder/1_Fundamentals/Class_01/IESTI01_TinyML_Class_1.pdf) [[Video]](https://youtu.be/mbGH82YMc0w)
+ Class 2 - Introduction to TinyML [[Slides]](00_Curse_Folder/1_Fundamentals/Class_02/IESTI01_TinyML_class_2.pdf) [[Docs]](00_Curse_Folder/1_Fundamentals/Class_02/docs/) [[Video]](https://youtu.be/ozeL9a8xNXk)
+ Class 3 - TinyML Challenges - Embedded Systems [[Slides]](00_Curse_Folder/1_Fundamentals/Class_03/IESTI01_TinyML_class_3.pdf) [[Docs]](00_Curse_Folder/1_Fundamentals/Class_03/docs/) [[Video]](https://youtu.be/jumIhJMitSM)
+ Class 4 - TinyML Challenges - Machine Learning [[Slides]](00_Curse_Folder/1_Fundamentals/Class_04/IESTI01_TinyML_class_4.pdf) [[Video]](https://youtu.be/N1OWXpL4jMM)
  + Class 4a - Google CoLab [[Notebooks and Docs]](00_Curse_Folder/1_Fundamentals/Class_04a) [[Video]](https://youtu.be/m_Ueb88yd88)
  + Class 4b - Python Review [[Notebooks and Docs]](00_Curse_Folder/1_Fundamentals/Class_04a) [[Video]](https://youtu.be/07tGfteD4_s)
+ Class 5 - The Machine Learning Paradigm [[Slides]](00_Curse_Folder/1_Fundamentals/Class_05/IESTI01_TinyML_class_5.pdf) [[Notebooks and Docs]](00_Curse_Folder/1_Fundamentals/Class_05) [[Video]](https://youtu.be/MqWrwuMuOl8)
+ Class 6 - The Building Blocks of Deep Learning (DL) - Introduction [[Slides]](00_Curse_Folder/1_Fundamentals/Class_06/IESTI01_TinyML_class_6.pdf) [[Notebooks and Docs]](00_Curse_Folder/1_Fundamentals/Class_06) [[Video]](https://youtu.be/-yuAaq4s5NQ)
+ Class 7 - The Building Blocks of DL - Regression with DNN [[Slides]](00_Curse_Folder/1_Fundamentals/Class_07/IESTI01_TinyML_class_7.pdf) [[Notebooks and Docs]](00_Curse_Folder/1_Fundamentals/Class_07) [[Video]](https://youtu.be/nEMHqVyWlzU)
+ Class 8 - The Building Blocks of DL - Classification with DNN [[Slides]](00_Curse_Folder/1_Fundamentals/Class_08/IESTI01_TinyML_class_8.pdf) [[Notebooks and Docs]](00_Curse_Folder/1_Fundamentals/Class_08) [[Video]](https://youtu.be/WCzNvVEPigE)
+ Class 9 - The Building Blocks of DL - DNN Recap, Datasets and Model Performance Metrics [[Slides]](00_Curse_Folder/1_Fundamentals/Class_09/IESTI01_TinyML_class_9.pdf) [[Notebooks and Docs]](00_Curse_Folder/1_Fundamentals/Class_09) [[Video]](https://youtu.be/bQjIZc9iWhw)
+ Class 10 - Introducing Convolutions (CNN) [[Slides]](00_Curse_Folder/1_Fundamentals/Class_10/IESTI01_TinyML_class_10.pdf) [[Docs]](00_Curse_Folder/1_Fundamentals/Class_10) [[Video]](https://youtu.be/swAs2-RuTpQ)
+ Class 11 - Image Classification using CNN [[Slides]](00_Curse_Folder/1_Fundamentals/Class_11/IESTI01_TinyML_class_11.pdf) [[Notebooks and Docs]](00_Curse_Folder/1_Fundamentals/Class_11) [[Video]](https://youtu.be/GYGlD9mj7oo)
+ Class 12 - Introduction to Edge Impulse – CNN with Cifar-10 [[Slides]](00_Curse_Folder/1_Fundamentals/Class_12/IESTI01_TinyML_class_12.pdf) [[Notebooks]](00_Curse_Folder/1_Fundamentals/Class_12) [[Video]](https://youtu.be/f0o8vkudAkc)
+ Class 13 - Preventing Overfitting [[Slides]](00_Curse_Folder/1_Fundamentals/Class_13/IESTI01_TinyML_class_13.pdf) [[Notebooks and docs]](00_Curse_Folder/1_Fundamentals/Class_13) [[Video]](https://youtu.be/JYv6iPhmv9w)
  +  Class 13a - Wisconsin Diagnostic Breast Cancer (WDBC) [[Video]](https://youtu.be/-51OdKePxyQ)
+ Class 14 - Fundamentals wrap-up and Application’s preview [[Slides]](00_Curse_Folder/1_Fundamentals/Class_14/IESTI01_TinyML_class_14.pdf) [[Docs]](00_Curse_Folder/1_Fundamentals/Class_14) [[Video]](https://youtu.be/639Tr-grOnk)
  
### Parte 2: Applications & Deploy
+ Class 15 - ML Applications Overview - AI Lifecycle and ML Workflow [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_15/IESTI01_TinyML_class_15.pdf)  [[Video]](https://youtu.be/AvNlaOsnwPw)
+ Class 16 - Introduction to TFLite and TFLite-Micro [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_16/IESTI01_TinyML_class_16.pdf) [[Notebooks]](00_Curse_Folder/2_Applications_Deploy/Class_16) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_16/docs) [[Video]](https://youtu.be/76G5LkWHsh8)
  + Class 16a - EdgeML with TensorFlow Lite (RaspberryPi Demo) [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_16/EdgeML-Demo/IESTI01_TinyML_class_16a.pdf) [[Video]](https://youtu.be/lZ1W7MnJFD4)
  + Class 16b - TFL-Micro Hello World [[Video]](https://youtu.be/hjOKVo1mbaY)
+ Class 17 - Arduino TinyML Kit Overview - HW and SW Installation & Test [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_17/IESTI01_TinyML_class_17.pdf) [[Notebooks]](00_Curse_Folder/2_Applications_Deploy/Class_17) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_17/docs) [[Video]](https://youtu.be/H6ABUMTWqlo)
  + Class 17c - Seeed XIAOML Kit Overview - HW and SW Installation & Test [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_17/IESTI01_TinyML_class_17c.pdf) [[Video]](https://youtu.be/SLFUvt-Eu0o) [[e-book]](https://mjrovai.github.io/TinyML_Made_Easy_XIAO_ESP32S3_ebook/content/xiaoml_kit/setup/setup.html)
+ Class 18 - TFLite-Micro Overview & Hello World Code Walkthrough [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_18/IESTI01_TinyML_class_18.pdf) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_18/docs) [[Video]](https://youtu.be/GPZ9FeGfizE)
+ Class 19 - Motion Classification - Introduction [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_19/IESTI01_TinyML_class_19.pdf) [[Video]](https://youtu.be/sf92FFbrbrQ)
+ Class 20 -  Motion Classification using MCU (Nano 33) [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_20/IESTI01_TinyML_class_20.pdf) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_20) [[Video]](https://youtu.be/qnpfl7Eaz_k)
  +  Class 20a - Motion Classification using MCU (ESP32) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_20/ESP32-Motion_Classification)
  +  Lab Review and Edge Impulse Studio Updates [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_20/IESTI01_TinyML_class_lab_review.pdf) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_20/EI_Studio-Spectral_Analysis-Updated_March-23.pdf) [[Video]](https://youtu.be/3qLPPmTzoEY)
+ Class 21 - K-means Clustering & Anomaly Detection [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_21/IESTI01_TinyML_class_21.pdf) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_21/docs) [[Notebooks]](00_Curse_Folder/2_Applications_Deploy/Class_21) [[Video]](https://youtu.be/4Tg78HPfSbY) 
+ Class 22 - Anomaly Detection Hands-On Lab & Pos-Processing [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_22/IESTI01_TinyML_class_22.pdf)  [[Code]](00_Curse_Folder/2_Applications_Deploy/Class_22) [[Video]](https://youtu.be/oTsAWb4w2lY)
  + Class 22a - Motion Classification and Anomaly Detection (XIAOML Kit) [[e-book]](https://mjrovai.github.io/TinyML_Made_Easy_XIAO_ESP32S3_ebook/content/xiaoml_kit/motion_classification/motion_classification.html)
+ Class 23 - Keyword Spotting - Introduction [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_23/IESTI01_TinyML_class_23.pdf) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_23/docs) [[Notebooks]](00_Curse_Folder/2_Applications_Deploy/Class_23) [[Video]](https://youtu.be/VCkQ2A6_huM) 
+ Class 24 - Lab KWS using MCU (Nano 33) [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_24/IESTI01_TinyML_class_24.pdf) [[Docs and code]](00_Curse_Folder/2_Applications_Deploy/Class_24/docs) [[Notebooks]](00_Curse_Folder/2_Applications_Deploy/Class_24) [[Video]](https://youtu.be/-4BqS_KMJtc)
  + Class 24a - KWS using MCU (ESP32) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_24/ESP32-KWS)
  + Class 24b - KWS using MCU (XIAOML Kit) [[e-book]](https://mjrovai.github.io/TinyML_Made_Easy_XIAO_ESP32S3_ebook/content/xiaoml_kit/kws/kws.html)
+ Class 25 - Image Classification Introduction [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_25/IESTI01_TinyML_class_25.pdf) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_25/docs) [[Notebooks]](00_Curse_Folder/2_Applications_Deploy/Class_25) [[Video]](https://youtu.be/A6wdJzEXNzM) 
  + Class 25a - Person Detection (VWW) - Application [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_25a/IESTI01_TinyML_class_25a.pdf) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_25a/doc) [[Video]](https://youtu.be/QhpdluF0MHk)
+ Class 26 - Image Classification using Edge Impulse Studio [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_26/IESTI01_TinyML_class_26.pdf)  [[Video]](https://youtu.be/x439ha4gg2g)
  + Class 26a - Image Classification (XIAOML Kit) [[e-book]](https://mjrovai.github.io/TinyML_Made_Easy_XIAO_ESP32S3_ebook/content/xiaoml_kit/image_classification/image_classification.html)
+ Class 27 - Collecting Data - Alternative ways [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_27/IESTI01_TinyML_class_27.pdf) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_27) [[Video]](https://youtu.be/oYRl-UhFZ-U)
+ Class 28 - Responsible AI & Course Wrap-up [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_28/IESTI01_TinyML_class_28.pdf) [[Docs]](00_Curse_Folder/2_Applications_Deploy/Class_28/docs) [[Video]](https://youtu.be/8-kkzuLYl4Q)
+ Class 29 - EdgeAI: Going Further [[Slides]](/00_Curse_Folder/2_Applications_Deploy/Class_29/IESTI01_TinyML_class_29.pdf) [[Video]](https://youtu.be/mC4WiH_AaMg)
+ Class 30 - Group Presentations

### Group Presentations
  + 2025.1
    + Detector de choros de bebes [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Choro/Trabalho_Final_TinyML.pdf) [[Video]](https://youtu.be/Ov7MMjnfcW8)
    + Sistema de Reconhecimento Facial para Autenticação [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Facial/Final_Report.pdf) [[Video]](https://youtu.be/B7GltTHmBLw)
    + Classificação de Frutas  [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Frutas/Fruit_Classification.pdf) [[Video]](https://youtu.be/AiAv8nQES2Y)
    + Detecção Comportamental de Gado Leiteiro [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Gado/TinyMLVaca.pdf) [[Video]](https://youtu.be/5aNiKhy-PMg)
    + Classificação de vibração no liquidificador [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Liquidificador/ProjFinal-TinyML.pdf) [[Video]](https://youtu.be/U8-l8EIqWZQ)
    + Detecção de Cancer de Pele [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Manchas/Relatorio_projeto_final.pdf) [[Video]](https://youtu.be/WgMikJTf960)
    + Visual Voice Activity Detection (VVAD) [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Olhos/Relatorio_Final_IESTI01.pdf) [[Video]](https://youtu.be/6SZ9RHeHqzM)
    + Identificação de Pássaros por Meio do Canto [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Passaros/Relatorio_Projeto_Final.pdf) [[Video]](https://youtu.be/ZaAuV36bF5s)
    + CLASSIFICAÇÃO DE ESPÉCIES DE PÁSSAROS ATRAVÉS DE SONS [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Passaros2/Relatorio_final_IESTI01.pdf) [[Video]](https://youtu.be/F-mhGeoWfkA)
    + SISTEMA DE CLASSIFICAÇÃO DE CANTOS DE PÁSSAROS [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Passaros3/tinyml-final-report.pdf) [[Video]](https://youtu.be/nIBJ5Wscej8)
    + RECONHECIMENTO DE PLACAS DE TRÂNSITO [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Placas/Projeto_Final.pdf) [[Video]](https://youtu.be/3JIaNws0-ys)
    + Detecção de Materiais Recicláveis [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Reciclagem/Detec_Materiais_Recicláveis.pdf) [[Video]](https://youtu.be/xSvNDBeEcTA)
    + FrogSoundGuard – Identificação de sons de sapos [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Sapos/FrogSoundGuard.pdf) [[Video]](https://www.youtube.com/watch?v=8DZ4IFw-Abk)
    + Detecção de Sirenes de Emergência no Trânsito [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Sirenes/Detec_Sirenes.pdf)
    + Classificação de sons ambientes [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Sons/Projeto_Final_Rafael_Belchior_Ferreira.pdf) [[Video]](https://youtu.be/7_ssrKbjeXY)
    + Monitoramento Inteligente de Ventiladores [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Ventilador/ProjetoFinal.pdf) [[Video]](https://youtu.be/6-ncl7uFGNM)
    + Reconhecimento de Vogais [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2025/Vogais/relatorio_IESTI01.pdf) [[Video]](https://youtu.be/c2Hsn-vvNrM)
  
  + 2024.1
    + Monitoramento Acústico de Fluxo Hídrico [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2024/Monit_Acustico.pdf) [[Video]](https://youtu.be/qnwZsdTilxs)
    + Detecção de Quedas de pessoas [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2024/Deteccao_Quedas.pdf) [[Video]](https://www.youtube.com/watch?v=7BsHzaYMCd8)
    + Contagem de Capacitores [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2024/monitor_capacitor.pdf) [[Video]](https://youtu.be/Wa7THRv9V4c)
    + Identificador de estilos musicais[[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2024/identificador_estilos_musicais.pdf) [[Video]](https://youtu.be/KfVXU62bcRQ?si=jPZCSlwS1WNSguNF)
    + Teste de qualidade de Produtos [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2024/Teste_qualidade.pdf) [[Video]](https://youtu.be/5t2TAhu-h50)
    + Afinador de violão [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2024/afinador_violao.pdf) [[Video]](https://youtu.be/X9sGIUbH6mk)
    + Detecção de doenças em folhas de tomate [[Report]](00_Curse_Folder/2_Applications_Deploy/Final_Projects_2024/Detec_doencas_folhas_tomate.pdf)
  + 2023.1
    + COPD [[Report]](00_Curse_Folder/2_Applications_Deploy/2013_Final_Projects/COPD-IESTI01_Projeto_Final.pdf) 
    + hidrometro [[Report]](00_Curse_Folder/2_Applications_Deploy/2013_Final_Projects/hidrometro-Projeto_Final_IESTI01.pdf) 
    + Libras [[Report]](00_Curse_Folder/2_Applications_Deploy/2013_Final_Projects/Libras-Trabalho-IESTI01.pdf) 
    + Ronco[[Report]](00_Curse_Folder/2_Applications_Deploy/2013_Final_Project/Ronco-Proj_final_IESTI01.pdf) 
  + 2022.1
     - Classificador de Vogais em Libras [[Doc]](00_Curse_Folder/3_Final_Projects/Libras-Trabalho-IESTI01.pdf) [[Video]](https://youtu.be/P9h7r_xhWc8)
     - Detecção de doença pulmonar (DPOC) [[Doc]](00_Curse_Folder/3_Final_Projects/COPD-IESTI01_Projeto_Final.pdf) [[Video]](https://youtu.be/gjVJFaGKl6E)
     - Detecção de algarismos em hidrômetros [[Doc]](00_Curse_Folder/3_Final_Projects/hidrometro-Projeto_Final_IESTI01.pdf) [[Video]](https://youtu.be/rV6lmdJqsvc)
     - Detecção de Roncos [[Doc]](00_Curse_Folder/3_Final_Projects/Ronco-Proj_final_IESTI01.pdf) [[Video]](https://youtu.be/DbujrQEzVy8)
     - SCancer (No TinyML) [[Video]](https://youtu.be/QCH9iYNjDJc)
  + 2021.2
    + Groups 1, 2, 3, 4, 5 [[Video]](https://youtu.be/IkUbbWcL5Z4)
      + 1-Keyboard
      + 2-Sobriety
      + 3-Bearing
      + 4-Ex-Maquina
      + 5-Helmet
    + Groups 6, 7 [[Video]](https://youtu.be/-T9o38oo4Bk)
      + 6-Emotions
      + 7-Eletricity 
    + [[Final Reports]](/00_Curse_Folder/Group%20Project/final_reports/)
  + 2021.1
    +  Seismic Detection [[Docs]](00_Curso_Folder/2_Applications/Group_Projects-Final%20Reports/RelatorioTinyML_TrabalhoFinal_1-Abalos.pdf) [[Video]](https://youtu.be/vswoWrOpC1s)
    +  Fire Detection [[Docs]](00_Curso_Folder/2_Applications/Group_Projects-Final%20Reports/Projeto_final_Fire_detection/trabalho_final_Fire_Detection.pdf) [[Video]](https://youtu.be/70ySBIPzvJk)
    +  Covid Detection (cough) [[Docs]](00_Curso_Folder/2_Applications/Group_Projects-Final%20Reports/Project__Covid_19_Detection_by_Cough.pdf) [[Video]](https://youtu.be/7Lca8lfdKAI)
    + Mask Detection [[Docs]](00_Curso_Folder/2_Applications/Group_Projects-Final%20Reports/relatorio_final_deteccao_de_mascara.pdf) [[Video]](https://youtu.be/jeRetSaqm1w)
    + Personal Trainer [[Docs]](00_Curso_Folder/2_Applications/Group_Projects-Final%20Reports/IESTI01_ProjetoFinal_PersonalTrainer.pdf) [[Video]](https://youtu.be/RxlHRyaRfBc) 
<hr>

## Relevance of TinyML Learning
Microcontrollers (MCUs) are affordable electronic components, usually with only a few kilobytes of RAM, and designed to consume minimal power. MCUs are embedded in nearly all residential, medical, automotive, or industrial devices. It's estimated that over 40 billion microcontrollers are sold annually, and probably hundreds of billions are currently in service. However, interestingly, these devices often need to receive the proper attention, as they are frequently used merely as replacements for the functionalities that older electromechanical systems used to perform in cars, washing machines, or remote controls.
  
More recently, with the advent of the Internet of Things (IoT), a significant portion of these MCUs has started generating "quintillions" of data, much of which goes unused due to the high cost and complexity of transmission (bandwidth and latency).

On the other hand, in the past few decades, we've witnessed the development of Machine Learning models (a sub-field of Artificial Intelligence) trained on large datasets using powerful mainframes. But what's happening now is that suddenly, it has become possible to extract "meaning" from noisy and complex data like images, audio, or vibrations, using neural networks. And importantly, we can run these neural network models on microcontrollers and sensors, using very little power to interpret much more of the sensor data we typically overlook. This is TinyML, a new field that enables extracting "machine intelligence" right in the physical world (where the data is generated).

## Course Overview
TinyML is an introductory course at the intersection of Machine Learning and Embedded Devices. The proliferation of embedded devices with ultra-low power consumption (on the order of milliwatts), coupled with the introduction of machine learning frameworks dedicated to embedded devices, such as TensorFlow Lite for Microcontrollers (TFLite Micro or TFLM), enables the widespread adoption of AI-powered IoT devices, known as "AioT."
  
Furthermore, the explosive growth of machine learning and the user-friendliness of platforms like TensorFlow (TF) make it an essential subject of study for engineering students, especially in Electronics, Computer Science, and Control & Automation.
  
TinyML differs from conventional machine learning (e.g., server-cloud-based) because it requires software knowledge and expertise in embedded hardware. This course aims to provide a foundation for understanding this emerging field.

## References
The current version of this pioneering course in Latin America is primarily based on:
+ [Harvard School of Engineering and Applied Sciences - CS249r: Tiny Machine Learning](https://sites.google.com/g.harvard.edu/tinyml/home)
+ [Professional Certificate in Tiny Machine Learning (TinyML) – edX/Harvard](https://www.edx.org/professional-certificate/harvardx-tiny-machine-learning)
+ [Introduction to Embedded Machine Learning - Coursera/Edge Impulse](https://www.coursera.org/learn/introduction-to-embedded-machine-learning)
+ [Computer Vision with Embedded Machine Learning - Coursera/Edge Impulse](https://www.coursera.org/learn/computer-vision-with-embedded-machine-learning)
+ Fundamentals textbooks:
  + ["Python for Data Analysis by Wes MacKinney"](https://wesmckinney.com/book/)
  + ["Deep Learning with Python" by François Chollet](https://www.manning.com/books/deep-learning-with-python) - [GitHub Notebooks](https://github.com/fchollet/deep-learning-with-python-notebooks)
  + ["Technical Strategy for AI Engineers, In the Era of Deep Learning" by Andrew Ng](https://github.com/ajaymache/machine-learning-yearning/blob/master/full%20book/machine-learning-yearning.pdf)
+ Applications & Deploy textbooks:
  + ["TinyML" by Pete Warden, Daniel Situnayake](https://www.oreilly.com/library/view/tinyml/9781492052036/)
  + [“AI at the Edge” book by Daniel Situnayake and Jenny Plunkett](https://www.oreilly.com/library/view/ai-at-the/9781098120191/)
  + ["TinyML Cookbook 2E" by Gian Marco Iodice](https://github.com/PacktPublishing/TinyML-Cookbook_2E)
  + [“MACHINE LEARNING SYSTEMS for TinyML” by a collaborative effort](https://harvard-edge.github.io/cs249r_book/)

### The IESTI01 course is part of the [TinyML4D](https://tinyml.seas.harvard.edu/), an initiative to make TinyML education available globally.

## Course Topics
1. Fundamentals of IoT
2. Fundamentals of Machine Learning (ML)
3. Fundamentals of Deep Learning (DL)
4. Collecting Data for ML
5. Training and Deploying ML Models
6. Basics of Embedded ML
7. Code behind some of the most widely used applications in TinyML
8. Real-world applications of TinyML in the industry
9. Principles of Automatic Speech Recognition (Keyword Spotting apps like Alexa, Hey Google, Siri, etc.)
10. Principles of Automatic Image Classification (Visual Wake Words)
11. Anomaly Detection Concepts and Applicable ML Models
12. Principles of Data Engineering applied to TinyML
13. Overview of microcontroller-based device hardware
14. Overview of software behind microcontroller-based devices
15. Real projects using market platforms
16. Design, Development, and Deployment of Responsible AI

## Course Load: 
+	30 hours (Recorded videos) 
+	15 hours de assignments/labs
+	15 hours of individual research and study + final group project

## Approval Process:
+ Individual Quiz Responses: 20%
+ Code Assignments (ML/DL) (Jupyter Notebook / CoLab): 25%
+ Practical Projects (Laboratory Reports): 25%
+ Final Group Project (with presentation): 30%

## Prerequisites:
+ Proficiency in the English language (for reading).
+ Basic programming knowledge in C/C++ (Arduino IDE) and Python. All class tasks will involve one or both programming languages.
+ Familiarity with command-line tools on Mac, Windows, or Linux. Projects will require some operations in a terminal.
+ Understanding linear algebra, signal analysis, basic probability, and statistics. Many ML topics revolve around grasping vector and matrix operations, notation, and concepts like Gaussian distributions, means, standard deviations, etc.

## Methodology/Resources:
+ Students will be able to take classes sequentially at their convenience.
+ Exercises and projects can be developed on personal computers with TensorFlow v2.x installed or by utilizing online tools like Google Colab (desirable).
+ Real TinyML models will be developed and trained using the Edge Impulse Studio.
+ For initial data capture, deployment of trained models, and familiarization with market tools, personal smartphones equipped with at least an accelerometer, microphone, and camera sensors will be used.
+ In the second part of the course, an Arduino BLE Sense (Cortex-M4) Kit and a digital camera model OV7675 will be used. (Each student will receive a Kit the university provides for personal use during the course.)

## Professor:
+ [Marcelo José Rovai](http://lattes.cnpq.br/4234592863079468)

## Supervision and support:
+ [José Alberto Ferreira](http://lattes.cnpq.br/8319509175327154)

UNIFEI-IESTI01-TinyML

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README