Damien Gonot
Home Blog Notes About

Machine Learning

Homepage / Notes / Computer Science / Artificial Intelligence / Machine Learning

Artificial Neural Networks

Deep Learning


Process of reducing the number of bits (weights and biases) of a model/neural network. The primary goal is to compress the model in size for faster execution/computation without sacrificing too much in terms of accuracy.

LoRA (Low-Rank Adaptation)

Efficient training method by creating and updating low-rank approximations of the original weight matrices (update matrices).


MIT 6.S191: Introduction to Deep Learning


NYU DS-GA 1008: Deep Learning


UC Berkeley Full Stack Deep Learning
UC Berkeley CS182: Designing, Visualizing and Understanding Deep Neural Networks


Deep Learning Book by MIT Press


Cornell CS5787: Deep Learning
Introduction to Deep Learning


Physics-based Deep Learning Book


Deep Learning with Python

by François Chollet

Practical Deep Learning

A free course designed for people with some coding experience, who want to learn how to apply deep learning and machine learning to practical problems.


Gradient descent

A method of mathematical optimization. Algorithm to find the local minimum of a loss function.


Neural Networks: Zero to Hero

A course by Andrej Karpathy on building neural networks, from scratch, in code. We start with the basics of backpropagation and build up to modern deep neural networks, like GPT. In my opinion language models are an excellent place to learn deep learning, even if your intention is to eventually go to other areas like computer vision because most of what you learn will be immediately transferable. This is why we dive into and focus on languade models. Prerequisites: solid programming (Python), intro-level math (e.g. derivative, gaussian).



Weights & Biases (W&B)


The AI Developer Platform Weights & Biases helps AI developers build better models faster. Quickly track experiments, version and iterate on datasets, evaluate model performance, reproduce models, and manage your ML workflows end-to-end.


Cornell CS5785: Applied Machine Learning


Hands-On Machine Learning with Scikit-Learn and Tensorflow

by Aurélien Géron

Machine Learning Engineering Open Book