Programming, Math, Science

This is a list of links to different freely available learning resources about computer programming, math, and science.

Table of contents

• AI
  • Machine Learning
  • Computer Games AI
• Algorithms
• Biology
• Command Line and Tools
• Compilers and Interpreters
• Computer Graphics
  • Demoscene
  • Ray Tracing
  • Shaders
  • Vulkan
• Computer Networks and Network Programming
• Cryptography
• Databases
• Design Patterns
• Distributed Systems
• Electronics
• Emulators and Virtual Machines
• Game Programming
• GUI Programming
• Hardware
• Logical Games
• Math
  • Algebra
  • Category Theory
  • Probability and Statistics
  • Theoretical Computer Science
• Multithreading and Concurrency
• Operating Systems
• Photography
• Physics
• Programming Languages
  • Assembly
  • Basic
  • C
  • C++
  • Clojure
  • Common Lisp
  • D
  • Erlang
  • Go
  • Haskell
  • JavaScript
  • Nim
  • OCaml
  • Pascal
  • Prolog
  • Pyret
  • Python
  • Racket
  • Regular expressions
  • Ruby
  • Rust
  • Scheme
  • Smalltalk
• Retrocomputing
  • Books by Fabien Sanglard
• Reverse engineering
• Robotics
• Text editors
  • Emacs
  • Vim
• Unicode
• Version control tools
• Web programming
• Other
• Other lists

AI

• Paradigms of Artificial Intelligence Programming: Case Studies in Common Lisp by Peter Norvig

Machine Learning

• A Course in Machine Learning by Hal Daumé III

• Algorithms for Decision Making by Mykel J. Kochenderfer, Tim A. Wheeler, and Kyle H. Wray

• An Introduction to Statistical Learning by Gareth James, Daniela Witten, Trevor Hastie, Rob Tibshirani

• Deep Learning by Ian Goodfellow, Yoshua Bengio and Aaron Courville

• Deep Learning Interviews Second Edition by Shlomo Kashani

• Dive into Deep Learning Compiler

• Foundations of Data Science by Avrim Blum, John Hopcroft, and Ravindran Kannan

• Information Theory, Inference, and Learning Algorithms by David MacKay

• Machine Learning Engineering Book by Andriy Burkov

• Mathematics for Machine Learning by Marc Peter Deisenroth, A. Aldo Faisal, and Cheng Soon Ong

• Neural Networks: Zero to Hero - A course by Andrej Karpathy

• Physics-based Deep Learning by N. Thuerey, P. Holl, M. Mueller, P. Schnell, F. Trost, K. Um

• Practical Deep Learning for Coders

• Probabilistic Machine Learning: An Introduction by Kevin Patrick Murphy

• Probabilistic Machine Learning: Advanced Topics by Kevin Patrick Murphy

• The Hundred Page Machine Learning Book by Andriy Burkov

Computer Games AI

• Game AI Pro by Steve Rabin

• Programming Starcraft AI by Peter Kis

Algorithms

• Algorithms by Jeff Erickson

• Algorithms for Optimization by Mykel J. Kochenderfer and Tim A. Wheeler

• Algorithms for Modern Hardware by Sergey Slotin

• The Arcane Algorithm Archive

• Clever Algorithms: Nature-Inspired Programming Recipes by Jason Brownlee

• Competitive Programming Algorithms

• Competitive Programmer's Handbook by Antti Laaksonen

• Exact String Matching Algorithms by Christian Charras and Thierry Lecroq

• Introduction to High Performance Scientific Computing by Victor Eijkhout with Edmond Chow and Robert van de Geijn

• Planning Algorithms by Steven M. LaValle

• Principles of Algorithmic Problem Solving by Johan Sannemo

• Problem Solving with Algorithms and Data Structures using Python by Brad Miller and David Ranum

Biology

• Introduction to Genomics for Engineers

Command line and tools

• Curl Cookbook

• Curl Exercises by Julia Evans

• Effective Shell by Dave Kerr

• Getting started with tmux by ittavern

• How I'm still not using GUIs: A guide to the terminal by Lucas Fernandes da Costa

• Linux command line for you and me by Kushal Das

• The Linux Command Handbook by Flavio Copes

• The Linux Command Line by William Shotts

Compilers and Interpreters

• Build Your Own Lisp by Daniel Holden

• Crafting Interpreters by Robert Nystrom

• Creating the Bolt Compiler by Mukul Rathi

• How Clang Compiles a Function by John Regehr

• How LLVM Optimizes a Function by John Regehr

• Let's Build a Compiler by Jack Crenshaw

• Let's Write a Compiler by Brian Robert Callahan

  • Part 1: Introduction, selecting a language, and doing some planning
  • Part 2: A lexer
  • Part 3: A parser
  • Part 4: Testing
  • Part 5: A code generator
  • Part 6: Input and output
  • Part 7: Arrays
  • Part 8: Strings, forward references, and conclusion

• Make A Language - A series about making a programming language called Eldiro using the Rust programming language.

Computer Graphics

• 3D Math Primer for Graphics and Game Development by Fletcher Dunn and Ian Parberry

• A Gentle Introduction to D3D12 by Alex Tardif

• A Primer on Bézier Curves

• A trip through the Graphics Pipeline by Fabian Giesen

• Collection of AMD Research Publications

• Computer Graphics from Scratch by Gabriel Gambetta

• Curves and Surfaces by Bartosz Ciechanowski

• A fast and precise triangle rasterizer by Kristoffer Dyrkorn

• GPU Gems Books Series

  • GPU Gems
  • GPU Gems 2
  • GPU Gems 3

• GPU Performance for Game Artists by Keith O’Conor

• Learn Computer Graphics From Scratch

• Learn OpenGL by Joey de Vries

• Learn WebGPU by Elie Michel

• Learning Modern 3D Graphics Programming by Jason L. McKesson

• Matrix Compendium by Łukasz Izdebski - The main purpose of this article is to gather information in the field of transformation in computer graphics and put it in one place.

• Optimizing Software Occlusion Culling by Fabian Giesen

• Order Independent Transparency by Kostas Anagnostou

  • Part 1
  • Part 2
  • Part 3

• Probability Theory for Physically Based Rendering by Jacco Bikker

  • Part 1
  • Part 2

• WebGL2 Fundamentals

• WebGPU Fundamentals

Demoscene

• The making of Immersion
  • Part 1: A dive into the making of Immersion
  • Part 2: Texturing in a 64kB intro
  • Part 3: Procedural 3D mesh generation in a 64kB intro

Ray Tracing

• Getting Started With DirectX Raytracing by Seppe Dekeyser

• How to build a BVH by Jacco Bikker

• Introduction of the Raytracing Technology

  • Part 1
  • Part 2

• Physically Based Rendering: From Theory To Implementation by Matt Pharr, Wenzel Jakob, and Greg Humphreys

• Ray Tracing Gems by Eric Haines and Tomas Akenine-Möller

• Ray Tracing Gems II by Adam Marrs, Peter Shirley, and Ingo Wald

• Ray Tracing in One Weekend: The Book Series by Peter Shirley

Shaders

• 3D Game Shaders For Beginners

• A Beginner's Guide to Coding Graphics Shaders by Omar Shehata

  • Part 1
  • Part 2
  • Part 3

• Shaders For People Who Don't Know How To Shader by Manuela Malasaña

• Shader Tutorials by Ronja

• The Book of Shaders by Patricio Gonzalez Vivo and Jen Lowe

Vulkan

• I Am Graphics And So Can You - a series of blog posts about implementing a Vulkan renderer for Doom 3 by Dustin H. Land

• NVIDIA Vulkan Ray Tracing Tutorials

• Vulkan Guide

• Vulkan Raytracing Tutorials

• Vulkan Tutorial by Alexander Overvoorde

• Vulkan Tutorial (Rust) by Kyle Mayes

Computer Networks and Network Programming

• An Introduction to Computer Networks by Peter L. Dordal

• Computer Networks: A Systems Approach by Larry Peterson and Bruce Davie

• Computer Network Tutorials

• HTTP2 Explained by Daniel Stenberg

• HTTP/3 explained by Daniel Stenberg

• Networking 101 by Internal Pointers

• REST Servers in Go by Ely Bendersky

Cryptography

• A Graduate Course in Applied Cryptography by Dan Boneh and Victor Shoup

• Practical Cryptography for Developers by Svetlin Nakov

Databases

• Build Your Own Database From Scratch by James Smith

• Build Your Own Redis with C/C++ by James Smith

• MySQL for Developers by Aaron Francis

• PostgreSQL 14 Interbals by Egor Rogov

• The Theory of Relational Databases by David Maier s

Design Patterns

• Data-Oriented Design by Richard Fabian

• Design Patterns & Refactoring SourceMaking

• From design patterns to category theory by Mark Seemann

• Game Programming Patterns by Robert Nystrom

• The Architecture of Open Source Applications

Distributed systems

• Notes on Theory of Distributed Systems by James Aspnes [pdf]

• Testing Distributed Systems - Curated list of resources on testing distributed systems by Andrey Satarin.

Electronics

• Lessons in Electric Circuits

Emulators and Virtual Machines

• GameBoy Emulation in JavaScript by Imran Nazar

• Write your Own Virtual Machine

• Writing NES emulator in Rust by Rafael Bagmanov

Game Programming

• 2D Game Development: From Zero To Hero by Daniele Penazzo

• Books by Wireframe Magazine

• Gentle Introduction to Realtime Fluid Simulation for Programmers and Technical Artists by Shahriar Shahrabi

• Retro Rampage a tutorial series in which you will learn how to build a Wolfenstein-like game from scratch, in Swift by Nick Lockwood

• Roguelike Tutorial - In Rust by Herbert Wolverson

• Reverse engineering the rendering of The Witcher 3

• Scroll Back: The Theory and Practice of Cameras in Side-Scrollers by Itay Keren

• Write a First Person Game in 2KB With Rust by Grant Handy

GUI Programming

• A Book about Qt5

• Minimal Cross-Platform Graphics by Serge Zaitsev

• Sol on Immediate Mode GUIs

• X Window System Basics by Jasper St. Pierre

Hardware

• Architecture of Consoles by Rodrigo Copetti

• Modern Microprocessors: A 90-Minute Guide! by Jason Robert Carey Patterson

• Processor Design: An Introduction

Logical Games

• Hex: A Strategy Guide by Matthew Seymour

• The World's Fastest Scrabble Program by Andrew W. Appel and Guy J. Jacobson [pdf]

Math

• A Gentle Introduction to Tensors by Boaz Porat

• A Programmer's Introduction to Mathematics by Jeremy Kun

• An Infinitely Large Napkin by Evan Chen

• Approved Textbooks of the American Institute of Mathematics

• Book of Proof, Third Edition by Richard Hammack

• Books by Dr. Kenneth Kuttler

• Calculus Made Easy by Silvanus P. Thompson

• Euclid's Elements

• Introduction to Homotopy Type Theory by Egbert Rijke

• Paul's Online Math Notes by Paul Dawkins

• Topology Without Tears by Sidney A. Morris

Algebra

• Algebra: An Elementary Text-Book by George Chrystal

• Immersive Linear Algebra by J. Ström, K. Åström, and T. Akenine-Möller

• Interactive Linear Algebra by Dan Margalit and Joseph Rabinoff

• Intermediate Algebra by Saylor Academy

Category Theory

• Category Theory for Programmers by Bartosz Milewski

• Category Theory Illustrated by Boris Marinov

• Category Theory: Lecture Notes and Online Books - collection by Peter Smith

Probability and Statistics

• Bayes Rules! An Introduction to Applied Bayesian Modeling by Alicia A. Johnson, Miles Q. Ott, Mine Dogucu

• Digital textbook on probability and statistics by Marco Taboga

• Introduction to Probability for Data Science by Stanley H. Chan

• Markov Chains for programmers by Ricardo M. Czekster

• Probability 101, the intuition behind martingales and solving problems with them

• Probability and Statistics Cookbook by Matthias Vallentin

• Seeing Theory - a book about statistics with interactive visualizations by Daniel Kunin, Jingru Guo, Tyler Dae Devlin, and Daniel Xiang

Theoretical Computer Science

• Busy Beavers! - An interactive intro to Computability Theory by Jim Fisher

• Foundations of Computer Science by Alfred V. Aho and Jeffrey D. Ullman

• Introduction to Theoretical Computer Science by Boaz Barak

Multithreading and Concurrency

• A C++17 Thread Pool for High-Performance Scientific Computing by Barak Shoshany

• Is Parallel Programming Hard, And, If So, What Can You Do About It? by Paul E. McKenney

• POSIX Threads Programming by Blaise Barney

• The Little Book of Semaphores by Allen B. Downey

Operating Systems

• A Journey in Creating an Operating System Kernel by Mohammed Q. Hussain

• Advanced Linux Programming by Mark Mitchell, Jeffrey Oldham, and Alex Samuel

• Linux Insides by 0xAD

• Making our own executable packer by Amos

• Operating Systems: Three Easy Pieces by Remzi H Arpaci-Dusseau and Andrea C Arpaci-Dusseau

• Systems Programming: Lecture Notes by Jian Huang

• The Linux Documentation Project

• Writing a Simple Operating System — from Scratch by Nick Blundell

• Writing an OS in Rust by Philipp Oppermann

Photography

• Photography for geeks by Michal Zalewski

Physics

• A free introduction to quantum computing and quantum mechanics by Andy Matuschak and Michael Nielsen

• Motion Mountain by Christoph Schiller - A free physics textbook in 5 volumes.

• Relativity: A Modern Primer by Kevin Han

• Structure and Interpretation of Classical Mechanics, Second Edition by Gerald Jay Sussman and Jack Wisdom

• The Feynman Lectures on Physics

Programming languages

• Introduction to the Theory of Programming Languages by Bertrand Meyer

Assembly

• A fundamental introduction to x86 assembly programming by Nayuki

• Learn Assembly Language - NASM x86 assembly language tutorial on Linux.

• Let's Learn x86-64 Assembly!

  • Part 0 - Setup and First Steps
  • Part 1 - Metaprogramming in Flat Assembler
  • Part 2 - We're Writing a Virtual Machine
  • Part 3 - Arithmetic and Logic

• NASM Tutorial

• Some Assembly Required: An approachable introduction to assembly

Basic

• BBC BASIC for SDL 2.0

C

• Coroutines in C by Simon Tatham

• Demystifying bitwise operations, a gentle C tutorial by Andrei Ciobanu

• How Does a C Debugger Work?

• The Lost Art of Structure Packing by Eric S. Raymond

• Writing a Simple Garbage Collector in C by Matthew Plant

C++

• Awesome Modern C++

• Beginner's Guide to Linkers by David Drysdale

• C++ exceptions under the hood by Nicolás Brailovsky

• C++20 Coroutines: sketching a minimal async framework by Jeremy Ong

• C++20 Concepts: The Definitive Guide by Rajat Jain

• Hacking C++

• Learn C++

• Microsoft C++ language documentation

• Performance Analysis and Tunning on Modern CPUs by Denis Bakhvalov

Clojure

• Babashka Babooka: Write Command-Line Clojure by Daniel Higginbotham

• Clojure Concurrency Tutorial by Eric Normand

• Clojure for the Brave and True by Daniel Higginbotham

Common Lisp

• Learn Lisp The Hard Way by "the Phoeron" Colin J.E. Lupton

• Practical Common Lisp by Peter Seibel

• The Common Lisp Cookbook

• Typed Lisp, A Primer by Musa Al-hassy

D

• Programming in D by Ali Çehreli

Erlang

• Learn You Some Erlang for great good! by Fred Hebert

Go

• Network Programming with Go by Jan Newmarch

• Practical Go Lessons by Maximilien Andile

Haskell

• Learn Haskell by building a blog generator Gil Mizrahi

• Learn You a Haskell for Great Good! by Miran Lipovača

• Monday Morning Haskell

• Real World Haskell by Bryan O'Sullivan, Don Stewart, and John Goerzen

JavaScript

• Eloquent JavaScript by Marijn Haverbeke

• Speaking JavaScript: An In-Depth Guide for Programmers by Dr. Axel Rauschmayer

• The Modern JavaScript Tutorial by Ilya Kantor

• Mostly adequate guide to FP (in JavaScript)

Nim

• Computer Programming with the Nim Programming Language by Dr. Stefan Salewski

OCaml

• OCaml Programming: Correct + Efficient + Beautiful by Michael R. Clarkson

• Real World OCaml by Yaron Minsky, Anil Madhavapeddy and Jason Hickey

Pascal

• Modern Object Pascal Introduction for Programmers by Michalis Kamburelis

Prolog

• The Power of Prolog by Markus Triska

Pyret

• Programming and Programming Languages by Shriram Krishnamurthi, Benjamin S. Lerner, Joe Gibbs Politz, Kathi Fisler

• A Data-Centric Introduction to Computing by Kathi Fisler, Shriram Krishnamurthi, Benjamin S. Lerner, Joe Gibbs Politz

Python

• 30 Days Of Python by Asabeneh

• Automate the Boring Stuff with Python by Al Sweigart

• Composing Programs by John DeNero

• Data Structures and Information Retrieval in Python by Allen B. Downey

• From Python to Numpy by Nicolas P. Rougier

• Learn Python the Right Way

• NumPy Illustrated: The Visual Guide to NumPy by Lev Maximov

• Pandas Illustrated: The Definitive Visual Guide to Pandas by Lev Maximov

• Practical Python Programming by David Beazley

• Python Asyncio: The Complete Guide by Jason Brownlee

• Python Design Patterns by Brandon Rhodes

• Python for Data Analysis, 3rd edition by Wes McKinney

• Scientific Visualization: Python + Matplotlib by Nicolas Rougier

• Think Python, 2nd Edition by Allen B. Downey

Racket

• Beautiful Racket by Matthew Butterick

• How to Design Programs, Second Edition by Matthias Felleisen, Robert Bruce Findler, Matthew Flatt, Shriram Krishnamurthi

• Programming Languages: Application and Interpretation by Shriram Krishnamurthi

Regular expressions

• Implementing Regular Expressions by Russ Cox

• Learn RegEx step by step, from zero to advanced

• RegexOne

• Regular-Expressions.info by Jan Goyvaerts

• Rex Eats Regular Expressions for Breakfast

Ruby

• Building Games with DragonRuby by Brett Chalupa

Rust

• A Gentle Introduction to Rust by Steve Donovan

• Asynchronous Programming in Rust

• Beginner's guide to Error Handling in Rust by Shesh Babu

• Clear explanation of Rust’s module system by Shesh Babu

• Comprehensive Rust

• Exploring ways to make async Rust easier by Carl Lerche

• Rust Atomics and Locks: Low-Level Concurrency in Practice by Mara Bos

• Rust Language Cheat Sheet

• Things you can’t do in Rust (and what to do instead)

Scheme

• Structure and Interpretation of Computer Programs by Harold Abelson and Gerald Jay Sussman with Julie Sussman

Smalltalk

• Smalltalk Resources - A list of free smalltalk books.

Retrocomputing

• A Guide to the Graphics of the Sega Mega Drive / Genesis

• An Afterlife User's Guide to the C64 by Gregorio Naçu

• Apple II Documentation Project

• Famicom Party: Making NES Games in Assembly by Kevin Zurawel

• First Steps in Z80 Assembly Language by Darryl Sloan

• How to Write ZX Spectrum Games by Jonathan Cauldwell

• Learn Multiplatform Assembly Programming by ChibiAkumas

• MEGA65 Documentation

• MEGA65 Welcome Guide by Dan Sanderson

• Michael Abrash’s Graphics Programming Black Book, Special Edition by Michael Abrash

• Multiplying and Dividing on the 6502

• Sinclair ZX Spectrum BASIC programming by Steven Vicker

• The Lost Ways of Programming: Commodore 64 BASIC by Tomas Petricek

• Z80 User's Manual

• ZX Spectrum Next: Assembly Developer Guide by Tomaz Kragelj

Books by Fabien Sanglard

• Game Eengine Black Book: Doom [pdf]

• Game Eengine Black Book: Wolfenstein 3D [pdf]

• The Book of CP-System [pdf]

Reverse engineering

• Reverse Engineering for Beginners by Dennis Yurichev

• Reversing for dummies - x86 assembly and C code by Sami Alaoui

• Linux Reverse Engineering CTFs for Beginners

Robotics

• Introduction to Autonomous Robots by Nikolaus Correll, Bradley Hayes, Christoffer Heckman, and Alessandro Roncone

• Modern Robotics: Mechanics, Planning, and Control by Kevin M. Lynch and Frank C. Park

• The open online robotics education resource

• Underactuated Robotics by Russ Tedrake

Text editors

• Build Your Own Text Editor

Emacs

• Use GNU Emacs: The Plain Text Computing Environment by Keith Waclena

Vim

• Interactive Vim Tutorial by Henrik Huttunen

• Learn Vim (the Smart Way) by Igor Irianto

• The Vi/Ex Editor by Walter Alan Zintz

• Vim from the ground up by Matthieu Cneude

• Vim Reference Guide by Sundeep Agarwal

Unicode

• Programming with Unicode by Victor Stinner

• The Absolute Minimum Every Software Developer Absolutely, Positively Must Know About Unicode and Character Sets by Joel Spolsky

• Unicode programming, with examples by Joe Nelson

Version control tools

• Git from the Bottom Up by John Wiegley

• Learn the workings of Git, not just the commands by Andre Fachat

Web programming

• FastCGI — The Forgotten Treasure by Peter Simons and Ralph Babel

• Intro to Web Dev

• The Flask Mega-Tutorial by Miguel Grinberg

Other

• Agner Fog's Website

• Beej's Guides

• Computer Science from the Bottom Up by Ian Wienand

• Explained from First Principles by Kaspar Etter

• How These Things Work - a book about abstraction

• Memory Management Reference

• Teach Yourself Computer Science

• The Computer Science Book by Tom Johnson

• The Fundamentals of Control Theory by Brian Douglas

• The Nature of Code a book about how can we capture the unpredictable evolutionary and emergent properties of nature in software by Daniel Shiffman

• The Scientist and Engineer's Guide to Digital Signal Processing by Steven W. Smith, Ph.D.

Other lists

• Build Your Own X

• Electronic References by Colin S. Gordon - a loosely-categorized collection of links to CS textbooks in a variety of areas that are freely available online.

• Free Computer Books

• Free Tech Books

• Project Based Learning