A highly accessible, step-by-step introduction to deep learning, written in an engaging, question-and-answer style. The Little Learner introduces deep learning from the bottom up, inviting students to learn by doing. With the characteristic humor and Socratic approach of classroom favorites The Little Schemer and The Little Typer, this kindred text explains the workings of deep neural networks by constructing them incrementally from first principles using little programs that build on one another. Starting from scratch, the reader is led through a complete implementation of a substantial application: a recognizer for noisy Morse code signals. Example-driven and highly accessible, The Little Learner covers all of the concepts necessary to develop an intuitive understanding of the workings of deep neural networks, including tensors, extended operators, gradient descent algorithms, artificial neurons, dense networks, convolutional networks, residual networks, and automatic differentiation. Conversational style, illustrations, and question-and-answer format make deep learning accessible and fun Incremental approach constructs advanced concepts from first principles Presents key ideas of machine learning using a small, manageable subset of the Scheme language Suitable for anyone with knowledge of high school math and some programming experience.