Guided curriculum
One path. Every topic. Proof at every step.
The complete README roadmap, converted into an ordered 12–18 month learning system with free, verified starting points.
How to use this path
Do not collect links. Complete the loop.
Work through one competency at a time. Follow its resources in order, build the lab, answer every confidence check aloud, and publish the required evidence before moving on.
Phase 01 · 28–36 weeks
Production AI Engineer
Learn to take an AI problem from requirements through data, evaluation, deployment, and safe operation.
1.1ML & mathematical foundationsBuild the mathematical intuition and experimental judgment needed to evaluate models honestly.4–5 weeks
Topics covered from the README
- Linear algebra, probability, statistics, and optimization
- Supervised and unsupervised learning
- Bias, variance, regularization, and overfitting
- Data leakage and dataset splitting
- Class imbalance and metric selection
- Feature engineering and experiment design
Follow in this order
Guided learning sequence
- 01PDF / bookOpen resource ↗
Mathematics for Machine Learning
Deisenroth, Faisal & OngDo: Read chapters 2, 5, 6, and 7; solve selected exercises rather than reading cover to cover.
Exit with: Explain vectors, gradients, probability, and optimization in model-training language.
- 02CourseOpen resource ↗
Machine Learning Crash Course
Google for DevelopersDo: Complete the modules in order through datasets, generalization, classification, and production ML.
Exit with: Choose losses, splits, and metrics for a real prediction problem.
- 03VideoOpen resource ↗
StatQuest machine-learning playlist
StatQuestDo: Use the statistics and machine-learning playlists to repair concepts that remain unclear after the course.
Exit with: Teach bias/variance, regularization, trees, and common metrics without notes.
- 04GuideOpen resource ↗
Common pitfalls and recommended practices
scikit-learnDo: Study leakage, inconsistent preprocessing, randomness, and pipeline safety before the lab.
Exit with: Build a leakage-safe experiment with a reproducible pipeline.
Required lab
Turn knowledge into implementation
Implement linear regression and logistic regression from scratch, then compare three scikit-learn baselines on an imbalanced dataset.
Publish this evidence
- Reproducible notebook
- Metric-selection memo
- Error-analysis report
- Statistical comparison
Confidence check
- Can I derive and explain gradient descent?
- Can I design train/validation/test splits without leakage?
- Can I defend a metric for an imbalanced product problem?
1.2Applied deep learningTrain, debug, evaluate, and serve a serious non-LLM PyTorch model.5–6 weeks
Topics covered from the README
- PyTorch tensors, autograd, datasets, and training loops
- CNNs, embeddings, attention, and transformers
- Transfer learning and fine-tuning
- Mixed precision, checkpointing, and reproducibility
- Hyperparameter experiments and error analysis
Follow in this order
Guided learning sequence
- 01VideoOpen resource ↗
Introduction to Deep Learning
MIT 6.S191Do: Watch the foundations lecture and one domain lecture; write the forward and backward pass in your own words.
Exit with: Understand backpropagation, modern architectures, and training failure modes.
- 02CourseOpen resource ↗
Learn the Basics
PyTorchDo: Run every notebook from tensors through save/load, then rewrite the training loop without copying.
Exit with: Own an end-to-end PyTorch training and inference loop.
- 03CourseOpen resource ↗
Practical Deep Learning for Coders
fast.aiDo: Complete lessons 1–5 and reproduce one transfer-learning experiment with your own dataset.
Exit with: Move from a baseline to a measured, fine-tuned model.
- 04DocumentationOpen resource ↗
Reproducibility
PyTorchDo: Add seeds, deterministic settings, environment capture, and checkpoint recovery to the project.
Exit with: Repeat an experiment and explain any remaining nondeterminism.
Required lab
Turn knowledge into implementation
Build one substantial vision, speech, anomaly-detection, or time-series project with a baseline, transfer learning, error slices, and a tested inference API.
Publish this evidence
- Training pipeline
- Baseline comparison
- Model card
- Error-analysis report
- Inference tests
Confidence check
- Can I debug exploding, vanishing, or stalled training?
- Can I explain what autograd records and computes?
- Can I show which examples still fail and why?
1.3LLM & generative AI engineeringBuild evaluated retrieval and tool-using systems instead of prompt-only demos.5–6 weeks
Topics covered from the README
- Tokenization, embeddings, transformers, and inference
- Structured output and tool calling
- RAG, chunking, retrieval, and reranking
- LoRA, QLoRA, quantization, and fine-tuning decisions
- Context management, agents, and MCP
- Evaluations, guardrails, prompt injection, multimodal models, and local/cloud routing
Follow in this order
Guided learning sequence
- 01VideoOpen resource ↗
Neural Networks: Zero to Hero
Andrej KarpathyDo: Complete the tokenizer and GPT-building material; implement a tiny transformer rather than only watching.
Exit with: Explain tokens, attention, training, sampling, and inference from first principles.
- 02CourseOpen resource ↗
The LLM Course
Hugging FaceDo: Study transformers, tokenizers, datasets, fine-tuning, and sharing; complete the exercises relevant to your capstone.
Exit with: Fine-tune or adapt a small model and document the compute/quality tradeoff.
- 03VideoOpen resource ↗
LLM Bootcamp
Full Stack Deep LearningDo: Follow foundations → augmented models → LLMOps → agents; convert each lecture into one testable system requirement.
Exit with: Design RAG and agent systems with evaluation and production constraints.
- 04DocumentationOpen resource ↗
Model Context Protocol introduction
MCPDo: Build one local MCP server with typed inputs and least-privilege tools.
Exit with: Explain hosts, clients, servers, transports, capabilities, and trust boundaries.
- 05GuideOpen resource ↗
OWASP Top 10 for LLM Applications
OWASP GenAI Security ProjectDo: Threat-model the RAG and agent projects; add prompt-injection and unsafe-tool tests.
Exit with: Demonstrate grounding, validation, approval gates, and bounded execution.
Required lab
Turn knowledge into implementation
Build an evaluated RAG system with citations and a constrained agent with typed tools, approval gates, traces, adversarial tests, and explicit fallbacks.
Publish this evidence
- Retrieval evaluation
- Answer-quality evaluation
- Agent trajectory tests
- Threat model
- Cost/latency report
Confidence check
- Can I separate retrieval quality from generation quality?
- Can I decide between prompting, RAG, and fine-tuning?
- Can I diagnose a failed tool call from its trace?
1.4Production ML engineeringOperate a versioned, observable AI service with safe rollout and rollback.6–7 weeks
Topics covered from the README
- Data validation, training pipelines, model registries, and versioning
- Batch, online, and streaming inference
- APIs, queues, caching, and asynchronous jobs
- Docker, CI/CD, and Kubernetes fundamentals
- Metrics, logs, traces, drift, staged rollout, and rollback
- Privacy, secrets, access control, and load testing
Follow in this order
Guided learning sequence
- 01CourseOpen resource ↗
MLOps Course
Made With MLDo: Follow design → data → model → testing → reproducibility → production while applying each section to your project.
Exit with: Create a tested, reproducible ML repository rather than a notebook-only model.
- 02VideoOpen resource ↗
Full Stack Deep Learning 2022
Full Stack Deep LearningDo: Prioritize infrastructure, testing, deployment, monitoring, data management, and continual learning lectures and labs.
Exit with: Connect training, serving, observability, and iteration into one lifecycle.
- 03GuideOpen resource ↗
Rules of Machine Learning
GoogleDo: Turn the rules into a design-review checklist for the service.
Exit with: Spot avoidable production and data-pipeline failure modes.
- 04CourseOpen resource ↗
Kubernetes Basics
KubernetesDo: Deploy locally, expose the service, scale it, update it, and perform a rollback.
Exit with: Explain deployments, services, health checks, scaling, and rollbacks.
Required lab
Turn knowledge into implementation
Convert the Phase 1 model into an authenticated, containerized service with automated evaluation, CI, telemetry, load testing, staged deployment, and rollback.
Publish this evidence
- Versioned pipeline
- CI evaluation gate
- Load-test report
- Observability dashboard
- Rollback runbook
Confidence check
- Can I reproduce the exact model behind a prediction?
- Can I distinguish model drift from service failure?
- Can I roll back without losing requests or evidence?
1.5AI system designMake defensible architecture decisions across data, models, scale, reliability, privacy, and cost.3–4 weeks
Topics covered from the README
- Requirements, scale estimates, and service-level objectives
- Data and model lifecycle design
- Evaluation, latency, reliability, and observability
- Privacy, security, and cost tradeoffs
- RAG, ranking, multimodal, gateway, and real-time pipeline patterns
Follow in this order
Guided learning sequence
- 01CourseOpen resource ↗
Machine Learning Systems Design
Stanford CS329SDo: Study the lectures in order and use their iterative framework for every design.
Exit with: Frame objectives, data, models, infrastructure, monitoring, and iteration together.
- 02PracticeOpen resource ↗
Machine Learning Systems Design exercises
Chip HuyenDo: Work through four cases under a 45-minute limit, then revise each with peer or rubric feedback.
Exit with: Produce structured designs under interview constraints.
- 03PDF / bookOpen resource ↗
Machine Learning Engineering
Andriy BurkovDo: Use the free online book as a reference for requirements, data, serving, monitoring, and technical debt.
Exit with: Recognize lifecycle and operational tradeoffs beyond model choice.
Required lab
Turn knowledge into implementation
Write and review designs for an enterprise RAG platform, recommendation system, multimodal search, and local/cloud model gateway.
Publish this evidence
- Four design documents
- Capacity calculations
- Failure-mode tables
- Security and cost reviews
Confidence check
- Can I turn an ambiguous request into measurable requirements?
- Can I explain the data and model lifecycle end to end?
- Can I defend reliability, privacy, and cost tradeoffs?
1.6Large-company interview preparationConvert project evidence into consistent coding, ML-depth, design, and behavioral interview performance.4–6 weeks alongside projects
Topics covered from the README
- Data structures, algorithms, complexity, Python, and SQL
- Concurrency and distributed-systems fundamentals
- Metrics, experiment design, training failures, transformers, RAG, agents, drift, and monitoring
- AI/ML system design
- Project walkthroughs, architecture tradeoffs, incidents, leadership, ambiguity, mentoring, and influence
Follow in this order
Guided learning sequence
- 01CourseOpen resource ↗
Coding Interview University
John WashamDo: Use the study plan selectively; pair each topic with timed problems and written complexity analysis.
Exit with: Solve common patterns clearly under time pressure.
- 02GuideOpen resource ↗
Tech Interview Handbook
Tech Interview HandbookDo: Use its coding, resume, behavioral, and negotiation sections to structure weekly practice.
Exit with: Run a complete interview loop rather than isolated coding practice.
- 03PDF / bookOpen resource ↗
Machine Learning Interviews Book
Chip HuyenDo: Answer questions aloud, tag weak areas, and link every strong answer to project evidence.
Exit with: Explain ML decisions precisely without hiding behind terminology.
Required lab
Turn knowledge into implementation
Complete five coding, three ML-depth, three AI system-design, and two behavioral mocks with scored rubrics and corrective drills.
Publish this evidence
- Mock scorecards
- 100–150 curated problems
- Story bank
- Evidence-backed resume
- Three polished project walkthroughs
Confidence check
- Can I solve and communicate under a fixed time limit?
- Can I diagnose a model or production failure aloud?
- Can every resume claim be opened and inspected?
Phase completion gate
Production AI Engineer exit gate
Begin applying when the evidence is complete—not when the reading list is complete.
- Traditional ML production system
- Evaluated RAG and constrained agent system
- AI platform capstone
- Four reviewed system designs
- Mock-interview scorecards and evidence-backed resume
Phase 02 · 28–40 weeks
Edge AI Engineer · NVIDIA track
Take trained models through systems programming, acceleration, device deployment, profiling, and fleet operation.
2.1Systems programming foundationBuild the C++, Linux, and computer-architecture foundation required for performance work.5–6 weeks
Topics covered from the README
- Modern C++17/20, ownership, RAII, move semantics, and templates
- Threads, synchronization, and concurrency
- Linux processes, signals, and debugging
- CMake and native test tooling
- Python/C++ interoperability
- Computer architecture, cache behavior, and SIMD fundamentals
Follow in this order
Guided learning sequence
- 01CourseOpen resource ↗
Learn C++
LearnCpp.comDo: Complete fundamentals, object lifetime, move semantics, templates, smart pointers, and concurrency-relevant chapters.
Exit with: Write idiomatic C++ with explicit ownership and predictable lifetime.
- 02VideoOpen resource ↗
The Missing Semester
MITDo: Complete shell, debugging/profiling, Git, and build-tool lectures using Linux.
Exit with: Navigate, debug, automate, and profile confidently from the terminal.
- 03GuideOpen resource ↗
CMake Tutorial
CMakeDo: Create a multi-target library, tests, install rules, and a release build.
Exit with: Own a reproducible native build instead of compiling ad hoc commands.
- 04DocumentationOpen resource ↗
pybind11 basics
pybind11Do: Expose one C++ tensor or preprocessing operation to Python with tests and benchmarks.
Exit with: Reason about copies, ownership, exceptions, and the Python/C++ boundary.
Required lab
Turn knowledge into implementation
Build a tested tensor component, a multithreaded preprocessing pipeline, and a Python extension; profile and optimize one CPU bottleneck.
Publish this evidence
- C++ library and tests
- Threading benchmark
- Python binding
- CPU profile
- Optimization report
Confidence check
- Can I explain every allocation and owner?
- Can I identify a race, deadlock, and false-sharing risk?
- Can I use a profiler before changing code?
2.2Parallel computing & CUDAWrite, profile, and improve CUDA kernels using measured evidence.6–8 weeks
Topics covered from the README
- CUDA grids, blocks, warps, and threads
- Global, shared, constant, and local memory
- Coalescing, synchronization, streams, and asynchronous copies
- Pinned and unified memory
- Occupancy, kernel fusion, Tensor Cores, and mixed precision
- Nsight Systems and Nsight Compute
Follow in this order
Guided learning sequence
- 01VideoOpen resource ↗
Intro to Parallel Programming
Udacity / NVIDIADo: Complete the lessons and exercises on mapping, memory, communication, and GPU algorithms.
Exit with: Think in parallel decomposition before writing CUDA syntax.
- 02PDF / bookOpen resource ↗
CUDA Programming Guide
NVIDIADo: Study the programming model, memory hierarchy, execution model, streams, and performance guidance selectively.
Exit with: Explain how a kernel maps to hardware and memory transactions.
- 03GuideOpen resource ↗
CUDA C++ Best Practices Guide
NVIDIADo: Apply the APOD cycle—assess, parallelize, optimize, deploy—to every lab kernel.
Exit with: Prioritize optimizations using expected impact and measured bottlenecks.
- 04DocumentationOpen resource ↗
Nsight Compute Kernel Profiling Guide
NVIDIADo: Capture a baseline, classify the bottleneck, change one factor, and compare profiles.
Exit with: Read occupancy, memory, instruction, and roofline evidence without guessing.
Required lab
Turn knowledge into implementation
Implement vector operations, reduction, matrix multiplication, image preprocessing, softmax, and one fused operation with a CPU/GPU benchmark suite.
Publish this evidence
- Correctness tests
- CPU/GPU benchmarks
- Nsight reports
- Before/after kernel profiles
- Optimization narrative
Confidence check
- Can I distinguish compute-bound from memory-bound behavior?
- Can I explain launch, transfer, synchronization, and occupancy overhead?
- Can I prove why an optimization worked?
2.3Model interchange & inference runtimesMove one model from PyTorch through ONNX Runtime and TensorRT without losing correctness.3–4 weeks
Topics covered from the README
- PyTorch export to ONNX
- ONNX graph inspection and validation
- ONNX Runtime CPU and CUDA execution providers
- Correctness, startup, latency, throughput, memory, and artifact-size comparison
- Unsupported operators, dynamic shapes, preprocessing mismatches, precision differences, and CPU fallback
Follow in this order
Guided learning sequence
- 01GuideOpen resource ↗
Export a PyTorch model to ONNX
PyTorchDo: Export with representative inputs, validate outputs, and inspect the graph and shape assumptions.
Exit with: Produce a valid ONNX artifact with a numerical parity test.
- 02DocumentationOpen resource ↗
ONNX Runtime performance tutorials
ONNX RuntimeDo: Benchmark CPU and CUDA providers with warmup, stable inputs, I/O binding where relevant, and percentile latency.
Exit with: Compare runtimes without measurement mistakes.
- 03CourseOpen resource ↗
Deploy on mobile
ONNX RuntimeDo: Follow the model-fit, runtime, execution-provider, measurement, and optimization flow.
Exit with: Evaluate whether a model and runtime fit an actual edge device.
Required lab
Turn knowledge into implementation
Benchmark the same model in PyTorch, ONNX Runtime CPU, ONNX Runtime CUDA, and TensorRT with numerical parity and identical preprocessing.
Publish this evidence
- Export script
- Parity tests
- Runtime benchmark table
- Failure diary
- Artifact-size report
Confidence check
- Can I locate a numerical mismatch in preprocessing, export, or precision?
- Can I detect unintended CPU fallback?
- Can I compare runtimes fairly?
2.4TensorRT specializationBuild and operate optimized TensorRT engines with explicit quality/performance tradeoffs.5–7 weeks
Topics covered from the README
- TensorRT network, engine, runtime, and execution-context lifecycle
- ONNX parsing, optimization profiles, static and dynamic shapes
- FP32, FP16, BF16, FP8, INT8, and INT4 concepts
- Explicit quantization, Q/DQ graphs, calibration, and accuracy validation
- Engine serialization, CUDA streams, and memory management
- Plugins, trtexec, and profiling
Follow in this order
Guided learning sequence
- 01GuideOpen resource ↗
Build Your First Engine
NVIDIA TensorRTDo: Complete the narrow end-to-end engine build before reading the broader API material.
Exit with: Verify the environment and understand the build → serialize → run loop.
- 02PDF / bookOpen resource ↗
TensorRT Quick Start Guide
NVIDIADo: Follow ONNX conversion, runtime API, precision selection, and deployment workflows with your Phase 1 model.
Exit with: Build FP32 and FP16 engines and run them from Python and C++.
- 03DocumentationOpen resource ↗
Working with Quantized Types
NVIDIA TensorRTDo: Study explicit quantization and Q/DQ, then build INT8 only with a representative evaluation set.
Exit with: Quantize while measuring accuracy rather than assuming it is preserved.
- 04GuideOpen resource ↗
Performance Best Practices
NVIDIA TensorRTDo: Use trtexec, profiling, streams, transfers, and batching guidance to find the real bottleneck.
Exit with: Create a reproducible performance report with controlled variables.
Required lab
Turn knowledge into implementation
Create FP32, FP16, INT8, dynamic-input, and asynchronous inference variants; compare accuracy, latency, throughput, memory, and engine size.
Publish this evidence
- Reproducible engine builds
- Precision accuracy report
- trtexec logs
- Async pipeline
- Bottleneck analysis
Confidence check
- Can I explain optimization profiles and execution contexts?
- Can I validate quantization quality on representative data?
- Can I separate GPU compute time from end-to-end latency?
2.5Jetson & real-time Edge AIOperate a sustained camera or video workload under real device, power, thermal, and recovery constraints.5–6 weeks
Topics covered from the README
- Jetson and JetPack architecture
- GPU, DLA, camera, and video pipelines
- GStreamer and DeepStream
- Zero-copy and hardware-accelerated media concepts
- Power modes and thermal behavior
- Container deployment and device recovery
Follow in this order
Guided learning sequence
- 01VideoOpen resource ↗
Jetson learning tutorials
NVIDIA DeveloperDo: Complete setup, JetPack, camera, and introductory edge-AI material for your exact Jetson model.
Exit with: Prepare, inspect, update, and recover the target device safely.
- 02CourseOpen resource ↗
GStreamer Basic Tutorials
GStreamerDo: Build pipelines, inspect caps, handle bus messages, and reason about clocks and buffering.
Exit with: Diagnose media-pipeline negotiation, buffering, and backpressure failures.
- 03DocumentationOpen resource ↗
DeepStream Developer Guide
NVIDIADo: Complete the Jetson quickstart, then study reference apps, latency measurement, metadata, containers, and tuning.
Exit with: Build an accelerated streaming inference pipeline using supported components.
- 04GuideOpen resource ↗
Getting Started with Jetson
Jetson AI LabDo: Use the setup and environment guides, then select one device-appropriate model tutorial.
Exit with: Run a reproducible device workload in a controlled container environment.
Required lab
Turn knowledge into implementation
Build camera/video decode → preprocess → TensorRT → tracking/postprocess → local event output and sustain it under load.
Publish this evidence
- End-to-end latency
- FPS and dropped frames
- CPU/GPU/memory telemetry
- Power/thermal report
- Recovery test
Confidence check
- Can I locate latency across decode, preprocess, inference, and postprocess?
- Can I explain the effect of power mode and thermal throttling?
- Can the service recover after camera, process, or device failure?
2.6Edge GenAI & multimodal systemsRun and evaluate useful local language and multimodal workflows within strict memory and power budgets.4–6 weeks
Topics covered from the README
- Small language models, prefill, decode, and KV-cache behavior
- Weight-only quantization
- Context and memory budgets
- Local embeddings and retrieval
- Multimodal pipelines
- Resource-aware local/cloud routing
Follow in this order
Guided learning sequence
- 01CourseOpen resource ↗
Introduction to GenAI on Jetson
Jetson AI LabDo: Follow the fundamentals and one LLM/VLM tutorial that fits the memory of your target Jetson.
Exit with: Run a local model and understand its runtime, container, and memory requirements.
- 02GuideOpen resource ↗
llama.cpp
ggml-orgDo: Run two quantization levels, control context size, and measure prompt processing, generation, and peak memory.
Exit with: Explain how model format, quantization, context, and backend affect performance.
- 03DocumentationOpen resource ↗
Quantization concepts
Hugging FaceDo: Compare weight-only and activation-aware approaches conceptually, then document why the chosen method fits the device.
Exit with: Make a quality/memory/performance quantization decision.
- 04VideoOpen resource ↗
Jetson Generative AI Lab videos
NVIDIA DeveloperDo: Use the Jetson and generative-AI playlists to reinforce deployment and optimization concepts for the selected stack.
Exit with: Connect model behavior to the NVIDIA edge runtime and hardware limits.
Required lab
Turn knowledge into implementation
Build an offline-first multimodal assistant with local inference and retrieval, deterministic tools, optional cloud escalation, and resource-aware routing.
Publish this evidence
- TTFT and decode rate
- KV-cache and peak memory
- Load time
- Power/thermal measurements
- Task-quality and fallback evaluation
Confidence check
- Can I explain prefill versus decode bottlenecks?
- Can I predict how context length changes memory?
- Can I justify when a request stays local or escalates?
2.7Edge MLOps, fleet engineering & securityUpdate, observe, reconcile, and recover edge models safely across unreliable networks.4–5 weeks
Topics covered from the README
- Signed and versioned model artifacts
- Compatibility manifests and checksums
- Resumable downloads and atomic activation
- Canary rollout and rollback
- Privacy-safe telemetry and fleet health
- Offline reconciliation and recovery
- Drift and adversarial input testing
Follow in this order
Guided learning sequence
- 01GuideOpen resource ↗
The Update Framework
TUFDo: Study roles, metadata, signatures, expiration, rollback protection, and key compromise recovery.
Exit with: Design a signed update chain that survives common repository attacks.
- 02DocumentationOpen resource ↗
Uptane Standard
UptaneDo: Map its secure automotive update concepts to a general edge fleet and document what you keep or simplify.
Exit with: Design staged, compatible, recoverable device updates.
- 03PDF / bookOpen resource ↗
Adversarial Machine Learning taxonomy
NISTDo: Select relevant evasion, poisoning, privacy, and misuse threats and turn them into tests or controls.
Exit with: Threat-model model behavior as well as software delivery.
- 04DocumentationOpen resource ↗
SLSA specification
OpenSSFDo: Add provenance, integrity checks, and a verifiable build path for models and containers.
Exit with: Trace deployed artifacts back to controlled source and build steps.
Required lab
Turn knowledge into implementation
Implement signed model manifests, resumable download, checksum validation, atomic activation, canary rollout, failed-update recovery, and rollback.
Publish this evidence
- Signed manifest
- Compatibility checks
- Canary report
- Rollback demonstration
- Offline reconciliation test
- Threat model
Confidence check
- Can a device reject a validly signed but incompatible model?
- Can activation survive power loss?
- Can I recover from a bad update or compromised signing role?
Phase completion gate
NVIDIA-oriented exit gate
Apply when TensorRT, target-device performance, fleet safety, and communication are proven together.
- Profiled and optimized CUDA kernels
- ONNX-to-TensorRT correctness and benchmark report
- Sustained Jetson real-time deployment
- Offline-first multimodal NVIDIA capstone
- Nsight, power, thermal, update, rollback, and threat-model evidence