How to use this path

Do not collect links. Complete the loop.

Work through one competency at a time. Follow its resources in order, build the lab, answer every confidence check aloud, and publish the required evidence before moving on.

01Learn02Implement03Evaluate04Profile05Explain06Publish

Phase 01 · 28–36 weeks

Production AI Engineer

Learn to take an AI problem from requirements through data, evaluation, deployment, and safe operation.

1.1ML & mathematical foundationsBuild the mathematical intuition and experimental judgment needed to evaluate models honestly.4–5 weeks

Topics covered from the README

  • Linear algebra, probability, statistics, and optimization
  • Supervised and unsupervised learning
  • Bias, variance, regularization, and overfitting
  • Data leakage and dataset splitting
  • Class imbalance and metric selection
  • Feature engineering and experiment design

Follow in this order

Guided learning sequence

4 free resources
  1. 01
    PDF / book

    Mathematics for Machine Learning

    Deisenroth, Faisal & Ong
    Open resource

    Do: Read chapters 2, 5, 6, and 7; solve selected exercises rather than reading cover to cover.

    Exit with: Explain vectors, gradients, probability, and optimization in model-training language.

  2. 02
    Course

    Machine Learning Crash Course

    Google for Developers
    Open resource

    Do: Complete the modules in order through datasets, generalization, classification, and production ML.

    Exit with: Choose losses, splits, and metrics for a real prediction problem.

  3. 03
    Video

    StatQuest machine-learning playlist

    StatQuest
    Open resource

    Do: Use the statistics and machine-learning playlists to repair concepts that remain unclear after the course.

    Exit with: Teach bias/variance, regularization, trees, and common metrics without notes.

  4. 04
    Guide

    Common pitfalls and recommended practices

    scikit-learn
    Open resource

    Do: Study leakage, inconsistent preprocessing, randomness, and pipeline safety before the lab.

    Exit with: Build a leakage-safe experiment with a reproducible pipeline.

Required lab

Turn knowledge into implementation

Implement linear regression and logistic regression from scratch, then compare three scikit-learn baselines on an imbalanced dataset.

Publish this evidence

  • Reproducible notebook
  • Metric-selection memo
  • Error-analysis report
  • Statistical comparison

Confidence check

  • Can I derive and explain gradient descent?
  • Can I design train/validation/test splits without leakage?
  • Can I defend a metric for an imbalanced product problem?
1.2Applied deep learningTrain, debug, evaluate, and serve a serious non-LLM PyTorch model.5–6 weeks

Topics covered from the README

  • PyTorch tensors, autograd, datasets, and training loops
  • CNNs, embeddings, attention, and transformers
  • Transfer learning and fine-tuning
  • Mixed precision, checkpointing, and reproducibility
  • Hyperparameter experiments and error analysis

Follow in this order

Guided learning sequence

4 free resources
  1. 01
    Video

    Introduction to Deep Learning

    MIT 6.S191
    Open resource

    Do: Watch the foundations lecture and one domain lecture; write the forward and backward pass in your own words.

    Exit with: Understand backpropagation, modern architectures, and training failure modes.

  2. 02
    Course

    Learn the Basics

    PyTorch
    Open resource

    Do: Run every notebook from tensors through save/load, then rewrite the training loop without copying.

    Exit with: Own an end-to-end PyTorch training and inference loop.

  3. 03
    Course

    Practical Deep Learning for Coders

    fast.ai
    Open resource

    Do: Complete lessons 1–5 and reproduce one transfer-learning experiment with your own dataset.

    Exit with: Move from a baseline to a measured, fine-tuned model.

  4. 04
    Documentation

    Reproducibility

    PyTorch
    Open resource

    Do: Add seeds, deterministic settings, environment capture, and checkpoint recovery to the project.

    Exit with: Repeat an experiment and explain any remaining nondeterminism.

Required lab

Turn knowledge into implementation

Build one substantial vision, speech, anomaly-detection, or time-series project with a baseline, transfer learning, error slices, and a tested inference API.

Publish this evidence

  • Training pipeline
  • Baseline comparison
  • Model card
  • Error-analysis report
  • Inference tests

Confidence check

  • Can I debug exploding, vanishing, or stalled training?
  • Can I explain what autograd records and computes?
  • Can I show which examples still fail and why?
1.3LLM & generative AI engineeringBuild evaluated retrieval and tool-using systems instead of prompt-only demos.5–6 weeks

Topics covered from the README

  • Tokenization, embeddings, transformers, and inference
  • Structured output and tool calling
  • RAG, chunking, retrieval, and reranking
  • LoRA, QLoRA, quantization, and fine-tuning decisions
  • Context management, agents, and MCP
  • Evaluations, guardrails, prompt injection, multimodal models, and local/cloud routing

Follow in this order

Guided learning sequence

5 free resources
  1. 01
    Video

    Neural Networks: Zero to Hero

    Andrej Karpathy
    Open resource

    Do: Complete the tokenizer and GPT-building material; implement a tiny transformer rather than only watching.

    Exit with: Explain tokens, attention, training, sampling, and inference from first principles.

  2. 02
    Course

    The LLM Course

    Hugging Face
    Open resource

    Do: Study transformers, tokenizers, datasets, fine-tuning, and sharing; complete the exercises relevant to your capstone.

    Exit with: Fine-tune or adapt a small model and document the compute/quality tradeoff.

  3. 03
    Video

    LLM Bootcamp

    Full Stack Deep Learning
    Open resource

    Do: Follow foundations → augmented models → LLMOps → agents; convert each lecture into one testable system requirement.

    Exit with: Design RAG and agent systems with evaluation and production constraints.

  4. 04
    Documentation

    Model Context Protocol introduction

    MCP
    Open resource

    Do: Build one local MCP server with typed inputs and least-privilege tools.

    Exit with: Explain hosts, clients, servers, transports, capabilities, and trust boundaries.

  5. 05
    Guide

    OWASP Top 10 for LLM Applications

    OWASP GenAI Security Project
    Open resource

    Do: Threat-model the RAG and agent projects; add prompt-injection and unsafe-tool tests.

    Exit with: Demonstrate grounding, validation, approval gates, and bounded execution.

Required lab

Turn knowledge into implementation

Build an evaluated RAG system with citations and a constrained agent with typed tools, approval gates, traces, adversarial tests, and explicit fallbacks.

Publish this evidence

  • Retrieval evaluation
  • Answer-quality evaluation
  • Agent trajectory tests
  • Threat model
  • Cost/latency report

Confidence check

  • Can I separate retrieval quality from generation quality?
  • Can I decide between prompting, RAG, and fine-tuning?
  • Can I diagnose a failed tool call from its trace?
1.4Production ML engineeringOperate a versioned, observable AI service with safe rollout and rollback.6–7 weeks

Topics covered from the README

  • Data validation, training pipelines, model registries, and versioning
  • Batch, online, and streaming inference
  • APIs, queues, caching, and asynchronous jobs
  • Docker, CI/CD, and Kubernetes fundamentals
  • Metrics, logs, traces, drift, staged rollout, and rollback
  • Privacy, secrets, access control, and load testing

Follow in this order

Guided learning sequence

4 free resources
  1. 01
    Course

    MLOps Course

    Made With ML
    Open resource

    Do: Follow design → data → model → testing → reproducibility → production while applying each section to your project.

    Exit with: Create a tested, reproducible ML repository rather than a notebook-only model.

  2. 02
    Video

    Full Stack Deep Learning 2022

    Full Stack Deep Learning
    Open resource

    Do: Prioritize infrastructure, testing, deployment, monitoring, data management, and continual learning lectures and labs.

    Exit with: Connect training, serving, observability, and iteration into one lifecycle.

  3. 03
    Guide

    Rules of Machine Learning

    Google
    Open resource

    Do: Turn the rules into a design-review checklist for the service.

    Exit with: Spot avoidable production and data-pipeline failure modes.

  4. 04
    Course

    Kubernetes Basics

    Kubernetes
    Open resource

    Do: Deploy locally, expose the service, scale it, update it, and perform a rollback.

    Exit with: Explain deployments, services, health checks, scaling, and rollbacks.

Required lab

Turn knowledge into implementation

Convert the Phase 1 model into an authenticated, containerized service with automated evaluation, CI, telemetry, load testing, staged deployment, and rollback.

Publish this evidence

  • Versioned pipeline
  • CI evaluation gate
  • Load-test report
  • Observability dashboard
  • Rollback runbook

Confidence check

  • Can I reproduce the exact model behind a prediction?
  • Can I distinguish model drift from service failure?
  • Can I roll back without losing requests or evidence?
1.5AI system designMake defensible architecture decisions across data, models, scale, reliability, privacy, and cost.3–4 weeks

Topics covered from the README

  • Requirements, scale estimates, and service-level objectives
  • Data and model lifecycle design
  • Evaluation, latency, reliability, and observability
  • Privacy, security, and cost tradeoffs
  • RAG, ranking, multimodal, gateway, and real-time pipeline patterns

Follow in this order

Guided learning sequence

3 free resources
  1. 01
    Course

    Machine Learning Systems Design

    Stanford CS329S
    Open resource

    Do: Study the lectures in order and use their iterative framework for every design.

    Exit with: Frame objectives, data, models, infrastructure, monitoring, and iteration together.

  2. 02
    Practice

    Machine Learning Systems Design exercises

    Chip Huyen
    Open resource

    Do: Work through four cases under a 45-minute limit, then revise each with peer or rubric feedback.

    Exit with: Produce structured designs under interview constraints.

  3. 03
    PDF / book

    Machine Learning Engineering

    Andriy Burkov
    Open resource

    Do: Use the free online book as a reference for requirements, data, serving, monitoring, and technical debt.

    Exit with: Recognize lifecycle and operational tradeoffs beyond model choice.

Required lab

Turn knowledge into implementation

Write and review designs for an enterprise RAG platform, recommendation system, multimodal search, and local/cloud model gateway.

Publish this evidence

  • Four design documents
  • Capacity calculations
  • Failure-mode tables
  • Security and cost reviews

Confidence check

  • Can I turn an ambiguous request into measurable requirements?
  • Can I explain the data and model lifecycle end to end?
  • Can I defend reliability, privacy, and cost tradeoffs?
1.6Large-company interview preparationConvert project evidence into consistent coding, ML-depth, design, and behavioral interview performance.4–6 weeks alongside projects

Topics covered from the README

  • Data structures, algorithms, complexity, Python, and SQL
  • Concurrency and distributed-systems fundamentals
  • Metrics, experiment design, training failures, transformers, RAG, agents, drift, and monitoring
  • AI/ML system design
  • Project walkthroughs, architecture tradeoffs, incidents, leadership, ambiguity, mentoring, and influence

Follow in this order

Guided learning sequence

3 free resources
  1. 01
    Course

    Coding Interview University

    John Washam
    Open resource

    Do: Use the study plan selectively; pair each topic with timed problems and written complexity analysis.

    Exit with: Solve common patterns clearly under time pressure.

  2. 02
    Guide

    Tech Interview Handbook

    Tech Interview Handbook
    Open resource

    Do: Use its coding, resume, behavioral, and negotiation sections to structure weekly practice.

    Exit with: Run a complete interview loop rather than isolated coding practice.

  3. 03
    PDF / book

    Machine Learning Interviews Book

    Chip Huyen
    Open resource

    Do: Answer questions aloud, tag weak areas, and link every strong answer to project evidence.

    Exit with: Explain ML decisions precisely without hiding behind terminology.

Required lab

Turn knowledge into implementation

Complete five coding, three ML-depth, three AI system-design, and two behavioral mocks with scored rubrics and corrective drills.

Publish this evidence

  • Mock scorecards
  • 100–150 curated problems
  • Story bank
  • Evidence-backed resume
  • Three polished project walkthroughs

Confidence check

  • Can I solve and communicate under a fixed time limit?
  • Can I diagnose a model or production failure aloud?
  • Can every resume claim be opened and inspected?

Phase completion gate

Production AI Engineer exit gate

Begin applying when the evidence is complete—not when the reading list is complete.

  • Traditional ML production system
  • Evaluated RAG and constrained agent system
  • AI platform capstone
  • Four reviewed system designs
  • Mock-interview scorecards and evidence-backed resume

Phase 02 · 28–40 weeks

Edge AI Engineer · NVIDIA track

Take trained models through systems programming, acceleration, device deployment, profiling, and fleet operation.

2.1Systems programming foundationBuild the C++, Linux, and computer-architecture foundation required for performance work.5–6 weeks

Topics covered from the README

  • Modern C++17/20, ownership, RAII, move semantics, and templates
  • Threads, synchronization, and concurrency
  • Linux processes, signals, and debugging
  • CMake and native test tooling
  • Python/C++ interoperability
  • Computer architecture, cache behavior, and SIMD fundamentals

Follow in this order

Guided learning sequence

4 free resources
  1. 01
    Course

    Learn C++

    LearnCpp.com
    Open resource

    Do: Complete fundamentals, object lifetime, move semantics, templates, smart pointers, and concurrency-relevant chapters.

    Exit with: Write idiomatic C++ with explicit ownership and predictable lifetime.

  2. 02
    Video

    The Missing Semester

    MIT
    Open resource

    Do: Complete shell, debugging/profiling, Git, and build-tool lectures using Linux.

    Exit with: Navigate, debug, automate, and profile confidently from the terminal.

  3. 03
    Guide

    CMake Tutorial

    CMake
    Open resource

    Do: Create a multi-target library, tests, install rules, and a release build.

    Exit with: Own a reproducible native build instead of compiling ad hoc commands.

  4. 04
    Documentation

    pybind11 basics

    pybind11
    Open resource

    Do: Expose one C++ tensor or preprocessing operation to Python with tests and benchmarks.

    Exit with: Reason about copies, ownership, exceptions, and the Python/C++ boundary.

Required lab

Turn knowledge into implementation

Build a tested tensor component, a multithreaded preprocessing pipeline, and a Python extension; profile and optimize one CPU bottleneck.

Publish this evidence

  • C++ library and tests
  • Threading benchmark
  • Python binding
  • CPU profile
  • Optimization report

Confidence check

  • Can I explain every allocation and owner?
  • Can I identify a race, deadlock, and false-sharing risk?
  • Can I use a profiler before changing code?
2.2Parallel computing & CUDAWrite, profile, and improve CUDA kernels using measured evidence.6–8 weeks

Topics covered from the README

  • CUDA grids, blocks, warps, and threads
  • Global, shared, constant, and local memory
  • Coalescing, synchronization, streams, and asynchronous copies
  • Pinned and unified memory
  • Occupancy, kernel fusion, Tensor Cores, and mixed precision
  • Nsight Systems and Nsight Compute

Follow in this order

Guided learning sequence

4 free resources
  1. 01
    Video

    Intro to Parallel Programming

    Udacity / NVIDIA
    Open resource

    Do: Complete the lessons and exercises on mapping, memory, communication, and GPU algorithms.

    Exit with: Think in parallel decomposition before writing CUDA syntax.

  2. 02
    PDF / book

    CUDA Programming Guide

    NVIDIA
    Open resource

    Do: Study the programming model, memory hierarchy, execution model, streams, and performance guidance selectively.

    Exit with: Explain how a kernel maps to hardware and memory transactions.

  3. 03
    Guide

    CUDA C++ Best Practices Guide

    NVIDIA
    Open resource

    Do: Apply the APOD cycle—assess, parallelize, optimize, deploy—to every lab kernel.

    Exit with: Prioritize optimizations using expected impact and measured bottlenecks.

  4. 04
    Documentation

    Nsight Compute Kernel Profiling Guide

    NVIDIA
    Open resource

    Do: Capture a baseline, classify the bottleneck, change one factor, and compare profiles.

    Exit with: Read occupancy, memory, instruction, and roofline evidence without guessing.

Required lab

Turn knowledge into implementation

Implement vector operations, reduction, matrix multiplication, image preprocessing, softmax, and one fused operation with a CPU/GPU benchmark suite.

Publish this evidence

  • Correctness tests
  • CPU/GPU benchmarks
  • Nsight reports
  • Before/after kernel profiles
  • Optimization narrative

Confidence check

  • Can I distinguish compute-bound from memory-bound behavior?
  • Can I explain launch, transfer, synchronization, and occupancy overhead?
  • Can I prove why an optimization worked?
2.3Model interchange & inference runtimesMove one model from PyTorch through ONNX Runtime and TensorRT without losing correctness.3–4 weeks

Topics covered from the README

  • PyTorch export to ONNX
  • ONNX graph inspection and validation
  • ONNX Runtime CPU and CUDA execution providers
  • Correctness, startup, latency, throughput, memory, and artifact-size comparison
  • Unsupported operators, dynamic shapes, preprocessing mismatches, precision differences, and CPU fallback

Follow in this order

Guided learning sequence

3 free resources
  1. 01
    Guide

    Export a PyTorch model to ONNX

    PyTorch
    Open resource

    Do: Export with representative inputs, validate outputs, and inspect the graph and shape assumptions.

    Exit with: Produce a valid ONNX artifact with a numerical parity test.

  2. 02
    Documentation

    ONNX Runtime performance tutorials

    ONNX Runtime
    Open resource

    Do: Benchmark CPU and CUDA providers with warmup, stable inputs, I/O binding where relevant, and percentile latency.

    Exit with: Compare runtimes without measurement mistakes.

  3. 03
    Course

    Deploy on mobile

    ONNX Runtime
    Open resource

    Do: Follow the model-fit, runtime, execution-provider, measurement, and optimization flow.

    Exit with: Evaluate whether a model and runtime fit an actual edge device.

Required lab

Turn knowledge into implementation

Benchmark the same model in PyTorch, ONNX Runtime CPU, ONNX Runtime CUDA, and TensorRT with numerical parity and identical preprocessing.

Publish this evidence

  • Export script
  • Parity tests
  • Runtime benchmark table
  • Failure diary
  • Artifact-size report

Confidence check

  • Can I locate a numerical mismatch in preprocessing, export, or precision?
  • Can I detect unintended CPU fallback?
  • Can I compare runtimes fairly?
2.4TensorRT specializationBuild and operate optimized TensorRT engines with explicit quality/performance tradeoffs.5–7 weeks

Topics covered from the README

  • TensorRT network, engine, runtime, and execution-context lifecycle
  • ONNX parsing, optimization profiles, static and dynamic shapes
  • FP32, FP16, BF16, FP8, INT8, and INT4 concepts
  • Explicit quantization, Q/DQ graphs, calibration, and accuracy validation
  • Engine serialization, CUDA streams, and memory management
  • Plugins, trtexec, and profiling

Follow in this order

Guided learning sequence

4 free resources
  1. 01
    Guide

    Build Your First Engine

    NVIDIA TensorRT
    Open resource

    Do: Complete the narrow end-to-end engine build before reading the broader API material.

    Exit with: Verify the environment and understand the build → serialize → run loop.

  2. 02
    PDF / book

    TensorRT Quick Start Guide

    NVIDIA
    Open resource

    Do: Follow ONNX conversion, runtime API, precision selection, and deployment workflows with your Phase 1 model.

    Exit with: Build FP32 and FP16 engines and run them from Python and C++.

  3. 03
    Documentation

    Working with Quantized Types

    NVIDIA TensorRT
    Open resource

    Do: Study explicit quantization and Q/DQ, then build INT8 only with a representative evaluation set.

    Exit with: Quantize while measuring accuracy rather than assuming it is preserved.

  4. 04
    Guide

    Performance Best Practices

    NVIDIA TensorRT
    Open resource

    Do: Use trtexec, profiling, streams, transfers, and batching guidance to find the real bottleneck.

    Exit with: Create a reproducible performance report with controlled variables.

Required lab

Turn knowledge into implementation

Create FP32, FP16, INT8, dynamic-input, and asynchronous inference variants; compare accuracy, latency, throughput, memory, and engine size.

Publish this evidence

  • Reproducible engine builds
  • Precision accuracy report
  • trtexec logs
  • Async pipeline
  • Bottleneck analysis

Confidence check

  • Can I explain optimization profiles and execution contexts?
  • Can I validate quantization quality on representative data?
  • Can I separate GPU compute time from end-to-end latency?
2.5Jetson & real-time Edge AIOperate a sustained camera or video workload under real device, power, thermal, and recovery constraints.5–6 weeks

Topics covered from the README

  • Jetson and JetPack architecture
  • GPU, DLA, camera, and video pipelines
  • GStreamer and DeepStream
  • Zero-copy and hardware-accelerated media concepts
  • Power modes and thermal behavior
  • Container deployment and device recovery

Follow in this order

Guided learning sequence

4 free resources
  1. 01
    Video

    Jetson learning tutorials

    NVIDIA Developer
    Open resource

    Do: Complete setup, JetPack, camera, and introductory edge-AI material for your exact Jetson model.

    Exit with: Prepare, inspect, update, and recover the target device safely.

  2. 02
    Course

    GStreamer Basic Tutorials

    GStreamer
    Open resource

    Do: Build pipelines, inspect caps, handle bus messages, and reason about clocks and buffering.

    Exit with: Diagnose media-pipeline negotiation, buffering, and backpressure failures.

  3. 03
    Documentation

    DeepStream Developer Guide

    NVIDIA
    Open resource

    Do: Complete the Jetson quickstart, then study reference apps, latency measurement, metadata, containers, and tuning.

    Exit with: Build an accelerated streaming inference pipeline using supported components.

  4. 04
    Guide

    Getting Started with Jetson

    Jetson AI Lab
    Open resource

    Do: Use the setup and environment guides, then select one device-appropriate model tutorial.

    Exit with: Run a reproducible device workload in a controlled container environment.

Required lab

Turn knowledge into implementation

Build camera/video decode → preprocess → TensorRT → tracking/postprocess → local event output and sustain it under load.

Publish this evidence

  • End-to-end latency
  • FPS and dropped frames
  • CPU/GPU/memory telemetry
  • Power/thermal report
  • Recovery test

Confidence check

  • Can I locate latency across decode, preprocess, inference, and postprocess?
  • Can I explain the effect of power mode and thermal throttling?
  • Can the service recover after camera, process, or device failure?
2.6Edge GenAI & multimodal systemsRun and evaluate useful local language and multimodal workflows within strict memory and power budgets.4–6 weeks

Topics covered from the README

  • Small language models, prefill, decode, and KV-cache behavior
  • Weight-only quantization
  • Context and memory budgets
  • Local embeddings and retrieval
  • Multimodal pipelines
  • Resource-aware local/cloud routing

Follow in this order

Guided learning sequence

4 free resources
  1. 01
    Course

    Introduction to GenAI on Jetson

    Jetson AI Lab
    Open resource

    Do: Follow the fundamentals and one LLM/VLM tutorial that fits the memory of your target Jetson.

    Exit with: Run a local model and understand its runtime, container, and memory requirements.

  2. 02
    Guide

    llama.cpp

    ggml-org
    Open resource

    Do: Run two quantization levels, control context size, and measure prompt processing, generation, and peak memory.

    Exit with: Explain how model format, quantization, context, and backend affect performance.

  3. 03
    Documentation

    Quantization concepts

    Hugging Face
    Open resource

    Do: Compare weight-only and activation-aware approaches conceptually, then document why the chosen method fits the device.

    Exit with: Make a quality/memory/performance quantization decision.

  4. 04
    Video

    Jetson Generative AI Lab videos

    NVIDIA Developer
    Open resource

    Do: Use the Jetson and generative-AI playlists to reinforce deployment and optimization concepts for the selected stack.

    Exit with: Connect model behavior to the NVIDIA edge runtime and hardware limits.

Required lab

Turn knowledge into implementation

Build an offline-first multimodal assistant with local inference and retrieval, deterministic tools, optional cloud escalation, and resource-aware routing.

Publish this evidence

  • TTFT and decode rate
  • KV-cache and peak memory
  • Load time
  • Power/thermal measurements
  • Task-quality and fallback evaluation

Confidence check

  • Can I explain prefill versus decode bottlenecks?
  • Can I predict how context length changes memory?
  • Can I justify when a request stays local or escalates?
2.7Edge MLOps, fleet engineering & securityUpdate, observe, reconcile, and recover edge models safely across unreliable networks.4–5 weeks

Topics covered from the README

  • Signed and versioned model artifacts
  • Compatibility manifests and checksums
  • Resumable downloads and atomic activation
  • Canary rollout and rollback
  • Privacy-safe telemetry and fleet health
  • Offline reconciliation and recovery
  • Drift and adversarial input testing

Follow in this order

Guided learning sequence

4 free resources
  1. 01
    Guide

    The Update Framework

    TUF
    Open resource

    Do: Study roles, metadata, signatures, expiration, rollback protection, and key compromise recovery.

    Exit with: Design a signed update chain that survives common repository attacks.

  2. 02
    Documentation

    Uptane Standard

    Uptane
    Open resource

    Do: Map its secure automotive update concepts to a general edge fleet and document what you keep or simplify.

    Exit with: Design staged, compatible, recoverable device updates.

  3. 03
    PDF / book

    Adversarial Machine Learning taxonomy

    NIST
    Open resource

    Do: Select relevant evasion, poisoning, privacy, and misuse threats and turn them into tests or controls.

    Exit with: Threat-model model behavior as well as software delivery.

  4. 04
    Documentation

    SLSA specification

    OpenSSF
    Open resource

    Do: Add provenance, integrity checks, and a verifiable build path for models and containers.

    Exit with: Trace deployed artifacts back to controlled source and build steps.

Required lab

Turn knowledge into implementation

Implement signed model manifests, resumable download, checksum validation, atomic activation, canary rollout, failed-update recovery, and rollback.

Publish this evidence

  • Signed manifest
  • Compatibility checks
  • Canary report
  • Rollback demonstration
  • Offline reconciliation test
  • Threat model

Confidence check

  • Can a device reject a validly signed but incompatible model?
  • Can activation survive power loss?
  • Can I recover from a bad update or compromised signing role?

Phase completion gate

NVIDIA-oriented exit gate

Apply when TensorRT, target-device performance, fleet safety, and communication are proven together.

  • Profiled and optimized CUDA kernels
  • ONNX-to-TensorRT correctness and benchmark report
  • Sustained Jetson real-time deployment
  • Offline-first multimodal NVIDIA capstone
  • Nsight, power, thermal, update, rollback, and threat-model evidence