PATH 06

AI Engineer
Roadmap 2025

Your structured path from ML foundations to production agentic AI systems β€” what to learn, build, and certify.

5
Phases
6–12
Months
5
Projects
3
Certifications
01

Phase-by-Phase Roadmap

1

ML & Python Foundations

Weeks 1–4 ⏱ 1 month

Core math, Python data stack, ML concepts. You must be able to build and evaluate a basic classifier before moving on.

MUST KNOW
  • β€’ Linear algebra (vectors, matrices)
  • β€’ Probability & Bayes theorem
  • β€’ Gradient descent intuition
  • β€’ Python: NumPy, Pandas, Matplotlib
TOOLS
  • β€’ scikit-learn
  • β€’ Jupyter Notebooks
  • β€’ Git / GitHub
  • β€’ VS Code
BUILD
  • β€’ Titanic survival classifier
  • β€’ House price regression
  • β€’ K-means clustering on real data
2

LLMs & Prompt Engineering

Weeks 5–8 ⏱ 1 month

Understand transformers, use OpenAI/Azure OpenAI APIs, master prompting techniques. Build your first LLM-powered app.

MUST KNOW
  • β€’ Transformer architecture
  • β€’ Tokenization + context windows
  • β€’ Zero-shot / few-shot / CoT prompts
  • β€’ Temperature, top-p sampling
TOOLS
  • β€’ Azure OpenAI / OpenAI API
  • β€’ LangChain basics
  • β€’ tiktoken (tokenizer)
  • β€’ Ollama (local LLM)
BUILD
  • β€’ CLI chatbot with conversation history
  • β€’ Document summarizer
  • β€’ Prompt template library
3

RAG Systems

Weeks 9–14 ⏱ 6 weeks

Build end-to-end RAG pipelines. Go beyond naive RAG to hybrid search, reranking, and evaluation with RAGAS.

MUST KNOW
  • β€’ Vector embeddings semantics
  • β€’ Chunking strategies
  • β€’ Cosine similarity
  • β€’ Dense vs sparse vs hybrid search
TOOLS
  • β€’ Azure AI Search
  • β€’ LangChain RAG chains
  • β€’ text-embedding-3 (Ada)
  • β€’ RAGAS (evaluation)
BUILD
  • β€’ Company document Q&A chatbot
  • β€’ Hybrid search with reranking
  • β€’ RAG eval dashboard
4

AI Agents & Multi-Agent Systems

Weeks 15–22 ⏱ 2 months

Build single agents with ReAct, then graduate to CrewAI / LangGraph multi-agent systems. Azure AI Agent Service for production.

MUST KNOW
  • β€’ ReAct pattern + tool calling
  • β€’ Agent memory types
  • β€’ Multi-agent coordination patterns
  • β€’ Function calling JSON format
TOOLS
  • β€’ LangGraph
  • β€’ CrewAI
  • β€’ Azure AI Agent Service
  • β€’ MCP Protocol
BUILD
  • β€’ ReAct research agent
  • β€’ CrewAI blog writing crew
  • β€’ Customer support multi-agent
5

Production Deployment & MLOps

Weeks 23–30 ⏱ 2 months

Deploy at scale on Kubernetes/AKS, set up CI/CD with GitHub Actions, observability, cost controls, governance.

MUST KNOW
  • β€’ Docker + Kubernetes basics
  • β€’ GitHub Actions CI/CD
  • β€’ Workload Identity (no secrets)
  • β€’ OWASP AI Security risks
TOOLS
  • β€’ AKS + ACR (Azure)
  • β€’ Helm / Terraform
  • β€’ LangSmith tracing
  • β€’ Prometheus + Grafana
BUILD
  • β€’ Full RAG system on AKS (this repo!)
  • β€’ Agentic platform CI/CD pipeline
  • β€’ Observability dashboard
02

Skills Matrix

Skill AreaBeginnerPractitionerSenior Engineer
LLM APIsCan call OpenAI APIToken optimization, function calling, streamingFine-tuning, model routing, cost modeling
RAGNaive RAG with ChromaHybrid search, reranking, RAGAS evalGraphRAG, multi-index, production-grade pipelines
AgentsLangChain ReAct agentLangGraph, CrewAI, tool designMulti-agent systems, custom orchestrators
InfrastructureDocker basicK8s/AKS, GitHub Actions CI/CDTerraform, OIDC/WI, multi-region, GitOps
Observabilityprint() debuggingLangSmith tracing, Prometheus metricsFull observability stack, SLO/SLA, cost attribution
SecurityAPI key awarenessKey Vault, managed identity, content filtersZero-trust, RBAC, prompt injection defense, audit
03

AI Engineering Tool Ecosystem

LLM Providers
πŸ”΅ Azure OpenAI
⚫ OpenAI API
🟠 Anthropic Claude
πŸ”΄ Google Gemini
🟣 Meta LLaMA
🐒 Ollama (local)
Frameworks
🦜 LangChain
πŸ“Š LangGraph
πŸ‘₯ CrewAI
πŸ€– AutoGen
πŸ”· Semantic Kernel
⚑ LlamaIndex
Vector Stores
πŸ” Azure AI Search
πŸ“Œ Pinecone
🌊 Weaviate
⚑ Qdrant
🟣 Chroma (dev)
βš™οΈ FAISS (local)
Infrastructure
☸️ Kubernetes/AKS
🐳 Docker
πŸ—οΈ Terraform
βš™οΈ GitHub Actions
πŸ“Š Prometheus/Grafana
πŸ”­ LangSmith
Azure AI Services
🏭 Azure AI Foundry
πŸ€– Azure AI Agent Svc
πŸ” Azure AI Search
πŸ—£οΈ Azure AI Speech
πŸ‘οΈ Azure AI Vision
πŸ“„ Azure Doc Intelligence
Orchestration
🌊 LangGraph
⏱️ Temporal.io
πŸŒ€ Apache Airflow
⚑ Azure Durable Fn
πŸ”„ Prefect
πŸ‡ Celery + Redis
Evaluation
πŸ“ˆ RAGAS
πŸ”­ LangSmith Evals
⚑ PromptFlow evals
πŸ§ͺ DeepEval
πŸ“Š MLflow Tracking
🎯 Azure AI Studio
Security
πŸ” Azure Key Vault
πŸ†” Managed Identity
πŸ›‘οΈ Content Filters
πŸ”’ OIDC / WIF
πŸ“‹ Microsoft Purview
πŸ” Defender for AI
04

Portfolio Project Ideas

1. Enterprise Document Q&A (RAG)
Upload internal docs β†’ answer questions with citations + confidence scores
Azure AI SearchLangChainFastAPI
2. AI Research Agent
Input a topic β†’ searches web, synthesizes sources, writes structured report with sections + bibliography
LangGraphBing SearchGPT-4o
3. Multi-Agent Code Review System
PR created β†’ Reviewer + Security + Performance agents analyze code, post consolidated comment
CrewAIGitHub ActionsMCP GitHub
4. Azure Infrastructure Cost Optimizer
Agent analyzes Azure resource usage, identifies waste, generates and applies Terraform recommendations
Azure SDKLangGraphTerraform
5. Production RAG on K8s (This Repo!)
Full-stack AI portal deployed via GitHub Actions to AKS + Azure AI Search β€” CI/CD, HITL, observability
AKSGitHub ActionsTerraformFastAPI
05

Azure AI Certifications Path

AI-900
Azure AI Fundamentals
2–4 weeks prep

AI/ML concepts, Azure AI services overview, responsible AI principles. Entry point to Azure AI.

Start here if new to Azure
AI-102
Azure AI Engineer Associate
6–8 weeks prep

Implement AI solutions: Azure OpenAI, AI Search, Document Intelligence, Speech, Vision, Bots.

Core role certificate
DP-100
Azure Data Scientist Associate
8–10 weeks prep

Azure ML, model training, deployment, MLflow, AutoML, Responsible AI at scale.

Add-on for ML heavy roles

Tip: Complete path β€” AI-900 β†’ AI-102 β†’ Build portfolio projects β†’ DP-100 if MLOps focused. GitHub Copilot cert (AZ-140 variant) coming 2025.

← Orchestration Back to Portal Home β†’