https://rmmartins.com/series/ai-for-infrastructure-engineers/ Recent content in AI for Infrastructure Engineers on Ricardo Martins — Cloud Architecture, Azure, Kubernetes & AI https://rmmartins.com/images/profile.png https://rmmartins.com/images/profile.png Hugo en-US Tue, 07 Jul 2026 12:06:25 -0400 https://rmmartins.com/2026/07/05/visual-glossary-infra-ai-your-rosetta-stone/ Sun, 05 Jul 2026 10:00:00 -0400 https://rmmartins.com/2026/07/05/visual-glossary-infra-ai-your-rosetta-stone/ Every AI term mapped to an infrastructure concept you already know. From 'model' to 'ZeRO', with practical analogies and context for when each one shows up in your work. https://rmmartins.com/2026/07/01/ai-adoption-framework-from-enthusiasm-to-governance/ Wed, 01 Jul 2026 10:00:00 -0400 https://rmmartins.com/2026/07/01/ai-adoption-framework-from-enthusiasm-to-governance/ Enthusiasm without a framework is expensive chaos. The 6 adoption phases, readiness scorecard, anti-patterns that kill AI projects, and how not to become another company with shadow AI. https://rmmartins.com/2026/06/27/ai-use-cases-for-infra-teams-aiops-and-beyond/ Sat, 27 Jun 2026 10:00:00 -0400 https://rmmartins.com/2026/06/27/ai-use-cases-for-infra-teams-aiops-and-beyond/ AI isn't just for data scientists. Log analysis with LLMs, anomaly detection, predictive capacity planning, IaC generation, and how to use AI to improve your own infra work. https://rmmartins.com/2026/06/23/troubleshooting-playbook-incidents-that-will-wake-you-at-2am/ Tue, 23 Jun 2026 10:00:00 -0400 https://rmmartins.com/2026/06/23/troubleshooting-playbook-incidents-that-will-wake-you-at-2am/ NVIDIA driver crash, CUDA OOM, pods stuck in Pending, 429 storm, and latency spikes. Symptoms, diagnosis, root cause, and prevention for each real-world scenario. https://rmmartins.com/2026/06/19/azure-openai-in-production-tokens-throughput-and-high-availability/ Fri, 19 Jun 2026 10:00:00 -0400 https://rmmartins.com/2026/06/19/azure-openai-in-production-tokens-throughput-and-high-availability/ HTTP 429 isn't a bug, it's bad capacity planning. Deployment types, PTU vs Standard, multi-region, retry patterns, and how not to take down your chatbot on launch day. https://rmmartins.com/2026/06/15/platform-ops-building-a-self-service-ai-platform/ Mon, 15 Jun 2026 10:00:00 -0400 https://rmmartins.com/2026/06/15/platform-ops-building-a-self-service-ai-platform/ You've become the bottleneck. Multi-tenancy, GPU scheduling, Kueue, quotas, priority classes, and how to stop being a help desk and become a platform engineer. https://rmmartins.com/2026/06/11/cost-engineering-for-ai-when-idle-gpus-cost-more-than-your-car/ Thu, 11 Jun 2026 10:00:00 -0400 https://rmmartins.com/2026/06/11/cost-engineering-for-ai-when-idle-gpus-cost-more-than-your-car/ A GPU idle over the weekend costs $4,700. Spot VMs, PTU vs pay-per-token, right-sizing, tagging, and FinOps to keep the CFO happy without killing innovation. https://rmmartins.com/2026/06/07/security-for-ai-threats-your-firewall-wont-catch/ Sun, 07 Jun 2026 10:00:00 -0400 https://rmmartins.com/2026/06/07/security-for-ai-threats-your-firewall-wont-catch/ Prompt injection is the SQL injection of the AI world. Managed identities, private endpoints, Key Vault, RBAC, and the defenses you need beyond a traditional WAF. https://rmmartins.com/2026/06/03/monitoring-and-observability-for-ai/ Wed, 03 Jun 2026 10:00:00 -0400 https://rmmartins.com/2026/06/03/monitoring-and-observability-for-ai/ Healthy infra doesn't mean a working model. Model drift, GPU metrics, Azure OpenAI throttling, and the 6 dimensions of observability you need to cover. https://rmmartins.com/2026/05/30/mlops-model-lifecycle-for-infra-engineers/ Sat, 30 May 2026 10:00:00 -0400 https://rmmartins.com/2026/05/30/mlops-model-lifecycle-for-infra-engineers/ A data scientist sends you model_final_v2_FIXED.pt and says 'put it in production'. Sound familiar? MLOps is the same CI/CD you already know, applied to ML models. https://rmmartins.com/2026/05/26/infrastructure-as-code-for-ai-automating-gpu-clusters/ Tue, 26 May 2026 10:00:00 -0400 https://rmmartins.com/2026/05/26/infrastructure-as-code-for-ai-automating-gpu-clusters/ A typo in a VM SKU cost $4,000 in three days. IaC isn't nice-to-have for AI infra. It's survival. Terraform, Bicep, and CI/CD for GPU clusters. https://rmmartins.com/2026/05/22/gpu-deep-dive-what-happens-inside-the-silicon/ Fri, 22 May 2026 10:00:00 -0400 https://rmmartins.com/2026/05/22/gpu-deep-dive-what-happens-inside-the-silicon/ Why doesn't a 14 GB model fit on a 40 GB GPU? How to read nvidia-smi like a pro? Understand GPU architecture, memory hierarchy, multi-GPU strategies, and troubleshooting. https://rmmartins.com/2026/05/18/compute-for-ai-choosing-the-right-hardware/ Mon, 18 May 2026 10:00:00 -0400 https://rmmartins.com/2026/05/18/compute-for-ai-choosing-the-right-hardware/ The difference between a two-day training job and a 90-minute one isn't a faster GPU. It's knowing which GPU to use and how to connect them. A complete guide to GPU VMs on Azure. https://rmmartins.com/2026/05/14/data-and-storage-for-ai-workloads/ Thu, 14 May 2026 10:00:00 -0400 https://rmmartins.com/2026/05/14/data-and-storage-for-ai-workloads/ Expensive GPUs sitting idle waiting for slow disk is the #1 problem in AI infrastructure. Learn how to diagnose data starvation, choose the right storage, and build a pipeline that keeps GPUs fed. https://rmmartins.com/2026/05/10/ai-for-infrastructure-engineers-why-ai-needs-you/ Sun, 10 May 2026 10:00:00 -0400 https://rmmartins.com/2026/05/10/ai-for-infrastructure-engineers-why-ai-needs-you/ You don't need to become a data scientist to work with AI. Your infrastructure skills already prepare you more than you think for the age of artificial intelligence.