Cost engineering for AI: when idle GPUs cost more than your car

Ninth post in the series. In the previous one, we hardened the platform against prompt injection and data leakage. Now: how not to go bankrupt in the process. The $127,000 Monday Monday morning. Coffee in hand, email from Finance in the subject line: “URGENT: Azure invoice $127,000, please explain.” Forecast was $42,000. Two ND96isr_H100_v5 VMs, provisioned three weeks ago for a “quick experiment,” never shut down. At ~$98/hour each, running 24/7 for three weeks: $33,000 in idle GPU compute. Nobody using them. Nobody remembered they existed. ...

June 11, 2026 · 6 min · Ricardo Martins

Cloud Maturity Is Not About Being 100% Cloud

For years, “cloud-first” has been treated as a badge of honor. Companies proudly announce that everything is in the cloud, architects optimize for migrations instead of outcomes, and teams equate progress with how little infrastructure they still own. But after working with dozens of real systems, across different industries and at different scales, one thing becomes clear. Cloud maturity is not about being 100% cloud. It is about knowing why each workload is where it is. ...

January 23, 2026 · 5 min · Ricardo Martins

Maximizing Cost Efficiency in Azure: Navigating Azure Reservations and Savings Plans

Introduction: In the realm of cloud computing, optimizing costs is paramount for businesses leveraging Microsoft Azure. Azure offers two primary cost-saving mechanisms: Azure Reservations and Azure Savings Plans. Both options come with distinct advantages, disadvantages, and usage scenarios. In this comprehensive guide, we’ll explore these features, penalties, and ideal use cases to empower you in making informed decisions tailored to your business needs. Understanding Azure Reservations: Azure Reservations provide businesses the opportunity to commit to one-year or three-year plans for various products within the Azure ecosystem. The commitment entails a promise of usage, enabling significant discounts of up to 72% off pay-as-you-go prices. ...

May 15, 2024 · 3 min · Ricardo Martins