Posts

The Secret Life of AWS: The Searchlight (CloudWatch Logs Insights)

Image
  The Secret Life of AWS: The Searchlight (CloudWatch Logs Insights) # aws # cloudwatch # devops # cloud Stop scrolling. Start querying. How to find the needle in the haystack with CloudWatch Logs Insights. Part 33 of The Secret Life of AWS "I know it's in here," he muttered. "The X-Ray trace said the error happened at 10:05 AM." He was looking at the raw  CloudWatch Logs  console. His Lambda function was running hundreds of times a minute, which meant there were dozens of "Log Streams." He was clicking into one, scrolling to the bottom, finding nothing, clicking back, and trying the next one. "It is like looking for a needle in a stack of needles," he sighed. Margaret walked by, noticing the repetitive clicking. "Are you reading the logs manually again, Timothy?" "I have to," Timothy said. "I need to find the  Exception . But there are too many lines of 'Info' and 'Debug' noise." Margaret shook h...

The Secret Life of Go: The Context Package

Image
  The Secret Life of Go: The Context Package # go # coding # programming # softwaredevelopment Mastering  context.Context , timeouts, and cancellation propagation. Chapter 22: Signals and Timeouts Ethan was watching the scrolling logs on his terminal. "That’s strange," he said. "What do you see?" Eleanor asked, pausing by his desk. "I have a report generation endpoint that takes about ten seconds to run," Ethan explained. "I clicked the button to test it, realized I made a mistake, and closed the browser tab immediately. But look at the logs." He pointed to the screen. The logs showed the server was still crunching numbers, querying the database, and formatting the PDF. "The user is gone," Ethan said. "But the server is still working." "That is because the server does not know the user is gone," Eleanor said gently. "You have started a process, but you have no way to stop it." "I thought closing the co...

The Secret Life of Azure: The Subscription That Had No Guardrails

Image
  The Secret Life of Azure: The Subscription That Had No Guardrails # azure # security # devops # coding Bringing your security vision to life through automated governance and the power of Azure Policy. Governance & Guardrails The library was quiet, save for the sound of Margaret organizing a stack of new ledgers. She placed them neatly on the shelf and turned to Timothy, who was looking at a list of resources that had been created over the weekend. "Timothy," Margaret said gently, "I see we have some new entries. A few Virtual Machines in regions we don't usually use, and several Storage Accounts without encryption. It seems our library is growing faster than our manual checks can keep up." Timothy sighed, looking at his notes. "I tried to tell the team the standards, but everyone seems to have their own way of doing things. How do we stop the mess before it starts?" "We move from advice to  Governance ," Margaret replied, picking up a p...

The Secret Life of AWS: The X-Ray Vision (AWS X-Ray & Distributed Tracing)

Image
  The Secret Life of AWS: The X-Ray Vision (AWS X-Ray & Distributed Tracing) # aws # xray # devops # cloud Debugging the invisible. How to find bottlenecks in a distributed system. Part 32 of The Secret Life of AWS Timothy was staring at his monitor, rubbing his temples. "I don't understand," he muttered. "The logs say everything is fine." A customer had submitted a ticket claiming the  Checkout  page was "freezing" for five seconds before confirming their order. Timothy had checked his Lambda logs. CheckoutFunction : Duration 250ms. Success. He checked his Database logs. OrdersTable : Latency 15ms. Success. "My code is fast," Timothy insisted to Margaret. "The database is fast. But the customer is seeing a 5-second delay. It’s like the time is just... vanishing into thin air." Margaret pulled up a chair. "You are looking at the components, Timothy. But you are not looking at the  space between them ." "When you b...