All Posts

  • Published on
    Whether it's API abuse, scraping, DDoS attacks, or a threat actor probing your endpoints, detecting anomalies in server traffic can help contain these attacks and improve system's resiliency. Building real-time detection pipelines however can be challenging because of variety of factors including infrastructure, cost, etc. Offline anomaly detection is an important tool that can not only be used in the absence of real-time detection but can also complement it. Root Cause Analysis, Forensics & Security Audit, Shadow Testing, Training & Tuning Real-Time Detectors, etc. are some of the use cases. In this article, I will present a simple offline anomaly detection pipeline that can be used to detect anomalies in server traffic. This pipeline is designed to be lightweight, easy to implement, and effective for many common scenarios.
  • Published on
    Over the weekend I was talking to a friend about troubleshooting remotely, logging and monitoring. It would be cool if we could spin up a temporary log viewer on the fly for fast troubleshooting, and then tear it down just as easily once the issue is resolved. In this article, I will demonstrate how to setup a simple logging pipeline using OpenSearch and FluentBit.
  • Published on
    Most AI applications, whether a RAG based chatbot or a simple model wrapper, rely on prompts to generate responses. User or application inputs are converted into prompts, which are then fed to the underlying model to generate responses. Due to the nature of the models, the quality of response is highly dependent on the quality of the prompt. Of course, we can manually test prompts to some extent, but it's not scalable. In this article I will discuss Latitude - a prompt engineering platform that can help in refining prompts, A/B testing them and measuring their performance.
  • Published on
    Building for Kubernetes is complex. For any fairly complex app that has multiple services, developing, building and deploying these services in a standard fashion can be a challenge. Skaffold is a tool that simplifies this process by automating the build, push, and deploy process, making it easier for teams to develop and deploy applications consistently.