As a Machine Learning Engineer, designing a data pipeline involves ensuring data flow is efficient, scalable, reliable, and optimized for the requirements of ML models. Here’s a structured outline to keep in mind: 1. Data Ingestion Sources and Types: Identify data sources (e.g., databases, APIs, logs, IoT devices) and data types (structured, semi-structured, unstructured). Batch … Continue reading Quick Outline for Designing Data Pipelines for Machine Learning Projects
Author: Harini Kannan
Understanding Production RAG Systems (Retrieval Augmented Generation)
1. What is RAG ? Retrieval Augmented Generation (RAG), is a method where you have a foundation model, and you have a library of personal documents – this can be unstructured data in any format. Now your goal is for answering some questions from your persona library of docs, with the help of LLM. Enter … Continue reading Understanding Production RAG Systems (Retrieval Augmented Generation)
TIL Journal : Oct 09, 2024
Options Trading !!! It's been a while since I wanted to understand the terms and risks involved in Options trading, so far I have been doing tradition investment trading for last 5 years now (and I thoroughly enjoy it, wealth building and management should be taught at schools, my regret is to not have started … Continue reading TIL Journal : Oct 09, 2024
TIL Journal : Oct 07, 2024
Sales and Negotiation In Sales, if you are playing to win, you are most probably going to lose. You have to play for the other side to WIN, because if they win, you have automatically WON. This's a quote from one of those quick Instagram interview reels.. and feels like this basically captures the essence … Continue reading TIL Journal : Oct 07, 2024
TIL Journal : Oct 04, 2024
Topic 1 : Rabbit hole of Investments, How to think in Bets, Risk Management, Forcing out your authentic self (POV) Source: Wharton's Private Equity & Venture Capital (PE/VC) Club Fireside Chat series This is an interview of Chamath Palihapitiya by Wharton's PE club. He is a pretty controversial public personality, I do enjoy listening (agreeing … Continue reading TIL Journal : Oct 04, 2024
TIL Journal : Oct 03, 2024
AI GTM, Never ending quest of PMF, Most important slide in your pitch deck ... Topic 1: Source: Lenny's Podcast | Lessons from a 2-time unicorn builder, 50-time startup advisor and 20-time board member | Uri Levine Notes from my NotebookLM assistant: Here are some important takeaways from the podcast in a Q&A format: What … Continue reading TIL Journal : Oct 03, 2024
What’s LLM Observability ? Latest tools to look out for
2024 is looking to be the year where a lot of applied Large Language Models (LLMs) from enterprise companies, other than the creators of the foundation LLMs, are going to come out of the Proof of Concept (POC) phase to actually being used by their customers. It's gonna be a year of trial and error, … Continue reading What’s LLM Observability ? Latest tools to look out for
Sample Go-To-Market Strategy for an LLM feature- Translate natural language to query language in a database company
Large Language Models (LLMs) have significantly turned the tide towards AI applications being taken seriously by almost every company in every single domain. Now if you a Product Manager, you may come across the ask - Craft a Go-To-Market (GTM) strategy for an LLM feature. So here's a sample GTM strategy for a new LLM … Continue reading Sample Go-To-Market Strategy for an LLM feature- Translate natural language to query language in a database company
The Plentiful Cybersecurity Problem: Too Many Vendors, Too Little Product Sense
Let’s get one thing out of the way - the market opportunity for cybersecurity as a whole - in the next 5 years, is humongous. Gartner predicts it will reach $267 billion in 2026, with an annual growth rate of 11%. If there is one domain where you find it difficult to find experienced professionals, … Continue reading The Plentiful Cybersecurity Problem: Too Many Vendors, Too Little Product Sense
Data Science Leadership Series – Part 3: Building Great Products by Balancing Product and Engineering Mindsets
I wrote about why we need AI Product Management when building complex data products in a previous post in the Data Science Leadership Series, and I feel this has to be followed by a very important topic that almost every single software development team faces, especially in high growth startups where the speed of innovation … Continue reading Data Science Leadership Series – Part 3: Building Great Products by Balancing Product and Engineering Mindsets



