Articles on LinkedIn
49 articles — each links out to LinkedIn. The list is generated fromposts.parquet.
LinkedIn ↗Jul 25, 2026Not Enough Benchmarks for AI-Native Delivery
Over the past few days, I have been exploring a connected problem. AI engineering practices are evolving rapidly, but estimation, pricing, productivity measurement, and value realization are still catching up.
LinkedIn ↗Jul 21, 2026What Pharma Can Teach AI Engineering About Trust
AI engineering is moving very fast. Every week, we hear about new models, new agent development frameworks, Vector databases, RAG pipelines, MCP servers, Connectors & Tools, evaluation frameworks, and automation platforms.
LinkedIn ↗Jul 21, 2026Beyond RAG: Building Ontology-Driven Test Intelligence with Knowledge Graphs
Across decades of working on large enterprise products, multiple projects, and top-tier engineering teams, I have rarely seen a complete and dependable solution for two persistent problems: Impact analysis and bidirectional traceability. This is especially difficult for enterprise products that have
LinkedIn ↗Jul 20, 2026OpenLineage Viewer: Databricks-Style Lineage for Local dbt, in Pure HTML
This is a sequel to Last week's post on the Claimwise dataset and dbt pipeline. Last week I shared the Claimwise dataset and the dbt pipeline behind it.
LinkedIn ↗Jul 18, 2026Anatomy of a Bolt — Ceremonies, Evals, Rubrics, and Traces on a Real Feature
Production-Grade Agents, Built in the Open — Part 3 of 6 One Core, Four Doors Specs, Not Vibes Anatomy of a Bolt (this article) The LLM Never Scores Stop Burning Tokens on Grep AI Did the Typing Part 2 gave you the totals: 11 Bolts, 62 tasks, 135 evals. This part picks one real Bolt — the cover-lett
LinkedIn ↗Jul 18, 2026Introducing Claimwise — End-to-End Data Lakehouse Storytelling with dbt, Databricks/Snowflake, and Unity Catalog, From Raw Data to Dashboard
Claimwise is a healthcare Revenue Cycle Management (RCM) demo I built — the billing back office of a fictitious hospital network. The hospital is not real, but everything running behind it is real: synthetic patients and claims, all of it sits in one repo, and you can run it on your laptop.
LinkedIn ↗Jul 15, 2026I Left My Job Hunt Running — Now It's a Public Dataset Anyone Can Query
Dashboard: senthilsweb.github.
LinkedIn ↗Jul 14, 2026Specs, Not Vibes — Building a Production Agent with AI-DLC
Production-Grade Agents, Built in the Open — Part 2 of 6 One Core, Four Doors Specs, Not Vibes (this article) Anatomy of a Bolt The LLM Never Scores Stop Burning Tokens on Grep AI Did the Typing The agent from Part 1 was built through 62 tasks and 135 evals across 11 Bolts — every one of them writte
LinkedIn ↗Jul 13, 2026Leading Teams, Building Systems: How My Homelab Keeps Me Hands-On
Today, I am sharing my homelab infrastructure—my small personal data centre where many of my ideas and projects have taken shape. After 26 years in technology, my work naturally spans architecture, engineering leadership, and management, but I have never wanted to move away from hands-on engineering
LinkedIn ↗Jul 13, 2026My View: The AI Era Is Distilling and Rewarding Elegant Engineers
The titles AI Engineer and Forward-Deployed Engineer may sound new, but many of the qualities behind them are not. In my view, an elegant software engineer may already possess nearly 70–75% of the foundation needed for these roles.
LinkedIn ↗Jul 12, 2026One Core, Four Doors — Shipping the Same AI Agent as CLI, REST, MCP Tool, and Chat
Production-Grade Agents, Built in the Open — Part 1 of 6 One Core, Four Doors (this article) Specs, Not Vibes Anatomy of a Bolt The LLM Never Scores Stop Burning Tokens on Grep AI Did the Typing I built an AI agent that compares a resume against job postings and returns evidence-grounded, determinis
LinkedIn ↗Jul 7, 2026Telemetry and Observability for Claude Code
Where this started? In my previous article, This Cover Image Was Not Designed. It Was Orchestrated, I shared a fully working agent — a LinkedIn cover image generator built on Vercel's Eve agentic framework.
LinkedIn ↗Jul 5, 2026This Cover Image Was Not Designed. It Was Orchestrated
Every cover image on my recent articles — including this one — was generated by a small open-source agent I built using vercel eve framework in TypeScript. One reasoning pass, one image call, everything else deterministic The phone call that triggered this article Yesterday my article "Job Hunting I
LinkedIn ↗Jul 3, 2026Job Hunting Is a Data Problem. I Treated It Like One.
Every job posting is a row of data. Recently I had reason to read a lot of them, and within two days I noticed something familiar.
LinkedIn ↗May 25, 2026From Test Cases to Capabilities: A Testing Architecture for Agentic AI-Augmented Quality Engineering
At Pentaho, we did not "add AI" to Quality Engineering (QE). We are re-architecting QE so AI can actually do the work — by replacing the scattered test plan with capability folders that every skill (drafting, pairwise design, triage, lint) reads and writes the same files a human reviewer would.
LinkedIn ↗May 1, 2026Applying combinatorial science and discrete mathematics to data-platform engineering and testing
When a product spans many data sources, several deployment targets, multiple connection types, and a wide set of overlapping capabilities, you don't have a test plan — you have a math problem. Here is how we apply combinatorial science at Pentaho to keep release confidence high without burning the t
LinkedIn ↗Apr 20, 2026Why I’m Building TemplrGo: Turning Enterprise Engineering Pain into Open Source Productivity
TemplrGo Feature Sets For the last two and a half decades, I’ve worked in enterprise software engineering across product development, architecture, testing, and platform operations. For the last decade, I’ve been leading engineering initiatives around complex data platforms, including my current rol
LinkedIn ↗Apr 19, 2026Beyond Detection: Why Epistemic Honesty Matters in Sensitive Data Discovery and Governance
One underrated principle in data discovery and data catalog products: epistemic honesty. When a sensitive data scan flags PII, PHI, PCI, or other regulated data, the product should be transparent about: what it detected why it detected it how confident it is whether the result is heuristic, ML-infer
LinkedIn ↗Apr 11, 2026I Replaced Five Design Tools with a YAML-First Visual Rendering Engine in TemplrGo
Every week I need a different visual. Architecture diagram for a client presentation.
LinkedIn ↗Apr 2, 2026Lua Is Quietly Becoming My Favorite Extension Layer
One of the projects I’m working on is built on Go and Next.js — Go powers the server, and Next.
LinkedIn ↗Jan 11, 2026Medallion Architecture & Star Schema: Old Concepts Powering Modern AI Pipelines
You have a flat file or a table. You need metrics. So you write some joins, add aggregations, and ship it -> Nothing wrong with that, It works. But as data grows and questions multiply, that approach starts to crack. To illustrate a more sustainable path, I'll use an airports dataset — 19,793 records, 27 columns mixing GPS coordinates, facility codes, and certification details. Typical messy sourc
LinkedIn ↗Jan 9, 2026Naming Conventions I Use Daily.
For a long time, I have written code, named files, and defined configuration and environment variables using a consistent style that felt natural. While I was familiar with terms like camelCase, PascalCase, and kebab-case, I often mixed up or forgot others. Here is my personal cheat sheet: Blog post URLs like my-awesome-post.md ? That's kebab-case. Environment variables like API_SECRET_KEY? That's
LinkedIn ↗Jan 2, 2026Part 2 - Loading CSV Data into Apache Iceberg Tables with PyIceberg and PyArrow
In Part 1 - Building a $0 Data Lakehouse with Apache Iceberg, Nessie, Neon, and Cloudflare R2 , we set up the infrastructure — a Nessie catalog on Fly.io, Neon PostgreSQL for metadata, and Cloudflare R2 for object storage. All on free tiers. Now comes the interesting part: actually loading data into Iceberg tables . In this article, I'll walk you through a Python-based approach that: Reads CSV fil
LinkedIn ↗Jan 2, 2026One-Line Local Web Server with Python
Sometimes you just need to quickly serve some HTML files locally. Maybe you're testing a static site, previewing an SVG, or checking how your CSS looks in a browser. You don't need to install anything. Python has you covered. The Command That's it. One line. What It Does Serves files from your current directory Runs on http://localhost:8888 (or any port you specify) Zero configuration - just run a
LinkedIn ↗Dec 31, 2025Looking Back on 25 Years in Software Development
This year marks 25 years since I started in software development. As I look back, I'm filled with gratitude for everyone who shaped this journey. To my mentors who saw potential when I couldn't, to colleagues who challenged me to think differently, and to the open source community that welcomed contributions from a curious developer — thank you. Every code review, every late-night debugging sessio
LinkedIn ↗Dec 31, 2025Part 1 - Building a $0 Data Lakehouse with Apache Iceberg, Nessie, Neon, and Cloudflare R2
Modern data lakehouses typically require expensive infrastructure—object storage, metadata catalogs, and databases. But what if you could build a production-ready Apache Iceberg lakehouse using only free-tier services ? In this article, I'll show you how to set up a complete data lakehouse stack for $0/month using: Nessie - Git-like catalog for Apache Iceberg ( Fly.io free tier) Neon - Serverless
LinkedIn ↗Feb 3, 2025Edge-Optimized GenAI Chat Web-UI for Ollama & Cloudflare AI models with Context Injection
It is a simple GenAI chat web interface built with Next.js that connects to both local Ollama and Cloudflare AI models. This application provides an intuitive interface for interacting with various AI models through a generic chat completions API, featuring customizable settings and real-time streaming responses. The default selected model is Technology Stack Frontend : Next.js 14, React 18 Stylin
LinkedIn ↗Jan 27, 2025Embedding LLM in SQL is simple!
Inspired by Snowflake’s AI-driven analytics and MotherDuck’s recent implementation of SQL + LLM ( Introducing the function), I explored LLM-powered Business Insights using DuckDB , embedding AI directly into SQL workflows for real-time data intelligence . Use Case: Privacy Engineering – Detecting and Masking PII The fully working code is available as a Jupyter Notebook , which can be accessed from
LinkedIn ↗Jan 6, 2025Data Pipeline Diagrams as Code
Introduction Creating diagrams for data pipelines, workflows, and architectures is a routine task for many of us. Whether it's for internal presentations, client discussions, or technical documentation, the process can often feel repetitive and time-consuming. I just launched a new open source tool/utility designed to simplify the process of creating data pipeline diagrams—a YAML-based tool that g
LinkedIn ↗Dec 31, 2024Privacy Engineering with LLMs: Safeguarding PII While Enhancing Text with Privacy Shield
Introduction In today’s data-driven environment, the use of Large Language Models (LLMs) for generative AI and text processing is not just important but increasingly common. With tools like ChatGPT, Google Gemini, Claude.ai , Perplexity and open-source AI models like Llama, Mistral.ai etc. people now rely on LLMs for tasks ranging from email proofreading to refining documents like legal contracts
LinkedIn ↗Dec 27, 2024Lightweight HTML to PDF with Puppeteer: Simple PDF Export for Edge Deployments
This microservice is designed to address simple PDF export needs, making it ideal for generating blog articles, profile cards, and other lightweight use cases. It prioritizes efficiency and edge platform compatibility, avoiding the overhead of heavy PDF reporting tools. While it's a valuable addition to my open-source TemplrJS Nuxt Fullstack Framework , it is equally useful for standalone applicat
LinkedIn ↗Dec 25, 2024Building a Generative Q&A Engine with Semantic Search and Embeddings
Introduction In the age of AI-powered tools and intelligent systems, the ability to search, analyze, and generate insights from documents has become paramount. Semantic search and generative AI offer powerful capabilities to build engines that allow querying large sets of documents, answering questions naturally, and even recommending relevant content. This article is part one of a multi-series gu
LinkedIn ↗Oct 6, 2024Crafting Stunning Event Tickets with Pentaho Reports: A Low-Code No-Code Journey!
When it comes to generating business reports, organizations often face a plethora of choices. Solutions like JasperReports, Crystal Reports, Microsoft Reporting Services, ActiveReports for .NET, HTML to PDF etc. dominate the market for their powerful report design and rendering capabilities. However, in this article, I'll dive into Pentaho Reports —and demonstrate how I created a flashy and stunni
LinkedIn ↗Sep 30, 2024Deploying Pentaho Carte Server on Fly.io with Firecracker VM: A Fun Way to Learn ETL! 🌟
This is a quick guide on deploying the Pentaho Carte Server on Fly.io using Firecracker VM —a great way to learn and practice the Pentaho data platform with the Pentaho Data Integration carte server. Carte is a lightweight web container that allows you to set up a dedicated, remote ETL server, making it easier to manage and execute Pentaho jobs. Firecracker is a lightweight virtualization technolo
LinkedIn ↗Sep 29, 2024Pentaho: Versatile Data Engineering for All Needs—ETL, Reverse ETL, ELT, Data Lakes, Big Data, Data Quality, Reporting, Visualization & Data 360
Pentaho remains a powerful and relevant tool in the data integration and analytics space. Its comprehensive features, cross-platform support, and strong community make it an excellent choice for organizations and developers alike. Whether you want to build complex data pipelines, design insightful reports, or dive into data analysis, Pentaho has the tools to help you succeed. In today's fast-chang
LinkedIn ↗Sep 21, 2024Simplify Decision Logic with GoRules: An Embeddable Rules Engine for Python, Go, Rust, and NodeJS
If you've worked with JBOSS Drools or other rule engines, you're probably all too familiar with the complexity that comes with them. Managing decision-making logic often turns into a chore, with intricate configurations and steep learning curves. That's why I'm excited to introduce GoRules Zen BRE —an open-source Business Rules Engine (BRE) built in Rust , designed to support Python, Go, Rust, and
LinkedIn ↗Sep 14, 2024JIRA to DuckDB Bot: A Simple Python Data Pipeline with DLThub
Use Case Organizations often use JIRA for project management, and the need to automate data extraction from JIRA for analytics is common. The approach was to create a lightweight bot that automates the extraction of JIRA issue data using a JQL query, processes it in CSV format, and loads it into databases like DuckDB for development purposes or Snowflake for production-level analytics. This provid
LinkedIn ↗Sep 10, 2024Social-Card: Dynamic Image Creation on the Edge with Vercel Open Graph
social-card: A dynamic image generator for business, profile, and social cards using Vercel Open Graph, Next.js, and TailwindCSS. Easily customize and create visually appealing cards for any purpose! Features Business, Profile, and Social Cards: Automatically generate profile cards for sharing across platforms. QR Code Generation: A built-in API to create QR codes that can be embedded in profile c
LinkedIn ↗Sep 8, 2024Flog: A Powerful Fake Log Generator by @mingrammer 🚀📊
Looking for a simple way to generate fake log data for testing or simulating real-world scenarios? Look no further than Flog by @mingrammer ! Flog supports multiple common log formats like , JSON, and Common Log Format, making it versatile for various use cases. Whether you're testing log management systems, benchmarking, or generating synthetic data, Flog has you covered . Best of all , it's avai
LinkedIn ↗Sep 8, 2024Mastering Otel collector - Filelog Receiver: Log Routing & Data Enrichment for Microservices
This article is a sequel to my earlier post, “ Instant Observability with Zero Code! ” . In this second part of the series, we dive into more advanced configurations for the Open telemetry collector especially the filelog receiver for log files routing and data enrichment leveraging router, multiple filelog receivers, regex parsers etc. Modern Applications & Microservices In today’s world, modern
LinkedIn ↗Sep 1, 2024Scrape and Transform Instagram Posts into Blog Content—No API Key Needed!
A simple, serverless tool that effortlessly fetches Instagram posts, complete with images, without the need for an API key! Whether you're a content creator, marketer, or small business owner, this tool can help you seamlessly repurpose your Instagram content for your blog or website. Highlights: Extracts your latest Instagram posts exposed as REST api. No API key or complex authentication require
LinkedIn ↗Sep 1, 2024🚀 Instant Observability with Zero Code!
Need observability in your existing applications? Look no further! I’ve developed a ready-to-use, zero-code solution that brings observability to your applications, regardless of the technology or platform. This Dockerized sidecar leverages OpenTelemetry and OpenObserve seamlessly integrate telemetry and observability without requiring any code changes. Adding Observability as Sidecar into your ex
LinkedIn ↗Jun 11, 2024Introducing Semantic Data Modeling with Malloy and DuckDB | MotherDuck | PostgreSQL | BigQuery
If you work in Data Engineering, Data Science, or AI/ML, you have likely encountered terms such as DataOps, DataFabric, Data Governance, Business Metadata Management, ETL & Reverse ETL, Data Quality, Knowledge Graph, Semantic Layer/Data Modeling , and Self-Service Analytics. Let us explore what semantic data modeling is and why it is generating so much hype. What is a Semantic Layer? According to
LinkedIn ↗Apr 27, 2024Kudos to #MotherDuck for a successful first Data Community Meetup in NYC!
What a night at Data Peeps NYC Trivia! Teamed up with brilliant minds: Our Squd Anthony Elizondo from Adobe, Ryan Shaffer from AWS, Senthilnathan Karuppaiah from Pentaho, a Hitachi Vantara Company, and Wangda Zhang from MS Research - clinched first place! 🥇🦆
LinkedIn ↗Apr 21, 2024Streamlining Data Workflows: How I Use Dagster to Solve Practical Problems for Reliable Data Pipelines
I'm sharing a collection of my work in data engineering that showcases practical applications of Dagster for managing and orchestrating data pipelines. Through these examples, you'll discover how Dagster helps streamline and optimize various data processes. In this collection, I've included tasks related to data engineering, and other day-to-day application-related long-running multi-step backgrou
LinkedIn ↗Apr 16, 2024🚀 I’m pleased to present the dbt-duckdb-tickit-pipeline, a data engineering workflow integrating dbt with DuckDB tailored around the TickitDB schema.
Generic Data Lake Architecture w ETL/ELT Data Pipeline https://github.com/senthilsweb/dbt-duckdb-tickit-pipeline This project is a tailored workflow designed to empower data engineers with a seamless and robust data engineering pipeline using dbt alongside DuckDB, focusing on the well-known TickitDB schema. As a complement to this work, my open-source projects, DuckDB Data API and DuckDB Studio ,
✨ DuckDB Data API Enhanced with Serverless Redis Cache for Better Edge Performance ✨
LinkedIn ↗Apr 15, 2024✨ DuckDB Data API Enhanced with Serverless Redis Cache for Better Edge Performance ✨
I've noted concerns and personally observed that my duckdb-studio application , hosted on Vercel using the hobby plan, frequently crashes due to function timeouts. Developing on Vercel's hobby plan poses significant challenges, such as a maximum function invocation time of 10 seconds and limited memory , which impact the performance of data-intensive applications. To mitigate these limitations, I
✨I am pleased to announce that DuckDB Studio has integrated SQLGlot, a respected SQL parser, transpiler, and optimizer✨
LinkedIn ↗Apr 12, 2024✨I am pleased to announce that DuckDB Studio has integrated SQLGlot, a respected SQL parser, transpiler, and optimizer✨
SQL Parsing Capabilities in DuckDB Studio Powerd by SQLGlot Python library What is SQLGlot? SQLGlot is a no-dependency SQL parser, transpiler, optimizer, and engine. It can be used to format SQL or translate between 21 different dialects like DuckDB , Presto / Trino , Spark / Databricks , Snowflake , and BigQuery . It aims to read a wide variety of SQL inputs and output syntactically and semantica
LinkedIn ↗Mar 31, 2024Re-Introducing TemplrJS: Another One of My Open Source Contributions, Powering Modern Web and Mobile Apps with NuxtJS and MotherDuck (DuckDB).
TemplrJS is an Open Source Developer tooling platform I developed, leveraging the capabilities of Vue.js, Nuxt.js, Tailwind CSS, Supabase, and DuckDB/MotherDuck. It's crafted to provide developers with a seamless and efficient experience for creating fast, performance-optimized web and mobile sites, apps, and data-driven dashboards. I initiated the TemplrJS Project to power my blog site www.senthi