All posts

Building a Generative Q&A Engine with Semantic Search and Embeddings

In the age of AI-powered tools and intelligent systems, the ability to search, analyze, and generate insights from documents has become paramount.

Edge-Optimized GenAI Chat Web-UI for Ollama & Cloudflare AI models with Context Injection

It is a simple GenAI chat web interface built with Next.js that connects to both local Ollama and Cloudflare AI models.

Embedding LLM in SQL is simple!

Inspired by Snowflake’s AI-driven analytics and MotherDuck’s recent implementation of SQL + LLM (Introducing the prompt() function), I explored LLM-powered Business Insights using DuckDB, embedding AI directly into SQL workflows for real-time data intelligence.

Data Pipeline Diagrams as Code

Creating diagrams for data pipelines, workflows, and architectures is a routine task for many of us. Whether it's for internal presentations, client discussions, or technical documentation, the process can often feel repetitive and time-consuming.

Privacy Engineering with LLMs: Safeguarding PII While Enhancing Text with Privacy Shield

In the age of AI-powered tools and intelligent systems, the ability to search, analyze, and generate insights from documents has become paramount.

Lightweight HTML to PDF with Puppeteer: Simple PDF Export for Edge Deployments

This microservice is designed to address simple PDF export needs, making it ideal for generating blog articles, profile cards, and other lightweight use cases.

Crafting Stunning Event Tickets with Pentaho Reports: A Low-Code No-Code Journey!

When it comes to generating business reports, organizations often face a plethora of choices. Solutions like JasperReports, Crystal Reports, Microsoft Reporting Services, ActiveReports for .NET, HTML to PDF etc.

Deploying Pentaho Carte Server on Fly.io with Firecracker VM: A Fun Way to Learn ETL!

This article is a sequel to my earlier post, “Instant Observability with Zero Code!”. In this second part of the series, we dive into more advanced configurations for the Open telemetry collector especially the filelog receiver for log files routing and data enrichment leveraging router, multiple filelog receivers, regex parsers etc.

Pentaho: Versatile Data Engineering for All Needs—ETL, Reverse ETL, ELT, Data Lakes, Big Data, Data Quality, Reporting, Visualization & Data 360

When it comes to generating business reports, organizations often face a plethora of choices. Solutions like JasperReports, Crystal Reports, Microsoft Reporting Services, ActiveReports for .NET, HTML to PDF etc.

Simplify Decision Logic with GoRules: An Embeddable Rules Engine for Python, Go, Rust, and NodeJS

If you've worked with JBOSS Drools or other rule engines, you're probably all too familiar with the complexity that comes with them.

JIRA to DuckDB Bot: A Simple Python Data Pipeline with DLThub

Organizations often use JIRA for project management, and the need to automate data extraction from JIRA for analytics is common.

Social-Card: Dynamic Image Creation on the Edge with Vercel Open Graph

A dynamic image generator for business, profile, and social cards using Vercel Open Graph, Next.js, and TailwindCSS. Easily customize and create visually appealing cards for any purpose.

Flog: A Powerful Fake Log Generator by @mingrammer 🚀📊

Looking for a simple way to generate fake log data for testing or simulating real-world scenarios?. Look no further than Flog by @mingrammer

Mastering Otel collector - Filelog Receiver: Log Routing & Data Enrichment for Microservices

This article is a sequel to my earlier post, “Instant Observability with Zero Code!”. In this second part of the series, we dive into more advanced configurations for the Open telemetry collector especially the filelog receiver for log files routing and data enrichment leveraging router, multiple filelog receivers, regex parsers etc.

Instant Observability with Zero Code

Need observability in your existing applications? Look no further! I’ve developed a ready-to-use, zero-code solution that brings observability to your applications, regardless of the technology or platform.

Scrape and Transform Instagram Posts into Blog Content—No API Key Needed

A simple, serverless tool that effortlessly fetches Instagram posts, complete with images, without the need for an API key! Whether you're a content creator, marketer, or small business owner, this tool can help you seamlessly repurpose your Instagram content for your blog or website.

Introducing Semantic Data Modeling with Malloy and DuckDB | MotherDuck | PostgreSQL | BigQuery

If you work in Data Engineering, Data Science, or AI/ML, you have likely encountered terms such as DataOps, DataFabric, Data Governance, Business Metadata Management, ETL & Reverse ETL, Data Quality, Knowledge Graph, Semantic Layer/Data Modeling, and Self-Service Analytics..

Kudos to MotherDuck for a successful first Data Community Meetup in NYC.

I'm sharing a collection of my work in data engineering that showcases practical applications of Dagster for managing and orchestrating data pipelines.

Streamlining Data Workflows: How I Use Dagster to Solve Practical Problems for Reliable Data Pipelines.

I'm sharing a collection of my work in data engineering that showcases practical applications of Dagster for managing and orchestrating data pipelines.

I am pleased to present the dbt-duckdb-tickit-pipeline, a data engineering workflow integrating dbt with DuckDB tailored around the TickitDB schema.

This project is a tailored workflow designed to empower data engineers with a seamless and robust data engineering pipeline using dbt alongside DuckDB, focusing on the well-known TickitDB schema.

DuckDB Data API Enhanced with Serverless Redis Cache for Better Edge Performance

I've noticed that my DuckDB Studio app on Vercel's hobby plan often crashes due to function timeouts. The hobby plan's 10-second function limit and limited memory make it hard to run data-heavy apps.

I am pleased to announce that DuckDB Studio has integrated SQLGlot, a respected SQL parser, transpiler, and optimizer

DuckDB Studio has integrated SQLGlot, a widely recognized SQL parser, transpiler, and optimizer, enhancing its SQL processing capabilities.

Mastering SQL Queries with the Tickit Database on DuckDB

Dive into the SQL with the Tickit database, a comprehensive dataset for a fictional ticket sales company. This guide will explore the nuances of SQL operations, utilizing DuckDB's efficient analytical data management system. From querying event and venue data to analyzing ticket sales and customer interactions, enhance your SQL skills through practical scenarios and examples.

Re-Introducing TemplrJS: Another One of My Open Source Contributions, Powering Modern Web and Mobile Apps with NuxtJS and MotherDuck (DuckDB).

Discover TemplrJS, the amalgamation of best-practice templates and cutting-edge development inspired by RedwoodJS for building high-performance web and mobile applications.

TemplrJS

Discover TemplrJS, the amalgamation of best-practice templates and cutting-edge development inspired by RedwoodJS for building high-performance web and mobile applications.

Profiling Columnar Data with DuckDB

Leveraging DuckDB for efficient data profiling offers a novel approach to understanding statistics and distributions within columnar files. This documentation outlines the simplicity with which DuckDB can be utilized to gather insightful statistics from your data without the overhead of complex data pipelines or heavyweight ETL processes.

Seamlessly Deploying ERPNext's Healthcare Module named Frappe Health on Docker

A walkthrough of deploying the Healthcare module of ERPNext using Docker-Compose, shedding light on some challenges and their solutions.

Smoothing ERPNext Deployment on Apple's M1 via Docker-Compose

Addressing the overlooked detail in ERPNext's Docker setup for the Apple M1 architecture and providing a simple solution.

Building and Running AMD64 Docker Containers on Apple M1

Navigating through the challenge of running AMD64 Docker images on the ARM-based Apple M1 chip, and finding a solution that ensures seamless development across different architectures.

Using Makefiles to Bundle a Full-Stack App into a Go Binary

Creating a seamless deployment process can be a challenge when building full-stack applications. This blog will walk you through packaging a web frontend and a Go backend into a single binary, making deployment easier and more efficient.

Boosting JS Frontend Projects with Lodash, Underscore.js, and Underscore.string.js

In TemplrJS projects, leveraging utility libraries like Lodash, Underscore.js, and Underscore.string.js can make your code more efficient, readable, and maintainable. This guide demonstrates the power of these libraries with real-world examples.

Running a Binary in Headless Mode

Running a binary in headless mode can be a useful technique when you need to run a binary on a remote server or in a terminal environment. By running the binary without a graphical user interface (GUI), you can save system resources and ensure that the binary runs smoothly. In this blog post, we'll explore how to run a binary in headless mode using the command line. We'll cover the steps involved in running the binary, verifying that it's running, and stopping it when necessary.

Getting Started with DuckDB SQL IDE

The "Tickit" database typically contains tables related to a fictional ticket-selling company, including data about events, venues, ticket sales, and customer information. It's designed to showcase various SQL operations and query scenarios.

Free Lightweight Online DuckDB SQL Query Editor in NuxtJS and Tailwind CSS

Building a No-Code MicroORM with RESTful API for DuckDB

Converting PDF to PNG Images with OCR using Docker and Tesseract

How to expose apps running in your home lab server securely to public internet thru cloudflare tunnel?

Open sourced new Go API Server which can be deployed 100% free in Netlify

Deploy Zypress (or Static Website) in a standalone Golang binary

All about Zypress, a blog engine in a single binary

Zypress is an open source app which means you can customize absolutely everything without having any andvanced programming skills or web design skills. Just by editing the simple config files listed below at the root of the project, you'll find straightforward controls for changing colors, navigation, logos and settings — so you can set your site up just how you like it.

Host Zypress in Life-time free linux box from Oracle Cloud Infrastructure (OCI)

Zypress, Open-source Jamstack framework created using NuxtJS (Vue.js) + Tailwindcss

Got back into blog writing.

How we built our cloud based physician portal web, mobile and HL7 Interface engine – 01

AZ-Tech Radiology is one of the leading medical imaging organization that provides the highest quality imaging services utilizing state-of-the-art equipment and technologies in Arizona.