Senthilsweb
Search
Served from JSON Resume v1.0.0Download resume.json ↓

Senthilnathan Karuppaiah

Data & GenAI Architect · Engineering Manager · Data Engineering & Governance

nathansweb@icloud.comNew Jersey, USA (NYC/EST)

Summary Highlights

Core Competencies

Data Engineering & GovernanceAgentic & GenAI EngineeringPlatform, Delivery & Leadership
ETL / ELT · DBT · dlthub · DagsterAgents · Skills/Tools · MCP ServersPython · TypeScript · Golang · SQL
Data Catalog · Discovery · ClassificationRAG · Semantic Search · ChatbotsJava · AWS/S3 · Docker · Kubernetes
Lineage · Provenance · Metadata HarvestingText-to-SQL · Agentic AnalyticsSnowflake · Lakehouse · DuckDB · Postgres
Data Quality · PII · ML & Agent GovernancePrompt Engineering · Guardrails · EvalsDistributed Teams · Hiring · Mentoring
Data & Pipeline Observabilityeve · Pydantic AI · LangChain · BentoMLForward-Deployed · Client Delivery

Professional Experience

Senior Engineering Manager & Data / GenAI Architect | PentahoMay 2021 – Present

Remote, New Jersey · Pentaho was part of Hitachi Vantara until 15 June 2026

  • Run delivery management, release readiness and engineering standards for the follow-the-sun team behind Pentaho Data Integration (PDI), Pentaho Business Analytics (PBA) and Pentaho Data Catalog.
  • Own quality and performance engineering for Pentaho Data Integration (PDI) — an enterprise ETL and data integration product — covering connectors, transformations and job orchestration, large-volume performance runs and release readiness.
  • Built TestDataLake, an internal governed data platform engineered like a real customer business application — dlthub ingestion pipelines feeding DBT models — producing realistic data at volume for catalog, discovery, classification and lineage validation.
  • Drive engineering and architecture for Pentaho Data Catalog — automated discovery, classification, metadata harvesting and lineage across many thousands of data sources and billions of rows and files, spanning JDBC databases, structured and unstructured documents on file systems and network drives, object stores and lakehouses; applied data and pipeline observability, lineage and provenance across governed platforms via Grafana, Prometheus and OpenObserve.
  • Extended the governance model beyond data to ML model and AI agent governance — bringing catalog, lineage and policy controls to the models and agents themselves for regulated enterprise customers.
  • Took customer-facing GenAI from prototype through production with product engineering and enterprise customers — grounding AI chat and analytics on governed semantic layers, with evals, guardrails and human review in place before release.
  • Designed NLP/ML classification and metadata enrichment (Legal-BERT served via BentoML) and privacy-safe LLM processing (Presidio) for sensitive enterprise data in-product.
  • Built the SDET and Performance Engineering competencies from the ground up — defining the practice, standards and tooling, hiring and training engineers, and automating 80% of regression testing; scaled SDET from its Io-Tahoe origins into a far larger capability.
  • Developed and introduced AI-DLC and the Pentaho SDET AI Workbench — a spec-driven AI engineering methodology combining requirements traceability, deterministic tooling, automated validation, human review and repeatable evaluation; adopted as a standard across the wider engineering team and in internal production use.
  • Serve as Data Solutions Architect across 10+ concurrent enterprise engagements — large banks, insurance, healthcare and life sciences, government and a leading US mortgage institution — delivering Catalog, Discovery and Lakehouse implementations through discovery, BRDs, specs, demos, workshops and enablement with CDO, CISO and product stakeholders.

Solutions Architect / Client Delivery & Head of Production Engineering | Io-Tahoe LLCDec 2018 – May 2021

New York City, New York

  • Rejoined Io-Tahoe — an early AI-driven data discovery and governance product company, acquired twice — having been with the team since its Rokittech days; shaped product capabilities from ideation through enterprise implementation.
  • Led ActiveDQ, a data quality product built natively on Snowflake — delivering quality capability that ran directly against warehouse data for enterprise customers.
  • Led client delivery and production engineering across banking, insurance and healthcare — scoping, implementation, reliability and release readiness for multiple concurrent engagements; turned customer goals into repeatable delivery playbooks.
  • Established the SDET competency from the ground up — defining test automation standards, tooling and engineering discipline that were later scaled organization-wide at Pentaho.

Solutions Architect | AZ-Teach Radiology & Open MRIJul 2017 – Nov 2018

Mesa, Arizona

  • Architected a custom Radiology Information System (RIS), HL7 integration engine, and web/mobile applications for multi-site radiology centers.

Earlier Experience

Vmoksha Technologies — Solutions ArchitectNJ, USA & Bangalore, India | Aug 2008 – Jun 2017

Enterprise application delivery; led teams across US and India. Client assignment: Rokittech, later Io-Tahoe (Dec 2014 – Jun 2017) — platform engineering and product ideation for the data discovery product.

Digitalpia — Programmer AnalystMatsuyama, Japan | Jan 2006 – Aug 2008

Multiple web and client-server projects using Oracle, MS SQL Server and MS Access.

Infosys Technologies — Team LeaderBangalore, India | Jun 2004 – Dec 2005

Solution engineering, technology consultation and performance optimization for enterprise clients.

Hewlett Packard — Systems EngineerBangalore, India | Oct 2003 – Jun 2004

Workforce Management product and SMART CRAWLER for information security.

Earlier Roles — Software EngineerBangalore, India | Jan 1999 – Oct 2003

Software engineering across call-centre, CMS, e-commerce and telecom directory systems.

Independent Projects & Open-Source

Privacy & Governance Engineering

  • Privacy Shield — open-source Python/FastAPI utility using Presidio, LangChain and OpenAI/Ollama to detect and anonymize PII before LLM processing and reverse it afterwards with full auditability. Also an OpenLineage proxy capturing lineage events as JSON, and ClaimWise, a synthetic healthcare dataset generator built as DBT pipelines, open-sourced to demonstrate DBT lineage in the catalog product.

Agentic Analytics & Data Tooling

  • DuckDB Data Studio — browser-based analytics console querying S3/Parquet via DuckDB-WASM over a governed DBT/Cube.dev semantic layer for text-to-SQL. Also dlthub ingestion and DBT pipelines orchestrated with Dagster and agentic analytics on top, a Data Pipeline Visualizer that generates diagrams from pipeline metadata, and TemplrGo, a single-binary data/ops toolkit with a built-in AI assistant.

AI Agents

  • ai-agents — monorepo of filesystem-first eve agents sharing one runtime kit; typed tools do the deterministic work and models only coordinate, with every run recording data, reports and metrics to a timestamped folder — an observability-first agent pattern.

Writing & Community

  • Templrpress publishing toolkit, regular long-form LinkedIn articles and cheatsheets on GenAI, agentic engineering and data governance — github.com/senthilsweb · senthilsweb.com, blogging since 2007.

Full open-source portfolio →

GenAI, Data & Platform Tooling

Data Engineering & Governance: Enterprise ETL/ELT (Pentaho Data Integration), dlthub, DBT, Dagster, Cube.dev semantic layers; catalog, discovery, classification, metadata harvesting, lineage, provenance, data quality, PII/privacy (Presidio), ML and agent governance; Snowflake, lakehouse, S3, DuckDB, pgvector

GenAI Observability & Evals: LangSmith, Arize, OpenObserve; Grafana, Prometheus, node exporters; data and pipeline observability, agent run logging and metrics, prompt engineering, guardrails

Agents & Frameworks: eve (Vercel), Pydantic AI, Flue, LangChain, MCP servers, skills/tools, deterministic tool-calling, RAG, text-to-SQL

MLOps, Models & Delivery: BentoML, HuggingFace, Docker, Kubernetes, CI/CD; Claude, GPT, Gemini, GLM, DeepSeek, Ollama/local models; AI-DLC, spec-first delivery, forward-deployed engagement

Education & Certifications

B.E. (Electronics & Instrumentation) & M.B.A. (IT & Tourism)Annamalai University · Global: US, Japan (3 yrs), India, Ukraine
Social Innovation Leader – Global (SIL-G)Hitachi Academy · IMD Business School