Jayprakash Bilgaye

Senior Solution Specialist

Big Data & Platform Engineering

Pune, India

0+ Years Experience
0 Companies
0+ Technologies
0+ Cloud Platforms

About

I build and run distributed data platforms in production — Kafka, ClickHouse, Hadoop-family stacks, and the observability around them (Prometheus, Grafana). Over 15+ years I've worked across greenfield builds, upgrades, migrations, and steady-state operations: cluster scaling, incident response, security hardening (TLS, LDAP, Kerberos, Ranger), and automation (Terraform, Ansible, GitOps tooling).

Currently focused on open-source big data platforms in enterprise environments — Kafka operations, ClickHouse deployments & remediation, Iceberg-related capabilities, and platform upgrades with minimal disruption to data teams.
Earlier roles span large multi-environment Hadoop estates (~300 nodes), Kubernetes on Azure/GCP, AKS/Terraform, and CDH/Hortonworks-era hardening — from Cognizant through Persistent, Clairvoyant, and my current engagement.
Cloud & analytics — hands-on with GCP BigQuery for large-scale analytics workloads, Azure cloud operations, container orchestration, and infrastructure-as-code with Terraform for reproducible, cost-optimized deployments.
Observability & reliability — Prometheus, Grafana, and custom alerting pipelines for proactive monitoring. Building the automation and runbooks that keep platforms safe to change at scale.
Contribute to the tech community through educational content on Udemy and Medium, focusing on DevOps best practices, Kubernetes, ClickHouse, and emerging data technologies.

Open to relevant platform / SRE / big data engineering conversations.

Focus Areas

Kafka ClickHouse Hadoop / Iceberg Kubernetes Azure / Cloud Ops GCP / BigQuery Prometheus / Grafana Terraform / Ansible Platform Reliability NiFi GitOps

Writing & Courses

Experience

2022 – Present

Senior Solution Specialist

Telstra (client)

Production Kafka, ClickHouse, Hadoop platforms; observability & upgrades.

2017 – 2022

Senior Engineer, Cloud & Ops

Clairvoyant

Large-scale Hadoop, Kubernetes on Azure/GCP, Terraform, monitoring.

2014 – 2017

Module Lead, DevOps / Hadoop

Persistent Systems

CDH, security (LDAP, TLS), NiFi, platform standards.

2010 – 2014

Programmer Analyst

Cognizant

Hadoop operations & delivery support.

Certifications

CKA Certified Kubernetes Administrator
AZ-104 Microsoft Certified: Azure Administrator Associate
HDPCA Hortonworks Certified Apache Hadoop Administrator
CCAH Cloudera Certified Hadoop Administrator
RHCE Red Hat Certified Engineer

Let's Connect

Interested in big data platforms, distributed systems, or just want to say hi?