Kuldeep Pal

👋 Hello! I'm Kuldeep Pal

A passionate Data Engineer with 7+ years of experience in Big Data Analytics and Cloud Technologies. 🚀

💼 Throughout my journey, I've worked across diverse domains:
Capital Markets Insurance FinTech Pharmaceutical Healthcare Retail/E-commerce

🎯 Core Expertise:

✨ Building scalable data warehouses & data lakes using modern cloud platforms

✨ Implementing and automating data pipelines with real-time processing

✨ Data processing & standardization using ML and NLP

✨ Data Migration across heterogeneous systems

🛠️ Technical Focus:

📊 Data Engineering (80%)

💻 Backend Development (10%)

🔄 DevOps (5%)

🤖 GenAI (5%)

I'm passionate about solving complex data challenges and building robust, scalable solutions. Currently working at Walmart Global Tech where I focus on fraud detection and healthcare data platforms. 🌟

LinkedIn GitHub

Skills

Programming

Python, PySpark, SQL, Scala, Java(Spring-Boot)

Big Data

Spark, Hadoop, Hive, ETL, Pandas, Numpy, CRUD API, Kafka, Airflow

Cloud

AWS-S3, EMR, Athena, Redshift, GCP-BigQuery, BigTable, DataProc, Vertex AI

Databases

BigQuery, ElasticSearch, Azure SQL Server, MySQL, MongoDB

Tools/CICD

Jupyter, DataBricks, Tableau, Git, Jenkins, Docker, Kubernetes, GenAI (LLM, GPT)

Data Engineering

ETL, Data Modeling, Data Warehousing, Data Lakes, Real-time Processing

Streaming

Kafka, Spark Structured Streaming, Real-time Analytics

Soft Skills

Collaboration, Teamwork, Problem-Solving, Stakeholder Management

Experience

Walmart Global Tech

June 2022 - Present

PySpark Kafka BigQuery Elasticsearch Airflow Spring Boot GenAI Java Scala Docker Kubernetes

ZS Associates

September 2021 - June 2022

AWS EMR Hive PySpark SQL Airflow Data Modeling AWS S3 Entity Resolution Data Warehousing

Tata Consultancy Services

September 2018 - September 2021

Clients: Morgan Stanley, Nassau RE

AWS Glue Python Redshift Lambda Athena Shell Scripts Tableau Computer Vision ETL SQL

Education

Bachelor of Engineering (Honours)

Computer Science Engineering

Institution: Shri Vaishnav Institute of Technology and Science

Location: Indore, Madhya-Pradesh, India

Duration: July 2014 - July 2018

Key Achievement

GATE CSE (2019-2020) 90 percentile

Conducted by IIT-D National Exam

Personal Projects

SplitKro

A robust expense sharing application built with Spring Boot, designed to help users manage shared expenses easily and efficiently.

Real-time Streaming Pipeline

Built a real-time content popularity tracker using Kafka and Flink for streaming data processing.

Real-time OLAP

Developed a real-time analytics pipeline with Kafka and Pinot for efficient data querying.

GenAI Projects

I have worked for text-to-SQL conversion with OpenAI integration. I also worked with synthetic data generation with LLM.

Recommendations

I had the chance to work with Kuldeep for almost 6 months in TCS, collaborating in a sales and trading, middle office, production support project. It's rare that you come across a standout talent like Kuldeep. He has sound technical knowledge and is always keen to learn new things.

Srisakhi Sengupta

Senior Manager at Morgan Stanley

I have had the pleasure of working closely with Kuldeep for over a year at TCS, where he has consistently demonstrated exceptional expertise in Big Data Analytics, Programming (Python) and Cloud technologies. His ability to adapt to new technologies and methodologies has been instrumental in delivering high-quality solutions to complex business challenges.

Payal Ghosal

Financial Analyst at Siemens

Kuldeep is an excellent resource, and a master at Data Engineering. He is dedicated, hard and smart worker with an easiness to build interpersonal relations. He is always capable of adapting new work environments and is a quick learner with excellent fundamentals.

Sundarm Soni

SDE-III at Morgan Stanley

Kuldeep was an outstanding student who consistently demonstrated exceptional skills and knowledge. His excellent communication skills, strong work ethic, and ability to work well under pressure have made him a valuable professional. He is a team player who is always willing to collaborate.

Rahul Patel

Faculty at Sunstone

Hi! I'm Kuldeep Pal

I'm a Data Engineer