- Published on
This guide covers essential PySpark operations for data cleaning, transformation, and analysis. Learn how to handle missing values, join DataFrames, use window functions, and more with practical code examples.
Hi, I’m Kamrul Hasan — Lead Data Platform Engineer & AI Consultant
I help organizations design scalable data platforms and deliver solutions across Data Engineering, AI, ML, and Web Applications. With expertise in governance and strategy, I enable businesses to unlock the full potential of their data for smarter decision-making and growth.
About Me
I’m Kamrul Hasan, a Data Platform Lead with deep experience in Data Engineering, Science, and AI. Over the years, I’ve led teams in building end-to-end solutions that make data accessible, reliable, and impactful. I’m passionate about transforming raw data into innovation and love working with forward-thinking organizations.
Read my full story →What I Do
🔧Data Engineering & Platforms
🤖Agentic AI, ML & Deep Learning Solutions
📊Data Governance & Strategy
🧑💼Consulting & Mentorship
Latest
A blog about programming, data and web development.
- Published on
This guide explores how to handle semi-structured JSON data using PySpark. It details Spark's complex data types—Array, Struct, and Map—and demonstrates how to parse, access, and flatten nested JSON records for efficient data transformation.
Subscribe to the newsletter