Azure Data Engineer Needed in Pune

Part-Time On-Site Azure Data Engineer – Pune

I am looking for a hands-on Azure Data Engineer for a personal project in Pune. This is a part-time, on-site/in-person opportunity. The selected freelancer will work directly with me for approximately 5 hours per day.

Required Skills:
• Azure Databricks
• PySpark / Python
• Strong SQL / SQL Server
• Azure Data Factory (ADF)
• Azure Data Lake Storage Gen2 (ADLS Gen2)
• Delta Lake
• ETL/ELT
• Historical and incremental data processing
• Delta MERGE / Upsert
• JSON and nested JSON processing
• Data transformation and deduplication
• Source-to-target data validation and reconciliation
• Basic Spark/Databricks performance optimization

Healthcare or Insurance domain experience is preferred. Experience with Member, Claims, Policy, Benefits, FHIR or HL7 data will be an advantage.

Responsibilities:
• Develop and troubleshoot Azure Databricks notebooks using PySpark.
• Build and modify ADF data pipelines.
• Process data from SQL Server and other sources.
• Implement historical and incremental data processing.
• Create and maintain Delta Lake tables.
• Implement MERGE/Upsert logic.
• Parse and transform nested JSON data.