Senior Associate – Data Engineer (Azure & Databricks)

About the role

As a Senior Associate in PwC’s Data Engineering team, you will design, build and optimise modern data platforms on Azure and Databricks, delivering scalable and secure solutions that enable advanced analytics and AI for enterprise clients.

Key responsibilities

• Design, develop and maintain end‑to‑end data pipelines for structured, semi‑structured and unstructured sources.
• Implement ingestion, transformation and orchestration using Azure Data Factory, Synapse and Microsoft Fabric pipelines.
• Develop high‑performance ETL/ELT processes in Databricks (PySpark, SQL, Delta Lake) and enforce data quality, lineage and governance.
• Collaborate with solution architects to create modern data architectures that meet security and privacy standards.
• Participate in client workshops and technical discussions to translate business needs into technical designs.

Required profile

• 3–6 years of data engineering experience.
• Strong hands‑on expertise with Azure Data Platform services and Databricks.
• Proficiency in Python and SQL for large‑scale data processing.
• Solid understanding of data modelling, medallion architecture and lakehouse principles.
• Experience with CI/CD pipelines, DevOps practices and version control (Git, Azure DevOps).

Required skills

• Azure Data Factory, Synapse Analytics, Azure Data Lake Storage, Microsoft Fabric, Event Hub, IoT Hub, Azure Functions.
• Databricks, PySpark, Spark SQL, Delta Lake, Unity Catalog, Databricks Workflows.
• Python, SQL.
• CI/CD, Git, Azure DevOps.
• Data governance, lineage, observability tools.
• Performance optimisation, cost control.
• Apache Airflow, Apache Hadoop, AWS.