Data Engineer, Senior Associate – Azure & Databricks

About the role

PwC's data and analytics engineering team builds robust data solutions for clients, turning raw data into actionable insights. As a Senior Associate in the Data Engineering team, you will design, build and optimise modern data platforms and pipelines on Azure and Databricks, working in cross-functional teams to deliver scalable, secure and high-performing data solutions for enterprise clients.

Key responsibilities

• Design, develop and maintain end-to-end data pipelines across structured, semi-structured and unstructured data sources.
• Implement data ingestion, transformation and orchestration using Azure Data Factory, Synapse and/or Microsoft Fabric Data Pipelines.
• Develop and optimise ETL/ELT processes with Databricks (PySpark, SQL, Delta Lake).
• Enforce data quality, lineage and governance practices.
• Work with solution architects to design modern data architectures compliant with security and privacy standards.
• Take part in client workshops and technical discussions to turn business needs into technical designs.

Required profile

• 3-6 years of data engineering experience, preferably in a consulting or enterprise environment.
• Solid understanding of data modelling, medallion architecture and lakehouse principles.
• Familiarity with CI/CD, DevOps and version control (e.g. Git, Azure DevOps).
• Knowledge of data governance, lineage and observability tools.

Required skills

• Azure Data Platform: Data Factory, Synapse Analytics, Azure Data Lake Storage, Microsoft Fabric, Event Hub/IoT Hub, Azure Functions.
• Databricks: PySpark, Spark SQL, Delta Lake, Unity Catalog, Databricks Workflows.
• Python and SQL for large-scale data processing.
• Performance optimisation, cost control and cloud best practices.