Azure and Databricks Data Engineer, Senior Associate

About the role

As a Senior Associate in PwC's Data Engineering team, you will design, build, and optimise modern data platforms on Azure and Databricks. You will collaborate with cross‑functional teams to deliver secure, high‑performance pipelines that enable advanced analytics and AI for enterprise clients.

Key responsibilities

• Design, develop and maintain end‑to‑end data pipelines for structured, semi‑structured and unstructured sources.
• Implement ingestion, transformation and orchestration using Azure Data Factory, Synapse Analytics and Microsoft Fabric.
• Develop ETL/ELT processes in Databricks (PySpark, SQL, Delta Lake) ensuring scalability and performance.
• Enforce data quality, lineage and governance standards.
• Collaborate with solution architects to design compliant data architectures.
• Participate in client workshops to translate business needs into technical designs.

Required profile

• 3–6 years of data engineering experience, preferably in consulting or large enterprises.
• Strong hands‑on expertise with Azure data services and Databricks.
• Proficiency in Python and SQL for large‑scale data processing.
• Solid understanding of data modelling, medallion architecture and lakehouse concepts.
• Experience with CI/CD pipelines, DevOps practices and version control (Git, Azure DevOps).

Required skills

• Azure Data Factory
• Azure Synapse Analytics
• Azure Data Lake Storage
• Microsoft Fabric
• Azure Event Hub / IoT Hub
• Azure Functions
• Databricks (PySpark, Spark SQL, Delta Lake, Unity Catalog, Workflows)
• Python
• SQL
• CI/CD and DevOps
• Git / Azure DevOps
• Data governance, lineage and observability tools