Senior Data Engineer

About the role

We are building a regional technology Delivery Hub in Egypt that will serve as a centre of excellence for AI, advanced analytics and enterprise‑scale data solutions. As a Senior Data Engineer you will design, develop and optimise data platforms and pipelines that power reporting, machine‑learning and intelligent automation across the organisation.

Key responsibilities

• Design, develop and maintain scalable data pipelines using Azure Data Factory and/or Microsoft Fabric.
• Build modern lakehouse solutions with Delta Lake and implement complex data transformations in Python and SQL.
• Ingest and integrate structured and unstructured data from multiple enterprise sources.
• Create analytics‑ready data models and enforce data‑quality checks, monitoring and alerting.
• Optimise queries and pipelines for performance, scalability and cost efficiency.
• Apply software‑engineering best practices: modular code, testing, documentation and code reviews.
• Implement CI/CD pipelines for automated testing and deployment of data solutions.
• Troubleshoot pipeline failures and resolve production issues.
• Mentor junior engineers and promote knowledge sharing within the team.

Required profile

• 5‑8+ years of professional data‑engineering experience.
• Strong hands‑on expertise with Azure Data Factory and/or Microsoft Fabric.
• Advanced SQL skills, including complex queries, performance tuning and data transformation.
• Proficient Python development for data‑processing and automation workloads.
• Practical experience with Delta Lake and lakehouse architecture.
• Experience building production‑grade ETL/ELT pipelines and implementing CI/CD for data platforms.

Required skills

• Delta Lake
• Microsoft Fabric
• Azure Data Factory
• Python
• SQL
• Azure Databricks (desirable)
• PySpark / Apache Spark (desirable)
• Azure Data Lake Storage (desirable)
• CI/CD pipelines
• Power BI (desirable)