Data Engineer - Data Platforms (Databricks)

About the role

This role offers the chance to drive modern data platform initiatives that enable analytics and AI across the enterprise. As a Data Engineer focusing on Databricks, you will shape data infrastructure, collaborate with cross‑functional teams, and ensure data systems are performant, secure, and scalable.

Key responsibilities

• Design, develop, and maintain scalable batch and real‑time data pipelines.
• Build and optimise enterprise data platforms using Databricks and Apache Spark.
• Develop ETL/ELT processes to ingest, transform, and integrate data from multiple sources.
• Implement Delta Lake architecture and manage lakehouse solutions.
• Collaborate with Data Scientists, AI Engineers, Business Analysts, and application teams to support analytics and AI projects.
• Optimise data storage, partitioning, and query performance.
• Create reusable data‑engineering frameworks and automation tools.
• Implement data quality, validation, lineage, and governance processes.
• Ensure data security, privacy, and compliance with enterprise standards.
• Monitor platform performance, troubleshoot production issues, automate deployments, and maintain technical documentation.

Required profile

• Bachelor's degree in Computer Science, IT, Engineering or a related field.
• 6+ years of data‑engineering experience with Databricks and Apache Spark.
• Strong proficiency in Python and SQL.
• Hands‑on experience with ETL/ELT processes and Delta Lake.
• Experience working on cloud platforms.
• Fluent English and eligibility to work in Egypt.

Required skills

• Databricks
• Apache Spark
• Python
• SQL
• Delta Lake
• ETL / ELT processes
• Cloud platforms (e.g., AWS, Azure, GCP)