Jobiglo

No results.

Senior Lead Data Engineer - Databricks

Integrant · Maadi

New
Senior 🇬🇧 English
Databricks PySpark Apache Spark SQL Python Delta Lake Azure Data Factory Azure Synapse Analytics Azure DevOps Microsoft Purview Azure Key Vault Microsoft Entra ID Snowflake dbt Kafka Airflow Power BI Docker Kubernetes

Job description

About the role

Integrant is looking for a Senior Lead Data Engineer focused on Databricks. You will design and deliver modern, scalable data platforms for clients across multiple industries, using Azure and Databricks technologies. You will lead the design, development and optimization of end-to-end data engineering solutions based on Lakehouse architectures, work closely with clients and cross-functional teams, and mentor engineers.

Key responsibilities

  • Lead the design, development and maintenance of scalable data engineering solutions using Azure and Databricks
  • Design and implement Lakehouse architectures following industry best practices
  • Build and optimize large-scale batch and streaming data pipelines
  • Develop ETL/ELT pipelines with Databricks, PySpark, SQL and Azure Data Factory
  • Design and optimize Delta Lake solutions
  • Collaborate with clients to turn business needs into technical solutions
  • Optimize Spark workloads for performance, scalability and cost
  • Design and maintain data warehouses, data lakes and lakehouses
  • Implement data governance, security and metadata management with Azure Purview, Key Vault and Microsoft Entra ID
  • Set up CI/CD pipelines and DevOps practices, and mentor junior engineers

Required profile

  • 10+ years of professional experience in data engineering
  • 4+ years of hands-on Databricks experience
  • Experience working directly with clients and mentoring engineers
  • Nice to have: MSc in Computer Science or a related field

Required skills

  • Databricks, PySpark, SQL, Python, Azure Data Factory, Azure Synapse Analytics, ADLS Gen2
  • Delta Lake, Medallion architecture, dimensional modeling, ETL/ELT
  • Azure DevOps CI/CD, Azure Key Vault, Microsoft Entra ID, Microsoft Purview
  • Nice to have: Snowflake, Structured Streaming, Kafka, Event Hubs, Delta Live Tables, Unity Catalog, dbt, Airflow, Docker, Kubernetes, Power BI

What we offer

  • Salary paid in USD
  • Six-month career advancement opportunities
  • Premium medical insurance for employee and family
  • English language and technical development courses
  • Interest-free loans paid over 2.5 years
  • Planned overtime program and employment referral program
  • Premium location in Maadi

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Integrant.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:workable

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

💬 Chat with us on Telegram

Published 12 hours ago

Expires 1 month from now

2 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Integrant

Maadi