Job Summary:
We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize large-scale data pipeline, ensuring scalability, reliability and performance. This role involves working closely with multiple teams and business stakeholders to deliver cutting-edge data solutions.
Key Responsibilities:
1. Data Pipeline Development:
• Build and maintain scalable
ETL/ELT pipelines using Databricks.
• Leverage PySpark/Spark and
SQL to transform and process large datasets.
• Integrate data from multiple sources including Azure Blob
Storage, ADLS and other relational/non-relational systems.
2. Collaboration & Analysis:
• Work Closely with multiple teams to prepare data for dashboard and Bl Tools.
• Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.