Job Summary:
We are seeking an experienced ADF Developer to design, build, and maintain data integration solutions using Azure Data Factory with exposure to Azure Databricks (ADB). The ideal candidate will have hands-on expertise in ETL pipelines, data engineering, and Azure cloud services to support enterprise data initiatives.
Key Responsibilities:
Design and develop scalable ETL pipelines using ADF.
Integrate ADB for advanced data transformation tasks.
Optimize and troubleshoot ADF pipelines and queries (SQL, Python, Scala).
Implement robust data validation, error handling, and performance tuning.
Collaborate with data architects, analysts, and DevOps teams.
Maintain technical documentation and support ongoing solution improvements.
Required Qualifications:
Bachelor’s/Master’s in Computer Science or related field.
2+ years of hands-on ADF experience.
Strong skills in Python, SQL, and/or Scala.
Familiarity with ADB and Azure cloud services.
Solid knowledge of ETL, data warehousing, and performance optimization.
Preferred:
Microsoft Azure Data Engineer certification.
Exposure to Spark, Hadoop, Git, Agile practices, and domain-specific projects (finance, healthcare, retail).
Understanding of data governance and compliance.