Location: Hyderabad, India
Experience: 8 to 10 years
Skills Required: Azure, ETL, IBM Datastage, Snowflake, Azure Data Factory (ADF)

Job Description:

We are looking for an experienced Senior Data Engineer with expertise in cloud data platforms and ETL tools to join our Hyderabad team. The ideal candidate will have a strong background in Azure cloud services, ETL development, IBM Datastage, Snowflake data warehousing, and Azure Data Factory (ADF).

Key Responsibilities:

Design, develop, and implement scalable ETL pipelines using IBM Datastage and Azure Data Factory.

Develop and optimize data workflows and integration processes within Azure ecosystem.

Work with Snowflake for data warehousing solutions, including schema design, performance tuning, and data migration.

Collaborate with data architects and analysts to gather requirements and deliver efficient data solutions.

Monitor, troubleshoot, and improve existing data pipelines and workflows.

Ensure data quality, consistency, and security across systems.

Maintain documentation of data processes and architecture.

Stay updated on new Azure and Snowflake features and best practices.

Mandatory Skills:

Azure Cloud Services: Strong hands-on experience with Azure Data Factory, Azure Blob Storage, Azure SQL, and related services.

ETL Tools: Expertise in IBM Datastage for ETL process design and deployment.

Snowflake: Proven experience in Snowflake data warehouse design, implementation, and maintenance.

Azure Data Factory (ADF): In-depth knowledge of ADF pipelines, triggers, and monitoring.

Strong scripting skills (Python, PowerShell, or SQL) for automation and data transformation.

Experience with CI/CD pipelines for data deployment is a plus.

Excellent problem-solving skills and ability to work in an agile environment.