Bangalore, IND
17 days ago
Senior Data Engineer
**Job Description :** **About the Role** We are looking for a **Senior Data Engineer** with experience in excellent analytical abilities in **GCP BigQuery, ETL/BI, Python, Composer/Air** fl **ow, SQL** , **GCP Services** - with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse. **Skills & Competencies** ➔ A minimum of **4.5+ years** of working experience as a hands-on data engineering is a must ➔ Advanced Degree in the field of **Computer Science, Data Engineering, Data Analytics** or equivalent discipline ➔ Strong programming experience with **Python, SQL, ETL** and efficiently querying big datasets using **SQL** ➔ Prior experience with **CircleCI CI/CD, Terraform and Github version** control is a must ➔ Solid understanding of **Data Collection, Data Ingestion, Data Integration, and Data Operations & Maintenance** ➔ Implement **data governance** practices, including **data quality, security, and compliance,** in line with organizational standards. ➔ Domain knowledge on **News, Media & Communications** is an added advantage. **R E S P O N S I B I L I T I E S** ➔ **Design, build, and maintain scalable ETL/ELT pipelines in Google Cloud** , using tools like Cloud Composer (Airflow), and BigQuery. ➔ Collaborate with cross-functional teams to define **data architecture and data warehouse** requirements ➔ Automate data pipelines, ETL/ELT processes, and data integration workflows using **infrastructure-as-code (IaC)** and configuration management tools ➔ **Deep understanding of BigQuery,** including SQL, optimization techniques, partitioning, clustering, and performance tuning. ➔ Deliver production quality, modular, reproducible code in **Python, SQL** ➔ Implement **continuous integration and continuous deployment (CI/CD)** pipelines for data pipelines and data-related applications ➔ **Keep abreast of the latest developments** in the field through continuous learning and proactively champion promising new methods relevant to the problems at hand. **Our Tech Stack** ● **Google Cloud Platform** is IaaS ● BigQuery, GCS, Python, SQL ● **Composer / Air** fl **ow** - orchestration tools ● **Terraform** , **CircleCI** , CI/CD, **GIthub, Jira, Con** fl **uence** This job is posted with NTS Technology Services Pvt. Ltd. Job Category: News Corp is a global, diversified media and information services company focused on creating and distributing authoritative and engaging content to consumers throughout the world. The company comprises businesses across a range of media, including: news and information services, book publishing, digital real estate services, cable network programming in Australia, and pay-tv distribution in Australia. Headquartered in New York, the activities of News Corp are conducted primarily in the United States, Australia, and the United Kingdom.
Por favor confirme su dirección de correo electrónico: Send Email