JD - Data Engineer

We are recruiting Data Engineers with strong technical ability who can articulate well to non-tech audience, who will join our team on a permanent basis.

Technical Skills:

Mandatory Skills Big Query, ETL, Data Management, Python, SQL, Kubernetes, Cloud computing (GCP, Azure)

Optional Skills Cloud Storage, Hadoop, Kafka

Responsibilities: • Design, build, and maintain scalable data pipelines and ETL processes using GCP services such as Cloud Dataflow, Cloud Dataproc, and BigQuery.

• Implement and optimize data storage solutions using GCP technologies like Cloud Storage, Cloud SQL, and Cloud Spanner.

• Develop and maintain data warehouses and data lakes on GCP, ensuring data quality, accessibility, and security. 

• Collaborate with data scientists and analysts to understand data requirements and provide efficient data access solutions. 

• Implement data governance and security measures to ensure compliance with regulations and best practices.

• Automate data workflows and implement monitoring and ing systems for data pipelines. • Sharing data engineering knowledge with the wider functions and developing reusable data integration patterns and best practices.

Skills/Experience:

• BSc/MSc in Computer Science, Information Systems, or related field, or equivalent work experience.

• Proven experience (5+ years) as a Data Engineer or similar role, preferably with GCP expertise.

• Strong proficiency in SQL and experience with NoSQL databases.

• Expertise in data modeling, ETL processes, and data warehousing concepts.

• Significant experience with GCP services such as BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub. 

• Proficiency in at least one programming language (e.g., Python, Java, or Scala) for data pipeline development.

• Experience with big data technologies such as Hadoop, Spark, and Kafka. 

• Knowledge of data governance, security, and compliance best practices.

• GCP certifications (e.g., Professional Data Engineer) are highly advantageous. 

• Effective communication skills to collaborate with cross-functional teams and explain technical concepts to non-technical stakeholders.