Kuala Lumpur, Malaysia
20 hours ago
Data Engineer

We are currently seeking a talented Data Engineer to join our team at BASF's Agricultural Solutions department Digital Factory.

 

In this role, you will be responsible for ensuring we can leverage data effectively for analytics, reporting, and decision-making. Your main objective will be to build and maintain a robust data infrastructure for enterprise-grade IT solutions of BASF Agricultural. This role requires both technical expertise and strong leadership skills to drive efficient product delivery.

 

 

Responsibilities

 

You will leverage your expertise to design and maintain efficient data models, schemas, and structures that facilitate data storage and retrieval. Working closely with cross-functional teams, you will ensure that objectives are met and collaborate on data-related initiatives.Your responsibilities will include designing, building, and maintaining infrastructure and pipelines for extracting, transforming, and loading (ETL) data from various sources into data storage systems such as data warehouses or data lakes. You will implement quality checks, validation processes, and error handling to maintain high data quality standards.You will continuously monitor the pipelines and infrastructure, promptly troubleshooting and resolving any performance issues, errors, or anomalies to ensure seamless operations.Throughout the product lifecycle, you will provide technical support and expertise to the product team and stakeholders. This will involve performing rigorous testing and evaluation to ensure that the final product meets design specifications and quality standards.You will also play a crucial role in transforming and cleaning raw data, including handling missing values, data normalization, and aggregation. Administering and optimizing databases, such as performance tuning, indexing, and ensuring data security, may be required as well.You will have the opportunity to prepare, present, and maintain technical reports, documentation, and presentations. This may include creating and updating schematics, blueprints, and manuals to facilitate effective communication and knowledge sharing.To excel in this position, it is important to stay updated with new technologies, industry advancements, and best practices. This will enable you to bring innovative solutions and ideas to the table.You will be instrumental in improving efficiency and reducing manual intervention by automating processes and routine tasks. Ensuring compliance with regulatory standards and requirements is also crucial to meet industry guidelines.

 

 

Qualifications

 

Bachelor Degree in Computer Science / Computer Engineering / Information Technology or business-technology related disciplineMin. 3-5 years of professional experience in IT and / or IT ConsultingExperienced in Java, Scala, Python, SQL Experience in Tools like Databricks, Azure Data Factory, Synapse, SQL Server Design & Implementation of ETL / ELT data pipelines Familiar with Data Warehouse and Data Lake architecture concept 

 

 

Por favor confirme su dirección de correo electrónico: Send Email