Senior Data Engineer
Citigroup
**We are seeking a skilled and motivated Python and Database Developer to join our dynamic technology team. The ideal candidate will possess strong programming skills in Python, a solid understanding of database systems, and the ability to design, develop, and maintain efficient and scalable applications. This role involves working on a variety of projects, including data processing pipelines, web applications, and database integrations.**
**Responsibilities and Duties**
**Data Engineering Leadership: Lead the design and development of data pipelines for ingestion, transformation, and loading of data from various sources (databases, APIs, streaming platforms) into our data warehouse/lake, ensuring seamless data flow and accessibility.**
**Develop data models that support business requirements and analytical needs.**
**Optimize data models for query performance and data accessibility.**
**Ensure data models are well-documented and aligned with industry best practices.**
**Database Optimization: Write optimized and maintainable SQL queries and leverage SQLAlchemy for efficient database interaction, ensuring high performance and data accuracy.**
**Data Quality Assurance: Implement robust data quality checks and monitoring systems to ensure data integrity and accuracy, proactively identifying and resolving data issues.**
**Data Governance Contribution: Contribute to the design and implementation of data governance policies and procedures, ensuring compliance with regulatory requirements and internal standards.**
**Cross-Functional Collaboration: Collaborate closely with Data Scientists, Data Analysts, and business stakeholders to translate complex business requirements into efficient and impactful data solutions.**
**Technology Innovation: Continuously research and implement new technologies and best practices to improve the efficiency, scalability, and resilience of our data platform.**
**Cloud Deployment & Monitoring: Take ownership of the deployment and monitoring of data pipelines and related infrastructure on cloud platforms such as OpenShift, ECS, or Kubernetes, ensuring optimal performance and reliability.**
**Operational Excellence: Ability to occasionally work a non-standard shift, including nights and/or weekends, and/or have on-call responsibilities to support critical data operations.**
**Required Skills and Qualifications:**
**Education: Bachelor's degree in Computer Science, Software Engineering, or a related field.**
**Experience: 6+ years of hands-on experience in a Data Engineering role**
**Proven experience with database design, development, and administration.**
**Data Visualization: Experience with data visualization tools and techniques for presenting data insights effectively.**
**Agile Methodologies: Familiarity with agile development methodologies and experience working in agile teams.**
**Strong proficiency in Python (version 3.6+), with experience in Python packaging and shared libraries like Pandas and NumPy.**
**API Development: Experience implementing REST APIs in Python using microframeworks like Flask.**
**Extensive experience working with relational databases, writing complex SQL, and optimizing queries for performance.**
**Proven expertise with SQLAlchemy or similar ORM libraries for efficient database interaction.**
**Experience with workflow management tools like Airflow (experience with PySpark or PyFlink is a major plus).**
**Data Warehousing Knowledge: Solid understanding of data warehousing concepts and experience working with large datasets, including data modeling and ETL processes.**
**Leadership & Mentorship: Ability to guide and mentor junior developers, fostering a collaborative team environment and promoting professional growth.**
**Communication Skills: Strong communication skills, both written and verbal, with the ability to explain complex technical concepts to both technical and non-technical audiences.**
**DevOps Practices: Experience working in a Continuous Integration and Continuous Delivery environment and familiarity with tools like Jenkins, TeamCity, SonarQube, OpenShift, ECS, or Kubernetes.**
**Software Engineering Principles: Proficient in industry-standard best practices such as Design Patterns, Coding Standards, Coding modularity, and Prototyping.**
**Design, develop, and maintain database schemas and models.**
**Write and optimize SQL queries for data retrieval, manipulation, and reporting.**
**Communicate technical concepts and solutions effectively to both technical and non-technical audiences.**
**Provide technical support and troubleshooting for production systems.**
**Stay up-to-date with the latest trends and technologies in Python development, database systems, and data engineering.**
**Evaluate and recommend new tools and technologies to improve development efficiency and product quality.**
**Contribute to the continuous improvement of development processes and practices.**
------------------------------------------------------
**Job Family Group:**
Technology
------------------------------------------------------
**Job Family:**
Applications Development
------------------------------------------------------
**Time Type:**
Full time
------------------------------------------------------
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi (https://www.citigroup.com/citi/accessibility/application-accessibility.htm)_ _._
_View Citi’s_ _EEO Policy Statement (https://www.citigroup.com/global/eeo-aa-policy)_ _and the_ _Know Your Rights (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf)_ _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Por favor confirme su dirección de correo electrónico: Send Email