Big Data Engineer (PySpark & Apache Iceberg) - C12 – AVP - Chennai
Citigroup
**Role Overview:**
We are looking for a Big Data Engineer with expertise in PySpark and Apache Iceberg to design and implement scalable data pipelines. The candidate will work on processing large datasets, optimizing data workflows, and ensuring data quality and reliability.
**Key Responsibilities:**
+ Design, develop, and maintain big data pipelines using PySpark and Apache Iceberg.
+ Optimize data workflows for performance and scalability.
+ Implement data transformation, cleansing, and enrichment processes.
+ Collaborate with data scientists and analysts to deliver actionable insights.
+ Ensure data quality, consistency, and security across all pipelines.
+ Monitor and troubleshoot data pipeline issues in production.
**Required Skills:**
+ 8+ Strong experience with PySpark and Apache Iceberg.
+ Proficiency in distributed data processing and big data technologies.
+ Knowledge of data modeling and schema design.
+ Familiarity with cloud platforms like AWS, Azure, or GCP.
+ Experience with version control tools like Git.
**Education:**
+ Bachelor’s degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
------------------------------------------------------
**Job Family Group:**
Technology
------------------------------------------------------
**Job Family:**
Applications Development
------------------------------------------------------
**Time Type:**
Full time
------------------------------------------------------
**Most Relevant Skills**
Please see the requirements listed above.
------------------------------------------------------
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
------------------------------------------------------
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi (https://www.citigroup.com/citi/accessibility/application-accessibility.htm)_ _._
_View Citi’s_ _EEO Policy Statement (https://www.citigroup.com/global/eeo-aa-policy)_ _and the_ _Know Your Rights (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf)_ _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Por favor confirme su dirección de correo electrónico: Send Email