Bangalore, IND
25 days ago
Spark Scala+ AWS & SQL Developer
Job Description: We are looking for a skilled and experienced Spark Scala Developer with strong expertise in AWS cloud services and SQL to join our data engineering team. The ideal candidate will be responsible for designing, building, and optimizing scalable data processing systems that support our data platform. ⸻ Key Responsibilities: • Develop and maintain large-scale distributed data processing pipelines using Apache Spark with Scala. • Work with AWS services (S3, EMR, Lambda, Glue, Redshift, etc.) to build and manage data solutions in the cloud. • Write complex SQL queries for data extraction, transformation, and analysis. • Optimize Spark jobs for performance and cost-efficiency. • Collaborate with data scientists, analysts, and other developers to understand data requirements. • Build and maintain data lake and data warehouse solutions. • Implement best practices in coding, testing, and deployment. • Ensure data quality and consistency across systems. ⸻ Required Skills and Experience: • Strong hands-on experience with Apache Spark (preferably using Scala). • Proficiency in Scala programming language. • Solid experience with SQL (complex joins, window functions, performance tuning). • Working knowledge of AWS services like S3, EMR, Glue, Lambda, Athena, Redshift. • Experience in building and maintaining ETL/ELT pipelines. • Familiarity with data modeling and data warehousing concepts. • Experience with version control (e.g., Git) and CI/CD pipelines is a plus. • Strong problem-solving and communication skills. Cognizant is an equal opportunity employer that embraces diversity, champions equity and values inclusion. We are dedicated to nurturing a community where everyone feels heard, accepted and welcome. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other protected characteristic as outlined by federal, state or local laws.
Por favor confirme su dirección de correo electrónico: Send Email