Data Engineer Responsibilities :Deliver end-to-end data and analytics capabilities, including data ingest, data transformation, data science, and data visualization in collaboration with Data and Analytics stakeholder groups Design and deploy databases and data pipelines to support analytics projects Develop scalable and fault-tolerant workflows Clearly document issues, solutions, findings and recommendations to be shared internally & externally Learn and apply tools and technologies proficiently, including: Languages: Python, PySpark, ANSI SQL, Python ML librariesFrameworks/Platform: Spark, Snowflake, Airflow, Hadoop , Kafka Cloud Computing: AWSTools/Products: PyCharm, Jupyter, Tableau, PowerBI Performance optimization for queries and dashboardsDevelop and deliver clear, compelling briefings to internal and external stakeholders on findings, recommendations, and solutions Analyze client data & systems to determine whether requirements can be met Test and validate data pipelines, transformations, datasets, reports, and dashboards built by teamDevelop and communicate solutions architectures and present solutions to both business and technical stakeholdersProvide end user support to other data engineers and analystsCandidate Requirements :Expert experience in the following[Should have/Good to have]:SQL, Python, PySpark, Python ML libraries. Other programming languages (R, Scala, SAS, Java, etc.) are a plusData and analytics technologies including SQL/NoSQL/Graph databases, ETL, and BIKnowledge of CI/CD and related tools such as Gitlab, AWS CodeCommit etc. AWS services including EMR, Glue, Athena, Batch, Lambda CloudWatch, DynamoDB, EC2, CloudFormation, IAM and EDSExposure to Snowflake and Airflow.Solid scripting skills (e.g., bash/shell scripts, Python) Proven work experience in the following:Data streaming technologiesBig Data technologies including, Hadoop, Spark, Hive, Teradata, etc.Linux command-line operationsNetworking knowledge (OSI network layers, TCP/IP, virtualization) Candidate should be able to lead the team, communicate with business, gather and interpret business requirementsExperience with agile delivery methodologies using Jira or similar tools Experience working with remote teams AWS Solutions Architect / Developer / Data Analytics Specialty certifications, Professional certification is a plus Bachelor Degree in Computer Science relevant field, Masters Degree is a plus