Data Engineer
Kforce
Kforce has a client that is seeking a Data Engineer in Maryland Heights, MO.
Summary:
We are seeking a skilled Data Engineer with a strong background in distributed data processing and cloud technologies. This role will be responsible for building and optimizing scalable data pipelines to support advanced analytics and business intelligence initiatives. The ideal candidate has hands-on experience working with Apache Spark, Python (PySpark), AWS cloud services, and Apache NiFi for real-time and batch data integration.
Responsibilities:
* Data Engineer will design, develop, and maintain scalable ETL/ELT pipelines using Spark and PySpark
* Implement and optimize data workflows using Apache NiFi for ingestion from multiple sources
* Work within the AWS ecosystem (e.g., S3, Lambda, EMR, Glue, Redshift) to build cloud-native data solutions
* Collaborate with data scientists, architects, and analysts to deliver high-quality data sets for analytics
* Monitor pipeline performance, troubleshoot issues, and ensure data quality and integrity
* As a Data Engineer, you will maintain and document data models, data flow diagrams, and system integration points
* Follow best practices in data engineering, including CI/CD, version control, and infrastructure as code
Por favor confirme su dirección de correo electrónico: Send Email