Data Engineer
Kforce
Kforce has a client seeking a highly skilled and motivated Data Engineer to join their team in Atlanta, GA and help drive their data infrastructure to the next level.
Summary:
In this role, the Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and scalable data architectures that enable advanced analytics, reporting, and machine learning. The ideal candidate is hands-on, detail-oriented, and passionate about data engineering best practices in cloud-native environments.
Responsibilities:
* Engineer and maintain robust, scalable data pipelines utilizing Apache Spark, Python, and Databricks to support both real-time streaming and batch processing workloads
* Design and oversee ELT processes with Fivetran, ensuring seamless data ingestion into Snowflake for business intelligence and reporting applications
* Create and fine-tune data models and data warehouse structures that enable advanced analytics, reporting, and machine learning initiatives
* Partner with data scientists, analysts, and business teams to gather requirements and deliver trusted, governed, and high-quality data solutions
* Design and implement cloud-based data architectures on platforms such as Azure, AWS, or GCP, leveraging Databricks and Snowflake for performance and scalability
* Build and maintain CI/CD pipelines and apply Infrastructure as Code (IaC) practices using tools like Terraform and Azure DevOps to streamline deployment and data operations
* Uphold best practices in data governance, security, and compliance, ensuring responsible data management throughout the entire lifecycle
Por favor confirme su dirección de correo electrónico: Send Email