Senior Data Engineer
Kforce
Kforce has a client that is seeking a Senior Data Engineer in Plano, TX.
Primary Responsibilities:
Data Pipeline Execution:
* Ingest data into the landing zone, then move it into Databricks for transformation
Follow the medallion architecture:
* Bronze: Raw ingestion
* Silver: Clean and enrich
* Gold: Curated for reporting
* Data is primarily used for dashboarding and performance insights
Daily Activities:
* Analyze data in the landing zone
* Use Python and SQL to transform and enrich datasets
* Interpret repository and workflow IDs to derive meaningful insights
* Write modular Python notebooks scheduled via Databricks workflow jobs (99% sourced from GitHub)
Reporting & Visualization:
* Currently using Power BI, transitioning to Tableau
* Aggregate and expose data to support business intelligence and performance reporting
Por favor confirme su dirección de correo electrónico: Send Email