Python SQl Developer
Insight Global
Job Description
Experience:
Minimum of 5 years experience in a similar role, with a focus on data management and process automation.
Proven track record of successfully managing complex data processes and meeting deadlines.
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form (https://airtable.com/app21VjYyxLDIX0ez/shrOg4IQS1J6dRiMo) . The EEOC "Know Your Rights" Poster is available here (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf) .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills and Requirements
Experience:
Minimum of 5 years experience in a similar role, with a focus on data management and process automation.
Proven track record of successfully managing complex data processes and meeting deadlines. Overview:
As a Senior Developer I at NYU EDA team, you will play a vital role to improve the operation of our data load and management processes. Your primary responsibilities will be to ensure the accuracy and timeliness of data loads, maintain the health of data pipelines, and monitor that all scheduled jobs are completed successfully. You will collaborate with cross-functional teams to identify and resolve issues, improve processes, and maintain a high standard of data integrity.
Responsibilities:
Manage and perform Healthy Planet file loads into a data warehouse.
Monitor Airflow DAGs for successful completion, manage alerts, and rerun failed tasks as necessary.
Monitor and oversee other daily and weekly jobs, including FGP cash reports and external reports.
Collaborate with the data engineering team to streamline data processing workflows.
Develop automation scripts to reduce manual intervention in repetitive tasks using SQL and Python.
Ensure all data-related tasks are performed accurately and on time.
Investigate and resolve data discrepancies and processing issues.
Prepare and maintain documentation for processes and workflows.
Conduct periodic data audits to ensure data integrity and compliance with defined standards.
Skillset Requirements:
MS/Oracle SQL
Python
Data warehousing and ETL processes
Monitoring tools such as Apache Airflow
Data quality and integrity assurance
Strong analytical and problem-solving abilities
Excellent written and verbal communication
Additional Skillset
Familiarity with monitoring and managing Apache Airflow DAGs. null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.
Por favor confirme su dirección de correo electrónico: Send Email