SUMMARY:
This position is responsible for design, development and management of data workflows and pipelines in our Integrated Data and Analytics environment. The role is a blend of technical leadership, team leadership, and hands-on development.
RESPONSIBILITIES/TASKS:
• Responsible for collecting, moving, storing, and preparing data for analytics enablement.
• Participates in project planning sessions, working closely with business analysts and team members to analyse requirements and provides design recommendations for complex systems.
• Designs and develops new data pipelines for ingesting high-volume data sets.
• Develops pipelines using disciplined processes, adhering to industry standards and best practices, including complete ease with agile development methods throughout the SDLC.
• Demonstrates processes to all stakeholders.
• Shares knowledge and provide technical guidance to other team members within area of expertise.
• Takes part in reviews of work, e.g. design and code reviews.
• Works with team members to analyse and understand problems with complex systems and resolve them.
• Resolves customer complaints and respond with suggestions for improvements and enhancements.
• This position description identifies the responsibilities and tasks typically associated with the performance of the position.
• Other relevant essential functions may be required.
EMPLOYMENT QUALIFICATIONS: EDUCATION:
• Bachelor’s degree in a related field. Relevant combination of education and experience may be considered in lieu of degree.
• Continuous learning, as defined by the Company’s learning philosophy, is required.
• Certification or progress toward certification is highly preferred and encouraged.
EXPERIENCE:
• 8 years’ experience in application development.
• At least five years of experience in Azure big data services/technologies (Databricks, Azure, Python, unit testing, SQL and Azure Data Lake).
• SKILLS/KNOWLEDGE/ABILITIES (SKA) REQUIRED:
• Deep knowledge of SQL/TSQL
• Strong understanding of Azure Big Data Services such as Azure Data Lake Storage, Azure Data Factory, Logic Apps, Azure Functions Agile software process Working experiences of test-driven development framework.
• Excellent inter-personal and communication skills.
• Ability to multi-task in a fast-paced environment.
• Flexibility to adapt to changing business needs. Team player who is delivery-oriented and takes responsibility for the team’s success.
• Enthusiastic, can-do attitude with the drive to continually learn and improve. Highly self-motivated, creative, and able to dive deep in problem solving.