Brisbane, AUS
21 days ago
Data Architect
Are you a seasoned Data Architect looking to make a significant impact in a dynamic and innovative environment? We are on the hunt for a Senior Data Architect with to join our forward-thinking team. If you have a passion for cutting-edge technologies and a knack for driving transformative data solutions, this hybrid role is perfect for you. As a Senior Data Architect, you will have the opportunity to lead the design and implementation of scalable data architectures, leveraging your expertise in Spark in Scala, Databricks CLI, Delta Live Pipelines, Kafka, Azure Data Lake Store, Azure Key Vault, Azure DevOps, Azure Event Hub, Python, Databricks SQL, Databricks Workflows, and PySpark. Your innovative approach and deep understanding of data architecture will be crucial in driving our mission to deliver high-quality, efficient, and secure data solutions. In this role you will be responsible for: + Lead the design and implementation of scalable data architectures using Spark in Scala and Databricks CLI. + Oversee the development and deployment of Delta Live Pipelines to ensure efficient data processing. + Provide expertise in Kafka for real-time data streaming and integration. + Manage data storage solutions using Azure Data Lake Store and ensure data security with Azure Key Vault. + Implement and maintain CI/CD pipelines using Azure DevOps for seamless deployment. + Utilize Azure Event Hub for event-driven data processing and integration. + Develop and optimize data workflows using Python and PySpark to enhance performance. + Create and manage Databricks SQL queries for data analysis and reporting. + Design and automate workflows using Databricks Workflows to streamline processes. + Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions. + Ensure data quality and integrity through rigorous testing and validation processes. + Provide technical guidance and mentorship to junior team members. + Stay updated with the latest industry trends and technologies to drive continuous improvement. To be successful in this position your skills and experience should include: + Extensive experience with Spark in Scala and Databricks CLI. + Proficiency in Delta Live Pipelines and Kafka. + Strong understanding of Azure Data Lake Store and Azure Key Vault. + Expertise in Azure DevOps and Azure Event Hub. + Advanced skills in Python, Databricks SQL, and Databricks Workflows. + Hands-on experience with PySpark for data processing. + Excellent problem-solving and analytical skills. + Strong communication and collaboration abilities. + Proven track record of delivering high-quality data solutions. + Commitment to staying current with emerging technologies. + Ability to work effectively in a hybrid work model. + Proactive and innovative approach to problem-solving. + Relevant certifications in data architecture and cloud technologies. Join us and be part of a team that values collaboration, continuous learning, and the pursuit of excellence. You will work alongside talented professionals, mentor junior team members, and stay at the forefront of industry trends and technologies. If you are ready to take on new challenges and make a real difference, we want to hear from you! Cognizant is an equal opportunity employer that embraces diversity, champions equity and values inclusion. We are dedicated to nurturing a community where everyone feels heard, accepted and welcome. Your application and candidacy will not be considered based on race, color, sex, religion, creed, sexual orientation, gender identity, national origin, disability, genetic information, pregnancy, veteran status or any other protected characteristic as outlined by federal, state or local laws.
Por favor confirme su dirección de correo electrónico: Send Email