Overview About Business Unit: The Product team forms the crux of our powerful platforms and helps connect millions of customers worldwide with the brands that matter most to them. This team of innovative problem solvers develops and builds products that position Epsilon as a differentiator, fostering an open and balanced marketplace built on respect for individuals, where every brand interaction holds value. Our full-cycle product engineering and data teams chart the future and set new benchmarks for our products, by using industry best standard methodologies advanced capabilities in data, machine learning, and artificial intelligence. Driven by a passion for delivering smart end-to-end solutions, this team plays a key role in Epsilon’s success story. We are looking for a skilled Data Administrator with 4–7 years of experience to support and manage cloud-based data infrastructure using AWS managed services and Databricks. The ideal candidate will have strong expertise in Linux, automation, and operational support of services like EMR, Kafka, MSK, and Databricks clusters. Why we are looking for you: We are looking for Senior Software Engineer to work on groundbreaking multichannel SaaS Digital Marketing Platform that focuses on uniquely identify the customer’s patterns, effectively interact with them across channels and achieve a positive return on marketing investment (ROMI). he platform consolidates and harmonizes the features and functionality usually present in standalone services and channel-specific messaging platforms. This provides marketers with a tightly harmonized, easily orchestrated, cross channel marketing capability. Primary role of the Senior Software Engineer is to envision and build internet scale services on Cloud using Python and distributed technologies. Responsible for development and maintenance of applications with technologies involving Enterprise Python and Distributed technologies. Collaborate with developers, product manager, business analysts and business users in conceptualizing, estimating and developing new software applications and enhancements. Assist in the development, and documentation of software’s objectives, tasks, and specifications in collaboration with internal users and departments. Collaborate with QA team to define test cases, metrics, and resolve questions about test results. Assist in the design and implementation process for new products, research and create POC for possible solutions. Develop components based on business and/or application requirements Create unit tests in accordance with team policies & procedures Advise, and mentor team members in specialized technical areas as well as fulfill administrative duties as defined by support process Create Value-adds that would contribute to Cost Optimizations/ Scalability/ Reliability/Secure solutions What you will enjoy in this role About the Team and opportunities The India Product Engineering team forms the crux of our powerful PeopleCloud platform and connects millions of customers. The 400+ strong product organization in Epsilon India, is a full-cycle Engineering team that drives architecture, POCs, implementation, Quality Automation, product management, support, operations and DevOps. There are, 25+ Scrum teams as part of the India Engineering center, driving outcomes across the breadth of the Epsilon PeopleCloud suite of products. This team of innovative problem solvers develops and builds products that help Epsilon be a market differentiator. They map the future and set new standards for our products, empowered with industry standard processes, ML and AI capabilities. The team passionately delivers intelligent end-to-end solutions and plays a key role in Epsilon’s success story Tech Stack: Our integrated suite of modular products is designed to help deliver personalized experiences and drive meaningful outcomes. Our tech stack caters to a fusion of data and technology with SaaS offerings developed as a Cloud-first approach. Here, a solid understanding of software security practices including user authentication and authorization and being data-savvy would be key. You should also come with the ability to use best standard processesesign patterns, and design algorithms for software development that focus on high quality and agility. You must also have a good understanding of Agile Methodologies like SCRUM. You can refer this article also. What you will do: You would - Be responsible for development and maintenance of applications with technologies involving Enterprise Python and Distributed technologies. Collaborate with developers, product manager, business analysts and business users in conceptualizing, estimating and developing new software applications and enhancements. Help develop and document software objectives, work you're doing, and specifications in collaboration with internal users and departments. Collaborate with QA team to define test cases, metrics, and resolve questions about test results. Assist in the design and implementation process for new products, research and create POC for possible solutions. Develop components based on business and/or application requirements Create unit tests in accordance with team policies & procedures Advise, and mentor team members in specialized technical areas as well as fulfill administrative duties as defined by support process Create Value-adds that would contribute to Cost Optimizations/ Scalability/ Reliability/Secure solutions Click here to view how Epsilon transforms marketing with 1 View, 1 Vision and 1 Voice. Responsibilities Key Responsibilities: Administer and support Linux-based big data environments hosted on AWS Cloud and on-prem environments. Manage and maintain AWS-managed big data services including Amazon EMR, Amazon MSK, and Amazon Managed Kafka. Administer HBase clusters, ensuring optimal performance, scalability, and data integrity. Manage and monitor Databricks All-Purpose Clusters, Job Clusters, and SQL Warehouses, ensuring efficient resource utilization and high availability. Perform cluster upgrades and patching for EMR and MSK to enhance system stability and performance. Implement automation for cluster provisioning, configuration, and operational tasks using Ansible and Shell scripting. Monitor job performance and resource usage across data pipelines, taking corrective actions as needed. Collaborate with data engineers and developers to support ETL workflows and optimize pipeline reliability. Configure IAM roles, networking, and security policies to secure data environments. Implement proactive monitoring, logging, and alerting using CloudWatch, Databricks metrics, or third-party tools. Solve cluster failures, job execution issues, and data inconsistencies across services. Maintain backups and support disaster recovery strategies for critical data and metadata stores. Document infrastructure components, operational runbooks, upgrade processes, and standard methodologies. Analyze and optimize performance and cost-efficiency of cloud-based data workloads. Stay updated with emerging data and cloud technologies and contribute to architectural improvements. Qualifications Bachelor’s degree or equivalent experience or equivalent in computer science Strong experience in Linux system administration. Hands-on expertise with AWS services: EMR, MSK, Kafka, S3, IAM, and VPC. Experience managing HBase in distributed environments. Deep understanding of Databricks clusters, job scheduling, and SQL Warehouse monitoring. Proficiency in Ansible and Shell scripting for automation and orchestration. Experience with EMR/MSK upgrades, tuning, and solving. Strong analytical, communication, and problem-solving skills. Additional Information Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. For decades, we’ve provided marketers from the world’s leading brands the data, technology and services they need to engage consumers with 1 View, 1 Vision and 1 Voice. 1 View of their universe of potential buyers. 1 Vision for engaging each individual. And 1 Voice to harmonize engagement across paid, owned and earned channels. Epsilon’s comprehensive portfolio of capabilities across our suite of digital media, messaging and loyalty solutions bridge the divide between marketing and advertising technology. We process 400+ billion consumer actions each day using advanced AI and hold many patents of proprietary technology, including real-time modeling languages and consumer privacy advancements. Thanks to the work of every employee, Epsilon has been consistently recognized as industry-leading by Forrester, Adweek and the MRC. Epsilon is a global company with more than 9,000 employees around the world. Epsilon has a core set of 5 values that define our culture and guide us to create value for our clients, our people and consumers. We are seeking candidates that align with our company values, demonstrate them and make them meaningful in their day-to-day work: Act with integrity. We are transparent and have the courage to do the right thing. Work together to win together. We believe collaboration is the catalyst that unlocks our full potential. Innovate with purpose. We shape the market with big ideas that drive big outcomes. Respect all voices. We embrace differences and foster a culture of connection and belonging. Empower with accountability. We trust each other to own and deliver on common goals. Because You Matter YOUniverse. A work-world with you at the heart of it! At Epsilon, we believe people make the place. And everything we do is designed with you in mind. That’s why our work-world, aptly named ‘YOUniverse’ is focused on creating a nurturing environment that elevates your growth, wellbeing and work-life harmony. So, come be part of a people-centric workspace where care for you is at the core of all we do. Take a trip to YOUniverse and explore our unique benefits, here Epsilon is an Equal Opportunity Employer. Epsilon is committed to promoting diversity, inclusion, and equal employment opportunities by using reasonable efforts to attract, recruit, engage and retain qualified individuals of all ethnicities and backgrounds, including, but not limited to, women, people of color, LGBTQ individuals, people with disabilities and any other underrepresented groups, traits or characteristics. #DNI