Job Title: SQL to Databricks Migration Specialist (Crystal Reports)
Location: Chennai or Mumbai
Experience: 5-8 years

We are seeking a skilled and experienced SQL to Databricks Migration Specialist to join our dynamic team. The primary responsibility of this role is to migrate SQL-based Crystal Reports to Databricks, ensuring seamless integration, and optimal performance. The ideal candidate will possess a strong background in SQL, Databricks, and Crystal Reports, with a keen eye for problem-solving and an exceptional attention to detail.

Key Responsibilities:

Analyzing Existing Crystal Reports: Review and assess existing Crystal Reports that utilize SQL queries. Identify underlying data sources and dependencies to understand the structure and complexity of each report. Evaluate the compatibility of each report with Databricks for migration feasibility. Designing Data Models on Databricks: Collaborate with business analysts, developers, and other stakeholders to understand reporting requirements and align them with Databricks' capabilities. Translate complex SQL queries into optimized SparkSQL or Pyspark code for execution in the Databricks environment. Design and implement efficient data models using Delta Lake or other appropriate storage formats for optimal performance. Migrating Crystal Reports: Develop detailed migration strategies based on thorough analysis of existing reports and their dependencies. Rewrite or modify existing reports to leverage Apache Spark APIs within Databricks, ensuring accuracy and functionality. Ensure data integrity during the migration process and resolve any discrepancies. Performance Optimization: Profile, optimize, and fine-tune the migrated reports for improved performance on Databricks clusters. Implement best practices in query optimization, caching mechanisms, and partitioning techniques to enhance report execution speed and efficiency. Documentation and Training: Document the entire migration process, outlining steps taken, challenges faced, and solutions implemented. Provide training sessions or create user-friendly documentation for end-users on how to use and interact with migrated reports in Databricks.

Qualifications:

Educational Requirements: Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent work experience). Experience: 5-8 years of experience in SQL programming, Databricks, and Crystal Reports migration or similar reporting tools. Technical Skills: Strong proficiency in SQL programming language, including experience with complex queries. In-depth knowledge of Apache Spark ecosystem, including SparkSQL, Pyspark, and Python programming languages. Familiarity with cloud-based platforms such as Azure Databricks (preferred). Previous experience with Crystal Reports or similar reporting tools is highly advantageous. Other Skills: Strong problem-solving abilities and the capability to analyze complex systems and identify areas for optimization. Excellent communication and collaboration skills to work effectively with cross-functional teams. Attention to detail, ensuring high data integrity and efficient performance in the migration process.