The Senior Data Quality Assurance Analyst represents the business to ensure applications meet business requirements and are free of major defects.  This role is involved in all aspects of product development, identifies risks and creates mitigation plans.  The Senior Analyst assists in evolving formal quality processes & best practices, coordinating and mentoring team members, reporting status, and implementing test automation in existing frameworks.

The main focus will be on testing Large Language Model (LLM) chatbot for document retrieval, along with other software projects including Machine Learning (ML) and Data Analytics/Data Warehouse applications.

Basic Qualifications Required - Experience, Skills, and Knowledge

Bachelor of Science in a related field or equivalent work experience3 years of test strategy and IT QA ExperienceExperience with programming languages or as a software developerKnowledge of LLM, RAG, and ML conceptsExperience with test automation tools (Selenium, Pytest, etc.)Experience with data repositories/data warehouseStrong SQL, proven experience working with large volume of data required, MS SQL Server preferredExperience with SDLC in Enterprise applications

Preferred Experience, Skills, and Knowledge

Experience testing LLM chatbot/RAG, NLP, GenAI, or Machine Learning (ML)Experience with test automation frameworkExperience with Python. R/Scala/C++/Java helpfulExperience with API testing, Prompt EngineeringExperience with Azure Databricks/Data Factory/DevOps, SSIS, web servicesFamiliar with on-premise and cloud infrastructures, MS SQL Server and Azure preferredExperience with Data Lake, Data Lakehouse, Data PipelinesFamiliar with MS Fabric, Unity Catalog, medallion lakehouse architectureFamiliar with Machine Learning development LifecycleKnowledge of MLOps, LLMOps, PlatformOpsExperience as QA team lead