**Responsibilities:** + Design, prototype, and implement Generative AI applications, ensuring robust, scalable, and secure solutions. + LangChain & Orchestration: Drive the practical implementation and advanced utilization of LangChain (or similar orchestration frameworks) for building complex LLM applications, managing conversational flows, agentic behaviors, and tool integration. + Vector Databases: Architect, select, and manage vector databases (e.g., Pinecone, Weaviate, Chroma, Milvus) for efficient similarity search, RAG (Retrieval Augmented Generation), and knowledge management, ensuring optimal performance and data freshness. + LLM Validation & Evaluation: Establish and implement rigorous methodologies for the validation, testing, and continuous evaluation of LLMs (e.g., perplexity, factual consistency, safety, bias, performance metrics, A/B testing of prompt variations). Develop automated pipelines for tracking and reporting LLM performance. + Practical LLM Platform Knowledge: Demonstrate and apply deep practical knowledge of various LLM platforms and versions (e.g., Gemini, OpenAI GPT-3.5/4, open-source models like Llama 2, Mistral). This includes understanding their respective strengths, limitations, APIs, fine-tuning capabilities, and cost implications. + Expertise in AI and Machine learning algorithms and related business usecases/applications + Architecture Implementation: Lead the practical implementation of end-to-end architectures for Generative AI use cases, encompassing data ingestion, pre-processing, model serving, prompt engineering, RAG pipelines, output post-processing, and integration with existing enterprise systems. + Provide expert-level guidance on Generative AI best practices, model selection, and prompt engineering techniques. + Work with cross-functional teams in the practical application of LangChain, vector databases, and LLM evaluation. **Qualifications:** + 12 - 14 years of relevant experience in the Financial Service industry + Experience as Applications Development Lead/manager + Competent in Gen AI skills + Expertise in prompt engineering / Open AI / Vertex models + Stakeholder and people management experience + Demonstrated leadership skills + Proven project management skills + Basic knowledge of industry practices and standards + Consistently demonstrates clear and concise written and verbal communication **Education:** + Bachelor’s degree/University degree or equivalent experience + Master’s degree preferred This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required. ------------------------------------------------------ **Job Family Group:** Technology ------------------------------------------------------ **Job Family:** Applications Development ------------------------------------------------------ **Time Type:** Full time ------------------------------------------------------ **Most Relevant Skills** Please see the requirements listed above. ------------------------------------------------------ **Other Relevant Skills** For complementary skills, please see above and/or contact the recruiter. ------------------------------------------------------ _Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._ _If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi (https://www.citigroup.com/citi/accessibility/application-accessibility.htm)_ _._ _View Citi’s_ _EEO Policy Statement (https://www.citigroup.com/global/eeo-aa-policy)_ _and the_ _Know Your Rights (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf)_ _poster._ Citi is an equal opportunity and affirmative action employer. Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.