Job Description:

This position requires office presence of a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered.

What You'll Do:

We are looking for a highly skilled Senior Software Engineer (LLM/Prompt-Context Engineer) with a strong full stack Python background to design, develop, and integrate intelligent systems focused on large language models (LLMs), prompt engineering, and advanced context management. In this role, you will play a critical part in architecting context-rich AI solutions, crafting effective prompts, and ensuring seamless agent interactions using frameworks like LangGraph.

What You'll Bring:

Prompt & Context Engineering:
Design, optimize, and evaluate prompts for LLMs to achieve precise, reliable, and contextually relevant outputs across a variety of use cases.Context Management:
Architect and implement dynamic context management strategies, including session memory, retrieval-augmented generation, and user personalization, to enhance agent performance.LLM Integration:
Integrate, fine-tune, and orchestrate LLMs within Python-based applications, leveraging APIs and custom pipelines for scalable deployment.LangGraph & Agent Flows:
Build and manage complex conversational and agent workflows using the LangGraph framework to support multi-agent or multi-step solutions.Full stack Development:
Develop robust backend services, APIs, and (optionally) front-end interfaces to enable end-to-end AI-powered applications.Collaboration:
Work closely with product, data science, and engineering teams to define requirements, run prompt experiments, and iterate quickly on solutions.Evaluation & Optimization:
Implement testing, monitoring, and evaluation pipelines to continuously improve prompt effectiveness and context handling.

What You'll Need:

Deep experience with fullstack Python development (FastAPI, Flask, Django; SQL/NoSQL databases).Demonstrated expertise in prompt engineering for LLMs (e.g., OpenAI, Anthropic, open-source LLMs).Strong understanding of context engineering, including session management, vector search, and knowledge retrieval strategies.Hands-on experience integrating AI agents and LLMs into production systems.Proficient with conversational flow frameworks such as LangGraph.Familiarity with cloud infrastructure, containerization (Docker), and CI/CD practices.Solid understanding of PostgreSQL or other relational databases, including fundamentals of database design and querying.Exceptional analytical, problem-solving, and communication skills.

Preferred:

Experience evaluating and fine-tuning LLMs or working with RAG architectures.Background in information retrieval, search, or knowledge management systems.Contributions to open-source LLM, agent, or prompt engineering projects.

Our Senior Software Engineers, earn between $116,700.00 - $196,100.00 USD Annual Not to mention all the other amazing rewards that working at AT&T offers. Individual starting salary within this range may depend on geography, experience, expertise, and education/training.  

Joining our team comes with amazing perks and benefits:

Medical/Dental/Vision coverage  401(k) plan  Tuition reimbursement program  Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)  Paid Parental Leave  Paid Caregiver Leave  Additional sick leave beyond what state and local law require may be available but is unprotected  Adoption Reimbursement  Disability Benefits (short term and long term)  Life and Accidental Death Insurance  Supplemental benefit programs: critical illness/accident hospital indemnity/group legal  Employee Assistance Programs (EAP)  Extensive employee wellness programs  Employee discounts up to 50% off on eligible AT&T mobility plans and accessories,AT&T internet (and fiber where available) and AT&T phone.

#LI-Onsite – Full-time office role-

Ready to join our team? Apply today

Weekly Hours:

40

Time Type:

Regular

Location:

USA:GA:Alpharetta / 500 North Point Pkwy - Adm (Owned):500 North Point Pkwy

Salary Range:

$116,700.00 - $196,100.00

It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.

Job ID R-81901-4 Date posted 09/10/2025