AI Software Engineer - Operations

Company OverviewKLA is a global leader in diversified electronics for the semiconductor manufacturing ecosystem. Virtually every electronic device in the world is produced using our technologies. No laptop, smartphone, wearable device, voice-controlled gadget, flexible screen, VR device or smart car would have made it into your hands without us. KLA invents systems and solutions for the manufacturing of wafers and reticles, integrated circuits, packaging, printed circuit boards and flat panel displays. The innovative ideas and devices that are advancing humanity all begin with inspiration, research and development. KLA focuses more than average on innovation and we invest 15% of sales back into R&D. Our expert teams of physicists, engineers, data scientists and problem-solvers work together with the world’s leading technology providers to accelerate the delivery of tomorrow’s electronic devices. Life here is exciting and our teams thrive on tackling really hard problems. There is never a dull moment with us.Job Description/Preferred QualificationsThe AI Software Engineer will design and build AI-driven applications powered by large language models (LLMs), with a focus on integrating AI capabilities into user-facing products. This role emphasizes application development, orchestration, and user experience rather than model training. The engineer will develop scalable backend services, prototype intuitive user interfaces, and enable seamless interaction between users and LLM-based systems.This position requires a strong blend of software engineering, systems thinking, and practical AI implementation to deliver production-ready solutions that leverage LLM APIs and frameworks.Design and develop end-to-end AI applications that leverage LLMs for business use casesResponsibilities:Build and maintain backend services that orchestrate LLM interactions, prompts, and workflowsPrototype and develop intuitive user interfaces that enable effective human-AI interactionIntegrate LLM APIs (e.g., OpenAI, Azure OpenAI, Anthropic) into scalable applicationsDevelop prompt engineering strategies and manage prompt lifecycle for performance and reliabilityImplement retrieval-augmented generation (RAG) architectures using internal and external data sourcesDesign data pipelines and connectors to enterprise systems (e.g., databases, APIs, knowledge bases)Monitor, evaluate, and improve AI application performance using metrics such as latency, cost, and response qualityCollaborate with product managers, data scientists, and business stakeholders to translate requirements into AI-enabled solutionsEnsure responsible AI practices, including privacy, security, and bias mitigationRapidly prototype AI tools and iterate based on user feedbackMinimum QualificationsBachelor’s degree in Computer Science, Software Engineering, or related fieldMinimum three (3) years of professional software development experienceStrong programming skills in Python, JavaScript, or similar languagesExperience building AI products using LLM frameworks (e.g., LangChain, Semantic Kernel, LlamaIndex)Knowledge of retrieval-augmented generation (RAG) and vector databases (e.g., Pinecone, FAISS, Azure Cognitive Search)Vector database (Milvus) for semantic search, along with a knowledge graph (Neo4j)Experience orchestrating multi-step AI workflows or agent-based systemsFamiliarity with enterprise data platforms and integrations (e.g., Snowflake, SAP, APIs, knowledge graphs)Experience designing conversational interfaces or chat-based applicationsUnderstanding of evaluation techniques for LLM outputs (quality, grounding, hallucination mitigation)Exposure to prompt optimization, fine-tuning concepts (not necessarily hands-on training)Experience deploying scalable microservices architecturesStrong UI/UX sensibility for AI-driven applicationsExperience working in cross-functional teams delivering production-grade AI solutionsFamiliarity with prompt engineering and LLM interaction patternsExperience developing web-based user interfaces (e.g., React, Angular, or similar frameworks)Experience working in with or for a global manufacturing companyBase Pay Range: $90,400.00 - $153,700.00 AnnuallyPrimary Location: USA-MI-Ann Arbor-KLAKLA’s total rewards package for employees may also include participation in performance incentive programs and eligibility for additional benefits including but not limited to: medical, dental, vision, life, and other voluntary benefits, 401(K) including company matching, employee stock purchase program (ESPP), student debt assistance, tuition reimbursement program, development and career growth opportunities and programs, financial planning benefits, wellness benefits including an employee assistance program (EAP), paid time off and paid company holidays, and family care and bonding leave.Interns are eligible for some of the benefits listed. Our pay ranges are determined by role, level, and location. The range displayed reflects the pay for this position in the primary location identified in this posting. Actual pay depends on several factors, including state minimum pay wage rates, location, job-related skills, experience, and relevant education level or training. We are committed to complying with all applicable federal and state minimum wage requirements where applicable. If applicable, your recruiter can share more about the specific pay range for your preferred location during the hiring process.KLA is proud to be an Equal Opportunity Employer. We will ensure that qualified individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us at View email address on click.appcast.io or at View phone number on click.appcast.io to request accommodation.Be aware of potentially fraudulent job postings or suspicious recruiting activity by persons that are currently posing as KLA employees. KLA never asks for any financial compensation to be considered for an interview, to become an employee, or for equipment. Further, KLA does not work with any recruiters or third parties who charge such fees either directly or on behalf of KLA. Please ensure that you have searched KLA’s Careers website for legitimate job postings. KLA follows a recruiting process that involves multiple interviews in person or on video conferencing with our hiring managers. If you are concerned that a communication, an interview, an offer of employment, or that an employee is not legitimate, please send an email to View email address on click.appcast.io to confirm the person you are communicating with is an employee. We take your privacy very seriously and confidentially handle your information. SummaryLocation: Ann Arbor, MIType: Full time