Senior AI Engineer - LLM, RAG
BrightAI Corporation
Senior AI Engineer - RAG Systems Bright.AI is a high-growth Physical AI company transforming how businesses interact with the physical world through intelligent automation. Our AI platform processes visual, spatial, and temporal data from billions of real-world events-captured across edge devices, mobile sensors, and cloud infrastructure-to enable intelligent decision-making at scale. We are now hiring a Senior AI Engineer - LLM, RAG to lead the development of Retrieval-Augmented Generation (RAG) systems that harness the power of large language models (LLMs) and real-world knowledge sources. This role is pivotal to building next-generation intelligent assistants that help technicians and operators troubleshoot complex issues in industrial settings. You'll work at the intersection of NLP, foundational models, and real-time information systems-developing intelligent tools that turn manuals, technician notes, and sensor data into actionable, conversational guidance for the physical world.
Responsibilities
Responsibilities
- Lead the architecture and development of RAG systems that combine LLMs (e.g., LLAMA, Mistral, Claude, GPT) with structured and unstructured external information sources.
- Develop AI-powered assistants to support technicians in diagnosing and resolving anomalies or failures in factory, plant, or industrial settings.
- Build pipelines to ingest, preprocess, and index large corpora of documents (manuals, logs, notes, procedures) for semantic search and grounding.
- Customize and fine-tune foundational models to incorporate domain-specific language, tone, and logic for industrial troubleshooting scenarios.
- Collaborate with product, data, and cloud teams to design scalable, privacy-compliant, and latency-sensitive LLM applications.
- Design evaluation strategies to measure performance, accuracy, and user experience of RAG-enabled systems in production settings.
- Stay up to date with the latest advances in LLM architectures, retrieval methods, and prompt engineering, and integrate emerging techniques into the product roadmap.
- M.S. or Ph.D. in Computer Science, AI, Machine Learning, or a related field, with specialization in NLP or deep learning.
- Strong research or applied background in large language models (LLMs) and retrieval-augmented generation (RAG) systems. Agentic RAG experience is highly desirable.
- 5+ years of experience in machine learning or AI with a strong focus on NLP, LLMs, or conversational AI.
- Fluency with modern LLMs and open-source foundational models (e.g., LLAMA, Falcon, Mistral, GPT, Claude).
- Experience building RAG pipelines with tools like LangChain, LlamaIndex, or custom vector database integrations, with at least one production grade system was built.
- Fluency with prompt engineering, instruction tuning, or fine-tuning open-source models.
- Deep understanding of document retrieval (semantic search, embedding generation, similarity metrics) and vector stores (e.g., FAISS, Weaviate, Pinecone).
- Strong foundation in core machine learning techniques, including experience with reinforcement learning (RL) or decision-making models.
- Proficiency with ML development frameworks such as PyTorch, Hugging Face Transformers, or similar. Strong Python programming is a must.
- Experience integrating AI systems into real-world applications with user-facing interfaces and operational constraints.
- Excellent problem-solving and critical thinking skills; ability to design solutions for complex, ambiguous problems.
- Strong written and verbal communication skills, with ability to collaborate cross-functionally with engineers, product managers, and domain experts.
- Experience applying LLMs in industrial or physical infrastructure settings (e.g., manufacturing, logistics, utilities, energy).
- Knowledge of industrial control systems, maintenance workflows, or technician support processes.
- Exposure to multimodal models or integrating textual data with sensor and/or time-series data.
- Prior experience in a startup or a fast-paced environment building LLM-powered products from the ground up.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer - LLM, RAG in Palo Alto, CA vacancy
- AI Chopping Block, Inc. in Palo Alto is seeking a Senior AI Engineer specializing in Retrieval-Augmented Generation (RAG) systems. This pivotal role requires 5+ years of experience in AI, strong expertise in large language models (LLMs), and proficiency in developing AI...Senior
$170k - $220k
Gatik, located in Mountain View, CA, is seeking an AI Operations Engineer to build the central knowledge base for the company. This position involves governing AI platforms, designing secure RAG architectures, and developing AI agents to automate business processes. Candidates...Suggested- AI Chopping Block, Inc. is seeking a Senior AI Engineer - RAG Systems to lead the development of cutting-edge Retrieval-Augmented Generation (RAG) systems. The ideal candidate will have over 5 years of experience in machine learning and NLP, focusing on building AI assistants...Suggested
- ...usher in this new era, we seek AI-native thinkers across every... ...data. You'll own the full AI engineering lifecycle: design, prompt/tool... ...modeling, analytics, retrieval / RAG, or semantic layers - highly... ...Prior work on eval harnesses, LLM observability, or safety / guardrails...Senior
- ...AI Engineer at Hippocratic AI As an AI Engineer at Hippocratic AI, you'll play a pivotal role... ...into production. From building scalable RAG and multi-agent pipelines to... ...: Experience building or deploying LLM-based or multi-agent systems at scale....Senior
- ...find the best job for you. Role: Senior Agentic AI Engineer (Palo Alto Networks Ecosystem)... ...optimizing token usage through advanced RAG (Retrieval-Augmented Generation) and semantic... ...Agentic Validation: Build "Evaluation LLM-as-a-Judge" frameworks to measure agent...SeniorPermanent employmentContract workRemote work
$170k - $210k
...Senior Software Engineer, AI Engineer Hybrid - SF Bay Area About Midi Health Midi Health is the... ...Will Do Design, build, and ship LLM-powered features end-to-end: prompt design... ...agentic systems or production RAG at scale Interview Process...SeniorWork at officeImmediate startRemote workShift work2 days per week$152k - $241.5k
NVIDIA Gruppe is seeking a Senior Software Engineer - AI Inference in Santa Clara, California. This role involves enhancing open-source LLM serving optimizations and implementing high-performance runtime capabilities. Candidates should have 5+ years of experience in building...Senior$163.2k - $220.8k
...Wilson Sonsini Goodrich & Rosati is seeking a Senior AI Security Engineer to join their Security Operations team in Palo Alto. This role involves collaborating on secure AI integration, conducting security architecture reviews, and building AI threat modeling capabilities...SeniorFull timeRemote work- ...Senior Staff AI Engineer As a Senior Staff AI Engineer at Hippocratic AI, you'll define the multi-year... ...direction across multiple AI domains RAG, agent orchestration, evaluation, real-... ...Experience building or deploying LLM-based or multi-agent systems at scale....SeniorWork at office
$163.2k - $220.8k
...Wilson Sonsini is looking for a Senior AI Security Engineer to join the Security Operations team. The... ...designing secure-by-default patterns for LLM integration, agentic workflows, retrieval-augmented generation (RAG) pipelines, and MCP server deployments across...SeniorWork experience placementWorldwideShift work$191k - $315k
...LinkedIn's Enterprise AI team creates meaningful... ...technical solutions including LLM fine-tuning, content... ...LLM-as-a-judge, prompt engineering, embedding-based retrieval... ..., how to best implement RAG, etc. Collaborate with... ...experience at the Senior Staff / L7 / Principal Engineer...SeniorFor contractorsWork at officeFlexible hours$262k - $365k
Google Inc. is seeking a Senior Staff Software Engineer, Applied AI, in Mountain View, CA. This role requires over 8 years of software development experience, strong leadership, and expertise in Machine Learning and AI technologies. Responsibilities include designing and...Senior- A leading AI technology company in Palo Alto seeks an AI Data Engineer to design a robust User Data Warehouse and integrate it with advanced AI capabilities. Responsibilities include establishing a tagging system and implementing pipelines for real-time data availability...Senior
$145k - $210k
...Senior AI/ML Engineer Cooley is seeking a Senior AI/ML Engineer to join the Practice Engineering team... ...in Python for building and operating LLM-powered applications and agentic workflows... ...sources, APIs, and retrieval systems (RAG) ~ Hands on experience building agentic...SeniorFull timeTemporary workWork at officeFlexible hoursWeekend work$100k - $300k
We are seeking a forward-thinking AI Data Engineer to bridge the gap between our user data assets... ...reflect the latest user interactions. LLM Integration & Data Intelligence Lead the... ...our internal data. Design and implement RAG (Retrieval-Augmented Generation) pipelines...SeniorFull time- ...AI Agents Applied Research/Engineering Senior Associate We recognize that our people are our strength and the diverse... ...ll lead the end-to-end lifecycle of LLM-based agents: defining research... ...fine-tuning, prompt engineering, and RAG. Experience scaling LLM systems with...Senior
$248.7k - $342k
Uniphore is seeking a Senior Director of Engineering to lead the architecture and delivery of AI-driven products utilizing Large Language Models (LLMs). This role involves managing multiple teams and driving innovation in conversational AI systems. Ideal candidates will...Senior$130k - $170k
NTT DATA, Inc. is seeking an AI Application Engineer in Santa Clara, California. This role involves developing production-grade AI applications... ...4 years of software engineering experience, with a focus on LLM development and Python skills. The position offers a salary...- A technology company focused on AI is seeking an individual to design and develop AI-... ...agents for customer support and integrating RAG systems into applications. The ideal... ...possess a strong understanding of software engineering practices and hands-on experience with RAG...
- TwinThread is seeking a highly skilled Principal AI/ML and Gen AI Engineer to join its dynamic team in Palo Alto, California. The ideal candidate... ...machine learning models, and implementing best practices for LLM Ops. The company offers a competitive salary and comprehensive...
$300k - $400k
...Senior Agentic AI Engineer $300,000 - $400,000 Remote / Hybrid, Palo Alto Full time / Permanent A well-known, frontier GenAI company... ...(e.g. image/video, voice, browsing, code execution) Own LLM orchestration and model routing across multiple providers,...SeniorPermanent employmentFull timeRemote workShift work$190k - $220k
...Assistant , uses cutting-edge AI to automate clinical... ...you come in. You will work on LLM-powered microservices that integrate... ...years experience in a software engineering role focused on application backend... ...prompting, orchestration, RAG, context and cost management....Senior$152.7k - $249.2k
...service. Overview We're looking for a Senior AI Engineer to help bring pragmatic, production-... .... Build and maintain core ML/LLM infrastructure (model gateways, prompt/agent... ...Familiarity with retrieval-augmented generation (RAG), embeddings, vector databases, and...SeniorTemporary work- ...Senior AI Engineer As a Senior AI Engineer at Intapp, you'll work on an AI-powered, industry-specific cloud platform that transforms professional... ...problems into reliable AI-driven processes by combining LLM reasoning, structured data, and external APIs. Extend,...SeniorWork at officeLocal areaFlexible hours
$110k - $190k
...Role Overview We are hiring a Senior Software & AI Engineer to build production-grade AI systems,... ...generative AI systems in production Build LLM-powered applications, including prompt... ..., retrieval-augmented generation (RAG), and agent-based workflows...Senior- ...Job Title: Senior AI Data Engineer Location: Menlo Park, CA (Hybrid) Duration: 6 months (potential extensions to long term) Our client... ...engineering for annotation, data cleaning, or evaluation using LLM APIs. Knowledge of generative AI like diffusion models,...SeniorRemote work
$280.71k
...Senior AI Engineer I Menlo Park, CA A Rare Opportunity to Shape the Future of Genomics Join a team of brilliant, passionate innovators... ...with the team. Responsibilities: Build and deploy LLM-powered applications (retrieval systems, AI agents, workflow...SeniorFull timeWorldwide2 days per week3 days per week$188k - $237.5k
...Senior AI Engineer At Sonatus, we're driving the transformation to AI-enabled software-defined... ...orchestration, tool-calling optimization, and LLM security. You will translate... ...the AI area, including LLM, Time Series, RAG, fine-tune large models, traditional ML...SeniorWork at officeLocal areaWorldwideFlexible hoursShift work- ...small, yet mighty team works with senior leaders and partners across the... ...for a strategic and rigorous engineering leader who is passionate about innovation and approaches AI agent design as an engineering... ...rule-based approaches. Develop RAG and Context Pipelines: Build...SeniorTemporary workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Engineer - LLM, RAG. Be the first to apply!
Related searches
- ai research engineer Palo Alto, CA
- machine learning ai engineer Palo Alto, CA
- ai engineer remote Palo Alto, CA
- ai prompt engineer Palo Alto, CA
- ai developer Palo Alto, CA
- ai engineer Palo Alto, CA
- ai ml engineer Palo Alto, CA
- senior ai engineer Palo Alto, CA
- senior game producer Palo Alto, CA
- senior manager process engineering Palo Alto, CA

