Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Engineer - LLM, RAG

BrightAI Corporation

Senior AI Engineer - RAG Systems

Bright.AI is a high-growth Physical AI company transforming how businesses interact with the physical world through intelligent automation. Our AI platform processes visual, spatial, and temporal data from billions of real-world events-captured across edge devices, mobile sensors, and cloud infrastructure-to enable intelligent decision-making at scale.

We are now hiring a Senior AI Engineer - LLM, RAG to lead the development of Retrieval-Augmented Generation (RAG) systems that harness the power of large language models (LLMs) and real-world knowledge sources. This role is pivotal to building next-generation intelligent assistants that help technicians and operators troubleshoot complex issues in industrial settings.

You'll work at the intersection of NLP, foundational models, and real-time information systems-developing intelligent tools that turn manuals, technician notes, and sensor data into actionable, conversational guidance for the physical world.
Responsibilities
  • Lead the architecture and development of RAG systems that combine LLMs (e.g., LLAMA, Mistral, Claude, GPT) with structured and unstructured external information sources.
  • Develop AI-powered assistants to support technicians in diagnosing and resolving anomalies or failures in factory, plant, or industrial settings.
  • Build pipelines to ingest, preprocess, and index large corpora of documents (manuals, logs, notes, procedures) for semantic search and grounding.
  • Customize and fine-tune foundational models to incorporate domain-specific language, tone, and logic for industrial troubleshooting scenarios.
  • Collaborate with product, data, and cloud teams to design scalable, privacy-compliant, and latency-sensitive LLM applications.
  • Design evaluation strategies to measure performance, accuracy, and user experience of RAG-enabled systems in production settings.
  • Stay up to date with the latest advances in LLM architectures, retrieval methods, and prompt engineering, and integrate emerging techniques into the product roadmap.
Educational Background
  • M.S. or Ph.D. in Computer Science, AI, Machine Learning, or a related field, with specialization in NLP or deep learning.
  • Strong research or applied background in large language models (LLMs) and retrieval-augmented generation (RAG) systems. Agentic RAG experience is highly desirable.
Required Skills & Expertise
  • 5+ years of experience in machine learning or AI with a strong focus on NLP, LLMs, or conversational AI.
  • Fluency with modern LLMs and open-source foundational models (e.g., LLAMA, Falcon, Mistral, GPT, Claude).
  • Experience building RAG pipelines with tools like LangChain, LlamaIndex, or custom vector database integrations, with at least one production grade system was built.
  • Fluency with prompt engineering, instruction tuning, or fine-tuning open-source models.
  • Deep understanding of document retrieval (semantic search, embedding generation, similarity metrics) and vector stores (e.g., FAISS, Weaviate, Pinecone).
  • Strong foundation in core machine learning techniques, including experience with reinforcement learning (RL) or decision-making models.
  • Proficiency with ML development frameworks such as PyTorch, Hugging Face Transformers, or similar. Strong Python programming is a must.
  • Experience integrating AI systems into real-world applications with user-facing interfaces and operational constraints.
  • Excellent problem-solving and critical thinking skills; ability to design solutions for complex, ambiguous problems.
  • Strong written and verbal communication skills, with ability to collaborate cross-functionally with engineers, product managers, and domain experts.
Bonus Qualifications
  • Experience applying LLMs in industrial or physical infrastructure settings (e.g., manufacturing, logistics, utilities, energy).
  • Knowledge of industrial control systems, maintenance workflows, or technician support processes.
  • Exposure to multimodal models or integrating textual data with sensor and/or time-series data.
  • Prior experience in a startup or a fast-paced environment building LLM-powered products from the ground up.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer - LLM, RAG in Palo Alto, CA vacancy
  • AI Chopping Block, Inc. in Palo Alto is seeking a Senior AI Engineer specializing in Retrieval-Augmented Generation (RAG) systems. This pivotal role requires 5+ years of experience in AI, strong expertise in large language models (LLMs), and proficiency in developing AI... 
    Senior

    AI Chopping Block, Inc.

    Palo Alto, CA
    3 days ago
  • $170k - $220k

    Gatik, located in Mountain View, CA, is seeking an AI Operations Engineer to build the central knowledge base for the company. This position involves governing AI platforms, designing secure RAG architectures, and developing AI agents to automate business processes. Candidates... 
    Suggested

    Booster

    Mountain View, CA
    2 days ago
  • AI Chopping Block, Inc. is seeking a Senior AI Engineer - RAG Systems to lead the development of cutting-edge Retrieval-Augmented Generation (RAG) systems. The ideal candidate will have over 5 years of experience in machine learning and NLP, focusing on building AI assistants... 
    Suggested

    AI Chopping Block, Inc.

    Palo Alto, CA
    1 day ago
  •  ...usher in this new era, we seek AI-native thinkers across every...  ...data. You'll own the full AI engineering lifecycle: design, prompt/tool...  ...modeling, analytics, retrieval / RAG, or semantic layers - highly...  ...Prior work on eval harnesses, LLM observability, or safety / guardrails... 
    Senior

    Snowflake Computing

    Menlo Park, CA
    6 days ago
  •  ...AI Engineer at Hippocratic AI As an AI Engineer at Hippocratic AI, you'll play a pivotal role...  ...into production. From building scalable RAG and multi-agent pipelines to...  ...: Experience building or deploying LLM-based or multi-agent systems at scale.... 
    Senior

    Hippocratic AI

    Palo Alto, CA
    21 hours ago
  •  ...find the best job for you. Role: Senior Agentic AI Engineer (Palo Alto Networks Ecosystem)...  ...optimizing token usage through advanced RAG (Retrieval-Augmented Generation) and semantic...  ...Agentic Validation: Build "Evaluation LLM-as-a-Judge" frameworks to measure agent... 
    Senior
    Permanent employment
    Contract work
    Remote work

    Tekfortune Inc

    Palo Alto, CA
    21 hours ago
  • $170k - $210k

     ...Senior Software Engineer, AI Engineer Hybrid - SF Bay Area About Midi Health Midi Health is the...  ...Will Do Design, build, and ship LLM-powered features end-to-end: prompt design...  ...agentic systems or production RAG at scale Interview Process... 
    Senior
    Work at office
    Immediate start
    Remote work
    Shift work
    2 days per week

    Midi Health

    Palo Alto, CA
    21 hours ago
  • $152k - $241.5k

    NVIDIA Gruppe is seeking a Senior Software Engineer - AI Inference in Santa Clara, California. This role involves enhancing open-source LLM serving optimizations and implementing high-performance runtime capabilities. Candidates should have 5+ years of experience in building... 
    Senior

    NVIDIA Gruppe

    Santa Clara, CA
    1 day ago
  • $163.2k - $220.8k

     ...Wilson Sonsini Goodrich & Rosati is seeking a Senior AI Security Engineer to join their Security Operations team in Palo Alto. This role involves collaborating on secure AI integration, conducting security architecture reviews, and building AI threat modeling capabilities... 
    Senior
    Full time
    Remote work

    Wilson Sonsini Goodrich & Rosati, Professional Corporation

    Palo Alto, CA
    1 day ago
  •  ...Senior Staff AI Engineer As a Senior Staff AI Engineer at Hippocratic AI, you'll define the multi-year...  ...direction across multiple AI domains RAG, agent orchestration, evaluation, real-...  ...Experience building or deploying LLM-based or multi-agent systems at scale.... 
    Senior
    Work at office

    Hippocratic AI

    Palo Alto, CA
    21 hours ago
  • $163.2k - $220.8k

     ...Wilson Sonsini is looking for a Senior AI Security Engineer to join the Security Operations team. The...  ...designing secure-by-default patterns for LLM integration, agentic workflows, retrieval-augmented generation (RAG) pipelines, and MCP server deployments across... 
    Senior
    Work experience placement
    Worldwide
    Shift work

    Wilson Sonsini Goodrich and Rosati

    Palo Alto, CA
    2 days ago
  • $191k - $315k

     ...LinkedIn's Enterprise AI team creates meaningful...  ...technical solutions including LLM fine-tuning, content...  ...LLM-as-a-judge, prompt engineering, embedding-based retrieval...  ..., how to best implement RAG, etc. Collaborate with...  ...experience at the Senior Staff / L7 / Principal Engineer... 
    Senior
    For contractors
    Work at office
    Flexible hours

    LinkedIn

    Mountain View, CA
    4 days ago
  • $262k - $365k

    Google Inc. is seeking a Senior Staff Software Engineer, Applied AI, in Mountain View, CA. This role requires over 8 years of software development experience, strong leadership, and expertise in Machine Learning and AI technologies. Responsibilities include designing and... 
    Senior

    Google Inc.

    Mountain View, CA
    3 days ago
  • A leading AI technology company in Palo Alto seeks an AI Data Engineer to design a robust User Data Warehouse and integrate it with advanced AI capabilities. Responsibilities include establishing a tagging system and implementing pipelines for real-time data availability... 
    Senior

    OPPO US Research Center

    Palo Alto, CA
    2 days ago
  • $145k - $210k

     ...Senior AI/ML Engineer Cooley is seeking a Senior AI/ML Engineer to join the Practice Engineering team...  ...in Python for building and operating LLM-powered applications and agentic workflows...  ...sources, APIs, and retrieval systems (RAG) ~ Hands on experience building agentic... 
    Senior
    Full time
    Temporary work
    Work at office
    Flexible hours
    Weekend work

    Cooley Corp.

    Palo Alto, CA
    21 hours ago
  • $100k - $300k

    We are seeking a forward-thinking AI Data Engineer to bridge the gap between our user data assets...  ...reflect the latest user interactions. LLM Integration & Data Intelligence Lead the...  ...our internal data. Design and implement RAG (Retrieval-Augmented Generation) pipelines... 
    Senior
    Full time

    OPPO US Research Center

    Palo Alto, CA
    2 days ago
  •  ...AI Agents Applied Research/Engineering Senior Associate We recognize that our people are our strength and the diverse...  ...ll lead the end-to-end lifecycle of LLM-based agents: defining research...  ...fine-tuning, prompt engineering, and RAG. Experience scaling LLM systems with... 
    Senior

    Chase

    Palo Alto, CA
    21 hours ago
  • $248.7k - $342k

    Uniphore is seeking a Senior Director of Engineering to lead the architecture and delivery of AI-driven products utilizing Large Language Models (LLMs). This role involves managing multiple teams and driving innovation in conversational AI systems. Ideal candidates will... 
    Senior

    Uniphore

    Palo Alto, CA
    21 hours ago
  • $130k - $170k

    NTT DATA, Inc. is seeking an AI Application Engineer in Santa Clara, California. This role involves developing production-grade AI applications...  ...4 years of software engineering experience, with a focus on LLM development and Python skills. The position offers a salary... 

    NTT DATA, Inc.

    Santa Clara, CA
    3 days ago
  • A technology company focused on AI is seeking an individual to design and develop AI-...  ...agents for customer support and integrating RAG systems into applications. The ideal...  ...possess a strong understanding of software engineering practices and hands-on experience with RAG... 

    Ethereum Technologies LLC

    Palo Alto, CA
    21 hours ago
  • TwinThread is seeking a highly skilled Principal AI/ML and Gen AI Engineer to join its dynamic team in Palo Alto, California. The ideal candidate...  ...machine learning models, and implementing best practices for LLM Ops. The company offers a competitive salary and comprehensive... 

    Aumni

    Palo Alto, CA
    2 days ago
  • $300k - $400k

     ...Senior Agentic AI Engineer $300,000 - $400,000 Remote / Hybrid, Palo Alto Full time / Permanent A well-known, frontier GenAI company...  ...(e.g. image/video, voice, browsing, code execution) Own LLM orchestration and model routing across multiple providers,... 
    Senior
    Permanent employment
    Full time
    Remote work
    Shift work

    DeepRec.ai

    Palo Alto, CA
    2 days ago
  • $190k - $220k

     ...Assistant , uses cutting-edge AI to automate clinical...  ...you come in. You will work on LLM-powered microservices that integrate...  ...years experience in a software engineering role focused on application backend...  ...prompting, orchestration, RAG, context and cost management.... 
    Senior

    Suki

    Redwood City, CA
    3 days ago
  • $152.7k - $249.2k

     ...service. Overview We're looking for a Senior AI Engineer to help bring pragmatic, production-...  .... Build and maintain core ML/LLM infrastructure (model gateways, prompt/agent...  ...Familiarity with retrieval-augmented generation (RAG), embeddings, vector databases, and... 
    Senior
    Temporary work

    Joby Aviation

    San Carlos, CA
    1 day ago
  •  ...Senior AI Engineer As a Senior AI Engineer at Intapp, you'll work on an AI-powered, industry-specific cloud platform that transforms professional...  ...problems into reliable AI-driven processes by combining LLM reasoning, structured data, and external APIs. Extend,... 
    Senior
    Work at office
    Local area
    Flexible hours

    Intapp

    Palo Alto, CA
    21 hours ago
  • $110k - $190k

     ...Role Overview We are hiring a Senior Software & AI Engineer to build production-grade AI systems,...  ...generative AI systems in production Build LLM-powered applications, including prompt...  ..., retrieval-augmented generation (RAG), and agent-based workflows... 
    Senior

    Covalent

    Sunnyvale, CA
    2 days ago
  •  ...Job Title: Senior AI Data Engineer Location: Menlo Park, CA (Hybrid) Duration: 6 months (potential extensions to long term) Our client...  ...engineering for annotation, data cleaning, or evaluation using LLM APIs. Knowledge of generative AI like diffusion models,... 
    Senior
    Remote work

    Intelliswift

    Menlo Park, CA
    1 day ago
  • $280.71k

     ...Senior AI Engineer I Menlo Park, CA A Rare Opportunity to Shape the Future of Genomics Join a team of brilliant, passionate innovators...  ...with the team. Responsibilities: Build and deploy LLM-powered applications (retrieval systems, AI agents, workflow... 
    Senior
    Full time
    Worldwide
    2 days per week
    3 days per week

    BillionToOne

    Menlo Park, CA
    2 days ago
  • $188k - $237.5k

     ...Senior AI Engineer At Sonatus, we're driving the transformation to AI-enabled software-defined...  ...orchestration, tool-calling optimization, and LLM security. You will translate...  ...the AI area, including LLM, Time Series, RAG, fine-tune large models, traditional ML... 
    Senior
    Work at office
    Local area
    Worldwide
    Flexible hours
    Shift work

    Sonatus

    Sunnyvale, CA
    3 days ago
  •  ...small, yet mighty team works with senior leaders and partners across the...  ...for a strategic and rigorous engineering leader who is passionate about innovation and approaches AI agent design as an engineering...  ...rule-based approaches. Develop RAG and Context Pipelines: Build... 
    Senior
    Temporary work
    Local area

    Intuit

    Mountain View, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Engineer - LLM, RAG. Be the first to apply!