Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Engineer LLM, RAG

Full-time

Brightai

Senior AI Engineer – RAG Systems


Bright.AI is a high-growth Physical AI company transforming how businesses interact with the physical world through intelligent automation. Our AI platform processes visual, spatial, and temporal data from billions of real-world events—captured across edge devices, mobile sensors, and cloud infrastructure—to enable intelligent decision-making at scale.

We are now hiring a Senior AI Engineer – LLM, RAG to lead the development of Retrieval-Augmented Generation (RAG) systems that harness the power of large language models (LLMs) and real-world knowledge sources. This role is pivotal to building next-generation intelligent assistants that help technicians and operators troubleshoot complex issues in industrial settings.

You’ll work at the intersection of NLP, foundational models, and real-time information systems—developing intelligent tools that turn manuals, technician notes, and sensor data into actionable, conversational guidance for the physical world.

Responsibilities



  • Lead the architecture and development of RAG systems that combine LLMs (e.g., LLAMA, Mistral, Claude, GPT) with structured and unstructured external information sources.

  • Develop AI-powered assistants to support technicians in diagnosing and resolving anomalies or failures in factory, plant, or industrial settings.

  • Build pipelines to ingest, preprocess, and index large corpora of documents (manuals, logs, notes, procedures) for semantic search and grounding.

  • Customize and fine-tune foundational models to incorporate domain-specific language, tone, and logic for industrial troubleshooting scenarios.

  • Collaborate with product, data, and cloud teams to design scalable, privacy-compliant, and latency-sensitive LLM applications.

  • Design evaluation strategies to measure performance, accuracy, and user experience of RAG-enabled systems in production settings.

  • Stay up to date with the latest advances in LLM architectures, retrieval methods, and prompt engineering, and integrate emerging techniques into the product roadmap.

Educational Background



  • M.S. or Ph.D. in Computer Science, AI, Machine Learning, or a related field, with specialization in NLP or deep learning.

  • Strong research or applied background in large language models (LLMs) and retrieval-augmented generation (RAG) systems. Agentic RAG experience is highly desirable.

Required Skills & Expertise



  • 5+ years of experience in machine learning or AI with a strong focus on NLP, LLMs, or conversational AI.

  • Fluency with modern LLMs and open-source foundational models (e.g., LLAMA, Falcon, Mistral, GPT, Claude).

  • Experience building RAG pipelines with tools like LangChain, LlamaIndex, or custom vector database integrations, with at least one production grade system was built.

  • Fluency with prompt engineering, instruction tuning, or fine-tuning open-source models.

  • Deep understanding of document retrieval (semantic search, embedding generation, similarity metrics) and vector stores (e.g., FAISS, Weaviate, Pinecone).

  • Strong foundation in core machine learning techniques, including experience with reinforcement learning (RL) or decision-making models.

  • Proficiency with ML development frameworks such as PyTorch, Hugging Face Transformers, or similar. Strong Python programming is a must.

  • Experience integrating AI systems into real-world applications with user-facing interfaces and operational constraints.

  • Excellent problem-solving and critical thinking skills; ability to design solutions for complex, ambiguous problems.

  • Strong written and verbal communication skills, with ability to collaborate cross-functionally with engineers, product managers, and domain experts.

Bonus Qualifications



  • Experience applying LLMs in industrial or physical infrastructure settings (e.g., manufacturing, logistics, utilities, energy).

  • Knowledge of industrial control systems, maintenance workflows, or technician support processes.

  • Exposure to multimodal models or integrating textual data with sensor and/or time-series data.

  • Prior experience in a startup or a fast-paced environment building LLM-powered products from the ground up.

Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer LLM, RAG in Palo Alto, CA vacancy
  •  ...usher in this new era, we seek AI-native thinkers across every...  ...the power of AI. As a Senior Applied AI Engineer on our Cortex AI team, you will...  ...especially with technologies like RAG and agentic workflows. ~...  ...and evaluation frameworks for LLM or agent systems, and using... 
    Senior
    Full time

    Snowflake

    Menlo Park, CA
    8 hours ago
  • $170k - $185k

     ...all continents. Our leading AI technology is the backbone of...  .... Job Description As a Senior AI/ML Engineer, you will design, develop, and...  ...solutions using LLMs, embeddings, RAG architectures, vector...  ...with AI evaluation frameworks, LLM observability, AI governance,... 
    Senior
    Full time
    For contractors
    Flexible hours

    Ifs

    Palo Alto, CA
    8 hours ago
  •  ...Senior AI Engineer – Edge Dialog Systems BrightAI is a high-growth Physical AI company transforming how businesses interact with the...  ...than a prompt-and-retrieve role. The competencies of a strong LLM and RAG engineer are needed for the position, but the work itself... 
    Senior
    Full time
    Contract work
    Local area
    Immediate start

    Brightai

    Palo Alto, CA
    8 hours ago
  • $171k

    Sr. Staff ll, AI Engineer - Search (L7-2)We exist to wow our customers. We know we’re doing the...  ...AI mindset, leveraging cutting-edge LLM technology to solve complex problems and...  ...latency serving.Develop and maintain strong RAG frameworks, grounding AI applications in... 
    Senior
    Temporary work
    Flexible hours

    Coupang

    Mountain View, CA
    a month ago
  • $191k - $315k

     ...LinkedIn’s Enterprise AI team creates meaningful...  ...technical solutions including LLM fine-tuning, content...  ...LLM-as-a-judge, prompt engineering, embedding-based retrieval...  ..., how to best implement RAG, etc. Collaborate with...  ...experience at the Senior Staff / L7 / Principal Engineer... 
    Senior
    Full time
    For contractors
    Work at office
    Flexible hours

    Linkedin

    Sunnyvale, CA
    8 hours ago
  • $225k - $250k

     ...Suki Assistant, uses cutting-edge AI to automate clinical...  ...including prompting, orchestration, RAG, context and cost managementHands...  ...implementing evaluation frameworks for LLM-based systems, including...  ...: We’re former Googlers, Apple engineers, Stanford docs, and healthcare... 
    Senior

    Suki

    Redwood City, CA
    7 days ago
  • $184k - $287.5k

     ...into the unlimited potential of AI to define the next era of...  ...on the world.NVIDIA is hiring senior software engineers in its Infrastructure, Planning...  ...with Large Language Mode (LLM), Machine Learning (ML), Agentic...  ...-augmented generation(RAG) and fine-tuning LLMs on enterprise... 
    Senior
    Full time
    Work experience placement

    Nvidia

    Santa Clara, CA
    a month ago
  •  ...DataVisor is the world’s leading AI-powered Fraud and Risk Platform...  ..., powerful decision engine, and investigation tools work together...  ...Automation Build map-reduce style LLM workflows and analytics...  ...orchestration, tool calling, or RAG architectures) for production or... 
    Full time

    Datavisor

    Mountain View, CA
    8 hours ago
  •  ...About the team We’re building the AI-native compliance platform for...  ...answer. Our team includes engineers and researchers from Stanford,...  ...Design, build, and operate RAG and agentic systems over complex...  ...~ Hands-on experience shipping LLM integrations or RAG systems into... 
    Full time

    Pear Vc

    Palo Alto, CA
    8 hours ago
  • $130k - $175k

     ...AI is the new electricity. Millions of AI engineers are needed to transform industries with AI, particularly in the realm...  ...building blocks (prompt engineering, RAG, finetuning, agentic frameworks,...  ...learning and AI, particularly using LLM APIs and frameworks for things like... 
    Full time
    Work experience placement
    Internship
    Work at office
    Remote work

    Ai Fund

    Mountain View, CA
    8 hours ago
  •  ...usher in this new era, we seek AI-native thinkers across every...  ...data. You'll own the full AI engineering lifecycle: design, prompt/tool...  ...modeling, analytics, retrieval / RAG, or semantic layers — highly...  ...Prior work on eval harnesses, LLM observability, or safety / guardrails... 
    Full time

    Snowflake

    Menlo Park, CA
    8 hours ago
  •  ...Description We’re an  Industrial AI start-up founded by a Stanford...  ...on proprietary Explainable AI engines for SME-explainable insights...  ...Integrate Explainable AI with LLM tools for Agentic AI experience...  ...with GenAI and LLM augmentation (RAG) An advanced degree... 
    Full time
    Part time
    For contractors
    Work at office
    Remote work

    Brain Gain Recruiting

    Palo Alto, CA
    8 hours ago
  • As a Senior AI Engineer at Intapp, you'll work on an AI-powered, industry-specific cloud platform that transforms professional and financial...  ...business problems into reliable AI-driven processes by combining LLM reasoning, structured data, and external APIs. Extend,... 
    Senior
    Work at office
    Local area
    Flexible hours

    INTEGRATION APPLIANCE, INC.

    Palo Alto, CA
    6 days ago
  • $168k - $264.5k

     ...Nvidia's SOC Design (SOCD) team is looking for an Applied AI Engineer who is passionate about eliminating bottlenecks in SOC...  ...can be accelerated with the use of AI services, from RAG-grounded knowledge systems and LLM-powered assistants to multi-step agents that plug into... 
    Senior
    Full time

    Nvidia

    Santa Clara, CA
    a month ago
  • $120k - $160k

     ...and information powered by advanced AI, recommendation systems, and adtech....  ...About the Role We're looking for a Senior Technical Recruiter, AI & Engineering to help build the teams behind our...  ...Experience recruiting for frontier AI, LLM, agentic AI, or generative AI teams.... 
    Senior
    Full time
    Work at office
    Local area
    Work from home
    Monday to Friday

    NewsBreak

    Mountain View, CA
    18 days ago
  • $227.5k - $300k

     ...driving the transformation to AI-enabled software-defined...  ...a highly motivated Senior Staff AI Engineerto join...  ...optimisation, and LLM security. You will translate...  ...a hands-on role for an engineer who prioritises execution...  ...including LLMs, Time Series, RAG, fine-tuning large... 
    Senior
    Work at office
    Local area
    Worldwide
    Flexible hours
    Shift work

    Sonatus

    Sunnyvale, CA
    a month ago
  • $185k - $230k

    The OpportunityWe are looking for a Senior AI Agent & LLM Engineer who combines strong software engineering capabilities with a deep focus on AI quality. You will help build and improve the AI systems behind Otter’s conversational knowledge engine and AI Chat, spanning... 
    Senior
    Permanent employment

    Otter.ai

    Mountain View, CA
    a month ago
  • $135k - $155k

     ...information powered by advanced AI, recommendation systems, and...  ...platform. You'll work alongside senior engineers to develop AI advertising...  ...Foundational understanding of LLMs, RAG, tool-use, and agent...  ...with structured/schema-validated LLM outputs and modern model APIs... 
    Full time
    Work experience placement
    Internship
    Local area
    Work from home

    News Break

    Mountain View, CA
    8 hours ago
  • $135k - $185k

     ...information powered by advanced AI, recommendation systems, and...  ...algorithm work as an excellent engineer to join our advertising team? In...  ...Technical Stack: Master LLMs, RAG, tool-use, memory handling, and...  ..., structured/schema-validated LLM outputs, and integration with modern... 
    Full time
    Work experience placement
    Local area
    Work from home

    News Break

    Mountain View, CA
    8 hours ago
  • $150k - $250k

     ...manual intervention. The Role We’re seeking a Sr. AI Software Engineer with deep expertise in building scalable AI platforms and developer...  ..., monitoring, and lifecycle management. AI Tooling & LLM Capabilities: Build tools and abstractions to interface with... 
    Senior
    Full time
    Work at office

    Globality, Inc

    Palo Alto, CA
    8 hours ago
  •  ...Senior AI Engineer, Time-Series Signal Processing Bright.AI is a high-growth Physical AI company transforming how businesses interact with the physical world through intelligent automation. Our platform processes visual, spatial, and temporal data from billions of... 
    Senior
    Full time
    Immediate start

    Brightai

    Palo Alto, CA
    8 hours ago
  • $200k - $270k

     ...Description Samsung SDS America AI Team is researching the next generation of intelligent robotic systems that operate...  ...robots in real-world environments. We are looking for a Senior Physical AI Engineer to join the team developing this end-to-end pipeline. You will... 
    Senior
    Full time
    Worldwide
    Flexible hours

    Samsung Sds America

    Mountain View, CA
    8 hours ago
  •  ...career development and success. Principal AI Engineer at BairesDev In this role, you'll set...  ...~ Proven experience owning an agentic or LLM platform end to end in production, from...  ...dataset design. ~ Experience with RAG over structured and unstructured sources.... 
    Remote job
    Local area
    Work from home
    Worldwide
    Flexible hours

    Jobleads-US

    Palo Alto, CA
    6 days ago
  •  ...usher in this new era, we seek AI-native thinkers across every...  ...demos to tools Data Science and Engineering teams depend on every day, and...  ...in production, including AI/LLM features. ~ Fluency in at least...  ..., analytics, retrieval/RAG, or semantic layers, which is... 
    Senior
    Full time

    Snowflake

    Menlo Park, CA
    8 hours ago
  •  ...team in: research, design, development, and deployment of advanced AI agents and agentic systems. Architect and implement complex multi...  ...(QLORA, DPO) and inference optimization (vLLM, TensorRT-LLM). Research experience in agentic AI or related fields. Experience... 
    Full time
    Work experience placement

    Eightfold

    Santa Clara, CA
    8 hours ago
  •  ...Description Accellor is an AI-native services firm...  ...advanced AI, data, and engineering capabilities. Our mission...  ...The ideal candidate is a senior hands-on architect who...  ...frameworks for large-scale LLM and GenAI workloads....  ...dynamic context assembly, RAG, memory, context compression... 

    Accellor

    Mountain View, CA
    a month ago
  • $120k - $160k

     ...and information powered by advanced AI, recommendation systems, and adtech.Recognized...  ...About the RoleWe're looking for a Senior Talent Partner, AI & Engineering to help shape the teams building our...  ...organizations in frontier AI, LLM, agentic AI, or generative AI.Experience... 
    Senior
    Full time
    Work at office
    Local area
    Work from home
    Monday to Friday

    News Break

    Mountain View, CA
    a month ago
  •  ...usher in this new era, we seek AI-native thinkers across every function...  ...and scale the orchestration engines that execute complex agentic...  ...Design high-performance systems for RAG (Retrieval-Augmented Generation...  ...the modeling team to take raw LLM capabilities and turn them into... 
    Senior
    Full time

    Snowflake

    Menlo Park, CA
    8 hours ago
  • $227k - $300k

     ...Sonatus, we’re driving the transformation to AI-enabled software-defined vehicles....  ...the Edge. We are looking for a great Senior Staff AI Engineer to join our seasoned AI team and lead...  ...train AI Edge models (e.g., Transformers, LLM, CNN, LSTM, Trees) to process... 
    Senior
    Full time
    Work at office
    Worldwide
    Flexible hours
    Shift work
    3 days per week

    Sonatus, Inc

    Sunnyvale, CA
    8 hours ago
  • $100k - $200k

     ...Description Job Description OPPO AI Center is seeking a passionate AI Engineer to help build next-generation AI...  ...design, develop, and deploy advanced LLM and AI Agent technologies that integrate...  ...API, Gemini API, vector databases, RAG pipelines, and agent orchestration... 
    Full time

    OPPO US Research Center

    Palo Alto, CA
    26 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Engineer LLM, RAG. Be the first to apply!