Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

LLM Engineer

$70 - $75 per hour

Insight Global

Responsibilities Design and build RAG pipelines, retrieval systems, and search capabilities Develop and maintain LLM‑powered backend services and APIs Implement document ingestion, indexing, and embedding pipelines Work cross‑functionally with product and engineering teams to deliver features Use a data‑driven approach to debug, optimize, and improve systems Own features end‑to‑end, ensuring performance, scalability, and reliability We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to View email address on click.appcast.io. To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: Qualifications Insight Global is hiring an LLM Engineer to join a high‑impact development team focused on building and scaling LLM‑powered features in production applications. This individual will work hands‑on across backend services, APIs, and AI systems, owning features end‑to‑end while leveraging modern AI engineering practices. Hands‑on experience building RAG (Retrieval‑Augmented Generation) systems end‑to‑end Strong experience with LLM APIs (OpenAI, Anthropic) and GenAI integrations Proficiency in Python (primary) with Java exposure or ability to work in Java environments Experience with vector databases, embeddings, and semantic search Strong experience with cloud platforms (AWS, Azure, or GCP) and REST APIs Practical use of AI‑assisted coding tools (Copilot, Cursor, Claude, agentic tools) Experience delivering LLM‑powered features in production environments (not just POCs) Strong backend engineering fundamentals (scalability, performance, system design) Compensation & Benefits Exact compensation may vary based on several factors, including skills, experience, and education ($70‑75/HR). This position may also be eligible for bonuses, benefits, or other forms of compensation, depending on the client and employment type. Experience with Elasticsearch / OpenSearch / Solr Familiarity with LangChain, LlamaIndex, or similar frameworks Experience with LLM guardrails, monitoring, and observability Exposure to multi‑agent systems / agentic workflows Experience with event‑driven architectures and messaging systems Background in NLP / ML concepts applied to LLM systems #J-18808-Ljbffr Insight Global

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the LLM Engineer in Boston, MA vacancy
  • Insight Global is seeking an LLM Engineer in Boston, MA to join a high-impact development team. This role focuses on building and scaling LLM-powered features using cutting-edge AI engineering practices. You will design and maintain RAG pipelines, develop APIs, and work... 
    Suggested
    Hourly pay

    Insight Global

    Boston, MA
    3 days ago
  • $82.3k - $220k

    Draper in Boston, MA is seeking an AI Systems Administrator, responsible for overseeing a closed GPT environment and ensuring system health. Candidates must have strong Linux administration skills, knowledge of automation, and a Bachelor's degree in Computer Science. This...
    Suggested
    Full time

    Draper

    Boston, MA
    1 day ago
  • $115k - $164k

     ...non‑functional and structural testing strategies to validate application performance, security, and interoperability across various LLM. Collaborate with Agile teams in TrakCare and HealthShare to incorporate end‑user needs and prioritize testing efforts to deliver work... 
    Suggested
    Temporary work
    Worldwide
    Flexible hours

    Mass Digital Health

    Boston, MA
    21 hours ago
  • $160k - $225k

     ...the Role Manifold is looking for a Staff Site Reliability Engineer (SRE) to work at the intersection of AI, data infrastructure, and...  ...issues across infrastructure, data, and application layers. Leverage LLM to the fullest extend to minimize toil and and manage date to... 
    Suggested

    Manifold AI

    Cambridge, MA
    2 days ago
  • $150k - $180k

     ...Job Description Job Description Senior Electrical Engineer US-MA-Newton Job ID: 2025-3192 # of Openings: 1 Category: MEP LiRo-Hill Overview We have an immediate need for a Senior Electrical Engineer in Newton, MA.   Come join our team... 
    Suggested
    Local area
    Immediate start

    The LiRo Group

    Newton, MA
    15 days ago
  • $65k - $80k

     ...continuous refinement. You don't need a traditional software engineering background or a computer science degree to succeed here. We...  ...you've built than how you built it, whether using no-code tools, LLM APIs, agentic frameworks, or a combination of all of the above.... 
    Local area
    Worldwide
    Flexible hours

    Black Kite

    Boston, MA
    4 days ago
  • $145k

     ...About the Role Entensiv is looking for a Senior Building Automation Service Engineer to join our growing team. This is a hands-on technical role for an experienced BAS professional who thrives on solving complex system challenges, building strong client relationships,... 
    Full time
    Work at office
    Flexible hours

    Entensiv

    Boston, MA
    2 days ago
  • $150k - $215k

     ...Computer Vision Engineer As a small team, we all wear many hats and enjoy tackling new challenges. When it comes to tech, we're seeking...  ..., coordinate reference systems) Experience integrating VLM/LLM APIs into production workflows Experience with MLOps We're... 
    Work at office
    Local area
    Remote work
    Flexible hours
    2 days per week

    CivilGrid

    Boston, MA
    2 days ago
  • $130k - $180k

     ...Access, visit How This Role Makes a Difference As a Senior Engineer, Test Automation , you will be responsible for building and evolving...  .... Evaluate and apply AI-assisted testing techniques, such as LLM-based test generation and intelligent failure triage, to extend... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Worldwide
    Visa sponsorship
    Work visa
    Flexible hours
    Shift work

    Care Access

    Boston, MA
    3 days ago
  • $12 - $16 per hour

     ...Description Insight Global is hiring a Senior Quality Assurance Engineer for a large consulting company. This role will sit fully remote...  ...performance, exploratory, and regression testing Validate AI and LLM‑driven systems, including non‑deterministic outputs and partial... 
    Remote work

    Insight Global

    Boston, MA
    3 days ago
  • $178.13k - $198.63k

     ...updates to various project stakeholders, such as other Red Hat AI Engineering teams, product managers and management. Participate in upstream...  ...used within our offerings. Working on ML frameworks, including LLM inference engine such as vLLM, Instructlab & PyTorch and LLM... 
    Contract work
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Dormont Manufacturing Company

    Boston, MA
    2 days ago
  • $148k - $264.99k

     ...internal Developer Productivity capability within the COO GET Engineering organization to reduce cognitive, operational, and repetitive burden...  ...platforms ~ Practical experience applying AI/ML or LLM-based systems to engineering workflows ~ Strong systems thinking... 
    For contractors

    Autodesk

    Boston, MA
    2 days ago
  • $155.66k - $225.16k

     ...About the Team and Role: We’re hiring our first AI Automation Engineer to lead how we apply AI internally across the company. This is...  ...hours " (Mon-Fri: 9am-3pm Pacific Time) ~ Experience creating LLM-backed tools involving prompt engineering and automated evals... 
    Remote job
    Full time
    Shift work

    Quora

    Cambridge, MA
    2 days ago
  •  ...experience. About the position We're seeking a Senior QA / Eval Engineer to own and evolve the quality and evaluation infrastructure...  ...platform. Our eval system is multi-factorial (deterministic, LLM-based, human expert), running against every voice interaction we... 
    Live in
    Shift work

    Third Way Health

    Cambridge, MA
    21 hours ago
  • $121.4k - $218.6k

     ...defend them when they are breached. As a Senior Site Reliability Engineer, you will be responsible for: Developing and scaling...  ...network break-fix events. Leveraging advanced AI utilities and LLM-assisted development paradigms where appropriate to accelerate technical... 
    Work experience placement
    Work at office

    Akamai

    Cambridge, MA
    2 days ago
  • $140k - $170k

     ...Image & Computer Vision Ai Engineer Hatch I.T. is partnering with Babel Street to find an Image & Computer Vision AI Engineer. Please...  ...efficient vision capabilities, including integration with multimodal LLM systems that allow users to search and reason over images using... 
    Work at office

    Hatchit Co

    Somerville, MA
    21 hours ago
  • Responsibilities Good Communication and knowledge on Imaging/Staging of desktops, laptops and other related devices. Maintain, analyze, and troubleshoot software and computer peripherals. Must have reliable transportation and clean driving history Travel to various sites...
    Remote work

    Tata Consultancy Services

    Boston, MA
    2 days ago
  • $30 - $34 per hour

     ...systems as well as performing preventative and unscheduled maintenance in accordance with Oxford guidelines. Under the Sr./Chief Engineer's guidance, the Technician will direct and coordinate engineering related activities to ensure a safe and secure work environment.... 
    Hourly pay
    Temporary work
    For contractors
    Local area
    Flexible hours

    OMERS / Oxford Properties Group

    Boston, MA
    4 days ago
  • $113k - $149k

     ...Field Test Engineer, Maritime Quincy, Massachusetts, United States Anduril Industries is a defense technology company with a mission to transform U.S. and allied military capabilities with advanced technology. By bringing the expertise, technology, and business... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start

    anduril

    Quincy, MA
    21 hours ago
  •  ...A leading facilities management company is seeking a Lead Building Engineer to oversee the operations and maintenance of mechanical, electrical, and plumbing systems. The role involves supervising maintenance staff and ensuring compliance with regulations. Qualified candidates... 
    Full time
    Monday to Friday

    C&W Services

    Cambridge, MA
    3 days ago
  • $53 - $55 per hour

     ...A real estate services company seeks a Lead Building Engineer in Cambridge, MA to manage maintenance and operations of building systems, ensuring safety and efficiency. Key responsibilities include overseeing HVAC equipment, coordinating repairs, and mentoring technical... 
    Hourly pay
    Work at office

    Lincoln Property Company

    Cambridge, MA
    2 days ago
  • $90k - $120k

     ...Job Description Job Description Mechanical Engineer US-MA-Newton Job ID: 2026-3327 # of Openings: 1 Category: MEP LiRo-Hill Overview We have an immediate need for a Mechanical Engineer in Newton, MA.   Come join our team! We are looking... 
    Immediate start

    The LiRo Group

    Newton, MA
    20 days ago
  •  ...Building Automation Design Engineer Location: Boston, MA Full-time | 5-8 years of experience K. Jacobs is seeking a Building Automation Design Engineer to join a well-established, multidisciplinary engineering firm. This role offers the opportunity to contribute... 
    Full time
    Flexible hours

    K. Jacobs Executive Search LLC

    Boston, MA
    3 days ago
  • $229.9k - $262.4k

     ...committed to continuing to build world‑class applied science and engineering teams to deliver our industry leading capabilities with...  ...Guardrails, PyTorch, and more. Invent and introduce state‑of‑the‑art LLM optimization techniques to improve the performance — scalability... 
    Local area

    Capital One

    Cambridge, MA
    2 days ago
  • $152k - $222.6k

     ...Role Summary Join Suffolk’s AI Studio in Boston as an AI Systems Engineer, a hybrid role responsible for architecting and building both:...  ...systems backbone that powers enterprise‑scale AI. The agentic and LLM‑driven capabilities transforming construction workflows. This... 
    Temporary work
    For contractors
    Work at office

    Suffolk

    Boston, MA
    1 day ago
  •  ...Job Title: Engineer III Duration: 06/30/2026 to 06/26/2027 with possible extension Office: Cambridge, MA 02142 Pay rate: $58/hr. on W2 About the role: The Facilities Management team is responsible for the daily operation and upkeep of site utilities, building... 
    Temporary work
    Work experience placement
    Work at office

    Intellipro Group

    Cambridge, MA
    3 days ago
  • $25.6 - $38.4 per hour

     ...part of Thermo Fisher Scientific, provides integrated solutions, instrument, and enterprise services to our customers. The Service Engineer is responsible for managing all aspects of service support and customer relationship management. The successful candidate will... 
    Hourly pay
    Temporary work
    Work at office
    Relocation
    Monday to Friday

    Dormont Manufacturing Company

    Cambridge, MA
    4 days ago
  •  ...feasibility relative to budget constraints, site limitations, and project timeline. Required Qualifications: Bachelor’s degree in Civil Engineering A minimum of 5 years’ experience related to design of commercial or institutional buildings Experience with Autodesk Software (... 
    Part time
    Local area

    Coast and Harbor Associates

    Boston, MA
    2 days ago
  • $50k

     ...CIVIL ENGINEER IV Department of Transportation, Bureau of Highway Design, Concord, NH. Position #21180. Salary: $31.33—$42.60 per hour. Summary Coordinate and supervise roadway design for a group of highway projects. Minimum Qualifications Master's degree in engineering... 
    Hourly pay
    For contractors
    Work at office
    Flexible hours

    State of New Hampshire

    Boston, MA
    4 days ago
  •  ...A leading construction firm in Boston is seeking an Entry Level Construction Project Engineer. This role focuses on developing skills in scheduling, estimating, budget control, and safety management within a collaborative team. Ideal candidates have a relevant degree,... 
    Internship

    Structural Group

    Boston, MA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to LLM Engineer. Be the first to apply!