Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Machine Learning Engineer

$210k - $230k

ELLKAY, LLC

ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY’s solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting-edge technologies and solutions that drive their growth and interoperability strategies.

Today, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today’s data-rich world.

ELLKAY's experience, customer-focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy.

Job Description:

ELLKAY is seeking a Staff Machine Learning Engineer, AI Systems Integration who can design, integrate, and operate production-grade, autonomous agentic systems across products, data pipelines, APIs, enterprise applications, and workflow engines.

This role sits at the intersection of machine learning engineering, backend systems, integration architecture, and cloud infrastructure. You will be responsible for building the core orchestration runtime, Model Context Protocol (MCP) gateways, enterprise context layers, and automated governance harnesses that allow autonomous and semi-autonomous AI agents to execute multi-step workflows safely and reliably across enterprise ecosystems.

Essential Duties & Responsibilities:

1. Enterprise Context Layer & Data Systems

  • Design and implement unified Enterprise Context Layers that combine structured relational/NoSQL data and unstructured document stores into high-performance hybrid retrieval engines.
  • Architect real-time streaming ingestion pipelines (e.g., Kafka, EventBridge) balancing recency (via fast-path memory/cache layers) with long-term semantic relevance (via asynchronous vector indexing).
  • Enforce granular security policies by embedding Row-Level Security (RLS) and Role-Based Access Control (RBAC) directly into retrieval queries so agents only retrieve context authorized for the active user session.

2. Model Context Protocol (MCP) Gateway Architecture

  • Design and maintain enterprise Model Context Protocol (MCP) gateways to seamlessly connect heterogeneous tools, REST/gRPC microservices, and enterprise databases to agent ecosystems.
  • Implement dynamic tool discovery mechanisms, schema validation (using Pydantic v2), and authentication delegation (OAuth2 token exchange and dynamic scope validation).
  • Build resilient tool execution handles featuring bounded retry loops, fallback routing, circuit breakers, and structured error reporting for agent self-correction during timeouts or malformed tool responses.

3. Agentic Execution Fabric & Orchestration

  • Structure multi-agent orchestration runtimes supporting both hierarchical manager-worker state graphs and asynchronous, event-driven agent meshes.
  • Architect state isolation models using thread-level persistence snapshots (Aurora PostgreSQL, DynamoDB) to maintain clear agent context boundaries.
  • Implement execution circuit breakers (token/depth limits), human-in-the-loop (HITL) escalation boundaries for high-risk actions, and reflection loops for autonomous self-correction.
  • Establish automated evaluation harnesses utilizing trajectory benchmarking, tool-selection precision evaluation, held-out test sets, and LLM-as-a-judge scoring to continuously govern system performance at scale.

4. Platform, Infrastructure & Developer Tools

  • Build high-performance backend microservices using Python (FastAPI, Pydantic, AsyncIO) and write production-grade Infrastructure as Code using AWS CDK (TypeScript/Python).
  • Deploy cloud-native agent runtime environments leveraging AWS Lambda, API Gateway, Step Functions, EventBridge, SQS, ECS Fargate, Aurora Serverless, and DynamoDB.
  • Leverage modern AI development tools and agentic coding workflows (e.g., Claude Code, OpenAI Codex, GitHub Copilot) to maximize developer velocity, code quality, and implementation speed.
  • Implement full observability across agent execution trajectories using structured logging, distributed tracing (OpenTelemetry, CloudWatch, X-Ray), and token/cost tracking.

Qualifications:

  • 10+ years of progressive experience in software engineering, machine learning engineering, or distributed systems, with significant ownership of production platforms.
  • Deep Agentic Systems Expertise: Hands-on experience building and deploying stateful agentic workflows, multi-agent frameworks (e.g., LangGraph, AutoGen, CrewAI, Bedrock Agents), dynamic tool/function calling, and agent memory systems.
  • Context Layer & Security: Proven track record designing enterprise context engines, hybrid retrieval systems (dense/sparse vector search + re-ranking), and strictly enforcing user-level RLS/RBAC access control within vector/retrieval layers.
  • MCP & Tool Integration: Experience architecting tool gateway solutions (such as MCP), contract/schema validation, authentication delegation, and robust error handling for external tool invocations.
  • Orchestration & Resiliency: Deep knowledge of state isolation, multi-agent coordination patterns, loop circuit breakers, human-in-the-loop intervention protocols, and automated agent evaluation frameworks.
  • Core Tech Stack: Advanced proficiency in Python (FastAPI, Pydantic, AsyncIO). Go/Rust a plus.
  • Cloud & DevOps: Deep expertise with AWS services (Lambda, ECS Fargate, Step Functions, EventBridge, DynamoDB, Aurora), AWS CDK, Docker, and streaming/messaging systems (Kafka, EventBridge, SQS).
  • AI-Assisted Development: Experience leveraging modern AI developer tools (Claude Code, Codex, Cursor, Copilot) to accelerate architecture design, prototyping, and production engineering.

Preferred Qualifications

  • Degree in Computer Science, Machine Learning, Electrical Engineering, or a related quantitative field.
  • Experience building or extending enterprise middleware, integration engines, or API gateways (e.g., Workato, MuleSoft, Apache Camel).
  • Experience with automated trajectory evaluation tools (LangSmith, Arize, Phoenix, RAGAS) and LLM-as-a-judge methodologies.

Benefits:

ELLKAY offers a comprehensive and competitive benefit package that starts day one! 

Including:

  • Medical, Dental, and Vision benefits
  • Employer-paid Life and LTD
  • 401k w/ matching – once eligibility is met
  • Work/life balance
  • Paid Volunteer Program 
  • Flexible working hours
  • Generous FTO
  • Remote work options
  • Employee Discounts
  • Parental Leave
  • Gym membership / Exercise class stipends

Our awesome culture includes:

  • Working with talented, collaborative, and friendly people who love what they do
  • Professional growth within
  • Innovation environment
  • On site in HQ Free daily lunches

Awards:

  • 2025 Top Workplaces Employee Appreciation
  • 2025 Top Workplaces Employee Well-Being
  • 2025 Top Workplaces Professional Development
  • 2025 Top Workplaces Leadership
  • 2026 USA Today Top Workplaces
  • 2026 NJ Top Workplaces

Additional information

At ELLKAY, we are committed to operating as a hybrid workplace, offering employees flexibility in how they structure their time between in-office and remote work. We recognize the significance of fostering connections, collaboration, and creativity within our office culture and its positive impact on our business. Our philosophy of operating as a hybrid workplace underscores our dedication to enabling employees to tailor work-life balance to their individual preferences. For those who do not live within 40 miles of one of our offices, we are open to considering remote work for candidates whose skills and experience strongly align with the role. While we prioritize a hybrid work environment for most roles, we understand the importance of flexibility and are open to remote work for specific positions and specialized skill sets.

For more information on our company, visit ;

ELLKAY LLC is a Smoke-Free Workplace. 

ELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Compensation Range: $210,000-$230,000

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff Machine Learning Engineer in United States vacancy
  • $109.7k - $175.5k

     ...Sign-In before you apply.Job Description:Job Title: Principal Machine Learning & Silicon Yield EngineerPosition OverviewBroadcom is seeking...  ...-Functional Collaboration: Partner with foundry, product engineering, design-for-manufacturing (DFM), DFT engineering teams to drive... 
    Suggested
    Full time
    Local area

    Broadcom

    Chandler, AZ
    4 days ago
  •  ...template — we're looking for strong people from varied backgrounds who learn fast, thrive in ambiguity, and can show us what they've built,...  ...projects, open-source contributions to major inference engines, or deep-dive technical write-ups.Full-cycle ownership. You can... 
    Suggested
    Full time
    Work at office
    Relocation package

    Inworld AI

    Mountain View, CA
    1 day ago
  • $251k - $310k

    Staff/Sr. Staff Machine Learning Engineer - World Modeling, Simulation Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building... 
    Suggested
    Full time
    Remote work

    Waymo

    Mountain View, CA
    1 day ago
  • $291k - $409k

     ...in the most challenging dense urban environments.As a Staff or Senior Staff engineer, you will be the technical lead for CAS algorithms, with...  ...world, combining interpretable geometric methods with machine learning, and you will own the architecture and roadmap that take... 
    Suggested
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    10 hours ago
  • $264.8k - $331k

     ...getting started — this team will define what dependable, production-grade agentic AI looks like.About the RoleAs a Staff Machine Learning Research Engineer, you will operate across the full breadth of AIS’s technical needs — wherever the hardest ML problem in agentic AI... 
    Suggested
    Full time

    Scale AI

    San Francisco, CA
    3 days ago
  •  ...means the opportunity to grow faster than ever while doing the most meaningful work of your career. The role We're hiring a Staff ML/OR engineer to define and build the intelligence at the core of Dispatch OS, our platform for ML-assisted dispatch decisions. You'll set... 
    Full time

    Burq, Inc.

    Remote
    27 days ago
  • $132.9k - $234.37k

    AI/ML Machine Learning Engineer Herndon, VA Top Secret/SCI Polygraph Unspecified Career Level not specified $132,900 - $234,370 Job Description By bringing together people that use their passion for purposeful innovation, at Lockheed Martin we keep people safe and solve... 
    Full time
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Lockheed Martin Corporation

    Herndon, VA
    1 day ago
  • $298k - $368k

     ...team builds the system which learns the spatial-temporal representation...  ...set of sensors, enabling engineers like you to (1) develop...  ...role, you'll report to a Senior Staff Technical Lead Manager. You...  ...Computer Science, Robotics, Machine Learning, or equivalent practical... 
    Full time
    Remote work
    Shift work

    Waymo

    San Francisco, CA
    4 days ago
  • $251k - $310k

     ...team builds the system which learns the spatial-temporal representation...  ...set of sensors, enabling engineers like you to (1) develop...  ...hybrid role, you'll report to a Staff Technical Lead Manager. You will...  ...7+ years experience in Machine Learning and/or Computer Vision... 
    Full time
    Flexible hours

    CapitalG

    Mountain View, CA
    1 day ago
  • $26 - $30 per hour

     ...your place in space. The Aerospace Corporation is hiring a Machine Learning Engineer Undergrad Intern for the Data Science and Artificial...  ...Segundo, CA. Information Systems and Cyber Division (ISCD) staff work with the latest in information system technologies, such... 
    Hourly pay
    Full time
    Temporary work
    Internship
    Work at office
    Immediate start
    Remote work
    Relocation package
    Flexible hours

    The Aerospace Corporation

    El Segundo, CA
    4 days ago
  • $29 - $34 per hour

     ...make smarter decisions, maximize asset performance, and achieve more resilient operations. Description: We're hiring a Machine Learning Engineering Intern who is currently enrolled in a master's program and brings rigorous, logic-driven thinking. You'll work alongside... 
    Hourly pay
    Full time
    Contract work
    Part time
    Summer work
    Internship
    Summer internship
    Local area
    Remote work

    Siemens

    Raleigh, NC
    4 days ago
  • $32 - $38 per hour

     ...take your place in space. Aerospace Corporation is hiring Machine Learning Engineering Interns for the Data Science and Artificial Intelligence...  ...(ISCD). Information Systems and Cyber Division (ISCD) staff work with the latest in information system technologies, such... 
    Hourly pay
    Full time
    Temporary work
    Internship
    Work at office
    Immediate start
    Remote work
    Relocation package
    Flexible hours

    The Aerospace Corporation

    El Segundo, CA
    1 day ago
  •  ...Worker Type Supplemental Job Description Intern - Machine Learning (Computer Vision) Summary Summer Internship Program Our paid...  ...Vision, Machine Learning, Computer Science, Electrical Engineering, or a related field. Familiarity with C/C++ and MATLAB.... 
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Internship
    Summer internship
    Work at office
    Relocation

    AV

    Centreville, VA
    18 hours ago
  • $49 - $58 per hour

     ...business priorities by delivering high-impact work across your area of expertise. About the role KLA is looking for a Machine Learning Engineer Intern to join our algorithms team. You'll work with experienced engineers and scientists to develop machine learning... 
    Hourly pay
    Minimum wage
    Internship

    KLA

    Milpitas, CA
    1 day ago
  • $70 per hour

     ...simulation across 15+ U.S. states. Software Engineering builds the brains of Waymo's fully...  ...robotics, perception, decision-making and deep learning, while collaborating with hardware and...  ...PhD or MS program in Computer Science, Machine Learning or a related field, returning... 
    Hourly pay
    Full time
    Internship
    Summer internship
    Relocation package

    Waymo

    San Francisco, CA
    3 days ago
  •  ...Overview Our Machine Learning Engineering Internship is a 10-week immersive experience designed for students who are passionate about building the systems at the intersection of machine learning, large-scale data, and markets. As a Machine Learning Engineering Intern... 
    Full time
    Summer work
    Internship

    Susquehanna

    Bala Cynwyd, PA
    1 day ago
  • $107.66k - $161.7k

     ...topics and providing a unique platform to learn and connect with others. Poe : a...  ...About the Team and Role: Our small engineering team works on challenging problems every...  ...product and our company. At Poe, we use Machine Learning in various parts of the product... 
    Remote job
    Full time
    Work experience placement
    Internship

    Quora

    Omaha, NE
    4 days ago
  •  ...while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with senior engineers and... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Anchorage, AK
    4 days ago
  • $62k - $100k

     ...Description: Job Description About the Role As an AI Engineering team member, you will be instrumental in advancing new features...  ...people and offer employees a comprehensive total rewards package. Learn more about what working at Crowe can mean for you! How You... 
    Full time
    Local area
    Worldwide

    Crowe

    Chicago, IL
    2 days ago
  • $175.04k - $206.46k

     ...Job Description Original Posting Date: 11/16/26 Job Title: Machine Learning Engineer (multiple positions available) Location: 3410 Hillview Ave., Palo Alto, CA 94304 Work Model: Hybrid work model Purpose and Objective: SAP Labs, LLC seeks a Machine Learning... 
    Permanent employment
    Full time
    Flexible hours

    SAP

    Palo Alto, CA
    3 days ago
  • $82.88k - $87.03k

     ...Job Description Junior Machine Learning Engineering Duration: Permanent Location: Indianapolis, Indiana Why join Rolls-Royce? At Rolls-Royce we are committed to always being a force for progress; powering, protecting and connecting people everywhere.... 
    Permanent employment
    Full time
    Internship
    Flexible hours

    Rolls-Royce

    Indianapolis, IN
    18 hours ago
  •  ...Job Description We are seeking a highly motivated Staff Engineer, Defect Metrology to join our MOCVD team. This role will provide technical...  .... Experience applying AI/ML, computer vision, statistical learning, or advanced analytics to engineering problems. Experience... 
    Full time

    Renesas Electronics

    Goleta, CA
    18 hours ago
  •  ...Technologies, Inc. Job Area: Interns Group, Interns Group Interim Engineering Intern - SW General Summary: About Qualcomm Qualcomm...  ...that values collaboration, creativity, and continuous learning. Our programs provide real-world experience, technical skills,... 
    Interim role
    Summer work
    Internship
    Summer internship

    Qualcomm

    Santa Clara, CA
    18 hours ago
  • $215.2k - $245.6k

    Machine Learning Engineer 4 - Intelligent Foundations and Experiences (IFX) Do you love building and pioneering in the AI and technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment?... 
    Full time
    Part time
    H1b
    Local area

    Capital One

    New York, NY
    18 hours ago
  • $25k

     ...business value. What you'll do Design, build, and deploy machine learning models and systems that operate reliably at scale in...  ...platforms, and real-time inference pipelines Embed on a product engineering team and collaborate closely with data scientists, PMs ,and... 
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours

    SeatGeek

    United States
    2 days ago
  •  ...the most challenging dense urban environments. As a Staff or Senior Staff engineer, you will be the technical lead for CAS algorithms,...  ...world, combining interpretable geometric methods with machine learning, and you will own the architecture and roadmap that take... 
    Full time

    zoox

    Foster, CA
    9 hours ago
  •  ...Specification: Design, train, and evaluate ML models Perform feature engineering and data preprocessing Deploy models to production with...  ...model performance and retrain as needed Mandatory Skills: Python, scikit-learn, TensorFlow/PyTorch, Pandas, NumPy, SQL, MLOps... 
    Local area

    OJUS LLC

    Berkeley Heights, NJ
    5 days ago
  • $180k - $200k

     ...Machine Learning Engineer USA based (Fully Remote) $180,000 to $200,000 base + bonus + equity A high-impact Machine Learning Engineering role focused on building and scaling production systems for real-time decisioning. You will join an AI Lab of 15 people and own... 
    Remote work
    Flexible hours

    Harnham

    Phoenix, AZ
    8 days ago
  • $65 - $68 per hour

     ...actively building the next-generation Machine Learning (ML) platform for low-cost, ultra-immersive...  ...-scale data. Our Machine Learning Engineers are excited to work on these challenging...  ...millions of riders. Working closely with a Staff ML Engineer mentor, you'll scope the... 
    Summer work
    Internship
    Work at office
    Local area
    3 days per week

    Lyft

    San Francisco, CA
    4 days ago
  • $150k - $220k

     ...Founding Machine Learning Engineer $150,000 - $220,000 base salary Pittsburgh - Onsite About the company We're partnering with an early-stage physical AI startup in Pittsburgh. They're building the software that helps robots and autonomous machines learn from... 

    Auxo Talent

    Pitsburg, OH
    27 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Machine Learning Engineer. Be the first to apply!