Staff Machine Learning Engineer
$210k - $230kELLKAY, LLC
ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY’s solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting-edge technologies and solutions that drive their growth and interoperability strategies.
Today, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today’s data-rich world. ELLKAY's experience, customer-focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy.Job Description:
ELLKAY is seeking a Staff Machine Learning Engineer, AI Systems Integration who can design, integrate, and operate production-grade, autonomous agentic systems across products, data pipelines, APIs, enterprise applications, and workflow engines.
This role sits at the intersection of machine learning engineering, backend systems, integration architecture, and cloud infrastructure. You will be responsible for building the core orchestration runtime, Model Context Protocol (MCP) gateways, enterprise context layers, and automated governance harnesses that allow autonomous and semi-autonomous AI agents to execute multi-step workflows safely and reliably across enterprise ecosystems.
Essential Duties & Responsibilities:
1. Enterprise Context Layer & Data Systems
- Design and implement unified Enterprise Context Layers that combine structured relational/NoSQL data and unstructured document stores into high-performance hybrid retrieval engines.
- Architect real-time streaming ingestion pipelines (e.g., Kafka, EventBridge) balancing recency (via fast-path memory/cache layers) with long-term semantic relevance (via asynchronous vector indexing).
- Enforce granular security policies by embedding Row-Level Security (RLS) and Role-Based Access Control (RBAC) directly into retrieval queries so agents only retrieve context authorized for the active user session.
2. Model Context Protocol (MCP) Gateway Architecture
- Design and maintain enterprise Model Context Protocol (MCP) gateways to seamlessly connect heterogeneous tools, REST/gRPC microservices, and enterprise databases to agent ecosystems.
- Implement dynamic tool discovery mechanisms, schema validation (using Pydantic v2), and authentication delegation (OAuth2 token exchange and dynamic scope validation).
- Build resilient tool execution handles featuring bounded retry loops, fallback routing, circuit breakers, and structured error reporting for agent self-correction during timeouts or malformed tool responses.
3. Agentic Execution Fabric & Orchestration
- Structure multi-agent orchestration runtimes supporting both hierarchical manager-worker state graphs and asynchronous, event-driven agent meshes.
- Architect state isolation models using thread-level persistence snapshots (Aurora PostgreSQL, DynamoDB) to maintain clear agent context boundaries.
- Implement execution circuit breakers (token/depth limits), human-in-the-loop (HITL) escalation boundaries for high-risk actions, and reflection loops for autonomous self-correction.
- Establish automated evaluation harnesses utilizing trajectory benchmarking, tool-selection precision evaluation, held-out test sets, and LLM-as-a-judge scoring to continuously govern system performance at scale.
4. Platform, Infrastructure & Developer Tools
- Build high-performance backend microservices using Python (FastAPI, Pydantic, AsyncIO) and write production-grade Infrastructure as Code using AWS CDK (TypeScript/Python).
- Deploy cloud-native agent runtime environments leveraging AWS Lambda, API Gateway, Step Functions, EventBridge, SQS, ECS Fargate, Aurora Serverless, and DynamoDB.
- Leverage modern AI development tools and agentic coding workflows (e.g., Claude Code, OpenAI Codex, GitHub Copilot) to maximize developer velocity, code quality, and implementation speed.
- Implement full observability across agent execution trajectories using structured logging, distributed tracing (OpenTelemetry, CloudWatch, X-Ray), and token/cost tracking.
Qualifications:
- 10+ years of progressive experience in software engineering, machine learning engineering, or distributed systems, with significant ownership of production platforms.
- Deep Agentic Systems Expertise: Hands-on experience building and deploying stateful agentic workflows, multi-agent frameworks (e.g., LangGraph, AutoGen, CrewAI, Bedrock Agents), dynamic tool/function calling, and agent memory systems.
- Context Layer & Security: Proven track record designing enterprise context engines, hybrid retrieval systems (dense/sparse vector search + re-ranking), and strictly enforcing user-level RLS/RBAC access control within vector/retrieval layers.
- MCP & Tool Integration: Experience architecting tool gateway solutions (such as MCP), contract/schema validation, authentication delegation, and robust error handling for external tool invocations.
- Orchestration & Resiliency: Deep knowledge of state isolation, multi-agent coordination patterns, loop circuit breakers, human-in-the-loop intervention protocols, and automated agent evaluation frameworks.
- Core Tech Stack: Advanced proficiency in Python (FastAPI, Pydantic, AsyncIO). Go/Rust a plus.
- Cloud & DevOps: Deep expertise with AWS services (Lambda, ECS Fargate, Step Functions, EventBridge, DynamoDB, Aurora), AWS CDK, Docker, and streaming/messaging systems (Kafka, EventBridge, SQS).
- AI-Assisted Development: Experience leveraging modern AI developer tools (Claude Code, Codex, Cursor, Copilot) to accelerate architecture design, prototyping, and production engineering.
Preferred Qualifications
- Degree in Computer Science, Machine Learning, Electrical Engineering, or a related quantitative field.
- Experience building or extending enterprise middleware, integration engines, or API gateways (e.g., Workato, MuleSoft, Apache Camel).
- Experience with automated trajectory evaluation tools (LangSmith, Arize, Phoenix, RAGAS) and LLM-as-a-judge methodologies.
Benefits:
ELLKAY offers a comprehensive and competitive benefit package that starts day one!
Including:
- Medical, Dental, and Vision benefits
- Employer-paid Life and LTD
- 401k w/ matching – once eligibility is met
- Work/life balance
- Paid Volunteer Program
- Flexible working hours
- Generous FTO
- Remote work options
- Employee Discounts
- Parental Leave
- Gym membership / Exercise class stipends
Our awesome culture includes:
- Working with talented, collaborative, and friendly people who love what they do
- Professional growth within
- Innovation environment
- On site in HQ Free daily lunches
Awards:
- 2025 Top Workplaces Employee Appreciation
- 2025 Top Workplaces Employee Well-Being
- 2025 Top Workplaces Professional Development
- 2025 Top Workplaces Leadership
- 2026 USA Today Top Workplaces
- 2026 NJ Top Workplaces
Additional information
At ELLKAY, we are committed to operating as a hybrid workplace, offering employees flexibility in how they structure their time between in-office and remote work. We recognize the significance of fostering connections, collaboration, and creativity within our office culture and its positive impact on our business. Our philosophy of operating as a hybrid workplace underscores our dedication to enabling employees to tailor work-life balance to their individual preferences. For those who do not live within 40 miles of one of our offices, we are open to considering remote work for candidates whose skills and experience strongly align with the role. While we prioritize a hybrid work environment for most roles, we understand the importance of flexibility and are open to remote work for specific positions and specialized skill sets.
For more information on our company, visit ;
ELLKAY LLC is a Smoke-Free Workplace.
ELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Compensation Range: $210,000-$230,000
$109.7k - $175.5k
...Sign-In before you apply.Job Description:Job Title: Principal Machine Learning & Silicon Yield EngineerPosition OverviewBroadcom is seeking... ...-Functional Collaboration: Partner with foundry, product engineering, design-for-manufacturing (DFM), DFT engineering teams to drive...SuggestedFull timeLocal area- ...template — we're looking for strong people from varied backgrounds who learn fast, thrive in ambiguity, and can show us what they've built,... ...projects, open-source contributions to major inference engines, or deep-dive technical write-ups.Full-cycle ownership. You can...SuggestedFull timeWork at officeRelocation package
$251k - $310k
Staff/Sr. Staff Machine Learning Engineer - World Modeling, Simulation Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building...SuggestedFull timeRemote work$291k - $409k
...in the most challenging dense urban environments.As a Staff or Senior Staff engineer, you will be the technical lead for CAS algorithms, with... ...world, combining interpretable geometric methods with machine learning, and you will own the architecture and roadmap that take...SuggestedFull timeTemporary workRelocation package$264.8k - $331k
...getting started — this team will define what dependable, production-grade agentic AI looks like.About the RoleAs a Staff Machine Learning Research Engineer, you will operate across the full breadth of AIS’s technical needs — wherever the hardest ML problem in agentic AI...SuggestedFull time- ...means the opportunity to grow faster than ever while doing the most meaningful work of your career. The role We're hiring a Staff ML/OR engineer to define and build the intelligence at the core of Dispatch OS, our platform for ML-assisted dispatch decisions. You'll set...Full time
$132.9k - $234.37k
AI/ML Machine Learning Engineer Herndon, VA Top Secret/SCI Polygraph Unspecified Career Level not specified $132,900 - $234,370 Job Description By bringing together people that use their passion for purposeful innovation, at Lockheed Martin we keep people safe and solve...Full timeTemporary workWork experience placementWork at officeRemote workFlexible hours$298k - $368k
...team builds the system which learns the spatial-temporal representation... ...set of sensors, enabling engineers like you to (1) develop... ...role, you'll report to a Senior Staff Technical Lead Manager. You... ...Computer Science, Robotics, Machine Learning, or equivalent practical...Full timeRemote workShift work$251k - $310k
...team builds the system which learns the spatial-temporal representation... ...set of sensors, enabling engineers like you to (1) develop... ...hybrid role, you'll report to a Staff Technical Lead Manager. You will... ...7+ years experience in Machine Learning and/or Computer Vision...Full timeFlexible hours$26 - $30 per hour
...your place in space. The Aerospace Corporation is hiring a Machine Learning Engineer Undergrad Intern for the Data Science and Artificial... ...Segundo, CA. Information Systems and Cyber Division (ISCD) staff work with the latest in information system technologies, such...Hourly payFull timeTemporary workInternshipWork at officeImmediate startRemote workRelocation packageFlexible hours$29 - $34 per hour
...make smarter decisions, maximize asset performance, and achieve more resilient operations. Description: We're hiring a Machine Learning Engineering Intern who is currently enrolled in a master's program and brings rigorous, logic-driven thinking. You'll work alongside...Hourly payFull timeContract workPart timeSummer workInternshipSummer internshipLocal areaRemote work$32 - $38 per hour
...take your place in space. Aerospace Corporation is hiring Machine Learning Engineering Interns for the Data Science and Artificial Intelligence... ...(ISCD). Information Systems and Cyber Division (ISCD) staff work with the latest in information system technologies, such...Hourly payFull timeTemporary workInternshipWork at officeImmediate startRemote workRelocation packageFlexible hours- ...Worker Type Supplemental Job Description Intern - Machine Learning (Computer Vision) Summary Summer Internship Program Our paid... ...Vision, Machine Learning, Computer Science, Electrical Engineering, or a related field. Familiarity with C/C++ and MATLAB....Permanent employmentFull timeContract workWork experience placementInternshipSummer internshipWork at officeRelocation
$49 - $58 per hour
...business priorities by delivering high-impact work across your area of expertise. About the role KLA is looking for a Machine Learning Engineer Intern to join our algorithms team. You'll work with experienced engineers and scientists to develop machine learning...Hourly payMinimum wageInternship$70 per hour
...simulation across 15+ U.S. states. Software Engineering builds the brains of Waymo's fully... ...robotics, perception, decision-making and deep learning, while collaborating with hardware and... ...PhD or MS program in Computer Science, Machine Learning or a related field, returning...Hourly payFull timeInternshipSummer internshipRelocation package- ...Overview Our Machine Learning Engineering Internship is a 10-week immersive experience designed for students who are passionate about building the systems at the intersection of machine learning, large-scale data, and markets. As a Machine Learning Engineering Intern...Full timeSummer workInternship
$107.66k - $161.7k
...topics and providing a unique platform to learn and connect with others. Poe : a... ...About the Team and Role: Our small engineering team works on challenging problems every... ...product and our company. At Poe, we use Machine Learning in various parts of the product...Remote jobFull timeWork experience placementInternship- ...while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with senior engineers and...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
$62k - $100k
...Description: Job Description About the Role As an AI Engineering team member, you will be instrumental in advancing new features... ...people and offer employees a comprehensive total rewards package. Learn more about what working at Crowe can mean for you! How You...Full timeLocal areaWorldwide$175.04k - $206.46k
...Job Description Original Posting Date: 11/16/26 Job Title: Machine Learning Engineer (multiple positions available) Location: 3410 Hillview Ave., Palo Alto, CA 94304 Work Model: Hybrid work model Purpose and Objective: SAP Labs, LLC seeks a Machine Learning...Permanent employmentFull timeFlexible hours$82.88k - $87.03k
...Job Description Junior Machine Learning Engineering Duration: Permanent Location: Indianapolis, Indiana Why join Rolls-Royce? At Rolls-Royce we are committed to always being a force for progress; powering, protecting and connecting people everywhere....Permanent employmentFull timeInternshipFlexible hours- ...Job Description We are seeking a highly motivated Staff Engineer, Defect Metrology to join our MOCVD team. This role will provide technical... .... Experience applying AI/ML, computer vision, statistical learning, or advanced analytics to engineering problems. Experience...Full time
- ...Technologies, Inc. Job Area: Interns Group, Interns Group Interim Engineering Intern - SW General Summary: About Qualcomm Qualcomm... ...that values collaboration, creativity, and continuous learning. Our programs provide real-world experience, technical skills,...Interim roleSummer workInternshipSummer internship
$215.2k - $245.6k
Machine Learning Engineer 4 - Intelligent Foundations and Experiences (IFX) Do you love building and pioneering in the AI and technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment?...Full timePart timeH1bLocal area$25k
...business value. What you'll do Design, build, and deploy machine learning models and systems that operate reliably at scale in... ...platforms, and real-time inference pipelines Embed on a product engineering team and collaborate closely with data scientists, PMs ,and...Work at officeLocal areaRemote workWork from homeHome officeFlexible hours- ...the most challenging dense urban environments. As a Staff or Senior Staff engineer, you will be the technical lead for CAS algorithms,... ...world, combining interpretable geometric methods with machine learning, and you will own the architecture and roadmap that take...Full time
- ...Specification: Design, train, and evaluate ML models Perform feature engineering and data preprocessing Deploy models to production with... ...model performance and retrain as needed Mandatory Skills: Python, scikit-learn, TensorFlow/PyTorch, Pandas, NumPy, SQL, MLOps...Local area
$180k - $200k
...Machine Learning Engineer USA based (Fully Remote) $180,000 to $200,000 base + bonus + equity A high-impact Machine Learning Engineering role focused on building and scaling production systems for real-time decisioning. You will join an AI Lab of 15 people and own...Remote workFlexible hours$65 - $68 per hour
...actively building the next-generation Machine Learning (ML) platform for low-cost, ultra-immersive... ...-scale data. Our Machine Learning Engineers are excited to work on these challenging... ...millions of riders. Working closely with a Staff ML Engineer mentor, you'll scope the...Summer workInternshipWork at officeLocal area3 days per week$150k - $220k
...Founding Machine Learning Engineer $150,000 - $220,000 base salary Pittsburgh - Onsite About the company We're partnering with an early-stage physical AI startup in Pittsburgh. They're building the software that helps robots and autonomous machines learn from...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Machine Learning Engineer. Be the first to apply!
- staff design engineer United States
- assistant project engineer United States
- assistant process engineer United States
- assistant building engineer United States
- assistant field engineer United States
- assistant chief engineer United States
- assistant civil engineer United States
- engineering aide United States
- staff devops engineer United States
- project engineer assistant project manager United States






