Edge AI Inference Engineer — On-Device ML Systems
Framework Ventures
A technology company in Georgia is seeking a C++ Engineer to own the inference backbone of its AI stack, focusing on deploying models to edge devices. You'll collaborate closely with researchers and manage a cross-functional team to enhance existing products with AI features. The ideal candidate has excellent C++ skills, is familiar with Llama.cpp and ggml, and possesses a solid background in AI and machine learning. This role offers an exciting opportunity to influence the development of next-generation peer-to-peer AI products. #J-18808-Ljbffr Framework Ventures
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Edge AI Inference Engineer — On-Device ML Systems in New York, NY vacancy
- ...job You will own the inference backbone behind QVAC's local AI stack: the C++ systems layer that makes models... ...The role is centered on engineering quality at runtime... ...directly enables private, on‑device AI experiences and... ...learning models to edge devices using the frameworks...SuggestedRemote jobLocal area
$100k - $150k
...leverage cutting-edge technologies to create... ...a skilled Edge AI Engineer to join our dynamic... ...-constrained edge devices, including mobile... ...platforms, embedded systems, and specialized... ...Build cross-platform inference runtimes... ...Runtime, and Core ML Optimize models...SuggestedFull timeH1bLocal areaImmediate startRemote workVisa sponsorshipWork visa$197.3k - $225.1k
...Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry... ...time, our applications of AI & ML are bringing humanity and...SuggestedFull timePart timeLocal areaCapital One
New York, NY4 days ago- ...healthcare. Our AI sensing platform... ...an Applied AI Engineer to take our... ...foundation models and ML components from... ...cloud and edge deployments, and some of the systems you'll touch are... ...Deploy across our inference surfaces: third-... ...implementations Medical devices, SaMD, or other...Suggested
Norbert Health
Brooklyn, NY3 days ago $12 per hour
...Unicorn, $1B+). 6 AI patents. Enterprise... .... Founding AI Engineer (Applied ML / Vision + LLM) Engineer... ...the nervous system for construction.... ...You'll turn cutting‑edge LLM and vision research... ...sites and mobile devices. About the Role... ...of optimizing inference costs What You'll...SuggestedFull timeFor contractorsRemote workFlexible hours$197.3k - $225.1k
Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry... ...time, our applications of AI and ML are bringing humanity and simplicity...Local area$85 per hour
...technical talent with leading AI research labs. Headquartered... ...Jack Dorsey . Position: ML Engineer (Coding Agent Experience) Type... ...model training , inference systems , MLOps , and LLM applications . Identify bugs, edge cases, performance issues, and...Remote jobContract workSummer workMercor
New York, NY10 days ago- ...looking for an experienced embedded software engineer to join their team. You will work on... ...solutions using machine learning on embedded devices. As part of the team, you'll connect... ...the functionality of machine learning on edge devices. Applicants should have at least...
$229.9k - $262.4k
Senior Lead AI Engineer (FM Hosting, LLM Inference) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an... ...real time, our applications of AI & ML are bringing humanity and simplicity...Full timePart timeLocal area- ...Senior AI Engineer Washington D.C. / New York Senior... ...supporting the cutting-edge development of credit scoring... ...of machine learning (ML) models, including... ...back-testing, rejection inference, and performance analyses... ...models into production systems, ensuring scalability...Flexible hours
VantageScore®
New York, NY3 days ago - ...Founding AI Engineer (AI + Production) New York City (5... ...breakthroughs into production systems that ship-and push... ...failures, and scaling inference-then immediately applying... ...team to access cutting-edge tools (NeMo, Modulus,... ...integration, and the entire ML ops stack Mentor and...Immediate startWeekend work
Everstar Inc
New York, NY3 days ago - ...leading executive search firm is currently seeking an FAE for a cutting-edge semiconductor company. This remote position will allow you to leverage your deep knowledge of embedded systems and AI/ML to assist customers and deliver technical training. The ideal candidate...Remote job
- ...Join the Future of AI at Tessera Labs... ...build multi-agent AI systems that can automate complex... ...a top-quality AI engineer with a strong focus... ...about AI, ML, and AI agents, we... ...or GCP. Deploy inference endpoints and serve... ...take pride in cutting-edge AI, value clear ownership...
Tessera Labs
New York, NY3 days ago - ...AI Solutions Engineer Baseten powers mission-critical inference for the world's most dynamic AI companies. By... ...of AI to bring cutting-edge models into production.... ...and maintain software systems and product features using... ...to its relevance in ML projects. Drive customer...Work experience placementFlexible hours
BaseTen
New York, NY3 days ago $172k - $349k
...AI Solution Engineer This role has been designated as 'Remote... ...Enterprise is the global edge-to-cloud company... ...~ Competency writing ML code (for example, using... ...with Python, Unix-like systems. ~ Ability to quickly... ...learning model training or inference, and how model...Work experience placementRemote workWork from homeHewlett Packard Enterprise Development LP
New York, NY3 days ago$250k
Edge AI is a production requirement across automotive, robotics, and... ...deploying models on edge devices rebuilds memory management, platform... ...are doing in the field. Inference latency, memory pressure, thermal... ...Application‑specific memory systems for edge workloads don't yet...$405k
...interpretable, and steerable AI systems. We want AI to be safe... ...committed researchers, engineers, policy experts, and... ...The Role Anthropic's Inference organization serves Claude... ...specialization, and edge cases stitch back into... ...systems engineering or ML infrastructure, with the...Visa sponsorship- Pivotal Health is seeking a Senior Applied AI/ML Engineer in New York who will design and optimize AI systems to transform healthcare operations. You will work closely with multiple teams to develop scalable solutions that enhance business outcomes. The ideal candidate...
$175k - $250k
...is developing a cutting‑edge autonomous agent... ...market outcomes. The Staff AI Engineer will be responsible for... ...propagation of insights to a system where the fleet gets... ...strategies. Model & Inference Infrastructure Ownership... ...Production ML Engineering: Proven experience...Full timeImmediate startRemote workShift work- A remote-first Voice AI startup is looking for an AI Engineer to join their early team. The role involves building and honing major capabilities for... ...agent, as well as infrastructure for model training and inference. Ideal candidates have a Bachelor's degree in a...Remote job
- ...few years making production LLM systems actually work - not... ...do that at a company where the AI is the product, this is worth... ...the product and hiring a senior engineer to help lead that. This is not... ...not looking for Research or ML backgrounds without production...
$130k - $200k
...fully configurable, content‑rich, AI‑powered platform along with... ...production‑grade agentic systems that audit medical claims end‑... ...weekly. We're hiring an L4 AI Engineer who can step into an ambiguous... ...Required 2‑4 years of applied ML / AI engineering experience with...Flexible hours- ...company is seeking an Application Management Specialist in New York or remote. The role focuses on building AI systems, production ML, and collaborating with engineering teams. Ideal candidates have over 5 years of experience in software development, especially with Python,...Remote job
$180k - $350k
You have built real AI systems that ship, break, and get... ...intersection of reasoning engines, proprietary data, and... ...fine-tune, and deploy ML and LLM-driven systems... ...investors Build and maintain inference pipelines that are fast... ...Hard problems at the edge of AI, data, and...Work at office- ...States (US). Job Duties Build agentic AI systems: Design and implement tool‑calling agents... ...policy enforcement) following MCP protocol. Engineer robust guardrails for safety, compliance,... ..., testing, and launching production ML systems, including model deployment/serving...Hourly payRemote work
- Advatix Inc. in New York is seeking a Founding AI Engineer / Member of Technical Staff to design and ship machine learning systems crucial for public safety. This role involves... ...in software engineering, particularly in AI/ML environments. You'll have a hands-on approach...
$85 per hour
...partnering with a leading AI research lab to... ...realistic machine learning engineering workflows and model... ...involving model training, inference systems, MLOps, and LLM... ...applications. Identify bugs, edge cases, performance... ...judgment to realistic ML engineering scenarios....Remote job- A pioneering VBC technology firm is seeking a Full Stack AI Engineer for a remote opportunity. In this role, you will join a small, dynamic... ...should have extensive experience in building scalable systems, a passion for user experiences, and proficiency in modern technologies...Remote job
- ...Industrial, a leading manufacturer of industrial cooling systems, is seeking an experienced AI Engineer/AI Developer to join our team. This role will work... ...professional, academic, or project‑based experience building AI/ML or intelligent software systems Strong programming...Full timeWork at officeLocal areaMonday to Friday
- Salesforce.com, inc. is seeking a Lead AI Engineer to build next-generation AI and machine learning systems focused on customer success. The role involves designing feedback loops, developing ML models, and owning data and model pipelines. The ideal candidate will have...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Edge AI Inference Engineer — On-Device ML Systems. Be the first to apply!
Related searches
- ai engineer New York, NY
- machine learning ai engineer New York, NY
- ai research engineer New York, NY
- ai ml engineer New York, NY
- senior ai engineer New York, NY
- ai prompt engineer New York, NY
- ai developer New York, NY
- ai engineer remote New York, NY
- system support engineer New York, NY
- system service engineer New York, NY