Staff Inference Engineer — Local AI & Performance
Ghost
Ghost, a personal AI hardware company in San Francisco, is hiring an engineer to build and optimize the inference stack that runs personal AI models locally on Core. You will improve latency, throughput and memory efficiency across interactive requests and background workloads, profile across the stack, and collaborate with hardware, post-training and product teams. The role requires strong C++ and Python skills, familiarity with GPU architecture and CUDA/Triton, and on-site work in San Francisco. #J-18808-Ljbffr Ghost
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Staff Inference Engineer — Local AI & Performance in San Francisco, CA vacancy
$170.4 per hour
...about enabling Data & AI teams to solve the... ....Founded by engineers, we leap at every... ...internal teams.As a Staff Backline Engineer,... ...involving model training, inference, Model Serving,... ...workloads.Perform deep technical investigations... ...our page here.Local Pay Range$170.40—$...Local areaPerformanceWorldwideDataBricks
San Francisco, CA8 days ago- ...GroqCore is building a high-performance software stack that converts... ...compute into a token-producing engine This role is for a seasoned engineer... ...individual will work on an inference serving software stack from a... ...while we establish our local Groq office, with the expectation...Local areaPerformanceWork at officeRemote work
Groq
San Francisco, CA2 days ago $244.7k - $279.2k
Staff AI Engineer role (Remote Eligible)At Capital One, we are creating responsible... ...and scalable, high-performance AI infrastructure. At Capital... ..., large language model inference, agents and multi-agent workflows... ...federal, state, and local laws. Capital One promotes a...Local areaPerformanceFull timePart timeRemote workCapital One Group
San Francisco, CA4 days ago$270.4k - $365k
...customer-consumable AI infrastructure.... ...a hands-on Senior Staff role: you will write... ...of a software engineering team. You will lead... ...scale AI training and inference workloads. You... ...we establish our local Groq office, with... ...Standard : High performance isn’t just encouraged...Local areaPerformanceWork at officeRemote workGroq, Inc.
San Francisco, CA3 days ago$244.7k - $279.2k
...responsible and reliable AI systems, changing... ...science and engineering teams to deliver our... ...scalable, high-performance AI infrastructure.... ...large language model inference, agents and multi-... ...00 - $279,200 for Staff AI... ...federal, state, and local laws. Capital One...Local areaPerformanceFull timePart timeRemote workCapital One
San Francisco, CA4 days ago$286.2k - $326.7k
...Senior Staff AI Engineer (Remote Eligible) At Capital One, we are creating... ...experiences and scalable, high-performance AI infrastructure. At... ...training, large language model inference, agents and multi-agent workflows... ...federal, state, and local laws. Capital One promotes a...Local areaPerformanceFull timePart timeRemote workCapital One
San Francisco, CA3 days ago- ...Member of Technical Staff - Partner Inference Engineer About LiquidAI Spun out of MIT CSAIL, we build general-purpose AI systems that run efficiently across deployment targets... ...power and thermal, and can explain where performance was lost. Wants the partner-facing...PerformanceImmediate startRemote work
Liquid-Ai
San Francisco, CA1 day ago $180k - $240k
...Member of Technical Staff (LA) – AI Engineer Palo Alto, CA NTT DATA AIVista... ...) AI infrastructure and inference systems Data processing... ...understand tradeoffs involving performance, scalability, reliability,... ...federal, state, or local law. #J-18808-Ljbffr...Local areaPerformanceWork experience placementFlexible hoursNTT DATA AIVista
San Francisco, CA5 days ago$224k - $336k
...Staff / Principal Research Engineer, AI Safety Mitigations Cambridge, MA USA; London,... ...use, alongside practical performance constraints. Use adversarial... ...training, post-training, inference and platform teams to... ...international salaries are set to local market. Expected Base...Local areaPerformanceFull timeWork at officeFlexible hoursShift workLila Sciences, Inc.
San Francisco, CA2 days ago- ...Sail builds the world’s most efficient software for inference and agent hosting. In this role, you’ll own token processing down to the lowest layers of the stack, optimize kernel performance, develop new request scheduling and parallelism strategies, and help us use a...Performance
SAIL
San Francisco, CA3 days ago $215k - $260k
...the only vertically integrated AI infrastructure company built... ..., and be part of a high-performing team that believes in each other... ...production. That means owning the inference stack end to end: profiling... ...work directly with customer engineering teams to tailor deployments...PerformanceTemporary workCrusoe
San Francisco, CA8 days ago$240k - $360k
...looking for a Senior Staff Data Engineer to be the technical backbone... ...as the company's AI ambitions scale. You'... ...reliability, performance, cost, and long-term... ...supports model training and inference workflows reliably.... ...by federal, state or local law. We also consider...Local areaPerformanceWork at officeImmediate startRemote workWorldwide3 days per weekHinge Health
San Francisco, CA7 days ago$246k - $340k
...financial lives. We're hiring a Staff AI/ML Engineer on our Lending and Cashflow... ..., batch and real-time inference, monitoring, and retraining... ...right one Connect model performance to member outcomes and business... ...your time off to support local community organizations of...Local areaPerformanceFull timeWork at officeRemote workChime
San Francisco, CA5 days ago$250k - $320k
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking for a software engineer, reliability-minded but still... ..., tools, and architecture that improve the performance, latency, throughput, and efficiency of our model inference...PerformancePermanent employmentFull timeTogether Computer Inc
San Francisco, CA2 days ago$222.72k - $389.75k
...Possible.At Pinterest, AI isn't just a feature, it... ...’re looking for an ML engineer with experience in ads... ...to drive ads delivery performance and maximum ROI for advertisers... ...learning.Proven Staff-level technical leadership... ...federal, state or local laws. We also consider...Local areaPerformanceWork at officeRelocationRelocation packagePinterest
San Francisco, CA6 days ago$190k - $285k
P-1504The Applied AI team at Databricks sits at the forefront... ...we are seeking multiple GenAI Engineers from junior levels to more... ...impact the capabilities and performance of Databricks' products and services... ...is in visit our page here.Local Pay Range$190,000—$285,000...Local areaPerformanceWork at officeWorldwideDataBricks
San Francisco, CA8 days ago$231k - $318k
...belief that the future is local. Independent retailers... ...less like a search engine and more like a trusted... ...and what will sell.As a Staff Engineer on the Search... ...recommendations, and Gen-AI experiences that drive... ...into a cohesive, high-performance system.You’re excited about...Local areaPerformanceWork experience placementWork at officeRemote workMonday to FridayFlexible hours3 days per weekFaire
San Francisco, CA4 days ago$222.72k - $389.75k
...It’s Possible.At Pinterest, AI isn't just a feature, it's... ...process here.We’re hiring a Staff Machine Learning Engineer to help drive the future of... ...for quality, safety, and performance.Design systems with strong... ...applicable federal, state or local laws. We also consider qualified...Local areaPerformanceWork at officeRelocationRelocation packagePinterest
San Francisco, CA8 days ago$210k - $260k
...The ideal candidate is local to and interested in working... .... Machine Learning Engineers at Rocket Money further... ...that support various AI product initiatives. We... ...on end users. At the Staff level, Machine Learning... ...systematic assessment of model performance, supporting rapid...Local areaPerformanceWork at officeRocket Money
San Francisco, CA3 days ago- DescriptionAbout the RoleAs a Staff AI Engineer at Innovaccer, you will be one of our most senior... ...flows around them, and ensuring they perform reliably in production.Own technical architecture... ...protected by federal, state or local law including, without limitation, race...Local areaPerformanceFull timeTemporary workImmediate start
Innovaccer
San Francisco, CA8 days ago $203.5k - $299.3k
...RoleWe are hiring a Causal Machine Learning Engineer to help build the causal ML foundation... ...…Deep practical experience with causal inference, econometrics, experimentation, or... ..., and market conditions. Base salary is localized according to an employee’s work location...Local areaHourly payWork at officeRemote workFlexible hoursDoordash
San Francisco, CA8 days ago$152.9k - $210.2k
...experiences and devices.As a Staff QA Engineer in the Dolby Cinema QA group,... ...partners and help advance practical AI-assisted QA tools that... ...and supporting infrastructure. Perform hands-on functional,... ...classification protected by federal, state, and local laws and ordinances.Local areaPerformanceFull timeWork at officeWorldwideDolby
San Francisco, CA6 days ago$192k - $260k
...running the world's best data and AI infrastructure platform so... ...their business. Founded by engineers — and customer obsessed — we... ...-end architecture, including performance, accessibility, security and... ...location is in visit our page here.Local Pay Range$192,000—$260,000...Local areaPerformanceWorldwideDataBricks
San Francisco, CA8 days ago- ...leading security-first enterprise AI company. We build cutting-... ...is a team of researchers, engineers, designers, and more, who are... ...strong talent and raise team performance, building leadership capability... ...75/£75 or equivalent in your local currency for lunch. ~ Full...Local areaPerformanceFull timeWork at officeRemote workHome office
Jaide Health
San Francisco, CA16 hours ago $126k - $204.5k
...Integrity, and Inclusion. We weave AI into the fabric of everything... ...looking for an Infrastructure Engineer to build developer tooling... ...end development lifecycle, from local development tools, CI/CD,... ...traffic loads, optimizing for performance, cost-efficiency, and near real...Local areaPerformanceFull timeRemote workPalo Alto Networks
San Francisco, CA6 days ago- ...location that support their best performance, while committing to... ...powers our subscription revenue engine by delivering the systems that... ...an agentic engineering team. AI agents (Claude Code, shared agent... ...international currencies and local methods. Ensure compliance...Local areaPerformanceFor contractorsWorldwideHome officeFlexible hours
Scribd, Inc.
San Francisco, CA1 day ago $249.12k - $367.92k
...are the Data Foundation & AI team within Plaid’s Data organization... ...across Plaid.As a Staff Machine Learning Engineer, you will lead the technical... ...to measure model performance across diverse use cases and... ...applicable federal, state, and local laws. Plaid is committed to...Local areaPerformanceWork experience placementWork at officeImmediate startPlaid Financial
San Francisco, CA7 days ago$159.2k - $301.6k
...and security analytics.As a Staff Security Data Engineer, you will own full-system... ...pipeline health, and query performance.Lead diagnosis and resolution... ...innovations, including AI-assisted engineering and operational... ...accordance with state and local laws and “fair chance”...Local areaPerformanceFull timeTemporary workWorldwideAdobe Systems
San Francisco, CA8 days ago- ...Staff Full-Stack Engineer (L5)Envoy protects the places the world relies on most... ...security, availability, and performance of the systems your team... ...architectures.Experience applying AI-assisted tools or workflows... ...characteristic protected by local, state or federal law....Local areaPerformanceWork at officeMonday to Thursday
Envoy
San Francisco, CA3 days ago $192k - $260k
...running the world's best data and AI infrastructure platform so... ...their business. Founded by engineers — and customer obsessed — we... ...-end architecture, including performance, accessibility, security and... ...is in visit our page here . Local Pay Range $192,000 — $260,000...Local areaPerformanceWorldwideFlexible hoursDatabricks
San Francisco, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Inference Engineer — Local AI & Performance. Be the first to apply!
Related searches
- project engineer assistant project manager San Francisco, CA
- staff security engineer San Francisco, CA
- staff engineer San Francisco, CA
- research assistant engineering San Francisco, CA
- senior staff systems engineer San Francisco, CA
- engineering aide San Francisco, CA
- senior staff engineer San Francisco, CA
- assistant engineering manager San Francisco, CA
- assistant chief engineer San Francisco, CA
- staff data engineer San Francisco, CA