Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ML Infrastructure Engineer

$180k - $250k

GraphOn

About Graphon

Graphon AI is building the pre-model intelligence layer for the next generation of AI. We are developing the context engine layer that solves a fundamental challenge: "What if I could just dump all my data and GPT/Claude/Gemini could smartly reason across it?" Today, this is incredibly difficult due to the limitations of LLM context windows and the fundamental squared scaling inherent to attention mechanisms. While sparse attention and RAG systems attempt to address this, they haven't proven to be robust general solutions.
Our Approach

Pre-model intelligence is our answer. We believe a graph-based approach that analyzes relationships across data on a topological level provides the correct inductive bias for long-context multimodal reasoning.

Just as CNNs provided the bias for spatial invariance in vision, and Transformers established the standard for sequential dependencies in language, our framework provides the structural foundation needed for complex, interconnected data.

We believe the next wave of AI progress will come from better infrastructure around models:
  • Better Memory & Context: Creating truly persistent, scalable state.
  • Better Representations: Moving beyond simple embeddings to relational world models.
  • Universal Infrastructure: A way to stop rebuilding the same context layer for every agent, dataset, and application.
The Team

We are a lean, experienced team that values ownership, pragmatism, and technical excellence. We have raised a significant seed round from top-tier VCs and strategic foundation model providers to scale this new paradigm.
  • Arbaaz Khan, CEO: ex-Amazon; PhD in Robotics and ML.
  • Clark Zhang, CTO: ex-Meta; PhD in Robotics and ML.
  • Deepak Mishra, COO: ex-VC; 10+ years of Enterprise Technology experience.
About You

Required
  • Bachelor's, Master's, or PhD in Computer Science, Machine Learning, Robotics, or a related technical field (or equivalent practical experience).
  • Strong software engineering fundamentals with experience building production systems (Python required; experience with C++/Go a plus).
  • Experience working with machine learning infrastructure , such as training pipelines, inference/serving systems, data pipelines, or model deployment.
  • Familiarity with modern ML stacks (e.g., PyTorch/JAX, GPUs, distributed training or inference).
  • Solid understanding of core systems concepts (version control, Linux, basic networking, CI/CD).
  • High agency and ownership mindset-you identify problems, propose solutions, and drive execution.
  • Pragmatic, "right tool for the job" thinker who enjoys collaborating and iterating quickly.
Nice to Have
  • Experience scaling ML systems in production environments.
  • Experience with distributed systems, large-scale data processing, or GPU optimization.
  • Exposure to multimodal ML, retrieval systems, or graph-based representations.
  • Prior startup experience or comfort operating in ambiguous, fast-moving environments.
Compensation & Benefits
  • Base salary range: $180,000 - $250,000 (depending on experience and level)
  • Meaningful equity with the opportunity to own a real stake in a category-defining company
  • Comprehensive benefits , including health, dental, vision, and competitive paid time off
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the ML Infrastructure Engineer in San Francisco, CA vacancy
  •  ...oprecruiting.comPhone: (***) ***-****Job Title: Machine Learning Infrastructure EngineerLocation: San Francisco, CA Metro Area (100% On-Site)...  ...company is seeking a Machine Learning Infrastructure Engineer to help architect the compute, training, and execution frameworks... 
    Suggested
    Full time
    Work at office
    Flexible hours

    Objective Paradigm

    San Francisco, CA
    4 days ago
  •  ...The RoleAt Mach9, ML infrastructure engineers build and maintain the systems that power production AI models for civil engineering and surveying. Our ML pipeline spans 10,000+ miles of labeled survey data, image segmentation networks, and 3D prediction models serving real... 
    Suggested
    Work experience placement

    Mach9

    San Francisco, CA
    4 days ago
  • $200k - $300k

     ...ML Infrastructure EngineerThe company is building one of the leading AI infrastructure platforms powering document intelligence for modern AI applications.As an ML Infrastructure Engineer, you'll own critical training and inference infrastructure powering production machine... 
    Suggested

    Recruiting from Scratch

    San Francisco, CA
    4 days ago
  • $190k - $250k

     ...Senior ML Infrastructure EngineerGridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical...  ...and Silicon Valley investors.As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core... 
    Suggested
    Local area

    Gridware

    San Francisco, CA
    4 days ago
  •  ...ML Infrastructure EngineerSan FranciscoCompany OverviewEcho Neurotechnologies is an exciting new startup in the Brain-Computer Interface (BCI) space, driving innovation through advanced hardware engineering and AI solutions. Our mission is to deliver cutting-edge technologies... 
    Suggested
    Flexible hours

    Echo Neurotechnologies

    San Francisco, CA
    4 days ago
  •  ...Role Description We are looking to recruit an exceptional Infrastructure Engineer to own and build the backend systems that power machine...  ...Lead technical and commercial discussions with cloud and ML compute providers, including capacity planning, performance,... 

    Maven Robotics

    San Francisco, CA
    3 days ago
  • Anthropic is seeking an engineer for its Safeguards team to own the infrastructure behind cutting-edge AI research. You will build the tooling, pipelines, and production workflows that enable researchers to run experiments, train detection methods, and deploy results at... 

    Neura Market

    San Francisco, CA
    3 days ago
  • Anthropic is seeking an engineer to own the infrastructure behind safeguards research. You will build the tooling researchers rely on to run experiments, train detection methods, and select detections for launch. This role sits between research and production, ensuring... 

    Jobzhr

    San Francisco, CA
    1 day ago
  • $166k - $244k

    A leading technology company is seeking a Research Software Engineer to develop next-generation technologies that enhance communication through advanced software and hardware. This role involves collaborating with researchers, optimizing machine learning performance, and... 

    Google

    San Francisco, CA
    2 days ago
  •  ...moonshot AI lab focused on mechanistic interpretability, new architectures, and pretraining science. As an ML Engineer, you will build and operate the infrastructure enabling cutting-edge research in training and evaluating large models. You will optimize inference and... 

    Tilde Research

    San Francisco, CA
    2 days ago
  • $150k - $250k

    Garuda Ventures is looking for a Senior Software Engineer (IC) to develop cloud and on-prem systems that will power future factories...  ...software and a strong background in backend systems and infrastructure. The position offers a competitive salary range of $150,000—$... 

    Garuda Ventures

    San Francisco, CA
    5 days ago
  •  ...Inc. seeks a Staff / Sr. Machine Learning Engineer for the AI, Search & Knowledge Platforms...  ...Safari. The role emphasizes building ML pipelines, applying NLP and entity linking...  ...on open web content, and advancing ML infrastructure for scalable data processing across billions... 

    Apple

    San Francisco, CA
    3 days ago
  • Parafin, Inc. is seeking a Software Engineer to lead the evolution of its ML Platform within the Infrastructure team. You will build scalable, reliable systems for model experimentation, training, evaluation, inference, and retraining powering underwriting and ML-driven... 

    Parafin, Inc.

    San Francisco, CA
    3 days ago
  • Lantern is seeking a Machine Learning Engineer in San Francisco to scale the core ML platform behind our product. You will own the data ingestion, training pipelines, and the end-to-end ML workflow that generates customer recommendations used across all accounts. We expect... 
    Work at office

    Lantern

    San Francisco, CA
    5 days ago
  • Brain Co. seeks a Machine Learning Engineer to build platform-level ML capabilities that power multiple products across industries. You will work on agent-native systems, foundation models, and production-grade pipelines that improve document extraction, reasoning, and... 

    BRAIN CORP

    San Francisco, CA
    3 days ago
  •  ...Francisco is seeking a Machine Learning Engineer to develop tools for interpretable AI systems. The role involves optimizing ML pipelines, implementing research into production...  ...have over 5 years of experience in ML infrastructure, with expertise in Python and distributed... 

    Goodfire

    San Francisco, CA
    3 days ago
  •  ...environments, in close partnership with Amazon and internal teams across Codex, Research, Safety Systems, and Applied. We're hiring Machine Learning Engineers to build and improve the AI systems that help strategic partners adapt OpenAI models to #J-18808-Ljbffr JobCubby

    JobCubby

    San Francisco, CA
    5 days ago
  •  ...generative AI company, is hiring a Machine Learning Engineer focused on Ads in the San Francisco Bay Area....  ...will work at the intersection of large-scale ML, generative AI, and advertising systems, building models and infrastructure that determine how creative is generated,... 

    Higgsfield

    San Francisco, CA
    5 days ago
  • A leading technology company in San Francisco is seeking an experienced Software Engineer for its Machine Learning Platform team. You will design and build services that support Apple’s machine learning and computer vision efforts. Responsibilities include leading systems... 

    Apple

    San Francisco, CA
    2 days ago
  • CoreWeave, the AI hyperscaler, is seeking a Senior Software Engineer to own the architecture and evolution of core systems in the Weights & Biases platform. You will drive ML Workflows, Artifacts, Registry, Automations, and Launch, collaborating with product, design, and... 

    Weights & Biases

    San Francisco, CA
    1 day ago
  •  ...automate complex construction documents and other workflows using agents and foundation models. As a Machine Learning Engineer on Platform, you will own core ML capabilities end-to-end, push frontier models into production, and enable dozens of institutional workflows with... 

    Socket.dev

    San Francisco, CA
    5 days ago
  • Faire is seeking a Staff Machine Learning Platform Engineer to design, improve, and operate a scalable ML platform that accelerates model training,...  ...Spark, Delta Lake, MLflow, Python and SQL, cloud/infrastructure-as-code, and strong MLOps practices. #J-18808-Ljbffr... 
    Remote job
    Local area

    Faire Inc

    San Francisco, CA
    2 days ago
  • Google Cloud is seeking a Customer Engineer in San Francisco to partner with the technical Sales team and serve as the AI/ML subject matter expert to differentiate Google Cloud for customers. You will help prospects and partners understand Google Cloud, develop cloud architectures... 

    Google

    San Francisco, CA
    4 days ago
  • Sardine is seeking a Senior Data/ML Engineer to own the data and machine learning foundation for compliance decisions. You will design and maintain end-to-end pipelines that transform raw telemetry and signals into features used by models across fraud and KYC on a remote... 
    Remote job

    SARDINE

    San Francisco, CA
    4 days ago
  • Superhuman is building a platform for AI Agents, and as a Machine Learning Engineer you will help accelerate the transformation by integrating advanced ML models into product experiences and shaping an AI-native productivity suite for enterprises. You will own core ML systems... 

    Superhuman

    San Francisco, CA
    2 days ago
  • $292k - $417.2k

     ...ads optimization that shape the future of streaming.We are seeking a Director of Machine Learning Engineering and Infrastructure to lead a hybrid team bridging advanced ML engineering with world-class infrastructure design. In this role, you will own the strategic direction... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    San Francisco, CA
    3 days ago
  • $350k

     ...Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to...  ...Policy commitments. We're looking for an engineer to own the infrastructure behind that research. This is the tooling our researchers rely... 
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Jobzhr

    San Francisco, CA
    1 day ago
  • Radical Numerics in San Francisco is seeking a Member of Technical Staff, ML Product Engineer to develop APIs and systems that support genome-scale workloads. This critical role involves building reliable batch systems and ensuring efficient inference for scientific applications... 

    Jobr

    San Francisco, CA
    5 days ago
  • Brain Co. is building AI-native operating systems for large, regulated institutions. As a Machine Learning Engineer on the Platform, you will develop core ML capabilities—document extraction, model routing, and a unified evaluation system—that support production-grade... 

    AI Chopping Block

    San Francisco, CA
    4 days ago
  • Energy Intelligence in San Francisco is seeking a founding ML Platform Engineer to design and own the core data and ML infrastructure that forecasts load and market prices. You will own the spine: ISO/RTO market feeds, weather and plant telemetry through a feature store... 

    United States Digital Space LLC

    San Francisco, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ML Infrastructure Engineer. Be the first to apply!