ML Infrastructure Engineer
Echo
Company Overview Echo Neurotechnologies is an exciting new startup in the Brain-Computer Interface (BCI) space, driving innovation through advanced hardware engineering and AI solutions. Our mission is to deliver cutting-edge technologies that restore autonomy to people living with disabilities and improve their quality of life. Team Culture Join a small, dedicated team of knowledgeable and motivated professionals. Our early-stage environment offers the opportunity to take ownership of broad decisions with significant and long-lasting impact. We emphasize continuous learning and growth, fostering cross-functional collaboration where your contributions are vital to our success. Job Summary We are seeking a Senior Machine Learning Infrastructure Engineer to join our team. The person who fills this role will design, build, and scale infrastructure to power massive-scale data, modeling, and analysis platforms, playing a critical role in shaping a high-performance, production-grade ML ecosystem to support rapid experimentation with diverse datasets spanning neural signals, behavior, and more. This person will have significant ownership over the ML R&D platform, working closely with domain experts to architect new cloud infrastructure, data pipelines, and modeling flows. The work will ultimately enable the development of cutting-edge models for neuroscientific discovery and neural decoding, empowering brain-computer interface technology to improve the lives of patients living with severe neurological conditions. Key Responsibilities Create flexible and performant ML infrastructure Design and build systems ML cloud infrastructure to enable massive-scale modeling and analytics Support diverse model exploration, hyperparameter optimization, pretraining, fine-tuning, and evaluation processes Design and optimize scalable distributed training pipelines, with support for features such model sharding, cross-GPU communication, and real-time training monitoring Create, operate, and maintain robust ML platforms and services across the model lifecycle Make informed architecture decisions that balance performance, cost, reliability, and scalability Build diverse and scalable data platforms Design, build, and optimize massive-scale databases and data pipelines for scalable, flexible, and reliable data access Explore research-driven, tailored data solutions using existing and simulated data, comparing performance and efficiency across solutions for typical data-access patterns Create infrastructure and pipelines for ingesting internal and external datasets with varied shapes, formats, and associated metadata Design and assess custom data formats for efficient storage and slicing of high-dimensional time-series data Enable efficient data movement, preprocessing, and artifact management for data lineage and modeling reproducibility Meet company standards for delivered solutions Establish best practices for reliability, observability, reproducibility, and operational excellence across the ML ecosystem Make informed and collaborative decisions with domain experts across the software & ML teams Foster visibility and reproducibility within the company by maintaining extensive documentation of design decisions, evaluations of viable alternatives for selected solutions, pipeline assessments, etc. Support ML R&D operations while preparing for eventual incorporation into product pipelines Required Qualifications Bachelor's degree in Computer Science, Electrical Engineering, or a related technical discipline 5+ years of industry experience in software engineering, large-scale data infrastructure, or systems ML Extensive proficiency in Python Familiarity with PyTorch Experience designing, building, and maintaining high-throughput data pipelines for large and diverse datasets Experience working with distributed-training frameworks (e.g. FSDP, DeepSpeed, Megatron-LM, Ray, etc.) Experience building or optimizing ML training pipelines for transformers or other large neural-network models Demonstrated ability to partner closely with research and modeling teams to productionize workflows Excellent communication and collaboration skills to work effectively on cross-functional and interdisciplinary teams Experience having technical ownership over at least one successfully implemented collaborative project Preferred Qualifications Advanced degree (MS or PhD) in Computer Science, Electrical Engineering, or a related technical discipline Proficiency in C++, Go, CUDA, Rust, and/or Java Experience in data engineering and systems ML for time-series data Deep understanding of the fundamentals of distributed systems, including scalability, fault tolerance, monitoring, observability, scheduling, performance tuning, and resource management Experience with cloud-native environments and orchestration (Kubernetes, Docker, etc.) Experience scaling foundation-model training infrastructure or multi-cluster computing environments What We Offer An opportunity to work on exciting, cutting-edge projects to transform patients’ lives in a highly collaborative work environment. Competitive compensation, including stock options. Comprehensive benefits package. 401(k) program with matching contributions. Equal Opportunity Employer Echo Neurotechnologies is an Equal Opportunity Employer (EOE). We celebrate diversity and are committed to creating an inclusive environment for all employees. Confidentiality All applications will be treated confidentially. Applicants may be asked to sign an NDA after the initial stages of the interview process. #J-18808-Ljbffr Echo
$149k - $186k
We are looking for brilliant software engineers who have a passion for consumer products and... ...systems, and/or machine learning infrastructure, with an understanding of the complexities... ...Familiarity with operational tooling for ML services (monitoring, alerting, etc), and...SuggestedFull timeWork at officeLocal area$224k - $280k
Cssmerge is seeking a foundational Machine Learning Infrastructure Engineer based in San Francisco. You will design ML training infrastructure, scale distributed GPU workloads, and collaborate with researchers. This role offers an ambitious challenge in automating the...SuggestedFlexible hours- We’re looking for an experienced HPC infrastructure engineer to lead bringup, administration, and operations on is probably the largest anime AI training cluster in the world . You’ll serve as the bridge between our researchers and the bare GPU machines, helping to make...SuggestedWork at officeVisa sponsorship
$295k - $380k
OpenAI is seeking a Systems Engineer to work on ML training infrastructure in San Francisco. This role focuses on creating reliable systems for large-scale training, enabling new model approaches while maintaining performance and debuggability. The ideal candidate will...Suggested- cursor in New York, New York, seeks talented engineers to enhance their ML Infrastructure team, focusing on building a robust and scalable coding model. Candidates should be proficient in Python, Golang, Rust, and have a strong background in systems-focused programming...Suggested
- ...looking for a candidate to scale and optimize ML training systems and core model code. You'll manage critical infrastructure for large-scale training, work with... ...Ideal candidates should have strong software engineering fundamentals, experience in JAX or PyTorch,...
- Baseten is looking for a Software Engineer to join their Training Infrastructure team in San Francisco. You'll architect and lead the development of the training... ...extensive experience with Kubernetes, and knowledge of ML workload management. Benefits include competitive...Flexible hours
$275k
Series C Startup | AI-Powered 3D & Avatar Platform | Hybrid (LA or SF) We’re hiring a Senior ML Infrastructure / Backend Engineer to join a well-funded AI company building the visual and interaction layer for the next generation of AI-powered digital identities. This team...Work at office- Atoms, based in San Francisco, is seeking a Machine Learning Infrastructure Engineer to design the ML training infrastructure for autonomous transport models. The role involves scaling distributed GPU workloads, leading to innovations across their platform. Ideal candidates...
$227.2k - $417k
Tubitv is seeking a Software Engineer to join its ML Infrastructure team in San Francisco. You will be responsible for building systems that support machine learning and enhance user experience through scalable architectures. The position requires expertise in languages...Remote workFlexible hours- Mach9 is looking for an experienced ML infrastructure engineer in San Francisco to build and maintain systems powering production AI models. This mid-career role involves designing centralized versioning systems, optimizing real-time inference services, and ensuring reliable...
- Chalk, based in San Francisco, is seeking an exceptional software engineer to partner with machine learning teams. In this role, you will develop bespoke solutions, build efficient feature pipelines, and collaborate closely with customers in healthcare and finance. The...
- ...Role Description We are looking to recruit an exceptional Infrastructure Engineer to own and build the backend systems that power machine learning... .... Lead technical and commercial discussions with cloud and ML compute providers, including capacity planning, performance,...
$224k - $280k
ATOMS Careers page is seeking a Staff Machine Learning Infrastructure Engineer to design and implement ML training infrastructure in San Francisco. The role involves building high-performance training pipelines and managing distributed GPU workloads. Ideal candidates should...$190k - $260k
Role Description As a Senior ML Infrastructure Engineer, you will work directly in the Automation org with the core ML, Ops, and Analytics teams to help improve and build out the infrastructure around model deployment and monitoring. This role is essential to helping scale...- causal, located in San Francisco, is seeking infrastructure engineers passionate about solving unsolved problems in AI. The role involves designing and maintaining large distributed ML training and inference clusters. The ideal candidate should have a deep understanding...
- ...moonshot AI lab focusing on mechanistic interpretability, new architectures, and pretraining science. As an ML Engineer, you will build and operate the infrastructure enabling cutting-edge research and scalable pipelines for training and evaluating large models. You will...
- Gridware in San Francisco is looking for a Senior ML Infrastructure Engineer to design, build, and maintain their ML deployment infrastructure. This role will involve creating monitoring systems and collaborating with engineering teams to improve CI/CD pipelines. The ideal...
$166k - $244k
A leading technology company is seeking a Research Software Engineer to develop next-generation technologies that enhance communication through advanced software and hardware. This role involves collaborating with researchers, optimizing machine learning performance, and...- ...is looking for a Member of Technical Staff, specializing in ML Infrastructure and Inference, focused on building and optimizing scalable systems... .... The ideal candidate will possess strong software engineering fundamentals, experience with model serving, and proficiency...
- Maven Robotics, located in San Francisco, is seeking an Infrastructure Engineer to lead the design and implementation of our machine learning infrastructure. This role involves managing backend systems that aid our innovative robotics and AI teams. The ideal candidate will...
$200k - $240k
Voxel is seeking a Software Engineer to develop and optimize ML Infrastructure in San Francisco. You will build systems for training multiple vision models, manage ML experiments, and establish best practices on AWS. The role demands strong Python skills and the capacity...Flexible hours$176k - $230k
Atoms, based in San Francisco, is seeking a Software Engineer to join our Machine Learning and AI Infrastructure team. You will build and maintain software for managing ML technologies, enabling data scientists to optimize their workflows. Ideal candidates have a strong...Flexible hours- OpenAI seeks a Senior Software Engineer for the Robotics team in San Francisco, CA. In this... ...enhance the training framework, debug ML systems, and support engineers and researchers... ...and have experience with ML systems and infrastructure components. The position offers a...Relocation package
$176k - $230k
ATOMS Careers page is seeking a Senior Software Engineer focused on Machine Learning Infrastructure in San Francisco. This role involves working on ML and AI tools that empower data scientists. Candidates should have 3+ years of software engineering experience, proficiency...Flexible hours- Cssmerge is seeking a skilled Software Engineer in San Francisco to work on their Machine Learning and AI Infrastructure team. This position involves building tools that assist data scientists in managing the full lifecycle of machine learning projects. The ideal candidate...
- A leading biotech company is seeking a Senior Machine Learning Engineer to join its Machine Learning Science team in Brisbane, California... ...designing and building deep learning pipelines and managing AI/ML systems in the cloud. Candidates should have at least 5 years of...Remote job
- The Role: Why, What and the Who Infrastructure Engineers build the foundation for Ivo’s entire platform. Customers are cagey about their contracts... ...(dev → staging → prod). Design strategies to isolate ML vs API workloads while optimizing for cost, performance, and...
$142k - $203k
Early Warning Services LLC is seeking a Senior ML Ops Engineer in San Francisco to enhance our machine learning operations. This role involves designing and maintaining scalable ML infrastructure and collaborating with data scientists and engineers. The ideal candidate...$150k - $250k
Garuda Ventures is looking for a Senior Software Engineer (IC) to develop cloud and on-prem systems that will power future factories... ...software and a strong background in backend systems and infrastructure. The position offers a competitive salary range of $150,000—$...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ML Infrastructure Engineer. Be the first to apply!
- graduate machine learning engineer San Francisco, CA
- junior machine learning research engineer San Francisco, CA
- data scientist machine learning engineer San Francisco, CA
- machine learning engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- machine learning software engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- computer vision machine learning engineer San Francisco, CA
- principal infrastructure engineer San Francisco, CA
