Software Engineer - ML Infrastructure [Remote]
$130k - $185kGray%20Swan%20AI
- Remote job
About Gray Swan
Gray Swan is on a mission to empower the world to use AI safely and securely. We evaluate AI models for the leading frontier labs along with building real-time threat detection and adaptive adversarial red teaming agents for teams deploying AI.
We're a team of approximately 70 people, well-funded, growing quickly. Our work directly influences how the world deploys AI agents and systems at scale.
The Role
We’re looking for a Software Engineer, AI Infrastructure to work at the intersection of machine learning, software engineering, and production infrastructure. You’ll partner closely with our ML team to build the systems, tools, and workflows that help move models from experimentation into reliable production environments.
You’ll improve the developer experience around model training and evaluation, build scalable infrastructure to support ML workflows, and help translate customer requirements and policy considerations into practical technical solutions. This role is ideal for a strong software engineer who enjoys solving complex infrastructure challenges while working closely with ML researchers and engineers to accelerate development and deliver real-world impact.
What You’ll Do:
Build and maintain the infrastructure, services, and deployment workflows that enable ML models to move from experimentation into reliable production environments.
Develop internal tools and automation that improve the developer experience for model training, experimentation, evaluation, and iteration.
Design and optimize systems supporting model evaluation pipelines, experiment orchestration, reproducibility, and performance monitoring.
Partner with ML engineers and researchers to identify infrastructure bottlenecks and build solutions that accelerate model development and deployment.
Support customer-specific technical requirements and policy-driven workflows, translating evolving needs into practical, scalable engineering solutions.
Improve the reliability, scalability, and observability of the systems powering our ML capabilities.
Who You Are:
A strong software engineer with experience building and maintaining production-grade systems, services, or infrastructure.
Experienced with Python and comfortable working across backend systems, APIs, and infrastructure code.
Familiar with cloud infrastructure, distributed systems, containerization, or platform engineering.
Knowledgeable about ML workflows, including model training, inference, evaluation, or deployment.
Comfortable collaborating with ML engineers and researchers to translate complex technical requirements into reliable software.
An owner who can navigate ambiguity, identify problems independently, and deliver practical solutions in a fast-moving environment.
Bonus Points If You Have:
Experience building ML infrastructure, ML platforms, or internal developer tooling.
Familiarity with Kubernetes, Docker, and cloud platforms such as AWS or GCP.
Experience with ML infrastructure tools such as Ray, Kubeflow, MLflow, or Weights & Biases.
Experience with model serving, distributed training, inference infrastructure, or large-scale evaluation pipelines.
Exposure to AI safety, AI security, adversarial testing, or model behavior evaluation.
Experience translating customer requirements, security constraints, or policy considerations into technical implementations.
If you don’t have 100% of these, you should still seriously consider applying. We care more about what you can do than your credentials.
You’ll Thrive Here If You:
Enjoy working at the intersection of software engineering, infrastructure, and machine learning rather than staying within a single technical domain.
Are excited to build foundational systems and tooling that help other engineers move faster and work more effectively.
Take ownership of problems from initial investigation through implementation, deployment, and iteration.
Thrive in a fast-moving environment where priorities evolve and there isn't always an established playbook.
Communicate effectively across disciplines and enjoy partnering with researchers, engineers, and other stakeholders.
Care about building reliable, scalable systems that contribute to the safe and secure deployment of advanced AI.
What We Offer:
We offer a competitive compensation package designed to reward impact and incentivize growth. Our compensation philosophy is informed by our current valuation and recent industry data.
Compensation: $130,000 - $185,000 plus performance-based bonus and meaningful equity package.
Benefits:
401k with up to 4% matching
28 days annual leave (vacation + holidays)
Health, dental, and vision coverage
Catered lunches (Pittsburgh office)
Flexible work arrangements
Visa sponsorship available for exceptional candidates
Interview Process
Application review. We read everything; we’ll respond within 10 days.
Recruiter Screen. We learn about you; you learn about us.
Technical interview or Hiring Manager Interview.
Role-related assessment.
Experience & culture interview.
Reference checks. We’ll reach out to 3–5 references that you provide.
Offer. If it’s mutual, we move fast.
How to Apply
Submit your resume, link to your portfolio, and answer the questions on the application.
$184.17k - $276.24k
...operations, systems and safety engineering - all dedicated to... ...pipelines, machine learning infrastructure, and evaluation systems that... ...autonomy behavior evolves from one software release to the next. Our software... ....Our work spans the full ML lifecycle, starting with the...SuggestedPermanent employmentFull timeWork at officeImmediate startVisa sponsorship$174k - $252k
...testing, maintaining, or launching software products, and 1 year of... ...with developing large-scale infrastructure, distributed systems or networks... ....Google's software engineers develop the next-generation technologies... ...that power every stage of an ML/LLM classifier's lifecycle....Suggested$184.17k - $276.24k
...compute systems, test operations, systems and safety engineering - all dedicated to redefining the relationship... ...Calif.Meet the team:We're searching for a Senior Software Engineer to come and join the Runtime Infrastructure Frameworks (RIF) team at Latitude AI. As a member...SuggestedPermanent employmentFull timeWork at officeImmediate startVisa sponsorship$147k - $210k
...experience.2 years of experience with software development in C++ programming language... ...of experience building and developing infrastructure, distributed systems or networks, or experience... ...and machine learning.Google's software engineers develop the next-generation...Suggested$147k - $210k
Software Engineer, AI/ML, ML Infrastructure, Search Ads Share Software Engineer, AI/ML, ML Infrastructure, Search Ads _corporate_fare_ Google _place_ Mountain View, CA, USA; Pittsburgh, PA, USA **Mid** Experience driving progress, solving problems, and...Suggested- ...are currently seeking a qualified Cloud Software Engineer to join our client’s organization and... ...or have transitioned from a Web Dev or ML background, we are looking for someone... ...who can architect a solution, deploy the infrastructure, build the backend, and keep it running...
$207k - $300k
Software Engineer Google's software engineers develop the next-generation technologies that change... .... 5 years of experience leading ML design and optimizing end-to-end Machine... ...building and architecting ML systems and infrastructure (e.g., for model training, evaluation,...Immediate start- Staff Machine Learning Engineer Stack is developing revolutionary AI and advanced autonomous... ...trucking industry's unique demands. The ML Training team is dedicated to increasing... ...by operating across ML Platform, Infrastructure, Autonomy and Safety Evaluation teams to...
- ...role, we are seeking a solid engineer who can take full end-to-end... ...transitioned from a Web Dev or ML background, we are looking... ...architect a solution, deploy the infrastructure, build the backend, and keep... ...What You'll Be Doing As a Software Engineer focusing on cloud...Full time
$197k - $307k
Senior Engineer, ML Infrastructure And Platform Agility's commercially deployed humanoids operate alongside teams in warehouses, manufacturing facilities... ...post-deployment Required Qualifications 5+ years of software engineering experience, with at least 2+ years working on...Full timeTemporary workRemote workRelocation packageFlexible hours$149k - $198.5k
...between our company's expansive data and the engineering teams that rely on it. We architect and operate the core services and infrastructure necessary to transform petabytes of raw... ...our rapidly scaling fleet and sophisticated ML engineering requirements. You will be...Work at officeRemote work$149k - $198.5k
Mission Summary:We are seeking a Senior Software Engineer to join our HIL Infrastructure team to scale and automate our offboard testing workflows to be thorough, efficient, and reliable. As a Senior Software Engineer, you will gain hands-on experience with Motional’s...Flexible hours$182.8k - $247.3k
...world.We’re looking for backend engineers who have experience building... ...be in product engineering, infrastructure, platform engineering, or a combination... ...packaging and advertising to ML-powered personalization. As a... ...ð§ You will...Collaborate on software projects with product design...Work experience placement$95.6k - $188.4k
Position Summary Software Engineer II with Anthropic AI Experience, AI & Engineering/Engineering... ..., data, AI, network, and hybrid cloud infrastructure. These solutions are powered by... ...designing, developing and delivering AI/ML solutionsAt least 6 months of hands-on...Work at officeLocal areaVisa sponsorshipFlexible hoursShift work$179.2k - $268.8k
...operations, systems and safety engineering - all dedicated to... ...as the full offboard/cloud infrastructure for machine learning at Latitude... ...transportation. In the Scalable ML team, we are looking at methods... ...to elevate the team's software development standardsWhat you...Permanent employmentFull timeWork at officeImmediate startVisa sponsorship$118.2k - $177k
...leading global architecture, engineering, and geospatial firm, we... ...communities, strengthen critical infrastructure, advance technology, and... ...OverviewWoolpert is hiring a Senior Software Engineer to join our dynamic... ...with domain experts in AI/ML, Geospatial Data, Software...Flexible hours$126k - $201k
...mobility more efficient and accessible for all.We are seeking a Software Engineer and Machine Learning practitioner to join the Perception... ...from different sensors.Design and implement state-of-the-art ML systems for object tracking and object attribute classification...Work at officeLocal area3 days per week$207k - $300k
Staff Software Engineer, AI/ML, ML Infrastructure, Search Ads Share Staff Software Engineer, AI/ML, ML Infrastructure, Search Ads _corporate_fare_ Google _place_ Mountain View, CA, USA; Pittsburgh, PA, USA **Advanced** Experience owning outcomes and...Immediate start$50 - $90 per hour
Job Title: Sr. Software Perception Engineer Job Description The Sr. Software Perception Engineer designs... ...actively participate in iterative ML training cycles to meet perception performance... ...with ROS or similar autonomous infrastructure software frameworks for robotic...Contract workTemporary work$213k - $263k
Senior Software Engineer, Eval Efficiency & Optimization Waymo is an autonomous driving technology... ...and scalability of our evaluation infrastructure. Collaborate with other engineers, data... ...field Fluency in implementing statistical, ML, and general mathematical algorithms...Full timeRemote work$105.4k - $207.8k
...skilled and client-facing Forward Deployed Engineer (FDE) to sit at the intersection of... ...staying current with the rapidly evolving AI/ML landscape and translating it into client-... ...equivalent field. MBA a plus.5+ years of software engineering experience, with significant...Local area$146k - $234k
...go, and make mobility more efficient and accessible for all. We are seeking a talented and experienced Software Engineer to join our data engineering and infrastructure team. In this role, you will be a key contributor to the design, development, and maintenance of our...Work at officeLocal area3 days per week$124k - $280k
...ApplicableSpecialismData, Analytics & AIManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Senior Engineering Manager, Google Cloud AI/ML you will lead engineering efforts that design, build, and scale AI and machine learning solutions on Google Cloud,...Full timeH1b$99k - $232k
...SectorNot ApplicableSpecialismData, Analytics & AIManagement LevelManagerJob Description & SummaryThe OpportunityAs a Engineering Manager, Google Cloud AI/ML you will lead the design and delivery of Google Cloud AI and machine learning solutions within our Data & Analytics...Full timeH1b- ...Industry and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities... ...Manager, Pre-Sales you support complex software sales cycles by delivering compelling... ...Crime agents differ from rules-based and ML detection. Agents investigate and adjudicate...Work experience placementLive inWork at officeLocal area
- Job-ID: 81715Category: Infrastructure EngineeringLocation: Lake Mary, FL, United States; New York... ...President, AI Infrastructure Support Engineer to join our AI Infrastructure Support team... ..., orchestration, and monitoring of AI/ML workloads across distributed environments...Full timeWorldwideFlexible hours
$75k - $137.5k
...contribute to the company's success. As a Software Engineer (Python, APIs, OCP/Kubernetes, Nvidia GPUs) within PNC''s DNA ML Ops Tech organization, you will be based in... ..., manage, and maintain on-prem GPU compute infrastructure. - Install, configure, and support Linux-based...Full timeTemporary workPart timeWork experience placementWork at office- ...2025315 What We Do: The Carnegie Mellon University (CMU) Software Engineering Institute (SEI) is a premier national research center dedicated... ...architecture and edge system optimization. Practical exposure to AI/ML model training, evaluation, and systems integration Joining...Full timePart timeWork experience placementLocal area
- ...AI Security Software Engineer The CERT Division of the Software Engineering Institute (SEI)... ...threats. As AI becomes central to critical infrastructure, advancing its security and resilience... ..., demonstrating strong expertise in ML development and deployment Collaborate...Full timePart timeRelocation packageFlexible hours
$180k - $290k
...work directly influences how the world deploys AI agents and systems at scale.. The Role Gray Swan is looking for an Infrastructure Engineer to build and scale the systems that power our AI security platform. You'll design the backend services, distributed...Remote jobFull timeWork at officeVisa sponsorshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - ML Infrastructure [Remote]. Be the first to apply!
- senior software design engineer Pittsburgh, PA
- software web developer Pittsburgh, PA
- senior software engineer Pittsburgh, PA
- software developer fintech Pittsburgh, PA
- scientific software engineer Pittsburgh, PA
- senior software engineer ruby on rails Pittsburgh, PA
- software engineer no experience Pittsburgh, PA
- intel software engineer Pittsburgh, PA
- graduate software developer no experience Pittsburgh, PA
- software developer entry level Pittsburgh, PA



