GPU AI Infra Engineer: Production K8s on Bare Metal
vCluster
A leading tech startup is looking for an AI Infrastructure Engineer to drive technical deployments and optimize GPU environments. This role involves deploying and validating Kubernetes, collaborating with customer teams, and documenting procedures. Ideal candidates should have over 5 years of experience with Kubernetes, practical GPU knowledge, and the ability to work in fast-moving environments. We offer competitive compensation, flexible schedules, and a remote-first culture. #J-18808-Ljbffr
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the GPU AI Infra Engineer: Production K8s on Bare Metal in New York, NY vacancy
- ...infrastructure company in the United States is seeking an AI Infrastructure Engineer to enhance customer experiences by setting up production-ready systems. Responsibilities include... .... Ideal candidates have deep expertise in GPU technologies and strong communication skills...SuggestedRemote work
Hydra Host
New York, NY16 hours ago - Senior GPU Systems / AI Infrastructure Engineer (NYC) Location: New York City (Hybrid / On-... ...Series A-C / high-growth AI infra) About the Role We’re... ...comfortable working close to the metal and care about squeezing... ...used at massive scale in production ML workloads #J-18808-...Suggested
- ...As vCluster’s AI Infrastructure Engineer, you will work directly with customers at the earliest... ...stage of their journey: from bare metal GPU nodes through to a production-ready deployment. This is not a... ...to provide GPU-powered managed K8s. Knowledge Transfer: Work...SuggestedRemote workFlexible hours
vCluster
New York, NY2 days ago - ...platform that powers AI at scale. We... ...Factories—high-performance GPU data centers—with... ...running production inference, and developer... ...meets software—the bare metal layer where reliability... ...AI Infrastructure Engineer, you'll work directly... .... Not just managed K8s. NVIDIA GPU stack expertise...SuggestedRemote work
Slope
New York, NY5 days ago - Darwin Recruitment is seeking a Senior GPU Systems / AI Infrastructure Engineer in New York City. This senior-level role focuses on building and optimising AI infrastructure for large-scale model training and inference. Candidates should have 5-10+ years in systems engineering...Suggested
$200k - $300k
...Staff+ Software Engineer, Backend and Infra Haize Labs takes AI-based applications from proof-of-concept to production. We eliminate risk and improve the reliability of LLM-based applications... ...Have built and/or operated large scale, GPU-based model training and serving...Visa sponsorshipHaize Labs
New York, NY3 days ago- ...Adaptive ML is a frontier AI startup building a... ...deploy LLMs into production with measurable... ...role As a DevOps Engineer in our Product... ...coordinating complex GPU infrastructure and... ...Build systematic K8s workflows to deploy... ...administration of long-running bare-metal infrastructure,...Live inWork at officeRemote workRelocationVisa sponsorship
Adaptive ML
New York, NY4 days ago $100k - $200k
...Nscale is seeking a Senior Network Engineer for AI Infrastructure to ensure the operational health of their high-speed interconnects. With 5+ years of experience in network engineering, you'll be responsible for maintaining and optimizing large-scale Infiniband and RoCE...Remote workNscale
New York, NY16 hours ago- ...Lead Platform Engineer (Private Cloud / Bare Metal) New York, NY (Hybrid, 3 days in office) Highly competitive compensation package Join... ...and how to use it for automated remediation to ensure production environments remain performant. Technical Leadership...Work at office
Elliot Partnership
New York, NY4 days ago $199k - $270k
Databricks Inc. seeks a Staff Software Engineer - AI Research Infrastructure in New York, NY. You'll develop and manage the infrastructure for AI research, including designing systems for large-scale experiments and model training. With a BS/MS or PhD in Computer Science...- ...supported the Regular Toilet is looking for a Staff Software Engineer specializing in AI Research Infrastructure. In this role, you will develop... ...to create a powerful pipeline that enhances developer productivity. The position involves design and implementation of large...
- Alignity Solutions is seeking a highly skilled AI DevOps Engineer based in New York, NY, to design and operate scalable infrastructures for... ...Terraform, and cloud infrastructure, with experience managing production-grade AI systems. Responsibilities include deploying,...
$230k - $310k
...capabilities to the world’s biggest AI Labs at industry-defining... ...Role Frontier AI runs on bare metal — and the bare metal it runs... ...Fluidstack's Information Security Engineer for Bare Metal, you'll own... ...golden images that run our production and development environments,...Local areaFluidstack
New York, NY4 days ago$160k - $180k
...Facet is seeking a skilled engineer to orchestrate AI infrastructure and enhance internal platforms. In this role, you will work with serverless technologies to drive efficiency and company growth while maintaining security standards. The ideal candidate has 4-8 years...Remote workFacet LLC
New York, NY3 days ago- ...DevOps Engineer We're building infrastructure to test and secure AI systems under extreme, adversarial,... ...down an AI system in production, we aim to surface it... ...Experience with GPU-based compute (NVIDIA... ...Comfort working with bare-metal or lab hardware (rack-...
Ezkl
New York, NY4 days ago $170k - $210k
...a fast‑growing NVIDIA‑backed AI company enabling AI data centers... ...them. The AI Infrastructure Engineer is responsible for designing,... ...and operates AI capabilities in production. The role requires deep technical... ..., distributed systems, and GPU infrastructure, with a strong...Local areaRemote workFlexible hoursUtilidata
New York, NY16 hours ago$180k - $225k
Scale AI is the data foundation for AI, helping organizations build and deploy reliable production AI applications. We partner with leading enterprises... ...As a Forward Deployed AI Engineer on our Enterprise team, you... ...in a devops, platform, or infra role Familiarity with...Full time$152k - $241.5k
...leading technology company in New York is seeking a Senior AI and FSI Developer Technology Engineer to enhance performance in the Financial Services... ...programming, C/C++, and have a deep understanding of CPU/GPU architecture. The base salary ranges from $152,000 to $2...- ...We’re hiring an Applied AI Engineer to push the boundaries of our Cofounder agent. You’ll own... ...with high ownership across research-to-production: prototyping, instrumenting, evaluating,... ...actions/outcomes Partner with product and infra to define success metrics and ship fast,...Immediate startFlexible hours
The General Intelligence Company of New York
New York, NY16 hours ago $145k - $160k
...accessible for enterprises and AI innovators around the world.... ...global Cloud Compute, Cloud GPU, Bare Metal, and Cloud Storage solutions.... ...experienced Staff AI/ML Infrastructure Engineer to drive the design,... ...complex infrastructure products Proven ability to lead projects...Work at officeImmediate startRemote workFlexible hoursVultr
New York, NY16 hours ago- ...-one problem. He was a humble engineer working on 2G mobile networks... ...what Hotard likes to call the "AI supercycle," it could - as one... ...5G radio access network (RAN) products has been in decline, and Nokia... ...of radio. "We believe that the GPU-based architecture provides...Full timeInterim roleFreelanceShift work
$110k - $140k
...accessible for enterprises and AI innovators around the world.... ...global Cloud Compute, Cloud GPU, Bare Metal, and Cloud Storage solutions... ...and experienced AI Platform Engineer to own the strategy and... ...lifecycle from image build to production. Deep familiarity with GitLab...Work at officeImmediate startRemote workFlexible hoursVultr
New York, NY16 hours ago- ...GPUs. The ideal candidate has experience with modern distributed training frameworks, strong debugging skills, and familiarity with GPU communication libraries. The company offers top-tier compensation, comprehensive health benefits, and a supportive team environment....
- ...Gen AI Python Software Engineer Engineer the future of global finance. At Citi, our Tech team doesn't just support finance – we are helping... ...Citi Tech. Help shape the next generation of AI-powered products in Markets Technology. Join a small, high-impact engineering...Casual workWork from home
Citi
New York, NY4 days ago - ...Role: AI/ML Azure Engineer Duration : Full Time / Contact W2 Location: NYC, NY... ...Deploy, monitor, and manage AI models in production. Implement rigorous security protocols... ...of Python and experience profiling GPU performance and distributed training runs...Full timeWork experience placement
ACI Infotech
New York, NY1 day ago - 6AM City, LLC is seeking an experienced Additive Manufacturing Engineer in New Jersey. In this role, you will develop and execute manufacturing plans for metal additive manufacturing, primarily using Laser Powder Bed Fusion. Responsibilities include managing job scheduling...Hourly pay
- ...A leading technology company is seeking AI Developers to design and implement AI/ML features in a remote role. Responsibilities include... ...for LLMs. Ideal candidates have mid-senior experience in AI product development with strong Python skills and a foundation in ML/DL,...Hourly payRemote work
Rex USA
New York, NY16 hours ago - ...About the team Adaptive ML is a frontier AI startup building a Reinforcement Learning... ...to specialize and deploy LLMs into production with measurable impact. We provide the... ...technologies-particularly through our Adaptive Engine product-to unlock maximum value....Live inWork at officeRelocationVisa sponsorship
Adaptive ML
New York, NY3 days ago - ...A Revenue Performance Agency is seeking a Senior Builder in the United States to own the execution of AI solutions. You will build production-grade applications, manage data pipelines, and integrate systems used by clients. The role requires experience in application development...Remote work
Hiretruss
New York, NY16 hours ago - ...Rearc is seeking a hands-on AI Native Software Engineer to design, build, and deploy AI-driven systems within enterprise environments. The ideal candidate will have 8–10 years of experience in software engineering, expertise in cloud-native architectures, and a strong...
Rearc
New York, NY16 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GPU AI Infra Engineer: Production K8s on Bare Metal. Be the first to apply!
Related searches