Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Machine Learning Infrastructure

Whatnot

Join the Future of Commerce with Whatnot! Whatnot is the largest livestream shopping platform in North America and Europe to buy, sell, and discover the things you love. Whether it's trading cards, fashion, electronics, or live plants, our sellers are building real businesses across hundreds of categories. We're building live commerce at a scale that's never been done in the West, and there's no playbook to copy. The people here are shaping how an entirely new industry develops. As a remote co-located team, we're inspired by our values and anchored in hubs across the US, UK, Ireland, Poland, Germany, and Australia. We move fast, stay close to our users, and focus on the work that drives the most impact. We're one of the fastest growing marketplaces and were recently named the #1 Best Startup Employer in America by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion into a business and bring people together through commerce. Role We’re looking for builders–intellectually curious, highly entrepreneurial engineers eager to shape the future of AI and ML at Whatnot. You’ll design and scale the core infrastructure that powers machine learning and self-hosted large language model applications across the company, working side by side with machine learning scientists to bring cutting-edge models into production and unlock entirely new product experiences. This means building systems that make advanced ML dependable and fast at scale–from low-latency, large model serving to distributed training & high-throughput GPU inference. What you’ll do: Own the infrastructure powering AI and ML models across critical business surfaces–supporting growth, recommendations, trust and safety, fraud, seller tooling, and more. Prototype, deploy, and productionalize novel ML architectures that directly shape user experience and marketplace dynamics. Design and scale inference infrastructure capable of serving large models with low latency and high throughput. Build distributed training and inference pipelines leveraging GPUs and both model and data parallelism. Stretch beyond your comfort zone to take on new technical challenges as we scale AI across Whatnot’s ecosystem. US Based: We offer flexibility to work from home or from one of our global office hubs, and we value in-person time for planning, problem-solving, and connection. Team members in this role must live within commuting distance of our New York, Seattle, Los Angeles, and San Francisco hubs. You People who do well at Whatnot tend to be comfortable figuring things out as they go, biased toward action, and genuinely curious about what they're building. They care more about outcomes than credit and stay close to the product and the people using it. As our next AI/ML Platform Engineer you should have 4+ years of professional experience developing machine learning systems and algorithms, plus: Bachelor’s degree in Computer Science, Statistics, Applied Mathematics or a related technical field, or equivalent work experience. 3+ years of software engineering experience building and maintaining production systems for consumer-scale loads. 1+ years of professional experience developing software in Python Ability to work autonomously and drive initiatives across multiple product areas and communicate findings with leadership and product teams. Experience with operational, search, and key-value databases such as PostgreSQL, DynamoDB, Elasticsearch, Redis. Firm grasp of visualization tools for monitoring and logging e.g. DataDog, Grafana. Familiarity with cloud computing platforms and managed services such as AWS Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS, Apache Kafka, Flink. Professionalism around collaborating in a remote working environment and well tested, reproducible work. Exceptional documentation and communication skills. Benefits Flexible Time off Policy and Company-wide Holidays (including a spring and winter break) Health Insurance options including Medical, Dental, Vision Work From Home Support Home office setup allowance Monthly allowance for cell phone and internet Care benefits Monthly allowance for wellness Annual allowance towards Childcare Lifetime benefit for family planning, such as adoption or fertility expenses Retirement; 401k offering for Traditional and Roth accounts in the US (employer match up to 4% of base salary) and Pension plans internationally Monthly allowance to dogfood the app All Whatnauts are expected to develop a deep understanding of our product. We're passionate about building the best user experience, and all employees are expected to use Whatnot as both a buyer and a seller as part of their job (our dogfooding budget makes this fun and easy!). Parental Leave 16 weeks of paid parental leave + one month gradual return to work *company leave allowances run concurrently with country leave requirements which take precedence. EOE Whatnot is proud to be an Equal Opportunity Employer. We value diversity, and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, parental status, disability status, or any other status protected by local law. We believe that our work is better and our company culture is improved when we encourage, support, and respect the different skills and experiences represented within our workforce. #J-18808-Ljbffr Whatnot

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Software Engineer, Machine Learning Infrastructure in New York, NY vacancy
  •  ...AI research, flexible infrastructure, and seamless...  ...help build the platform engineers turn to to ship AI products...  ...THE ROLE As a Software Engineer at on the Training...  ...reinforcement learning systems and continuous...  ...individual with a passion for machine learning and a desire... 
    Suggested
    Flexible hours

    Baseten

    New York, NY
    12 hours ago
  • $230k - $385k

     ...About the Team The Agent Infrastructure team at OpenAI is...  ...debug issues, and develop software just as human SWEs do. Our...  ...the Role As a Software Engineer on the Agent Infrastructure...  ...experience working on large-scale machine learning infrastructure. You know how... 
    Suggested
    Work at office
    Worldwide
    Relocation package

    OpenAI

    New York, NY
    2 days ago
  •  ...you. Team Description The Dropbox Engineering Team builds the technology that creates...  ...the opportunity for impact. Our software engineering team uses a range of...  ...team. Areas of work include Machine Learning Engineers, Infrastructure Engineer, Product SWE Frontend and... 
    Suggested
    Currently hiring
    Worldwide
    Flexible hours

    Dropbox

    New York, NY
    4 days ago
  • $160k - $220k

     ...innovate with new products, software features, and new market...  ...often given as a gift, so our infrastructure must support rapid...  ...apply computer vision and machine learning technology to hundreds of millions...  ...join our small infrastructure engineering team in our NYC and SF... 
    Suggested
    Full time
    Part time
    Flexible hours

    Aura Home, Inc.

    New York, NY
    12 hours ago
  • $160k - $230k

     ...nTop is pioneering the future of engineering design with our advanced software that pushes the boundaries of...  ...worker lifecycles. Hybrid-Cloud Infrastructure: Develop "run-anywhere"...  ...Familiarity: Knowledge supporting Machine Learning workflows, including model serving... 
    Suggested
    Local area

    nTop

    New York, NY
    4 days ago
  •  ...Engineering • Full-time • San Francisco; New York Apply Our mission is to automate coding. The first...  ...and shipping code. About the role The ML Infrastructure team builds large-scale compute, storage, and software infrastructure to support Cursor's work... 
    Full time

    Anysphere, Inc

    New York, NY
    2 days ago
  •  ...Summer '26. Join us in creating technology that extends human thinking. About We're looking for an experienced infrastructure engineer to help build Stream, a new conversational interface. You will be responsible for developing a highly scalable real-time... 
    Summer work

    Sandbar Inc

    New York, NY
    2 days ago
  • $180k - $250k

     ...deliver this vision. Our exceptionally strong team includes software engineers, AI researchers, security engineers, and product designers...  ...As an AI-first company and Senior Software Engineer, Infrastructure at Artemis, you'll own the backbone of a platform that processes... 

    Artemis Global Technologies, Inc

    New York, NY
    1 day ago
  •  ...Normal Team builds foundational software and hardware that help move...  ...industry, critical AI infrastructure, and the broader systems that...  ...an Infrastructure Software Engineer to build the production systems...  ...you can reason about state machines, failure modes, retries, queues... 

    Normal Computing

    New York, NY
    2 days ago
  • $175k - $220k

     ...to transform the world. Join us as we revolutionize video understanding and multimodal AI. About the Role As a Senior Cloud Infrastructure Engineer at Twelve Labs, you’ll build a scalable and reliable infrastructure to power our AI video platform. You’ll collaborate with... 
    Remote job
    Work at office
    Worldwide
    Flexible hours

    Carlsbad Tech

    New York, NY
    4 days ago
  • $250k - $300k

     ...C++ Software Developer Susquehanna is seeking a C++ Software...  ...software applications or HFT infrastructure ~ Strong understanding of...  ...in Computer Science, Engineering, Mathematics or related discipline...  ..., Susquehanna applies machine learning and advanced quantitative research... 
    Work experience placement

    Susquehenna International Group

    New York, NY
    3 days ago
  • $250k - $330k

     ...and grow as a team. About the Team The Infrastructure team builds and operates the foundations...  ...Role We’re hiring a Senior Infrastructure Engineer to design, build, and operate production...  ...AI‑ML/Platform/Voice, with curiosity to learn the rest. Proven track record meeting... 
    Work at office

    Decagon

    New York, NY
    12 hours ago
  •  ...customers. Cohere is a team of researchers, engineers, designers, and more, who are all...  ...-performance, scalable and reliable machine learning systems? Do you want to help define and...  ...engineering experience running production infrastructure at a large scale ~ Experience... 
    Work experience placement
    Work at office
    Remote work

    Cohere

    New York, NY
    1 day ago
  •  ...Senior Cloud Infrastructure Engineer A top-tier quantitative trading firm is hiring a Senior Cloud Infrastructure Engineer to design and...  ...programming, FPGA technology, hardware acceleration, and machine learning. The firm's ongoing investment in top talent and... 
    Work at office
    Worldwide

    Catch Talent

    New York, NY
    18 days ago
  • $174k - $252k

    Senior Software Engineer, Infrastructure, High Performance Networking Apply X Note: By applying to this position you will have an opportunity to share...  ...only, and do not include bonus, equity, or benefits. Learn more about benefits at Google. Responsibilities Write and... 
    Full time

    Google Inc.

    New York, NY
    4 days ago
  • Job Title: Senior DevOps Engineer (Infrastructure & MLOps) Company Overview Prompt is revolutionizing...  ...automated and modern B2B enterprise software to rehab therapy businesses, their...  ...) for both web applications and machine learning models. Build, maintain, and scale... 
    Remote work
    Flexible hours

    Prompt

    New York, NY
    4 days ago
  • $110.4k - $165.6k

     ...leave a positive mark on culture. Software Engineer, Content Engineering (AI Content...  ...downstream discovery systems and video infrastructure. System Integration: Partner with...  ...Basic knowledge of how to serve machine learning model outputs via APIs. Experience... 

    Paramount

    New York, NY
    1 day ago
  •  ...highly skilled and motivated Sr. AI/ML Software Engineer to join our core Platform Team in...  ...contributor to building and scaling the infrastructure that powers FutureSecure.AI's...  ...Innovation: Work with cutting-edge machine learning technology and contribute to a rapidly... 

    Future Secure AI

    New York, NY
    3 days ago
  • $200k - $400k

     ...Senior Data Infrastructure Engineer Decagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences. Our technology enables industry-defining enterprises like Avis Budget Group, Block's Cash App and Square, Chime, Oura... 
    Full time
    Work at office
    Local area

    Decagon

    New York, NY
    9 days ago
  • AI Infrastructure Engineer Job in USA 2026 with H-1B Visa Sponsorship AI Infrastructure Engineer...  ...infrastructure platforms that power machine learning and artificial intelligence workloads...  ...Vision Technologies is a U.S.-based software development and technology... 
    Full time
    H1b
    Remote work
    Visa sponsorship

    NewsNowGh

    New York, NY
    4 days ago
  • A leading technology firm is seeking an experienced Infrastructure Engineer to build and maintain the platform layer for large-scale machine learning workloads. The role focuses on enhancing the reliability and performance of infrastructure supporting AI systems. Candidates... 

    Maxana

    New York, NY
    4 days ago
  • $175k - $220k

    Fireworks AI is seeking a Software Engineer for their Cloud Infrastructure team in San Mateo, CA. This role involves architecting backend systems for scalable...  ...GCP, with strong skills in distributed systems and machine learning tooling such as PyTorch or Kubernetes. The... 

    Fireworks AI

    New York, NY
    12 hours ago
  • Roboflow in San Francisco is seeking a versatile Infrastructure Engineer to enhance our core infrastructure and scale our cloud operations...  ...security best practices. Candidates with a background in machine learning will thrive in our dynamic, fast-paced environment where... 

    Roboflow

    New York, NY
    1 day ago
  •  ...About the role Backend engineering at Mirage isn't narrowly defined. We work across product, platform, and machine learning-building the systems, services, APIs,...  ...including services, APIs, data pipelines, and infrastructure that power our products Solve complex... 
    Full time
    Local area
    Night shift

    Mirage

    New York, NY
    1 day ago
  •  ...our goal is to build software that can dramatically...  ...platform, backed by scalable infrastructure and state-of-the-art...  ...a full-stack software engineer to join our talented,...  ...for high impact while learning and growing with the...  ...engineers to integrate machine learning models and... 

    Inductive Bio

    New York, NY
    3 days ago
  •  ...building the identity trust infrastructure for the digital economy -...  ...Role As a Senior Backend Engineer on the Document...  ...including integration with machine learning models for ID authenticity...  ...delivering production backend software in fast-paced environments.... 

    Socure Inc

    New York, NY
    3 days ago
  • $209k - $313k

     ..., live in the moment, learn about the world, and have...  ..., Spectacles. Snap Engineering teams build fun and technically...  ...and storage systems Infrastructure and large-scale system...  ...and data storage Machine learning and natural...  ...years of post-Bachelor’s software development experience... 
    Work experience placement
    Live in
    Work at office
    Local area

    Snap

    New York, NY
    1 day ago
  •  ...Senior Backend Engineer Courted is the leading AI-powered platform for real estate...  ...We're building at the intersection of machine learning and a massive industry that's just beginning...  ...and async processing Contribute to infrastructure decisions as we scale—caching... 
    Full time
    Work at office
    Shift work
    3 days per week

    Courted

    New York, NY
    2 days ago
  • $110k - $150k

    Overview and Responsibilities The Applied Machine Learning Group is seeking a Software Engineer to build and scale systems that power content understanding...  ...catalog. In this role, you will work on the core infrastructure and internal tools that enable high‑quality metadata... 

    Paramount Pictures

    New York, NY
    12 hours ago
  • $222.22k - $287.5k

     ...is growing fast, and we're hiring Staff and Senior Software Engineers to work on Data Infrastructure at Suno, where you will be responsible for...  ...everything from analytics and experimentation to machine learning and product features. This is a high-impact, senior... 
    Work at office
    Local area
    Immediate start

    SUNO

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Machine Learning Infrastructure. Be the first to apply!