Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer (Backend) - AI Infrastructure San Jose, Ca

$158.8k - $190.55k

ESR Healthcare

Senior Software Engineer (Backend) - AI Infrastructure
San Jose, California, United States

Working here means you become part of a vision-driven team that’s ready to tackle challenges and build cutting-edge solutions. We value purpose, drive, and curiosity—and we thrive in a fast-paced, ever-changing environment. Whether in one of our offices in San Jose, CA, Draper, UT, or working remotely, BILLders collaborate to deliver real impact for businesses that need more time in their busy weeks.

Make your impact within a rapidly growing Fintech Company

Join our AI Infrastructure team at the forefront of transforming financial operations for small and mid-sized businesses, which form the backbone of the U.S. economy, contributing to about 1% of the U.S. GDP. Our team is the powerhouse behind a diverse range of AI models — from sophisticated credit models and advanced document understanding to intelligent virtual assistants and groundbreaking new projects on the horizon.

As a Senior Software Engineer, you'll play a pivotal role in shaping the future of fintech by developing cutting-edge solutions that streamline and enhance financial operations. This role offers a substantial scope for impact, allowing you to contribute directly to the success of millions of businesses while working at the intersection of AI, finance, and technology. You will define and execute architectural strategies that address long-term business and technical challenges. You'll have the opportunity to lead initiatives, drive innovations, and deploy models that save our customers time and effort, all within a dynamic, fast-paced environment that values high energy, cross-functional partnership, business acumen, and a strong sense of ownership.

We’d love to chat if you have:

  1. Advanced Degree in Computer Science, Engineering, Mathematics, or a related field, ideally, with a focus on Machine Learning/AI
  2. 5+ years of professional software development experience
  3. Demonstrated expertise in designing, implementing, and deploying scalable machine learning models, especially in the backend
  4. Experience with low latency systems, document understanding/generation, and virtual assistants is highly valued
  5. Skilled in integrations to ingest data sets from various data sources
  6. Experience in model evaluation frameworks to track and improve product/system performance, quality, data management and accuracy
  7. Demonstrated expertise in prompt engineering and fine tuning Large Language Models (LLMs) to drive model quality further
  8. Strong coding skills in Python, Java, or similar, along with experience in ML frameworks (e.g., PyTorch) and cloud services (e.g., AWS, GCP)
  9. Knowledge of CI/CD pipelines and MLOps principles
  10. A track record of successful cross-functional partnerships, with the ability to lead and inspire teams towards achieving shared goals
  11. Innovative Mindset: A passion for staying on the cutting edge of ML/AI technology, with a drive to explore and implement novel solutions
  12. Ownership and Drive: Exceptional problem-solving skills and a proactive approach to tackling challenges, taking ownership from concept through to deployment

The estimated salary range for this role is noted below for our San Jose based role. Our ranges for each role and job level are based on a variety of factors including candidate experience, expertise, and geographic location and may vary from the amounts listed above. The role is also eligible for a competitive benefits package that includes: medical, dental, vision, life and disability insurance, 401(k) retirement plan, flexible spending & health savings account, paid holidays, paid time off, and other company benefits.

San Jose pay range

$158,800-$190,550 USD

#J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer (Backend) - AI Infrastructure San Jose, Ca in San Jose, CA vacancy
  • $150k - $180k

     ...Senior Software Engineer - Core Team - San Jose, CA About ZEDEDA ZEDEDA unlocks the value of AI where it matters most, enabling enterprises to create, secure and operate edge...  ...developing AI agents that run natively in our infrastructure — agents that integrate deeply with our... 
    Senior
    Work at office

    ZEDEDA

    San Jose, CA
    2 days ago
  • $140k - $200k

     ...Senior Software Engineer, Windows/Desktop Applications - San Jose, CA, USA San Jose, CA, USA Mission The mission of Speechify is to make sure that reading...  ...has no office. These include frontend and backend engineers, AI research scientists, and others from Amazon,... 
    Senior
    Work at office
    Remote work

    Speechify

    San Jose, CA
    10 days ago
  •  ...Job Description: AI Infrastructure Engineer San Jose, CA Duration: 6+ months Must have...  ...integrate Nutanix AI, high-speed software-defined storage, and GPU-accelerated...  ...Architect high-performance storage backends using Nutanix Objects (S3-... 
    Suggested
    Full time
    Work at office

    ESR Healthcare

    San Jose, CA
    1 day ago
  • $194k - $410k

     ...Software Engineer - E-commerce Recommendation Infrastructure - San Jose Software Engineer - E-commerce Recommendation...  ...- San Jose Get AI-powered advice on this...  ...Exercising sound judgment. Seniority level ~ Seniority...  ...jobs in San Jose, CA . Mountain View,... 
    Suggested
    Full time
    Temporary work
    Local area

    Tik Tok

    San Jose, CA
    2 days ago
  • $120k - $140k

     ...unlocks the value of AI where it matters...  ...to be onsite in our San Jose Office. This position...  .... We're hiring a software engineer to grow with our...  ...natively in our infrastructure, working alongside senior engineers to ship real...  ...involving backend services or AI/LLM... 
    Suggested
    Permanent employment
    Temporary work
    Internship
    Work at office

    ZEDEDA

    San Jose, CA
    3 days ago
  • $120k - $140k

     ...ZEDEDA unlocks the value of AI where it matters most, enabling...  ...you to be onsite in our San Jose Office. This position is not...  ...curious, self-driven entry level Software Engineer who sits at the intersection of AI and cloud-native infrastructure. You'll work alongside... 
    Permanent employment
    Temporary work
    Work at office

    ZEDEDA

    San Jose, CA
    1 day ago
  • $140k - $200k

     ...has no office. These include frontend and backend engineers, AI research scientists, and others from...  ...low cost through a tight integration of infrastructure, engineering, and research work. We are looking for a skilled Software Engineer to join us. What You’ll Do Be scrappy... 
    Full time
    Work at office
    Shift work

    Speechify

    San Jose, CA
    11 days ago
  • $145k - $165k

     ...Sr. Dev Ops Engineer at Elekta Location: San Jose, CA - 4 days in the office per week Responsibilities Build...  ...Continuously improve the System/DevOps infrastructure. Review technical design developed...  ...3 years’ experience with standard software development lifecycle best... 
    Senior
    Work at office
    Flexible hours

    Elekta AB

    San Jose, CA
    2 days ago
  • $185k

     ...Senior Software Security Engineer Engineering · US, San Jose · Hybrid Who We Are Spectro Cloud lets organizations around the world run AI infrastructure at scale - without losing control. A rapidly growing number of Global 5000 and government organizations across the... 
    Senior
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Skydrop

    San Jose, CA
    2 days ago
  •  ...Role Name - Software Engineer - Backend (Java) Location - San Jose City, CA - Onsite 6-12 Months Contract Job Description As a Software Engineer - Backend (Java) you'll contribute to building robust backend systems. You'll collaborate closely with experienced... 
    Contract work

    AceStack LLC

    San Jose, CA
    5 days ago
  •  ...About the job Software Engineer - Data Security (AI-Driven) | San Jose, CA (Hybrid) Software Engineer Are you ready to join an exciting early-stage start-up that detects active data breaches and protects businesses? Be part of a team thats revolutionizing... 
    Full time
    Contract work
    Worldwide
    Relocation package

    The Valentino Group

    San Jose, CA
    3 days ago
  • $176.3k - $293.7k

     ...Principal Software Engineer- Java (HYBRID San Jose, CA) page is loaded## Principal Software Engineer- Java (HYBRID San Jose, CA)locations: San Jose, Californiatime...  ...fixes. They are also comfortable leveraging modern AI tools to accelerate debugging and development.**What... 
    For contractors
    Work experience placement

    Stryker

    San Jose, CA
    3 days ago
  •  ...Bio-Techne is looking for a Senior Software Engineer in San Jose, CA to lead the development of cloud-native backend systems for AI-driven software solutions. The role requires significant experience in building scalable systems and embedding AI functionalities into software... 
    Senior

    Bio-Techne

    San Jose, CA
    1 day ago
  • $140k - $200k

     .... Overview We're looking for a Senior Software Engineer to join our Core Experiences Team. This...  ...at the intersection of product and infrastructure, thinks strategically, and is passionate...  ...Ship cloud functions, lightweight backend services, and jobs using Kotlin An... 
    Senior
    Remote work

    Speechify

    San Jose, CA
    5 days ago
  •  ...Senior Java Designer/Developer Location: San Jose, CA Rate: DOE $/hr. on W2 only Position Type: Contract Interview Process: Phone Followed by F2F US Citizen, Green Card and GC EAD, H1B Transfer Job Description: SENIOR RESOURCES ONLY • Senior Developer with 8+... 
    Senior
    Contract work
    H1b

    Georgia IT Inc

    San Jose, CA
    5 days ago
  • $134.4k - $168k

     ...is an aerospace company based in San Jose, California building an all-electric...  ...What You’ll Do: As a Full-Stack Software Engineer in the Archer AI team, you will design, develop,...  ...the user-facing interfaces to the backend infrastructure. You will collaborate across the... 
    Senior
    Local area

    INSIDER

    San Jose, CA
    3 days ago
  •  ...LOCALS - Hihgly Preferred Job Title: Python + AI Developer Location: San Jose, CA (Onsite - Day 1) Duration: Contract Job Description...  ...cross-functional teams including data scientists, ML engineers, and product owners. Key Responsibilities... 
    Contract work
    Local area

    AceStack LLC

    San Jose, CA
    5 days ago
  •  ...Senior Software Engineer, Server Fleet Infrastructure Join to apply for the Senior...  ...CoreWeave Get AI-powered advice...  ...and maintain backend services and APIs...  ...in Sunnyvale, CA . Sunnyvale,...  ...0 6 days ago San Mateo, CA $90,00...  ...Platform San Jose, CA $224,000.00-... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Remote work
    Flexible hours

    CoreWeave

    Sunnyvale, CA
    2 days ago
  •  ...Senior Data Engineer Location: San Jose, CA Experience Level: Mid-senior Experience Required: 3 Years Education Level: Bachelor’s degree...  ...balance speed with accuracy, ensuring that our data infrastructure evolves to meet the needs of our growing business.... 
    Senior
    Work experience placement
    Visa sponsorship
    Relocation package

    ESR Healthcare

    San Jose, CA
    2 days ago
  •  ...Power BI + AI developer job at Programmers.io. San Jose, CA. Required Skills and Experience Demonstrated ability to create compelling and insightful dashboards and reports using Power BI and Tableau, including data modeling (DAX) and connectivity to various data sources... 

    Itlearn360

    San Jose, CA
    2 days ago
  •  ...Machine Learning Engineer | Python | Pytorch | Distributed Training | Optimisation | GPU | Hybrid, San Jose, CA Title: Machine Learning Engineer Location: San Jose, CA Responsibilities...  ...Industry Experience: ~3–5 years in ML/AI engineering roles owning training and/or... 

    Enigma

    San Jose, CA
    1 day ago
  • $140k - $200k

     ...no office. These include frontend and backend engineers, AI research scientists, and others from...  ...Inclusivity, we find the need for a Senior iOS Engineer to help us support the new...  ...Programming Working with CI/CD infrastructure Experience with Fastlane SOLID... 
    Work at office
    Remote work

    Speechify

    San Jose, CA
    4 days ago
  •  ...Broadcom Inc. is looking for a Physical Design Engineer to join the ASIC Products Division in San Jose, CA. This role involves working with cutting-edge technology to drive next-gen AI designs while executing Physical Design and Verification processes. The ideal candidate... 
    Senior

    Broadcom Corporation

    San Jose, CA
    3 days ago
  • $129.19k - $214.78k

     ...Software Engineer – Motion & Behavioral Planning San Jose, CA About the Company DiDi's autonomous driving unit was established in 2016 with the mission of developing Level 4 autonomous driving (AD) technology to make transportation safer and more efficient. In August 2... 
    Internship

    DiDi Labs

    San Jose, CA
    2 days ago
  • $150k - $200k

     ...Principal Software/Automation QA Engineer – Logitech – San Jose, CA The Principal Software Automation QA Engineer will lead the quality assurance efforts for...  ...program managers for timely resolution. Tool & Infrastructure Optimization: Work closely with engineers to enhance... 

    Payfuture Technologies

    San Jose, CA
    3 days ago
  •  ...A leading AI hardware company located in San Jose is seeking an IT Engineer to ensure seamless support for high-performance engineering teams. The role involves managing devices, implementing security measures, and driving operational excellence. Ideal candidates will... 
    Senior

    ETCHED LLC

    San Jose, CA
    2 days ago
  •  ...Sr. SAP ABAP Engineer Location: San Jose, CA Position Type: 12 months + Rate: DOE (W2/C2C/1099) US Citizen, Green Card GC EAD, and H1B NEED LOCAL CANDIDATES Skills and Experience: ~ Must have a minimum of 8 + years of ABAP experience in developing... 
    Senior
    H1b
    Local area

    Georgia IT Inc

    San Jose, CA
    5 days ago
  • $163.5k - $212.4k

     ...NIO is seeking a Senior AI Inference Infrastructure Software Engineer in San Jose, CA, specializing in building scalable inference systems for large language and vision-language models. This role requires over 5 years of software development experience and strong skills... 
    Senior

    NIO

    San Jose, CA
    3 days ago
  • $136.8k - $359.72k

     ...Senior Software Engineer - Compute Infrastructure (Orchestration & Scheduling) Location: San Jose Team: Infrastructure Employment Type: Regular Job Code: A228603 About...  ...and offline jobs daily, including AI and LLM workloads. The team is dedicated... 
    Senior
    Temporary work
    Overseas

    ByteDance

    San Jose, CA
    2 days ago
  •  ...& Azure ) Location: San Jose, CA - Onsite 5 days a week....  ...communication: a battle-tested Senior Cloud Architect who is equally...  ...delivering production cloud infrastructure on both Azure and AWS, lead...  ...both "in the weeds" with engineers and "in the boardroom" with... 

    E-Solutions

    San Jose, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer (Backend) - AI Infrastructure San Jose, Ca. Be the first to apply!