Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Hardware/Software Co-Design Engineer, Inference

$192k - $278k

Google

Drive the definition and optimization of the hardware/software stack to enable performant training and serving of large ML models.Collaborate with research and modeling teams to innovate on model architectures, focusing on scaling, quality, and their direct impact on hardware performance.Lead the development of configurable architectural simulators and cycle-accurate performance models to quantify microarchitectural optimizations and evaluate architectural decisions.Conduct system-level performance analysis across highly distributed ML systems, innovating new methodologies to balance compute, memory bandwidth, and inter-chip network requirements.Engage with partners across hardware design, compiler development, and ML research to transition architectural innovations from concept to production.Minimum qualifications:Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, or a related field, or equivalent practical experience.10 years of experience in computer architecture, chip architecture, or hardware-software co-design.Experience developing systems for performance modeling, simulation, or system analysis.Preferred qualifications:Master's degree or PhD in Electrical Engineering, Computer Engineering or Computer Science, with an emphasis on computer architecture.Experience architecting hardware solutions or performance optimizations for ML training and inference.Experience with deep learning frameworks such as TensorFlow or PyTorch.Deep understanding of ML trends, business drivers, and the software ecosystem.Ability to engage and collaborate with hardware designers, software architects, and ML researchers.In this role, you’ll work to shape the future of AI/ML hardware acceleration. You will have an opportunity to drive cutting-edge TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. You’ll be part of a team that pushes boundaries, developing custom silicon solutions that power the future of Google's TPU. You'll contribute to the innovation behind products loved by millions worldwide, and leverage your design and verification expertise to verify complex digital designs, with a specific focus on TPU architecture and its integration within AI/ML-driven systems. In this role, you will act as a key technical anchor bridging the gap between model architecture innovation and next-generation hardware design. You will operate cross-functionally across AI research and engineering, help shape the architectural roadmap for future machine learning serving and training capabilities. You will drive the integration of Machine Learning (ML) research such as the training and serving of massive foundation models with advanced silicon architectures to deliver industry-leading, high-performance, and power-efficient accelerators.The AI and Infrastructure team is redefining what’s possible. We empower Google customers with breakthrough capabilities and insights by delivering AI and Infrastructure at unparalleled scale, efficiency, reliability and velocity. Our customers include Googlers, Google Cloud customers, and billions of Google users worldwide.We're behind Google's groundbreaking innovations, empowering the development of AI models, delivering unparalleled computing power to global services, and providing the essential platforms that enable developers to build the future. From software to hardware our teams are shaping the future of world-leading hyperscale computing, with key teams working on the development of our TPUs, Vertex AI for Google Cloud, Google Global Networking, Data Center operations, systems research, and much more.Individual pay is determined by factors including job-related skills, experience, and relevant education or training. US: $192000 - $278000 (USD) + 20% bonus target + equity + benefitsLearn more about benefits at Google.Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, or a related field, or equivalent practical experience.10 years of experience in computer architecture, chip architecture, or hardware-software co-design.Experience developing systems for performance modeling, simulation, or system analysis.

Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Hardware/Software Co-Design Engineer, Inference in Sunnyvale, TX vacancy
  • $192k - $278k

     ...) or SystemVerilog-AMS.Design, implement, and maintain...  ...s degree in Electrical Engineering, Computer Engineering,...  ...shape the future of AI/ML hardware acceleration. You will...  ..., and mixed-signal co-simulation.The AI and Infrastructure...  ...build the future. From software to hardware our teams... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $116k - $165k

     ...clock control subsystem's design micro-architecture specifications...  ...'s degree in Electrical Engineering, Computer Engineering,...  ...shape the future of AI/ML hardware acceleration. You will...  ...require you to coordinate and co-design with our software and system hardware... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    22 hours ago
  • $147k - $210k

    Design, develop, test, deploy, maintain, and improve software. Manage individual project priorities, deadlines, and deliverables...  ...direction for research where engineering gaps are identified that merit...  ....2 years of experience with hardware design, and data structures or... 
    Software

    Google

    Sunnyvale, TX
    2 days ago
  • $163k - $236k

     ...physical package substrate design of large form-factor...  ....Manage and drive co-design initiatives across...  ...thermal, and mechanical engineering teams to refine and optimize...  ...the next generation of hardware experiences, delivering...  ...build the future. From software to hardware our teams... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    3 days ago
  • $192k - $278k

     ...embedded bridges, and co-packaged optics (CPO) modules...  ...electro-optical co-design across silicon...  ...readiness, while mentoring engineers, fostering technical excellence...  ...the next generation of hardware experiences, delivering...  ...build the future. From software to hardware our teams... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $163k - $236k

     ...RTL models and tests on hardware emulation platforms....  ...with firmware, system software, and post-silicon validation...  ...hardware/software co-verification, shift-left...  ...s degree in Electrical Engineering, Computer Engineering,...  ...worldwide, and leverage your design and verification... 
    Software
    Worldwide
    Shift work

    Google

    Sunnyvale, TX
    1 day ago
  • $100k - $136k

    Senior Digital Hardware EngineerSyracuse, New York$100,000 to $136,...  ...technology manufacturer that designs equipment for U.S. Department...  ...The Senior Digital Hardware Engineer will lead hardware design work...  ...VivadoExperience with RF systems or software defined radio (SDR)... 
    Software

    iLocatum Recruiting

    Syracuse, NY
    14 hours ago
  • $207k - $300k

     ...ongoing reliability.Develop software that executes in thousands...  ...and decision-making on hardware and software design and deployment.Support emerging...  ....Google's software engineers develop the next-generation...  ...We focus on training and inference acceleration, leading-edge... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    3 days ago
  •  ...Senior Electrical Engineer – Digital Hardware (110-136K) We have a fantastic opportunity available...  ...Responsibilities : · Lead the design and development of advanced digital hardware...  .... Xilinx Vivado. RF Systems or Software Defined Radio (SDR). Digital... 
    Software

    Client Growth Resources

    Syracuse, NY
    22 hours ago
  • $163k - $236k

     ...NPIs that involve technologies, design, development and deployment...  ...scale with full end-to-end software stack for cloud and shared compute...  ...a growth mindset.Engage with engineering directors, product leaders...  ...products (NPI), encompassing hardware and software development.... 
    Software

    Google

    Sunnyvale, TX
    14 hours ago
  • $262k - $364k

    Lead the technical goal, roadmap, and software architecture for hardware/software co-design, optimizing large-scale ML inference and training systems.Design, develop, and oversee...  ...’s degree in Computer Science, Computer Engineering, Electrical Engineering, a related... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    1 day ago
  • $188k - $274k

     ...requirements, define architecture, execute hardware design, and product validation.Lead the bring...  ...cross-functionally with Hardware, Software, Mechanical, Thermal, Validation,...  ...qualifications:Bachelor's degree in Electrical Engineering, Computer Engineering, Physics, a... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    3 days ago
  • $167k - $217k

    Principal Electrical Engineer - Digital Hardware At Hidden Level, we’re building the future of airspace...  ..., or enabling smarter cities. We design, manufacture, and deploy advanced sensor...  ...supporting digital signal processing, software-defined radios, communication systems... 
    Software
    Work experience placement
    Work at office
    Local area
    Flexible hours

    Hidden Level

    Syracuse, NY
    1 day ago
  • $163k - $236k

    Participate in the physical design of blocks.Contribute to the design...  ...'s degree in Electrical Engineering, Computer Engineering, Computer...  ...to shape the future of AI/ML hardware acceleration. You will have...  ...developers to build the future. From software to hardware our teams are... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $236k - $329k

     ...automation roadmap for data center hardware products, setting performance...  ...across NPI, Product Design, Quality, and manufacturing partners...  ...’s degree in Electrical Engineering, Computer Engineering, Computer...  ...inspection sensors) and the software systems required to integrate... 
    Software
    Contract work
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $134k - $174k

    Staff Electrical Engineer - Digital Hardware At Hidden Level, we’re building the future of airspace awareness...  ..., or enabling smarter cities. We design, manufacture, and deploy advanced...  ...Systems, Digital Signal Processing, Software Defined Radios, and RF System Design•... 
    Software
    Work experience placement
    Work at office
    Local area
    Flexible hours

    Hidden Level

    Syracuse, NY
    4 days ago
  • $138k - $197k

     ...verification of complex digital design blocks by understanding the...  ...and interacting with design engineers to identify important verification...  ...to shape the future of AI/ML hardware acceleration. You will have...  ...to build the future. From software to hardware our teams are shaping... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    14 hours ago
  • $280k

    Job title: ASIC Design Engineer, RTL (Senior/Staff/Principal)Location: San Jose, CA or Colorado Springs, CO (on-site)Salary: $280k-580k total compHelp design the chips that move...  ...day to day with verification, firmware, software, emulation and validation engineers across... 
    Software

    CyberCoders

    Sunnyvale, TX
    3 days ago
  • $138k - $197k

     ...verification of complex digital design blocks by fully understanding...  ...and interacting with design engineers to identify important...  ...to shape the future of AI/ML hardware acceleration. You will have an...  ...developers to build the future. From software to hardware our teams are... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $163k - $236k

     ...verification of complex digital design blocks by understanding the...  ...and interacting with design engineers to identify important verification...  ...to shape the future of AI/ML hardware acceleration. You will have...  ...to build the future. From software to hardware our teams are shaping... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    14 hours ago
  • $163k - $236k

     ...portfolio of Cloud products and solutions, engage with engineering directors, product leaders, and other groups to...  ...with new product introduction across software or hardware products (i.e. launching chips and chip design).Experience building and developing infrastructure... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $159k - $230k

    Lead silicon-to-system hardware quality across PCBA, server systems...  ...Drive "shift-left" preventative engineering during Concept, EVT, and DVT...  ..., and establish mandatory design rules for next-generation compute...  ...hardware, firmware, and software domains.Proficiency in querying... 
    Software
    Contract work
    Worldwide
    Shift work
    Early shift

    Google

    Sunnyvale, TX
    14 hours ago
  • $18 - $50 per hour

     ...Siemens Digital Industries Software Strategic Student Program (SSP...  ...the world of computer aided design, 3D modeling and simulation-...  ...We're currently recruiting co-ops and interns for our Spring...  ...a Thermo-Mechanical Product Engineering Intern , you will support the... 
    Software
    Remote job
    Hourly pay
    Full time
    Internship
    Work at office
    Local area

    Siemens

    Syracuse, NY
    2 days ago
  • $188k - $274k

     ...technology roadmap, and board-level design for next-generation platforms...  ...issues, mentoring engineering teams through complex debugging...  ...initiatives with Silicon, Firmware, Software, Thermal, Mechanical, and...  ...Artificial Intelligence (AI) Hardware platforms, including Graphics... 
    Software

    Google

    Sunnyvale, TX
    3 days ago
  • $159k - $230k

    Work closely with hardware design teams and suppliers to understand new project architectures...  ...regulations.Apply Hazard Based Safety Engineering principles to evaluate the hazards....  ...team designs and builds the hardware and software technologies that power all of Google'... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    22 hours ago
  • $138k - $197k

     ...RTL code for complex digital designs.Partner with Verification teams...  ...'s degree in Electrical Engineering, Computer Engineering, Computer...  ...to shape the future of AI/ML hardware acceleration. You will have an...  ...developers to build the future. From software to hardware our teams are... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $138k - $197k

     ...emulation team members in debug of hardware, tooling, and project specific issues, as well as software team members in running and...  ...'s degree in Electrical Engineering, Computer Engineering, Computer...  ...industry experience with RTL design (e.g., Verilog or System Verilog... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    1 day ago
  • $236k - $329k

     ...technical leader with in-depth design and architectural knowledge...  ...Bachelor's degree in Mechanical Engineering, Product Design, a related...  ...external partners to deliver the hardware that powers Google's global...  ...to build the future. From software to hardware our teams are shaping... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    2 days ago
  • $275k - $382k

     ...develop a comprehensive physical hardware roadmap and solutions for...  ...complex trade-offs.Elevate the engineering standards across the...  ...Mechanical Engineering, Product Design Engineering, Physics, a related...  ...developers to build the future. From software to hardware our teams are... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    1 day ago
  • $207k - $300k

     ...enabling Gemma model/runtime co-design (quantization,...  ...performance of on-device model inference via optimizations in...  ...of experience in software development.5 years of...  ...’s degree or PhD in Engineering, Computer Science, or...  ...from low-code APIs to hardware specific acceleration... 
    Software
    Worldwide

    Google

    Sunnyvale, TX
    22 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hardware/Software Co-Design Engineer, Inference. Be the first to apply!