Principal Software Engineer - GPU & Velox Architecture
IBM
Introduction
At IBM Software, we transform client challenges into solutions. Building the world's leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and make an impact on a global scale. Working in Software means joining a team fueled by curiosity and collaboration. You'll work with diverse technologies, partners, and industries to design, develop, and deliver solutions that power digital transformation. With a culture that values innovation, growth, and continuous learning, IBM Software places you at the heart of IBM's product and technology landscape. Here, you'll have the tools and opportunities to advance your career while creating software that changes the world.
Your role and responsibilities
This is a high-impact leadership role pairing directly with the Principal Architect to bridge the gap between GPU hardware acceleration and the Velox execution engine. You will define how Presto utilizes GPU resources for next-gen performance.
Responsibilities:
· Lead the architectural design for bridging GPU compute capabilities with the Velox C++ execution library.
· Collaborate with Presto/Velox architects to define interfaces for heterogeneous computing (CPU/GPU hybrid execution).
· Drive technical decision-making and roadmap planning for the GPU acceleration track.
· Mentor senior engineers and provide technical guidance on C++ internals and vectorization.
Required technical and professional expertise
· 10+ years of software engineering experience, with deep expertise in C++.
· Strong background in Database Internals (Query Execution, Optimizers, Vectorized Processing, columnar processing etc ).
· Experience with GPU architecture (CUDA/ROCm) or integrating hardware accelerators into distributed systems.
· Ability to navigate complex large-scale C++ codebases (e.g., Velox, ClickHouse, Arrow).
· Ability to contribute to design documents and architectural discussions, and to work effectively across a distributed engineering team.
Preferred technical and professional experience
· Experience with Velox / Presto / Trino
· Knowledge of resource management (resource groups, scheduling)
· Experience with fault tolerance / retry mechanisms
· Contributions to open-source systems
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
$96.8k - $251.6k
..., cross-team technical initiatives from architecture through production readiness, with emphasis... ...on OCI Batch, Skydance/SDA acceptance, GPU and 5K scale readiness, Fractional GPU... ...workflows in the cloud while improving the engineering systems, operational practices, and AI-...SuggestedTemporary workFlexible hours- ...the Role We are seeking a Principal Software Quality Engineer to serve as the senior technical leader... ...qualification on AMD Instinct™ GPU platforms. You will set the technical... ...~ Own the end-to-end validation architecture for ROCm - unit, integration, framework...SuggestedContract workShift work
- ...Introduction We are hiring a senior engineer to design and deliver a BYOC (Bring Your Own Cloud) platform... ...AWS (IBM Cloud is a strong plus), with a focus on GPU-enabled infrastructure. This role will lead architecture and implementation of secure, scalable, production...Suggested
$158.74k - $236k
...codebase, adding new features and evolving our next generation architecture. ~Contribute to a team that values code quality,... ...degree or foreign equivalent in Computer Science, Computer Engineering, Software Engineering or related field. Experience Requirements:...SuggestedLocal areaRemote workWorldwide$231.4k - $331.8k
...Join Cisco's distinguished Solution Architecture team within our Common Hardware organization... ...focused on bridging hardware and software-delivering seamless, high-performance networking... ...role in coordinating across multiple engineering and business units, ensuring technical...SuggestedFull timeTemporary workLocal areaFlexible hours$147k - $237.5k
...outcomes. Job Summary The Team Engineering - Our engineering team is at the core... .... Job Description As a Sr Principal Software Engineer within the Engineering team,... ...shaping the future of our network security architecture. This role offers the opportunity to...Full timeWork at office- ...powered IT management and cybersecurity software, serving Managed Service Providers (... ...bar. Job Summary The Principal Software Engineer - Cloud Native and SASE focused will... ...network. This is a hands-on architecture role responsible for defining how customer...Worldwide
$203k - $230k
...technologies with the company's COSMOS software suite to unify diverse components into... ...enabling customers to deploy tailored architectures to meet their unique infrastructure requirements... ...As member of Astera Labs Hardware Engineering team you will be responsible for...Contract workFlexible hours$180k - $205k
...other foundational industries. Our architecture and approachisbased on silicon photonics... ...PsiQuantumalso develops the algorithms and software needed to make these systems... ...at PsiQuantum works closely alongside engineers and scientists in the electronics, system...Full timeShift work$272k - $425.5k
Principal Software Engineer – Large-Scale LLM Memory and Storage Systems page is loaded## Principal Software... ...extensibility, Dynamo orchestrates GPU shards, routes requests, and manages... ...inference.* Partner closely with GPU architecture, networking, and platform teams to...Local areaRemote work$147k - $237.5k
...using the Palo Alto Networks network security portfolio. Principal Software Engineers are: Design and develop high-volume, low-latency... ...alternatives and technologies and presenting these for architectural review. Communicate with devops and cross functional...Full timeWork at office- ...Distributed Software Engineer Bengaluru, Karnataka, India; Sunnyvale CA or Toronto Canada... ...larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens... ...in the world, over 10 times faster than GPU-based hyperscale cloud inference services...
- ...larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens... ...the world, over 10 times faster than GPU-based hyperscale cloud inference services... ...About The Role As a New Graduate Software Engineer, you will collaborate with world-class...Internship
$2,000 per month
...that are hard-coded for individual model architectures. Our first product (Sohu) only supports... ...deep chain-of-thought reasoning. Software Engineer, ML Performance Running millions of... ...candidates may also have experience with: GPU kernel profiling and low-level...Work at officeRelocation package- ...larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens... ...the world, over 10 times faster than GPU-based hyperscale cloud inference services... ...for a deeply technical, hands-on software engineer to join our on-field Kernel Reliability...Internship
$170k - $220k
...Staff Software Engineer, GPU Algorithms We are looking for a full-time Staff Software Engineer, GPU Algorithms with a strong background... ...background in object-oriented programming, software architecture, and design patterns Proficiency with C++ programming...Full time- ...larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens... ...the world, over 10 times faster than GPU-based hyperscale cloud inference services... ...About The Role As a New Graduate Software Engineer, you will collaborate with world-class...Internship
$188k - $275k
...Staff Software Engineer, Compute Architecture Manhattan, NY / Sunnyvale, CA / Bellevue, WA / Livingston, NJ CoreWeave is The Essential Cloud for AI™... ...software systems that operate the backbone of our large-scale GPU data centers. The METALDEV team builds Go-based...Permanent employmentTemporary workCasual workWork at officeFlexible hours$96.8k - $251.6k
...machine instances - CPU and GPU -at global scale. We are hiring... ...scalable, and cost-efficient architectures that deliver consistent... ...reliability. Mentor and guide engineers in distributed systems design... ...Responsibilities: As a member of the software engineering division, you...Temporary workFlexible hours$154k - $286k
...world of technology. We are looking for an experienced C++ software engineer to join the Protium Software Development Team to develop and enhance... ...FPGA-Based Prototyping product which is used by leading CPU/GPU/HyperScaler companies for pre-Silicon software validation of...$154k - $286k
...Cadence C++ Software Engineer At Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology... ...the FPGA-Based Prototyping product which is used by leading CPU/GPU/HyperScaler companies for pre-Silicon software validation of...- ...OneROCm - driving a unified ROCm software stack across AMD's broad... ...across organizations, align architecture with product goals, and influence... ...~ Workload Performance Engineering: Lead the profiling, analysis... ...EXPERIENCE: ~ Knowledge in GPU architectures, basic knowledge...
$175k - $215k
...Semiconductors and Systems Power delivery architectures. At MPS, we cultivate creativity, are... ...senior level position in application/system engineering. Responsibilities include defining... ...cloud computing power solutions for CPU, GPU, ASIC, and SOC. Define and design 48V...Work experience placementWorldwide- ...GPUs. Our novel wafer-scale architecture provides the AI compute power... ...world, over 10 times faster than GPU-based hyperscale cloud... ...loop." You'll sit between engineering, product, and customer-facing... ...People who are serious about software make their own hardware. At Cerebras...
$169.6k
...larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens... ...the world, over 10 times faster than GPU-based hyperscale cloud inference services... ...for Member of Technical Staff (Software Engineer) Title : Member of Technical Staff...Full timePart timeInternshipRemote work$156k - $387.6k
...infrastructure for ByteDance and Volcano Engine Public Cloud. Our mission is to advance the architecture, development, and research of next-generation software-hardware technologies across compute... ...Distributed storage acceleration - GPU virtualization and scheduling for AI...Temporary workLocal area$140k - $240k
...GPUs. Our novel wafer-scale architecture provides the AI compute power... ...world, over 10 times faster than GPU-based hyperscale cloud... ...practices, security-first based engineering. Cerebras cluster involves complex... ...cluster management software stack - all the way from a bare...$163.5k - $212.4k
...simulation platform that powers software-defined vehicle development... ...Using state-of-the-art CPU, GPU, and NPU simulation / emulation... ...a Staff Simulation Software Engineer , you will design and... ...hypervisor technology, hardware architecture, and automotive real-time systems...Full timeTemporary workFlexible hours$175k - $275k
...GPUs. Our novel wafer-scale architecture provides the AI compute power... ...world, over 10 times faster than GPU-based hyperscale cloud... ...RoleAs a lead front-end design engineer, you will be a key part of the... ...verification, physical design, software and system teams to bring...$200k - $220k
...talented, passionate, and committed engineers, technologists, and business... ...an experienced AI Network Software Solution Architect to lead... ...role requires deep expertise in GPU fabric design, high-speed... ...teams. AI-Optimized Network Architecture Design low-latency, high-...Worldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Software Engineer - GPU & Velox Architecture. Be the first to apply!
- principal software engineer San Jose, CA
- principal architect San Jose, CA
- principal San Jose, CA
- senior principal scientist San Jose, CA
- senior principal cloud computing engineer San Jose, CA
- principal cloud computing engineer San Jose, CA
- internship software San Jose, CA
- software support San Jose, CA
- software quality assurance San Jose, CA
- embedded software San Jose, CA



