Machine Learning Engineer - GPU Performance & Low-Latency Inference
Fintal Partners
Job Description
We’re partnering with a leading global trading firm to hire a Machine Learning Engineer to make ML models run as fast as possible. You’ll work close to the hardware, squeezing latency out of real-time inference and speeding up training, in an environment where microseconds matter.
What you’ll do
- Build and optimize low-latency inference pipelines that deliver real-time predictions in production
- Profile and optimize ML workloads at the device level: memory, compute, kernels and compilers
- Write and tune custom GPU code (CUDA, Triton or equivalent) where libraries fall short
- Apply and validate low-precision techniques (FP8/INT8, quantization), knowing which optimizations stay bit-exact,
- Optimize batching, KV caching and serving paths for latency-critical workloads.
- Extend the internals of PyTorch and inference frameworks to raise performance on specific workloads
What you’ll bring
- 3+ years in machine learning, focused on inference or GPU performance
- Hands-on experience optimizing ML at the GPU level: CUDA, Triton, C++, TensorRT or similar
- Experience with profiling tools (Nsight, torch.profiler) and reasoning about memory bandwidth, latency and throughput
- A strong grasp of modern ML architectures, attention in particular, and how they map onto hardware
- Production-quality Python (C++ a strong plus), with testing discipline and ownership of the systems you ship
- A habit of measuring before optimizing, and the judgment to know when to build versus buy
Nice to have
- Experience building real-time, low-latency prediction systems in high-performance environments
- Experience with numerics: mixed precision, quantization and correctness at scale
- Contributions to open-source projects such as PyTorch, vLLM, Triton or FlashAttention
No trading experience is required. What matters is deep, hands-on performance engineering and a drive to make things faster.
- ...alike.Klover's engineering team powers... ...security, and performance, and that integrate... ...transparent, low-fee financial... ...a Senior Machine Learning Engineer to own... ...building low-latency online model serving... ...computing and GPU-accelerated... ...distributed training/inference), including...PerformanceWork at officeImmediate start1 day per week
- ..., Cloud, and Software Engineering. Our expertise in AI solution... ...are seeking a Senior Machine Learning Engineer with... ...teams to build robust, low-latency ML systems that scale... ...model drift detection, performance monitoring, and self-healing inference pipelines in high-reliability...PerformanceFull timeContract workFor contractors3 days per week
$165k - $225k
...its clients a Senior Machine Learning Engineer - this is a fully remote... ...evaluate algorithm performance, validate research... ...ready systems meeting latency and throughput requirements... ...Experience with GPU acceleration and optimization... .../ONNX export, and inference serving frameworks...PerformanceRemote workWorldwide$180k - $240k
...one of its clients a Senior Machine Learning Engineer - this is a fully remote... ...latest research into high-performing systems and models that can... ...) Familiarity with low-latency production ML systems (Mandatory... ...problems — low latency inference, hallucination reduction,...PerformanceRemote workFlexible hours- ...quantitative trading firm is seeking a Machine Learning Hardware Engineer to help deploy machine... ...the technical direction of ML inference in a demanding, latency-sensitive trading environment.... ...identify measurable improvements in performance. What you’ll bring:...Performance
- ...Title: Low Latency Network Engineer Location: New York or Chicago (4x per week onsite) Salary: Up to 250k base + bonus ($500K TOTAL COMP... ...leading technical role in shaping the global networks behind a performance-critical financial technology business. You’ll influence...Performance
- ...Head of Core C++ Low Latency Development About the Company Successful proprietary trading... ...the development of robust, high-performance trading systems. Responsibilities for the... ...valued. A degree in computer science, engineering, or a related field is typically required...Performance
- ...looking for an MLOps Engineer to deploy, scale,... ...DevOps, Data Engineering, Machine Learning, or Software... ...model serving (Triton Inference Server, TorchServe, KServe... ...managing/provisioning GPU compute resources.... ...experimentation to reliable, high-performance production deployment...PerformanceWork at officeRemote workRelocationVisa sponsorshipWork visaFlexible hours3 days per week
- ...retraining. Deploy and manage machine learning models in production... ...with Data Scientists and ML Engineers to optimize model deployment... ...tools. Monitoring model performance, latency, availability, and resource... .... Experience with GPU-based workloads and ML model...PerformanceH1bLocal area
$90 - $120 per hour
...Dorsey . Position: MLOps Engineer, LLM Systems (Serving, GPU Kernels, Profiling) Type:... ...across GPU kernels , performance profiling , debugging , and inference serving . Write accurate, well... ...and serving throughput and latency trade-offs. Collaborate with...PerformanceContract workSummer workRemote work$62k - $100k
...Description About the Role As an AI Engineering team member, you will be instrumental in... ...a comprehensive total rewards package. Learn more about what working at Crowe can... ...their goals with tax, advisory, risk and performance services. Crowe is recognized by many organizations...PerformanceFull timeLocal areaWorldwide$179.4k - $204.7k
Machine Learning Engineer 4 Do you love building and pioneering in the AI and technology space? Do you enjoy solving complex business problems... ...and Data Engineering. In this role, you'll be expected to perform many ML engineering activities, including one or more of the...PerformanceFull timePart timeH1bLocal area$135k - $162k
...TitleSenior AI/ML Engineering ManagerJob ID1088... ..., coaching, performance management, and career... ...requires it: inference and serving systems... ...Science, Engineering, Machine Learning, Data Science,... ...tuning, latency budgeting, and awareness... ...model endpoints, GPU / CPU workloads)...PerformanceFull timeWork at officeLocal areaImmediate start- ...REQ8336We are seeking highly skilled C++ engineers to join our Systematic technology team, focused on building modern low latency, high availability research, and trading infrastructure... ...and infrastructure, with a focus on performance, reliability, and scalability. Market...Performance
- ...forward when it matters most. Learn more about CCC at .The RoleAs a Senior Machine Learning Engineer, you'll own models and evaluations... ...and measuring how they perform Hands-on experience with both... ...us through Nice to haveCausal inference, survival analysis, or calibration...PerformanceFull time
- Machine Learning EngineerThe RoleUST is searching for a Machine Learning Engineer to design, build, and deploy ML models that drive insights... ...for model training and inference. · Train, tune, and evaluate... ...deployed models for performance, data drift, and degradation...PerformanceFull timeTemporary workPart timeWork at officeLocal areaRemote workFlexible hours
$135.1k - $231.6k
...we’re looking for a Staff Machine Learning Engineer on the Data Science Team.... ...model training, ensuring low-latency and high-availability at enterprise... ...education records, and inferences drawn from your PI. We... ...for our purposes, including performing services and operations...Full time$150k - $300k
...operate at a level most engineers never encounter? We... ...Engineer to build real-time, GPU-accelerated... ...typical front-end role. The performance bar here is closer to game... ...usage, and frame latency under extremely heavy,... ...graphics pipelines, and low-level rendering techniques...PerformanceImmediate start- ...seeks an AI/ML & MLOps Engineer to lead the architecture... ...governance of production machine learning capabilities supporting... ...deployment; monitor model performance and drift; and control updates... ...drift, concept drift, inference quality, latency, availability, errors,...PerformanceContract workFor contractorsLocal areaRemote work
$175k - $275k
...hypotheses and measure model performance before production... ..., statistical, and machine-learning models; prototype... ....Apply statistical inference, optimization,... ...Mathematics, Financial Engineering, Computational Mathematics... ...that trade on low latency scale at the milisecond...PerformancePermanent employmentFull timeRemote work$117.61k - $153.15k
...improve product/system performance, quality, data... ...maintenance. Applies deep learning technologies to give computers... ...key components of the Machine Learning Platform... ...data scientists, data engineers, and IT teams to design... ...Experience with GPU acceleration (e.g. CUDA...PerformanceHourly pay$180k - $200k
...Senior Machine Learning Engineer - Fraud Detection Remote, USA $180,000 – 200,000 base salary + annual bonus + equity THE COMPANY... ...learning models that improve fraud detection accuracy and system performance. Lead experimentation initiatives, including model...PerformanceRemote workFlexible hours$179.4k - $204.7k
Machine Learning Engineer 4 (Manager, IC) Do you love building and pioneering in the AI and technology space? Do you enjoy solving complex business... ...and Data Engineering. In this role, you'll be expected to perform many ML engineering activities, including one or more of...PerformanceFull timePart timeH1bLocal area$62k - $100k
...About the Role· We work on medium-term machine learning projects (1-6 months) with a high... ...language (C/C++, Go, etc) is a plus Software engineering experience. You enjoy software... ...their goals with tax, advisory, risk and performance services. Crowe is recognized by many...PerformanceFull timeLocal areaWorldwideShift work$200k - $300k
...infrastructure that allows our high-capacity, low-latency trading and data research environments... .... We are looking for a Senior Network Engineer with experience designing and managing large environments to fulfill the high-performance and availability requirements of a...PerformanceWork at officeLocal areaImmediate startWorldwide- ...We're looking for a **Machine Learning Engineer** to help build and improve AI-powered products. You'll work with large datasets, train and evaluate... ...analyze datasets for model training. * Improve model performance through experimentation and testing. * Deploy and...PerformanceRemote workFlexible hours
$200k - $225k
We are deploying machine learning directly onto custom hardware - and we... ...researchers and experienced engineers from any background. Trading... ...treating hardware constraints (latency budgets, resource limits,... ...implement, verify, and deploy ML inference solutions from proof-of-...Permanent employmentFull time$205k - $265k
...Most US-based positions can also be performed remotely (any exceptions will be... ...of lives. We are seeking a Staff Machine Learning Engineer / Data Scientist to serve as a technical... ...learning research into high-throughput, low-latency production systems. This is a high...Full timeRemote workFlexible hours$120k - $180k
...headquartered in Chicago, IL. Learn more at [coinflow.cash... ...We're hiring an MLOps Engineer to own the platform... ...of real money, so latency, reliability, and... ...Build and operate the inference layer that scores transactions... ...testing, compare performance on our data, and give...PerformanceFull timeWorldwide$180k - $225k
...forward when it matters most. Learn more about CCC at . The Role As a Senior Machine Learning Engineer, you'll own models and... ...production and measuring how they perform Hands-on experience with both... ...Nice to have Causal inference, survival analysis, or calibration...PerformanceRemote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Machine Learning Engineer - GPU Performance & Low-Latency Inference. Be the first to apply!
- computer vision machine learning engineer Chicago, IL
- machine learning software engineer Chicago, IL
- ai ml engineer Chicago, IL
- machine learning engineer Chicago, IL
- senior ml engineer Chicago, IL
- machine learning ai engineer Chicago, IL
- senior performance engineer Chicago, IL
- performance improvement specialist Chicago, IL
- senior performance tester Chicago, IL
- human performance consultant Chicago, IL






