Low-Latency Inference Infrastructure Engineer
Jobleads-US
Elorian AI in Palo Alto is seeking an infrastructure engineer to design, optimize, and scale the systems that serve our large multimodal models. Your work will make inference faster, more cost-efficient, and more reliable, so our teams can focus on advancing model capabilities rather than managing bottlenecks.
Our focus is on performant, efficient inference, both to power real-world applications and to accelerate research.
#J-18808-Ljbffr Jobleads-USVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Low-Latency Inference Infrastructure Engineer in Kentucky vacancy
$200k - $400k
...world‑class scientists and engineers. We recently raised $55M in... ...Role We're looking for an infrastructure engineer to design,... ...models. Your work will make inference faster, more cost‑effective... ...What You Will Do Build low‑latency, high‑throughput inference...SuggestedVisa sponsorshipWork visaRelocation package- ...implement next-generation cloud components. You will deliver low-latency, highly scalable services and partner with desktop agent and AI... ...can influence architecture, scale global systems, and mentor engineers while advancing CrowdStrike's AI-enabled security platform. #J...Suggested
- Zensors in San Francisco seeks an AI/ML Infrastructure Engineer to build and optimize scalable AI inference infrastructure for real-time video analytics. You will evolve... ...teams to push throughput while reducing latency. Applicants should have strong systems programming...Suggested
- DRW, a diversified trading firm, is seeking an AI Inference Platform Engineer to build, operate, and optimize systems that serve large language... ...models, tuning runtimes and configurations, and improving latency, throughput, reliability, and cost. You will work across inference...Suggested
- ...Unity Enterprise is seeking a Senior ML Engineer to design and evolve an online inference platform for production ML models. You will build reliable infrastructure for serving models, optimize inference performance, and enable safe experimentation across high-traffic systems...Suggested
$170k - $300k
...Infra Engineer Location: San Francisco (in-person, in-office, full-time ONLY) Compensation... ..., and asset we generate sits on top of infrastructure that has to stay fast and reliable as... ...state, expose capability, and keep latency low across the platform What Success...Full timeWork at officeRelocation packageVirio Labs Inc.
Eastern, KY4 days ago- ...a couple founding software engineers to help us stay afloat of current... ...to build and run the infrastructure behind those conversations.... ...demanding reliability requirements: latency is immediately noticeable,... ...workloads or self‑hosted AI inference. Familiarity with...Work at officeImmediate startNight shift
Simple AI Lab Company
Eastern, KY5 days ago $170k - $210k
...capacity from existing energy infrastructure. For over a decade, we have... .... The AI Infrastructure Engineer is responsible for designing... ...integration of power data with AI inference software. This is Utilidata'... ...at scale, with a focus on low latency, reliability, and cost...Local areaRemote workFlexible hoursKARMAN INC
Eastern, KY1 day ago$165k - $200k
...Join a world-class team of scientists, engineers, and business professionals to advance... .... Atom Computing is seeking an Infrastructure Engineer to enhance our software development... ...-premise hardware for performance and low latency using tools such as perf, systemd-...Temporary workWork at office3 days per weekAtom Computing
Eastern, KY5 days ago- ...As a Senior Platform Engineer at Equiforte, you will build and scale the core infrastructure that powers our AI-native financial reporting platform. You'll work... ...deploy and serve AI models in production with low-latency inference and high availability Drive technical...
Equiforte
Eastern, KY2 days ago - ...an API company, which means infrastructure isn't a support function. It'... ...directly with the founder and the engineers who come after you to set how... ...follow without asking. Latency and performance. Fast APIs... ...performance story end to end: low-latency data access, smart caching...Full time
Encrata
Eastern, KY2 days ago - ...performance computing (HPC) and cloud infrastructure that supports its clients’ research, production... ...shape the industries of tomorrow. Its engineers build critical infrastructure to... ...for robust, high throughput and low latency network infrastructure frameworks at scale...Temporary workFlexible hours
NorthMark Strategies LLC
Eastern, KY5 days ago - ...networking to talk to each other and to remote engineering teams, some of them international. We'... ...and run it like the piece of critical infrastructure it is. The person in this role will... ...engineering teams who need low-latency, stable control of test hardware, including...For contractorsWork at officeRemote work
ICON
Eastern, KY2 days ago $186.07k - $218.9k
...working at Coinbase. As an Infrastructure Lead on the Exchange team... ...depth, and trust. You'll keep latency-sensitive, multi-node trading... ...and optimize resilient, ultra-low-latency networks and physical... ...on-call rotation. Mentor engineers and partner cross-functionally...Local areaCoinbase
Eastern, KY3 days ago- ...Chantilly, VA is seeking a Senior Cloud Engineer (AI Integration) to design secure, scalable... .... You will build and optimize cloud infrastructure for distributed model training, high-performance compute, and low-latency inference. The role requires 8+ years of cloud engineering...
- OpenAI is seeking an AI Systems Engineer to scale infrastructure behind training and evaluation workflows. You will own projects from bottleneck... ...and collaboration with researchers. You will build shared inference and grading platforms, improve scheduling, and develop...
- Thinking Machines Lab Inc. in San Francisco, California is seeking an infrastructure research engineer to design, optimize, and scale the systems that power large AI models. Your work will make inference faster, more cost-effective, more reliable, and more reproducible to...
- ...Zeus AI Senior Software Engineer, Data Platform Cambridge, MA·Remote... ...to produce an accurate low latency representation of the planet... ...role, you will own the data infrastructure that provides near real-time... ...operations including data and inference pipelines. This will include...Full timeRemote workFlexible hours
Myzeus
Eastern, KY5 days ago $166.9k - $230k
...Platform (MLSP) team builds and operates the core infrastructure that powers ML model training,feature engineering, inference, and marketplace simulation at Upstart. Every... ...keep pace with our ML teams. That work spans low latency and GPU model serving, self-service model...Remote jobCurrently hiringLocal areaWork from home- ...Collective Intuition, Inc. seeks a Founding Infrastructure Engineer to define and own the production inference platform behind a new layer of AI intelligence. You will build core systems, set foundational architecture decisions, and influence engineering culture from...
- ...Observable Intuition, Inc. seeks a founding Infrastructure Engineer to define and own the production inference platform behind our data-driven AI layer. You will collaborate with the founding team to build core systems from the ground up, make foundational architectural...
- Virio Labs Inc. in San Francisco is seeking a seasoned Infrastructure Engineer to own and scale the foundation that powers our AI-native platform... ...including AI squads, to design scalable state management, low-latency APIs, and cost-efficient architectures that support...
- ..., policies, and evaluation infrastructure so that every channel reasons... .... You will fight for low latency without sacrificing instruction... ...telephony, speech-to-text, model inference, tool calls, and text-to-... ...of professional software engineering experience. You have...Work at officeFlexible hours
- ## Infrastructure Engineer Lead - Cloud AIApply: Gahanna, OH: Full time: Posted Today: End Date: October... ...and optimize spend on GPU compute, inference and token consumption, storage, and... ...including model endpoint availability, latency, throughput, and error rates.* Support...Full timeWork experience placementLocal area
- ...Karman, Inc. is seeking an AI Infrastructure Engineer to design and own the end-to-end AI inference platform across edge, cloud, and on-prem deployments. The role emphasizes reliability, performance, and scalability for production AI workloads. You will work cross-functionally...Remote job
$199.9k - $348.4k
...It all started when engineer Fred Luddy wrote code that automated... ...Product, Design, AI, Infrastructure, and Business leaders to... ...perform reliably in low-connectivity and offline... ...vision models, real-time inference constraints, and mobile latency tradeoffs. Experience...Work at officeImmediate startRemote workFlexible hours- ...Role**We are seeking a Senior ML engineer to design and evolve Unity Vector’s online model inference platform. This role focuses on building reliable infrastructure for serving machine learning... ...serves production ML models with low latency and high reliability, such as...Work at officeWorldwide
- ...with AI. What You’ll Do We are seeking a Staff Software Engineer to lead the design, development, and evolution of networking software... ..., and fault-tolerant networking software for high-speed, low-latency interconnects, delivering predictable performance across large...Permanent employmentFlexible hours
Teradata
Frankfort, KY3 days ago $86.7k - $173.3k
## Senior Software Engineer, CloudCandidatar-se: Individual Office Exception Approved: United States - Illinois - Abbott Park: Tempo... ...utilizing Go for cloud-based platforms.* Developing high-volume, low-latency services for a global health care platform* Collaborate with...Work at officeRemote workAbbott Laboratories company
Eastern, KY5 days ago- ...fast-moving team of aviators, engineers, and operators building an... ...Senior Software Engineers, Cloud Infrastructure to lead the buildout of our... .../EKS, Lambda, or Batch for inference jobs. Build and maintain... ..., or Pinecone. Tune recall, latency, and cost. Build and...Permanent employmentFull timeLocal areaRemote work3 days per week
AI Chopping Block, Inc.
Eastern, KY5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Low-Latency Inference Infrastructure Engineer. Be the first to apply!
Related searches
- remote infrastructure engineer Kentucky
- infrastructure engineer Kentucky
- principal infrastructure engineer Kentucky
- senior infrastructure engineer Kentucky
- infrastructure developer Kentucky
- data infrastructure engineer Kentucky
- infrastructure engineering manager Kentucky
- lead infrastructure engineer Kentucky
- infrastructure automation engineer Kentucky
- security infrastructure engineer Kentucky