Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Platform Engineer

$100k - $150k
Full-time

Bright Vision Technologies

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: AI Platform Engineer
Location: 100% Remote (Continental United States)
Position Type: Full-time, Direct W2
Salary Range: $100,000 – $150,000 per annum
Experience: 6+ years

Sponsorship:  U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.



 

Job Summary:
We are seeking an AI Platform Engineer to design, build, and operate scalable AI inference platforms for production ML workloads. The ideal candidate will have expertise in distributed systems, LLM serving, GPU optimization, autoscaling, and cloud-native infrastructure, with a strong focus on performance, reliability, and observability.

Key Responsibilities:

  • Design and maintain scalable AI model serving platforms.
  • Optimize inference performance, GPU utilization, and request routing.
  • Build autoscaling, deployment, and monitoring solutions.
  • Implement caching, security, and high-availability strategies.
  • Collaborate with ML teams to deploy and support production AI models.

Required Qualifications:

  • 6+ years of experience in distributed systems, infrastructure, or ML platform engineering.
  • Strong proficiency in Python and Go, Rust, or C++.
  • Experience with LLM inference frameworks (vLLM, TensorRT-LLM), Kubernetes, cloud platforms, and GPU optimization.

Preferred Qualifications:

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title

AI Platform Engineer

Location: 100% Remote (Continental United States)
Position Type: Full-time, Direct W2
Salary Range: $130,000–$180,000 Annually (based on experience)
Experience Required: 10+ Years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary

Bright Vision Technologies is seeking a highly experienced AI Platform Engineer with 10+ years of experience in distributed systems, cloud-native infrastructure, and AI platform engineering to design, build, and operate enterprise-scale AI inference and machine learning platforms. The ideal candidate will possess deep expertise in LLM serving, GPU optimization, Kubernetes, cloud infrastructure, distributed systems, and MLOps , with a proven ability to deliver highly scalable, reliable, secure, and cost-efficient AI platforms supporting production machine learning workloads.

Key Responsibilities

  • Design, build, and maintain scalable AI inference and model-serving platforms for enterprise production environments.
  • Architect highly available, cloud-native infrastructure supporting Large Language Models (LLMs), foundation models, and machine learning services.
  • Optimize inference latency, throughput, GPU utilization, memory management, and request scheduling across distributed AI workloads.
  • Design autoscaling, workload orchestration, traffic management, and intelligent request routing strategies for AI services.
  • Implement model deployment, versioning, rollback, and lifecycle management using modern MLOps practices.
  • Develop monitoring, observability, logging, distributed tracing, and alerting solutions to ensure platform reliability and performance.
  • Implement caching strategies, API gateways, security controls, authentication, authorization, and high-availability architectures.
  • Collaborate with AI researchers, ML engineers, DevOps teams, and software engineers to deploy and support production AI models.
  • Drive cloud infrastructure optimization, resource utilization, FinOps initiatives, and operational excellence.
  • Mentor engineering teams, conduct architecture reviews, and establish best practices for AI platform engineering and cloud-native development.
  • Evaluate emerging AI infrastructure technologies, model-serving frameworks, and GPU acceleration techniques to drive continuous innovation.

Required Qualifications

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Artificial Intelligence, or a related technical discipline.
  • 10+ years of professional experience in distributed systems, infrastructure engineering, cloud platforms, or machine learning platform engineering.
  • Strong programming skills in Python and at least one systems programming language such as Go, Rust, or C++ .
  • Extensive experience with Large Language Model (LLM) serving , model inference optimization, and production AI infrastructure.
  • Hands-on experience with vLLM, TensorRT-LLM, Triton Inference Server, Ray Serve, or similar AI serving frameworks .
  • Strong expertise in Kubernetes , container orchestration, Docker, and cloud-native application architectures.
  • Experience optimizing GPU workloads using CUDA , NVIDIA GPU technologies, distributed inference, and high-performance AI infrastructure.
  • Experience with cloud platforms including AWS, Microsoft Azure, or Google Cloud Platform (GCP) .
  • Strong understanding of distributed systems, networking, scalability, observability, and security best practices.
  • Excellent analytical, communication, collaboration, and technical leadership skills.

Preferred Qualifications

  • Experience designing and operating multi-region AI platforms and globally distributed inference services.
  • Knowledge of model optimization techniques such as quantization, pruning, compression, speculative decoding, KV cache optimization, and mixed-precision inference .
  • Experience with MLOps , GitOps, Infrastructure as Code (Terraform, Bicep, CloudFormation), and CI/CD automation.
  • Familiarity with service mesh technologies such as Istio or Linkerd , API gateways, and event-driven architectures.
  • Contributions to open-source AI infrastructure projects, technical publications, patents, or conference presentations.
  • Experience implementing FinOps strategies, cloud cost optimization, and enterprise AI governance.
  • Experience with multi-region AI deployments and AI infrastructure.
  • Familiarity with model optimization techniques such as quantization or compression.
  • Open-source contributions or experience supporting large-scale AI APIs.


Interested in this opportunity? Apply today for immediate consideration!

Email your updated resume to View email address on us.fitly.work
Call or Text View phone number on us.fitly.work if you have any questions.
Learn more about Bright Vision Technologies at .

We look forward to connecting with talented professionals and helping you take the next step in your career.

Bright Vision Technologies is an Equal Opportunity Employer.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Vacancy posted 18 days ago
Similar jobs that could be interesting for youBased on the AI Platform Engineer in Durham, NC vacancy
  • About the Role Direct Supply is building AI systems that change how care is delivered...  ...the people who care for them. We're hiring engineers to design, ship, and operate those...  ...Working knowledge of cloud and frontier AI platforms Nice to Have Degree in Computer Science,... 
    Suggested
    Full time

    Direct Supply

    Durham, NC
    2 days ago
  • $152k - $241.5k

     ...great technology—and amazing people. As part of Nvidia's applied AI team for chip design, you will have the opportunity to tap into...  ...industry. Our team operates at the intersection of research, engineering, and product development, transforming innovative ideas and research... 
    Suggested
    Full time

    Nvidia

    Durham, NC
    14 hours ago
  • Be the one building AI-powered experiences where they matter most.At Genesys, we help...  ...AI-powered experience orchestration. Our platform connects people, systems, data and AI to...  ...environments every day.Principal Applied AI Engineer, FinanceWe are seeking a Principal... 
    Suggested
    Full time
    Work at office
    Remote work
    Work from home
    Worldwide
    Flexible hours

    Genesys

    Durham, NC
    2 days ago
  • $130k - $180k

     ...software development company delivering cloud, AI, data, and enterprise solutions across...  .... Job Title Conversational AI Engineer Location: Remote (U.S.) Position Type...  ...LLMs with the ability to build reusable AI platforms, evaluation frameworks, and developer... 
    Suggested
    Full time
    H1b
    Local area
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Durham, NC
    18 days ago
  • $130k - $180k

     ...software development company delivering cloud, AI, data, and enterprise solutions across...  ...growth potential. Job Title NLP AI Engineer Location: 100% Remote (U.S.)...  ...optimization techniques. ~ Experience with cloud platforms such as AWS, Microsoft Azure, or Google... 
    Suggested
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Durham, NC
    18 days ago
  • $180k - $220k

     ...Top Skills' Details • Microsoft Foundry (Azure AI Foundry) hands-on experience with the model catalog, Foundry Agent Service, evaluation...  ...Protocol (MCP), retrieval-augmented generation, and prompt engineering. • Microsoft Fabric & One Lake experience grounding AI on... 
    Permanent employment

    TEKsystems

    Durham, NC
    14 hours ago
  •  ...US Citizen Required - FedRAMP Requirement Senior Cloud Platform Engineer ON W2 POSITION Top Skills Required : 1. AWS 2. Kubernetes 3. CI/CD Automation Job Description/ Responsibilities : • 10-14 years experience in cloud... 

    Ruri Software Technologies LLC

    Durham, NC
    3 days ago
  • $165k - $248k

     ...A leading software company is seeking a Director of Engineering to design and build cloud-native services focusing on resilience and collaboration with cross-functional teams. Candidates should have a Bachelor's or Master's degree, at least 5 years of experience in cloud... 

    Talkdesk

    Durham, NC
    2 days ago
  • $139.3k - $203.6k

     ...applications are received . Meet the team The Engineering Infrastructure team serves as the backbone for the Collaboration Devices CI/CD platform, enabling high-velocity development for...  ...ranging from device drivers to AI/ML models. We function as a collaborative... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Cisco

    Durham, NC
    3 days ago
  • $130k - $180k

     ...consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This...  ...offering tremendous career growth potential. Job Title:  Kafka Platform Engineer L ocation: 100% Remote (U.S.) Position Type: Full-time,... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Durham, NC
    1 day ago
  • $130k - $180k

     ...software development company delivering cloud, AI, data, and enterprise solutions across...  ...potential. Job Title Applied AI Engineer Location: 100% Remote (Continental United...  ...ML workflows. ~ Experience with cloud platforms such as AWS, Microsoft Azure, or Google... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Durham, NC
    18 days ago
  •  ...to set a higher standard for the apparel industry. The Lead AI Engineer provides dedicated leadership for AI engineering, sitting...  ...a small team of AI/ML engineers ESSENTIAL FUNCTIONS: AI Platform Ownership (Pilot → Production) Own the AI platform built on... 
    Full time
    Seasonal work
    Local area

    Peter Millar LLC

    Durham, NC
    25 days ago
  •  ...JOB DESCRIPTION OVERVIEW CREO’s AI Enablement team helps life sciences, healthcare...  ...to client business objectives using platforms such as Microsoft Copilot Agent Builder,...  ...solution proposal documentation. AI Process Engineering Analyzing current workflows,... 
    Full time
    Work experience placement
    Work at office

    CREO

    Durham, NC
    a month ago
  •  ...AI Automation EngineerAs an AI Automation Engineer, you will help shape how work is automated, orchestrated, and improved across Avalara. You will lead the...  ...automation solutions, using n8n as a core orchestration platform to improve productivity, quality, and operational... 
    Full time
    Casual work
    Remote work

    Bitovi

    Durham, NC
    4 days ago
  • $100k - $150k

     ...consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This...  ...offering tremendous career growth potential. Job Title: Data Platform Engineer Location: 100% Remote (U.S.) Position Type:  Full-time,... 
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Durham, NC
    24 days ago
  • $224k - $356.5k

    We are now looking for an AI Developer Technology Engineering Manager:Join our global Developer Technology (DevTech) team at NVIDIA, where we drive innovation and enhance the value of our platforms for developers. As a key member of our AI DevTech team, you'll lead a team... 
    Full time
    Temporary work

    Nvidia

    Durham, NC
    3 days ago
  • $152k - $241.5k

    NVIDIA's high-performance computing platforms are powering the AI revolution across many applications and industries. Within our software stack,...  ...see:Masters or PhD degree in Computer Science, Computer Engineering, or related field (or equivalent experience).3+ years of... 
    Full time

    Nvidia

    Durham, NC
    1 day ago
  • $224k - $356.5k

     ...tapping into the unlimited potential of AI to define the next era of computing. An era...  ...get the best experience. We own the platform — performance, CI/CD pipelines, validated...  ...MS, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience... 
    Full time
    Local area

    Nvidia

    Durham, NC
    3 days ago
  • DescriptionWe are looking for a DevOps Engineer to support and enhance a critical engineering delivery environment for a medical devices...  ..., making it ideal for someone who is comfortable managing both platform stability and delivery automation. The position offers the... 

    Robert Half

    Durham, NC
    2 days ago
  •  ...embrace you. Open up opportunities with HPE.Job Description:We are seeking a highly skilled Senior DevOps Engineer with deep expertise in Linux systems, Kubernetes platforms, virtualization technologies, automation, and modern DevOps practices.In this role, you will design,... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    2 days per week

    Hewlett Packard Enterprise

    Durham, NC
    4 days ago
  •  ...building its next generation contact center platform to deliver highly reliable, intelligent,...  ...engagement. We are seeking a Director of Engineering to help design, build and operate its...  ...standards across teams. Hand-on experience with AI-assisted software development tools to... 
    Full time

    Fidelity Investments

    Durham, NC
    9 hours ago
  •  ...and mentor a global DevOps team to scale platform capabilitiesTechnical Excellence & InnovationOversee...  ..., and monitoringEvaluate and integrate AI-powered tools into DevOps workflows (code...  ...and continuous improvement across engineering practicesEnsure operational excellence... 
    Full time
    Temporary work
    Casual work
    Internship
    Monday to Friday
    Flexible hours
    Day shift

    Laboratory Corporation of America

    Durham, NC
    14 hours ago
  • $175k - $213.5k

     ...a leading mobile and web-based learning platform that delivers efficient and affordable study...  ...and advance their careers. The engineering team collaborates closely with the product...  ...frontend integration, and interaction with AI/ML systems. Key Responsibilities Design... 
    Full time
    Local area
    Remote work
    Flexible hours

    Mobile Integration Workgroup

    Durham, NC
    14 hours ago
  •  ...EngineerIndustry: BankingLocation: Smithfield RI, Jersey City NJ, Durham NCDuration: Long term contractProject: Build Medical / Care Management platform, providing market-leading solution for Utilization Mgmt., Prior Authorization, Case & Disease Management and Concurrent Review.Top... 
    Work at office
    Work from home

    Samprasoft

    Durham, NC
    4 days ago
  •  ...Senior DevOps EngineerThe Senior Cloud Engineer is responsible for architecture, design, implementation, and management of the AWS cloud...  ...impact performance, reliability, and security across our platforms. You'll contribute to building thoughtful, well-architected infrastructure... 
    Work experience placement
    H1b
    Visa sponsorship

    ACA Group

    Durham, NC
    4 days ago
  •  ...Senior DevOps Engineer Dynamic work schedule - This is 5 days on site a month- in the same week then the remainder of the month is...  ...DevOps Engineer in the Search team, you will help us build a Search platform that supports millions of customer requests. You will be... 
    Remote work
    Work from home

    Samprasoft

    Durham, NC
    1 day ago
  •  ...and our clients are our strengths as the diverse talents and opportunities they bring to the table enable us to grow as a global platform and they are causally linked with our success. We provide strategic and technical advice, and we have expertise in areas covering... 
    Relocation

    InterSources

    Durham, NC
    4 days ago
  •  ...immigration sponsorship for this positionThe RoleOur Site Reliability Engineering group within Enterprise Infrastructure combines Operations...  ...; Experience with building and operating highly resilient platforms in AWS cloud environments.3-5 years of experience in software... 
    Full time

    Fidelity Investments

    Durham, NC
    2 days ago
  •  ...impact in helping to solve some of the most important challenges in global education. Client is currently seeking a talented Software Engineer who is able to work into the Site Reliability Engineer role. This candidate is expected to work towards becoming a Subject Matter... 
    Remote work

    Intelliswift

    Durham, NC
    3 days ago
  •  ...Gradient Health is building the data infrastructure for medical AI. Their platform gives AI developers access to millions of de-identified...  ...The role Gradient is hiring a Senior or Staff Software Engineer reporting to the CTO Sai and eventually managing part of their... 
    Full time

    Semata

    Durham, NC
    14 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Platform Engineer. Be the first to apply!