AI Systems Performance Specialist

Role Description

Bright Vision Technologies is seeking a highly experienced AI Systems Performance Specialist with 10+ years of experience in AI infrastructure, machine learning systems, High-Performance Computing (HPC), and performance engineering. The ideal candidate will optimize AI training and inference workloads for maximum performance, scalability, reliability, and cost efficiency. This role requires deep expertise in:

• GPU optimization
• Distributed training
• Large Language Model (LLM) inference
• Python, C++, CUDA
• Production AI systems

The candidate will lead performance optimization initiatives across enterprise-scale AI platforms.

Key Responsibilities

• Optimize AI training and inference pipelines for maximum throughput, low latency, scalability, and infrastructure efficiency.
• Analyze and improve GPU utilization, memory management, kernel execution, and multi-GPU performance across production AI workloads.
• Design and implement optimization techniques including:
  • Quantization
  • Pruning
  • Mixed precision
  • Batching
  • Caching
  • Speculative decoding
  • Model parallelism
• Profile AI applications using industry-standard performance analysis tools and identify bottlenecks across compute, memory, networking, and storage.
• Optimize distributed training and inference using:
  • NCCL
  • DeepSpeed
  • PyTorch Distributed
  • Ray
  • MPI
  • Similar distributed computing frameworks
• Collaborate with AI researchers, ML engineers, platform engineers, and infrastructure teams to improve model performance and production reliability.
• Build automated benchmarking frameworks, performance dashboards, monitoring solutions, and regression testing pipelines.
• Evaluate emerging AI hardware, GPU architectures, inference frameworks, and optimization technologies to improve enterprise AI capabilities.
• Drive AI infrastructure cost optimization through efficient resource utilization, cloud optimization, and FinOps best practices.
• Mentor engineering teams and provide technical leadership on AI systems architecture, GPU optimization, and performance engineering.

Qualifications

• Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, Artificial Intelligence, or a related technical discipline.
• 10+ years of professional experience in performance engineering, AI infrastructure, machine learning systems, High-Performance Computing (HPC), or distributed computing.
• Expert-level programming skills in Python and C++.
• Extensive experience optimizing GPU-accelerated AI workloads using CUDA, distributed training frameworks, and modern deep learning libraries.
• Strong knowledge of Large Language Models (LLMs), deep learning frameworks, model serving, and production AI inference.
• Hands-on experience with profiling tools such as NVIDIA Nsight Systems, Nsight Compute, PyTorch Profiler, TensorBoard, or similar performance analysis tools.
• Experience deploying and optimizing AI workloads on AWS, Microsoft Azure, or Google Cloud Platform (GCP).
• Strong understanding of distributed systems, networking, storage optimization, and AI infrastructure architecture.
• Excellent analytical, troubleshooting, communication, and technical leadership skills.

Preferred Qualifications

• Experience optimizing production-scale LLM inference and serving large foundation models.
• Hands-on experience with vLLM, TensorRT-LLM, DeepSpeed, Triton Inference Server, CUTLASS, FasterTransformer, or similar AI optimization frameworks.
• Knowledge of model compression, KV cache optimization, speculative decoding, and advanced inference optimization techniques.
• Experience implementing FinOps strategies for AI infrastructure cost optimization and resource management.
• Contributions to AI systems research, open-source AI infrastructure projects, patents, or technical publications.
• Familiarity with emerging AI accelerator technologies, including AMD ROCm, Intel oneAPI, or custom AI hardware.

Benefits

• Competitive salary range: $130,000–$180,000 Annually
• 100% Remote work opportunity
• Full-time, Direct W2 position

Company Description

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.