Senior Applied ML Engineer, Computer Vision

Company Description Have you ever looked up at the cameras as you drive past an intersection and wondered what is going on behind the scenes? Whenever you pick up a rental car, do you know what happens to the pictures and videos taken by the cameras near the exit of the parking lot? Would you like to know how NCIS Special Agents track down vehicles of interest? Come find out at ALPR Solutions.

Role Description We are seeking a highly experienced computer vision expert to design, improve, optimize, and productionize advanced computer vision models and inference engines. This role sits at the intersection of deep learning research, neural network architecture, computer vision, and high-performance inference engineering. The ideal candidate is comfortable moving well beyond simply training an existing model: they can analyze network architecture at the layer and node level, experiment with model structure and activation functions, diagnose accuracy and performance issues, optimize inference pipelines, and translate research models into production-ready computer vision engines. You will work on computer vision problems involving object detection, image classification, OCR, visual embeddings, image retrieval, image similarity, attribute recognition, and multimodal / vision-language models. This position requires hands-on expertise with technologies such as PyTorch, ONNX, OpenCV, OpenVINO, CNNs, Transformers, CLIP-style models, and Vision-Language Models (VLMs).

Job Responsibilities

Neural Network Research & Architecture

• Analyze and modify neural networks at the layer, block, channel, node, and tensor level. 
• Experiment with network depth, width, feature dimensions, convolutional blocks, normalization strategies, residual connections, attention mechanisms, and output heads. 
• Evaluate tradeoffs between accuracy, inference latency, model size, and memory/CPU utilization.
• Experiment with activation functions such as ReLU, Leaky ReLU, SiLU/Swish, GELU, and others.
• Investigate the effect of input resolution, feature-map resolution, receptive field, stride, padding, kernel size, and network capacity on model performance.

Model Training & PyTorch Development 

• Modify models and implement custom layers, heads, loss functions, and training strategies. 
• Analyze training behavior including convergence, overfitting, underfitting, class imbalance, hard-negative examples, and ambiguous classifications. 
• Develop effective data augmentation, normalization, preprocessing, and sampling strategies. 
• Perform model ablation studies to determine which changes materially improve performance. 
• Diagnose model confusion between visually similar classes (such as side-profile GMC Yukon versus Chevy Tahoe) and develop techniques to improve discriminative capability.

OpenCV & Image Processing

• Develop high-performance image processing and computer vision pipelines using OpenCV. 
• Implement preprocessing and post-processing including resizing, cropping, normalization, filtering, geometric transformations, color-space conversion, thresholding, image enhancement. 
• Understand the effect of interpolation, compression, image format, resolution on model accuracy. 
• Diagnose discrepancies caused by differences between training and production image pipelines.

Object Detection, Classification & OCR 

• Develop and improve models for: object detection, image classification, fine-grained visual classification, OCR / text recognition, attribute classification, region classification 
• Work with architectures such as YOLO and other modern CNN/Transformer-based detectors. 
• Research OCR architectures such as CTC-based and sequence-based recognition models.
• Analyze character-level confusion (such as “O” vs. “0”) and difficult visual cases. 
• Tune OCR network architecture, feature extraction, sequence length, decoding, and training data.
• Develop methods for handling ambiguous characters, unusual layouts, stacked characters, low-resolution images, blur, glare, weather conditions, poor illumination, and image compression.

ONNX & Model Interoperability

• Export and convert PyTorch models to ONNX for deployment, considering ONNX computational graphs, operators, tensors, shapes, dynamic/static dimensions, and opset compatibility. 
• Validate model outputs across PyTorch, ONNX Runtime, OpenVINO, C++, and other inference environments to diagnose model conversion problems and any differences in inference. 
• Optimize ONNX graphs, including operator fusion, constant folding, and graph simplification.
• Identify unsupported operators and redesign or replace network components when necessary.

Embeddings, CLIP & Image Search

• Evaluate embedding architectures and vector databases for visual search/similarity use cases.
• Work with CLIP, SigLIP, MobileCLIP, EVA-CLIP, and related multimodal embedding architectures. 
• Benchmark embedding models for retrieval accuracy, mAP, View email address on click.appcast.io, F1, ROC/AUC, embedding quality, NDCG, inference latency, model size, and CPU/GPU requirements.
• Evaluate tradeoffs between general-purpose foundation versus domain-specific embeddings. 
• Develop similarity search and nearest neighbor retrieval capable of operating at billion-plus scale.

Vision-Language Models & Foundation Models 

• Evaluate emerging Vision-Language Models (VLMs) and multimodal foundation models. 
• Experiment with models such as Qwen-VL, Florence, and other sota vision architectures to evaluate whether they can supplement or replace traditional task-specific CV models. 
• Develop approaches for zero-shot / few-shot classification, visual question answering, image understanding, semantic image search, automatic labeling, object and attribute extraction.
• Adapt large pretrained models to ALPR use cases through fine-tuning, distillation, adapters.
• Track emerging research and determine which techniques have practical production value.

Productionization & Computer Vision Engine Development 

• Work with software engineers to integrate nnet models into high-volume production systems. 
• Design reusable computer vision inference components, APIs, and microservices. 
• Optimize models where latency, throughput, memory/CPU constraints, and reliability are critical. 
• Maintain compatibility across model versions, inference runtimes, and hardware platforms. 
• Participate in model versioning, regression testing, performance benchmarking, and hypercare.

Desired Attributes

• Eye for design, care for security, and optimization for performance
• Self-starter with the demonstrated aptitude to be self-sufficient 
• Proven ability to effectively deliver on objectives 
• Works well under the pressure of a deadline and prides him/herself on delivering on time
• Strong desire to be successful and confident in one’s own success

Hybrid Work and Flexibility

On average, the ALPR Solutions team works on-site 3 days each week at our office at 12610 Race Track Road, Tampa, Florida 33626. We are interviewing candidates on-site every Wednesday. Candidates must be located within daily commuting distance to Tampa, Florida, or be ready to relocate at their expense. We prioritize candidates with high volume live streaming data experience.