Senior Machine Learning / Data Engineer - Evaluation
VTI Aerospace
Job Description
Job Description
About VTI Aerospace
VTI Aerospace builds AI-powered perception and pilot assist technologies to unlock the future of aviation. With offices in Bozeman, MT and Seattle, WA, we are a team of engineers and technologists from Boeing, Airbus, Aurora, and beyond. We are passionate about pushing the boundaries of autonomy and aviation safety. Our company is dedicated to advancing the field of aviation with cutting-edge solutions
The Role
As a Senior Software Engineer – Evaluation, you will design and implement systems that measure and monitor the performance of our computer vision, automatic speech recognition (ASR), and small language model (SLM) systems. You will develop evaluation methodologies, benchmarking pipelines, and monitoring tools that ensure our AI systems perform reliably in real-world environments. You will help establish the evaluation standards and performance benchmarks that guide the development of all AI systems at the company.
You will work closely with machine learning and data engineering teams to evaluate model performance, identify failure modes, and guide improvements to data collection and model training, helping bring AI-powered aviation tools to market.
This role is ideal for someone who enjoys designing robust evaluation systems and uncovering insights from model performance data, and wants to have a direct impact on the quality and reliability of our AI systems.
What You'll Do
- Define and implement evaluation methodologies for computer vision, ASR, and language systems
- Identify and track key performance indicators (KPIs) that measure system and model effectiveness
- Perform dataset coverage analysis to understand strengths, gaps, and biases in training and evaluation data
- Identify model deficiencies and collaborate with ML engineers to improve training data and model performance
- Build scalable model evaluation pipelines in Python for automated benchmarking and regression testing
- Design and maintain systems for monitoring model performance and drift in production environments
- Architect data models and storage systems for evaluation results using relational and time-series databases
- Build dashboards and reporting tools to visualize model performance and evaluation metrics
- Collaborate with ML and data engineering teams to improve evaluation workflows and data pipelines
- Contribute to ground-truth data pipelines and processes that support reliable evaluation
What We're Looking For
- 5+ years of experience developing production software systems in Python
- Strong experience designing and implementing data processing or analysis pipelines
- Experience building systems for machine learning evaluation, experimentation, or benchmarking
- Experience working with large datasets and building scalable data workflows
- Familiarity with statistical methods, experimental design, and model performance analysis
- Experience building automated pipelines using tools such as Airflow or similar orchestration frameworks
- Experience working with evaluation or experiment tracking tools such as MLflow or similar systems
- Experience designing data models and working with relational databases and time-series data
- Strong collaboration skills and ability to work closely with machine learning and data engineering teams
Bonus Points
- Experience working with computer vision, ASR, or language models in production environments
- Experience using PyTorch or other deep learning frameworks
- Experience evaluating multimodal or large-scale AI systems
- Experience building monitoring systems for ML models in production
- Experience designing dataset analysis or data quality tooling
- Experience building dashboards or monitoring tools using Grafana or similar platforms
Why You'll Love Working Here
- Opportunity to work on meaningful problems in aviation and deliver products to industry at a rapid pace
- Small team with significant impact on company direction
- Collaborative and innovative environment
- Competitive compensation and benefits
- Opportunities for growth and leadership
Location
Work arrangement: On-site
Primary location: Seattle or Bozeman
Compensation & Benefits
Salary range: DOE
Benefits may include:
• Health, dental, and vision insurance
• Retirement plan or 401(k)
• Paid time off and holidays
• Professional development opportunities
Equal Opportunity Statement
VTI is proud to be an equal opportunity employer. We value diverse perspectives and encourage candidates from all backgrounds to apply
- Job Title: Senior Machine Learning Engineer100% Remote Full Time As a Senior Member of... ...AI product.Own work end-to-end: data preparation, training, evaluation, inference, and iteration.Turn research... ...with research, product, and engineering to deliver real user impact....SeniorFull timeRemote work
$150.75k
...impacting the world for the greater good? As an ML Engineer at Axon, you will contribute to developing AI... ...Axon Air, VR and more) by supporting the training, evaluation, testing and deployment of machine learning models on Axon devices and cloud. As part of a multidisciplinary...SeniorFull timeWork experience placementWork at officeRemote work- ...and commodity recommendation. We are a group of applied machine learning engineers and data scientists that focus on E-commerce recommendations. We... ...explore users' latent interests efficiently• Design, develop, evaluate and iterate on predictive models for candidate...SeniorTemporary workWork experience placement
$172.5k - $306.63k
...Our mission is to employ machine learning to enhance our comprehension... ....What You'll DoAs a Senior Machine Learning Engineer on the Content Intelligence... ...experience in developing, evaluating, and deploying ML models... ...and Python-based ML and Data Science frameworks, with...SeniorFull timeTemporary workLocal areaWorldwide$185.6k - $255k
...Why NowMost customer data is a lie by omission.Every... ...without waiting on an engineering queue. The bet... ...accountable teams. As a Senior ML Engineer, you'll lead... ...our customers through machine learning products and features.... ...blameless post-mortems. Evaluate MLOps tooling that...SeniorWork at officeLocal areaRemote work$200.4k - $260.5k
Senior Machine Learning Engineer, Data InfrastructureUnity Vector builds an Data platform that powers insight, experimentation, attribution, and AI-driven decision-making across the company.Our systems operate at scale across batch and streaming data, supporting analytics...SeniorFull timeWork at officeWorldwideRelocation package$184.5k
...singular technology platform powered by data and machine learning provides secure, differentiated,... ...and traveler satisfaction.This Senior Machine Learning Engineer role is part of the Distribution... ..., and model development and evaluation through implementation, testing,...SeniorFull time$168.1k - $227.4k
...depends on the model, the harness, the evaluation infrastructure, and the serving... ...designed together.We are looking for a Senior Machine Learning Engineer to build and own core systems in... ...production experience into training data actually holds. You will own a piece...SeniorInternshipFlexible hoursDay shift$148.5k - $225k
...Sponsored Ads team is looking for a Senior Machine Learning Engineer to help launch various innovative ads... ...and wide array of engaging data-science latest methodologies including... ...distributed pipeline, tuning, optimizing and evaluation.Experience with Sponsored Ads or...SeniorLocal areaFlexible hours$150.75k - $241.2k
...make a positive impact at scale?As a Machine Learning Engineer at Axon, you’ll help build AI solutions... ...VR, and more—supporting the training, evaluation, testing, and deployment of machine learning... ...evaluation, inference optimization, data pipelines, cloud infrastructure, and...SeniorWork experience placementWork at officeRemote work$175k - $200k
Senior Machine Learning Engineer Truveta is the world’s first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers... ..., performance, and reliability. Understand evaluation deeply — fluent in ML validation and measurement...SeniorFor contractorsVisa sponsorshipWork visaFlexible hours- ...Senior Machine Learning Engineer (AI Training) About the Role What if your deep expertise in machine... ...for complex technical tasks. The data you create will directly influence... ...steps Familiar with advanced LLM evaluation and training methodologies Rigorous...SeniorHourly payOngoing contractContract workFreelanceRemote workFlexible hours
$184.5k
....The team is small and senior by design and operates... ...with decisions driven by data and AI tooling used in... ...a Senior AI / ML Data Engineer, you will build the data... ...and experimentation and evaluation support that let the... ...Network (IATAN) membership. Learn more about life at...SeniorFull time$180k - $215k
...place. We go beyond typical data-driven approaches or pure... ...architectures, combining rigorous engineering with learning systems proven in globally... ...What You'll Get To Do Machine Learning modeling... ...architectures, optimization, and evaluation, with a strong grasp of end...SeniorLocal area$150k - $220k
...closely with product, engineering and business leaders to... ...a difference with data. With access to multiple... ...company we value curiosity, learning and growth. As an... ...inference and machine learning practice.... ...techniques, such as Model Evaluation and Validation, Deep Learning...SeniorWork at office$175k - $308.5k
...Senior Machine Learning Engineer Join a team at the forefront of ML infrastructure and generative AI, where data and model workflows come together to enable the next generation of intelligent... ...includes embeddings (generation, evaluation, ANN search, multimodal support),...SeniorRelocationFlexible hours$138k - $208k
...Visits, March 2026) Day to Day As a Senior Machine Learning Engineer on our Sourcing team, you will work... ..., including prompt development and evaluation, training ML models, building LLM-as... ...Machine Learning Engineers, Data Scientists, Software Engineers, Product...SeniorWork experience placementLocal area$114.6k - $234.6k
...Machine Learning Engineer Implements machine learning (ML) models for production with minimal guidance... ...in deployment. Identifies potential data quality, security, and/or privacy... ...PyTorch, TensorFlow, Keras) to continuously evaluate their performance and scalability, and...SeniorTemporary workFlexible hoursShift work$140.2k
...world. The AI and Data Analytics Division, part of... ...connect foundational research to engineering to operations, providing... ...PNNL is seeking a Senior Machine Learning Engineer who has deep experience... ...for AI/ML infrastructure. Evaluates and recommend emerging...SeniorFor contractorsWork experience placementWork at officeLocal areaRelocation packageFlexible hours$196k - $245k
...About the RoleThe Trust Machine Learning team protects Remitly's... ...here takes both strong engineering and scientific rigor.As a Senior Machine Learning Engineer... ...rigorous offline and online evaluation methodologies that... ...practiceCollaborate with data scientists, risk operations...SeniorFull timeWork at officeWorldwideFlexible hours3 days per week$150k - $300k
...Senior Staff AI Engineer At GEICO, we offer a rewarding career where your ambitions are met with... ...knowledge graph, etc. System & Platform Evaluation: Own technical decisions regarding the... ...cross-functional teams, including data scientists, ML engineers, software engineers...SeniorHourly payWork experience placementLocal area- Rex.zone is hiring a Senior Data Annotator to produce and review high-quality training data for AI systems across NLP, computer vision, and multimodal evaluation. This is a Remote, full-time role focused on annotation guidelines compliance, content safety labeling, and...SeniorRemote jobFull time
$160k - $250k
...out if you are interested in joining the future of AI! Senior Machine Learning Engineer In order to execute our vision, we need to grow our... ...team, and is capable of planning out scalable, maintainable data pipelines. \n Responsibilities Everything involved...SeniorFull time- ...commerce enterprise. Utilizing cutting-edge machine learning technology, advanced NLP, CV,... ...technology, we're shaping a pioneering engine within the industry. Our objective is to... ...Excellent coding skills. Solid knowledge of data structure and algorithms.- Excellent in...SeniorWork experience placementWorldwide
- About the Team:The Data-Search-TikTok-Local Services team enhances local services by improving user discovery of hospitality, dining... ...while driving ecosystem growth. They leverage large-scale machine learning to refine search and recommendation systems, focusing on personalized...SeniorLocal area
- ...Responsibilities:1. Design and build large-scale machine learning algorithms to deeply optimize e-commerce search engines such as ranking, query analysis, and correlation... ...of the platform3. Use the large scale of data to deeply analyze the behavior of creators and merchants...Senior
- ...operational cost in TikTok E-commerce. We are currently looking for talented software engineers that have a deep understanding of machine learning (ML), operations research (OR), data mining and statistical inference. This position can be fulfilled in our San Jose and Seattle...SeniorWork experience placement
- ...recommendations, and ads.• Collaborate with product managers, data scientists, and the product strategy & operation team to define... ...field• 3+ working experience in one of the following fields: machine learning, NLP(Natural Language Processing), multimodal, and computer vision...SeniorWork experience placement
- ...deduplication/clustering.- Responsible for data construction, instruction fine-tuning,... ...Responsible for exploring reinforcement learning and operational research algorithms in intelligent... ...structures/algorithms, proficient in machine learning/deep learning theory, and rich...SeniorOverseas
$148.5k - $223.9k
...future of Salesforce.This role is for a Senior Machine Learning Engineer within the Trust Intelligence Platform team who will architect data-driven strategies for threat detection across... ...tools to help our recruiters assess and evaluate candidates’ resumes and qualifications...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Machine Learning / Data Engineer - Evaluation. Be the first to apply!
- machine learning engineer Seattle, WA
- machine learning software engineer Seattle, WA
- ai ml engineer Seattle, WA
- machine learning ai engineer Seattle, WA
- computer vision machine learning engineer Seattle, WA
- senior ml engineer Seattle, WA
- data platform engineer Seattle, WA
- aws data engineer Seattle, WA
- data engineer intern Seattle, WA
- data science developer Seattle, WA


