Senior Prompt Engineer: LLM Migration & Optimization
Part-time
Welo Data
Are you an expert at navigating the complex architecture of Large Language Models? Welo Data is seeking a Senior Prompt Engineer to lead the technical migration of template workflows into high-performance LLM autoraters.
This role is designed for a technical specialist who understands that "perfecting a prompt" is a rigorous engineering discipline. You will leverage advanced APG/APO tools and manual refinement to ensure our automated systems meet—and exceed—human crowd baselines in accuracy and nuance.
The Mission: Automated Quality at Scale
- Architectural Migration: Take full ownership of the end-to-end technical migration of templates to LLM autoraters.
- Optimization Leadership: Utilize Automatic Prompt Generation (APG) and supervise Automated Prompt Optimization (APO) tools to push model performance past plateaus and deadlocks.
- Metrics-Driven Excellence: Continuously measure quality against "gold data" baselines, tracking precision, recall, and $F_1$ scores to justify launch readiness.
- Edge-Case Engineering: Manually draft and refine complex prompts to overcome anti-patterns and architecture gaps that automated tools can't solve.
Project Details
- Job Title: Senior Prompt Engineer (LLM Migration)
- Schedule: Part-Time (Set your own hours within project milestones)
- Location: 100% Remote ( Must be based in the United States )
- Employment Type: Freelance / Independent Contractor
Candidate Profile
- Educational Foundation: Bachelor’s, Master’s, or PhD in Computer Science, Data Science, Computational Linguistics, or a related analytical field.
- Prompt Engineering Mastery: 4+ years of experience tuning LLMs for strict, structured outputs, complex classification, and few-shot learning.
- Analytical Power: High proficiency in identifying error patterns and using SQL or data analytics tools to monitor performance.
- Technical Agility: Fast learner capable of mastering proprietary internal tools and "Goose API" style interfaces with minimal oversight.
Preferred Technical Skills
- Familiarity with shadowbot monitoring and disagreement tracking.
- Experience in AI model evaluation and software engineering.
- Deep understanding of semantics, logic, and Chain-of-Thought (CoT) prompting.
- Proven ability to draft high-level Launch Certification Documentation .
Recruitment & Onboarding
- Technical Review: Submit your CV and portfolio of LLM optimization work.
- Prompt Assessment: Demonstrate your ability to navigate complex template clusters and APO deadlocks.
- Tooling Deep-Dive: Get access to our internal technical suite and migration workflows.
- Launch: Begin your part-time engagement and lead the shift to LLM-driven autorating.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Senior Prompt Engineer: LLM Migration & Optimization in United States vacancy
- ...Models? Welo Data is seeking a technical Prompt Engineer to lead the end-to-end migration of template workflows into high-performance LLM autoraters. This isn't just about... ...templates to LLM autoraters. Optimization Leadership: Run and supervise Automated...SuggestedPart timeFor contractorsFreelanceRemote workFlexible hours
- Amazon seeks a System Development Engineer (Contractor) to drive DRAM memory optimization through JDK migrations and heap right-sizing for Java-based services. You will plan upgrades (17→21, 21→25), validate zero-downtime migrations, and implement optimal heap configurations...SeniorFor contractors
- ...Texas Sports Academy is on the lookout for a Senior AI Engineer specializing in LLM (Large Language Model) Systems and RAG (Retrieval-Augmented Generation) Optimization. As we continue to push the boundaries of sports technology, your role will be pivotal in developing...SeniorRemote jobFull time
Texas Sports Academy
United States14 hours ago - A tech company is seeking a skilled Prompt Engineer for a remote position in the European Union. The ideal candidate will design, test, and optimize prompts to enhance AI model performance. Responsibilities include collaborating with data scientists, ensuring compliance...SuggestedRemote workFlexible hours
Codertal
Union, NJ1 day ago - ...Description We are looking for an experienced Senior LLM Engineer to build an AI-powered data... ...and retrieval pipelines. ~Design and optimize embeddings and semantic search strategies... ...sources into AI workflows. ~Develop prompt engineering strategies to improve response...SeniorFull timeHome office
Oowlish Technology
Remote14 hours ago - ...Master's and a track record of shaping LLM performance? Welo Data is seeking a Lead Prompt Engineer to spearhead the technical migration of template architectures into state-... ...child template clusters and automated optimization. Advanced Optimization: Direct the...Part timeFor contractorsFreelanceRemote workFlexible hours
Welo Data
United Statesmore than 2 months ago - Role Description We are looking for a Senior NLP/LLM Engineer . ~Conducting experiments with LLMs:... ...offline and online metrics. ~Optimizing models for inference: Improve the efficiency... ...and adaptation via SFT, LoRA, QLoRA, prompt tuning, and prefix tuning; familiarity...SeniorFull timeWork at officeRemote workWork from home
Social Discovery Group
Remote1 day ago - NVIDIA is seeking software engineers to join a Deep Learning models performance engineering team tasked with building and optimizing libraries and tools for efficient AI applications. The team accelerates DL frameworks like PyTorch and JAX, enabling researchers and engineers...Senior
$184k - $287.5k
We're now looking for a Sr. Inference Engineer, for GPU Kernel Optimization! What does it take to push every LLM inference operation to its performance ceiling? Our LLM Inference Performance Analysis and Optimization team builds the answer from the ground up. We develop...SeniorFull time$130k - $158k
Job DescriptionECS is seeking a Senior Databricks Migration Engineer to work onsite for the US Postal Services' Inspector General's Office (OIG) at our... ...schemas) specifically to maximize Power BI performance.Optimize Databricks SQL Warehouses to support high-concurrency,...SeniorPermanent employmentWork at office$184k - $287.5k
...We are now looking for a Senior High-Performance LLM Training Engineer!NVIDIA is seeking experienced engineers specializing in performance analysis and optimization to improve the efficiency of LLM training workloads, which are shaping the world's most advanced computing...SeniorFull timeWork experience placement- ...platform components used broadly across engineering teams. Key Responsibilities Design... ...implement orchestration patterns for LLM-powered agents. Evaluate and select... ...safeguards, fallback mechanisms, and cost optimization strategies. Collaborate with platform...SeniorFull time
Calliere
Remote14 hours ago - Role Description As a Senior CXE Engineer, you are a hands-on... ...AI, Amazon Lex plus LLM-based development (Amazon... ...), including prompt engineering and tool... ...behavior for voice AI ~Optimize inference cost and latency... ...legacy platform migrations ~Build custom Agent...SeniorFull timeWork at officeRemote workWorldwideFlexible hours
Caylent
Remote1 day ago - ...Tasks: As a Senior Engineer, you will design and ship agentic AI systems... ...robust failure handling. LLM adaptation & deployment: fine... ...efficiently adapt open-source LLMs; optimize inference (latency/cost) and... ...), regression tests, and prompt/model versioning....SeniorRemote job
Bluebird
Remote8 days ago $226k - $307k
...autonomous system intelligence.As a Machine Learning and System Optimization Engineer, you will orchestrate and allocate overall system capacity to... ...models) and edge deployment technologies (e.g., TensorRT-LLM).$226,000 - $307,000 a yearBase Salary Range There are three...SeniorFull timeTemporary workRelocation package- NVIDIA is seeking a Senior DL Algorithms Engineer to optimize LLM/Omni models and enhance performance across its software stack. The ideal candidate will have a PhD and 3+ years of experience in deep learning, specifically in inference. This role involves profiling, analyzing...Senior
$160k - $230k
...language models (LLMs). Our mission is to optimize inference frameworks, algorithms, and... ...anInference Frameworks and Optimization Engineer to design, develop, and optimize distributed... ...unique opportunity to shape the future of LLM inference infrastructure, ensuring scalable...Full time$184k - $287.5k
We are now looking for a Senior High-Performance LLM Training Engineer! NVIDIA is seeking experienced engineers specializing in performance analysis and optimization to improve the efficiency of LLM training workloads, which are shaping the world's most advanced computing...SeniorWork experience placement- Senior Data Center Systems Engineer -- AI Infrastructure & Performance OptimizationJob DescriptionPosition SummaryJohnson... ...center infrastructure, focusing on optimizing the interdependencies between... ...running diverse workloads including LLM training and inference, VLM...SeniorFull timeWork at office
- ByteDance in Seattle is seeking a Senior Research Engineer/Scientist for Storage for LLM to design and maintain a high-performance KV cache layer for LLM inference... ...will collaborate with inference and serving teams, optimize eviction policies, memory management, and explore...Senior
- Mercury in New York is seeking an experienced software engineer to evolve Command, Mercury's LLM-powered financial assistant. You will design and ship new... ...cash flow, and own end-to-end capabilities from system prompts to frontend rendering. You will build agentic...Senior
$145k - $185k
...looking for an experienced Senior LLMOps Engineer to design, implement, and maintain... ...large-language-model (LLM) pipelines, deployment... ...orchestration, evaluation, and optimization. ContributionsArchitect and... ..., and automated testing of prompt and model behaviors....Senior- ...seeking a skilled Linux/UNIX System Administrator to manage and maintain systems, ensuring optimal performance and security. The role involves troubleshooting, system migrations, and providing guidance to junior staff. The ideal candidate should have 5+ years of experience...Senior
- The Timberline Group is seeking a SQL Engineer to manage and optimize SQL Server environments, implement geoclustering for DR/BC, and automate DBA... ...PowerShell or Python. The role covers on‑prem and cloud migrations with emphasis on performance and security. You will...Senior
- ..., Michigan Software Engineer (4) - Premium Senior Engineer #1061383 Position... ..., or similar LLM-based development assistants... ...performance and optimizing the application and... ...Development, Prompt Engineering, LLM API... ...Platform, Big Query, Data Migration, Data Management...SeniorImmediate startFlexible hours
- ...full stack experience, data engineering skills, and expertise in AI,... ...expertise, schema design, and optimization are required. Experience building... ...LLMsExperience working with LLM-powered workflows (agents,... ...is required. Familiarity with prompt engineering, JSON outputs, and...Senior
Optimus
Austin, TX5 days ago $200k - $270k
...unlock the power of AI. As a Senior Forward Deployed Engineer, Applied AI on our Cortex... ..., monitoring, and optimization in secure, large-scale production... ...evaluation frameworks for LLM or agent systems, and... ...offline evals) to compare prompts, models, or agent architectures...Senior- ...Senior Backend EngineerHatch I.T. is partnering with... ...find a Senior Backend Engineer. See details below:Holokai... ...-step AI plans using LLM's, executed as deterministic... ...schema design, query optimization, and data... ...APIs and AI/ML pipelines: prompt engineering, model integration...Senior
Hatchit Co
Washington DC5 days ago - ManpowerGroup Global, Inc. in Seattle, WA seeks a System Development Engineer (Contractor) to drive DRAM memory optimization via JDK migrations and heap right-sizing for large-scale Java services. You will plan upgrades (e.g., JDK 17-25), resolve blockers, and implement...For contractors
- New England Technology Partners, Inc. is seeking an Exchange Administrator to join a migration team for MS Exchange infrastructure moving from Exchange 2007 to 2010. The role includes planning, migration, testing, and troubleshooting phases of the project. The successful...SeniorContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Prompt Engineer: LLM Migration & Optimization. Be the first to apply!
Related searches
- senior maintenance supervisor United States
- senior lead project manager United States
- senior robotics software engineer United States
- senior firewall engineer United States
- senior devops engineer remote United States
- senior sas administrator United States
- senior IT manager United States
- senior director of client services United States
- senior contracts analyst United States
- senior implementation consultant United States