Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Prompt Engineer: LLM Migration & Optimization

Welo Data

United States. Remote Part-Time Are you an expert at navigating the complex logic of Large Language Models? Welo Data is seeking a technical Prompt Engineer to lead the end-to-end migration of template workflows into high-performance LLM autoraters. This isn't just about writing prompts—it’s about engineering a technical bridge. You will use advanced APG/APO tools and manual refinement to ensure our automated systems meet (and exceed) human accuracy baselines. The Mission: Architecting the Future of Rating Technical Migration: Take ownership of the workflow for transitioning templates to LLM autoraters. Optimization Leadership: Run and supervise Automated Prompt Optimization (APO) tools, identifying where logic plateaus and providing the manual "spark" to overcome deadlocks. Metrics-Driven Accuracy: Continuously measure quality against gold data, calculating critical performance metrics like precision, recall, and $F_1$ scores. Edge-Case Engineering: Solve complex scenarios by designing manual prompts that handle anti-patterns and broken logic in legacy architectures. Project Details Schedule: Part-Time (Flexible hours within project milestones) Location: 100% Remote (Must be based in the United States) Employment Type: Freelance / Independent Contractor Who We Are Looking For Linguistic & AI Mastery: 2+ years of experience as a Prompt Engineer. You must be comfortable tuning LLMs for structured outputs and complex classification tasks. Academic Background: BS, MS, or PhD in Computer Science, Data Science, Computational Linguistics, or a related analytical field. Technical Agility: Fast learner capable of mastering proprietary internal tools and interfaces (like the Goose API) with minimal supervision. Data Fluency: Strong ability to identify error patterns and use SQL or data analytics tools to analyze model performance. Preferred Skills Familiarity with shadowbot disagreement tracking between humans and LLMs. Hands-on experience with Chain-of-Thought (CoT) and few-shot learning. Proven ability to draft high-level Launch Certification Documentation. #J-18808-Ljbffr Welo Data

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Prompt Engineer: LLM Migration & Optimization in New York, NY vacancy
  •  ...Prompt Engineer Innodata is building a team of prompt engineers to harness the power of large language models to automate data annotation...  ...modeling. Conduct user testing and feedback analysis to optimize prompt design for data accuracy and linguistic consistency.... 
    Suggested
    Fixed term contract

    latitude

    Ridgefield Park, NJ
    4 days ago
  •  ...for a creative, technically sharp Prompt Engineer to design, craft, and optimize the prompts and instruction sets that...  .... You will work across multiple LLM providers (OpenAI, Anthropic, open...  ...version changes and provider migrations Track and optimize token usage, prompt... 
    Suggested
    Remote work
    Worldwide

    Lockedinai

    New York, NY
    4 days ago
  •  ...Role We’re seeking Software Engineers to develop scalable systems that...  ....) to ensure robust, correct LLM outputs Collaborate with Ops...  ...handling Deploy, scale, and optimize your solutions in a secure,...  ...integrate LLMs using structured prompts, scaffolding frameworks (... 
    Suggested
    Full time
    Contract work
    Part time
    For contractors
    Flexible hours

    Basis Research Institute

    New York, NY
    2 days ago
  •  ...team comes from high‑performing engineering cultures, including Meta,...  ...creating reliable AI agents, prompt engineering, possesses a great...  ...‑of‑the‑art language models Optimize prompts to maximize classification...  ...3+ YOE in Python 1+ YOE in LLM framework like Langchain or... 
    Suggested

    GPTZero

    New York, NY
    2 days ago
  •  ...Anywhere Jobs (FlexJobs, 2025). We are looking for a Middle Prompt Engineer to help improve the quality and reliability of our AI...  .... You will work with large-scale user-generated content and optimize LLM prompts used for automated moderation of photos, profiles, and... 
    Suggested
    Remote job
    Full time
    Work at office
    Work from home

    Moonfire

    New York, NY
    2 days ago
  • R4 Solutions is looking for a Senior Data / ML Engineer to work on use cases with LLM models. The role involves addressing challenges related to LLMs...  ...States. If you're passionate about AI and have the skills to optimize model usage, apply now. #J-18808-Ljbffr R4 Solutions
    Full time

    R4 Solutions

    New York, NY
    2 days ago
  • Marketing AI Prompting and Automation Engineer Full‑time | Remote | Salary $200,000+ with bonuses. Hyros is looking for an AI Prompting and Automation Engineer to optimize our AIR AI agent, improve client revenue, design new agents, and train others. What You’ll Do Optimize... 
    Full time
    Remote work

    Hyros

    New York, NY
    2 days ago
  • $100k - $125k

    Verizon Communications is seeking a Cell Site Engineer to maintain and optimize cell sites across the Manhattan area. The ideal candidate will have at least 3 years of experience, an associate’s degree, and the ability to perform physical job requirements, including climbing... 

    Verizon Communications

    New York, NY
    21 hours ago
  •  ...policy enforcement) following MCP protocol. Engineer robust guardrails for safety, compliance...  ...LLMs; implement retrieval pipelines, prompt synthesis, response validation, and self...  ..., and risk. Scale and performance: Optimize cost and latency via prompt engineering,... 
    Hourly pay
    Remote work

    NTT DATA North America

    New York, NY
    2 days ago
  • A leading staffing agency is seeking an AI Engineer to join a rapidly growing AI team. The role focuses on building and deploying...  .... Ideal candidates will have strong experience with LLM frameworks and prompt engineering, along with excellent communication skills. This... 
    Remote job
    Full time

    Prestige Staffing

    New York, NY
    2 days ago
  •  ...platform components used broadly across engineering teams. Key Responsibilities Design...  ...implement orchestration patterns for LLM-powered agents. Evaluate and select models...  ..., fallback mechanisms, and cost optimization strategies. Collaborate with platform... 

    Calliere Group

    New York, NY
    4 days ago
  • $195k - $290k

     ...platform. About the Role Principal Data Engineer with deep expertise in Large...  ...You'll Do Architect, implement, and optimize data platforms and pipelines for...  ...massive scale. Hands‑on experience in LLM engineering (fine‑tuning, prompt engineering, deployment), RAG, and... 
    Remote job
    Work at office

    CrowdStrike

    New York, NY
    1 day ago
  • Yuno is looking for a Senior AI Engineer to build innovative AI-driven solutions. In this...  ...responsibilities include designing and optimizing AI systems, integrating AI features, and...  ...should have extensive experience with LLMs, prompt engineering, and proficiency in Python.... 
    Remote job
    Full time
    Work from home
    Home office

    Yuno

    New York, NY
    2 days ago
  • $66.67k - $100k

    The Marmon Group LLC is hiring a Manufacturing Optimization Engineer II to lead initiatives in factory transformation using Lean principles and automation technologies. In this role, you will analyze and redesign production environments to drive significant efficiency improvements... 

    The Marmon Group LLC

    New York, NY
    11 hours ago
  •  ...management technology company in New York City is seeking a Process Engineer to join their Data Solutions Team. The ideal candidate will have 3-5 years of experience in data operations, focusing on optimizing workflows and implementing automated solutions. You will work... 
    Flexible hours

    Canoe Intelligence

    New York, NY
    21 hours ago
  • Cacheflow is seeking a Senior Field Engineer to join its Professional Services organization, focusing on enhancing migration solutions using AI Coding Agents. This remote role requires over 6 years of software development experience, proficiency in API integrations and... 
    Remote job

    Cacheflow

    New York, NY
    4 days ago
  • Clinical Prompt Engineer (Therapy AI Specialist) At Mentalyc, we’re reimagining how therapy is supported. Our mission is to make therapists...  ...(accuracy, relevance, user satisfaction), and recommend optimizations. Help document best practices and prompt standards for internal... 
    Contract work
    Remote work
    Flexible hours

    Mentalyc Inc.

    New York, NY
    2 days ago
  • 6AM City, LLC is looking for a Process Engineer at their Middletown site in Delaware. You will design and optimize GMP drug product manufacturing and packaging processes, ensuring all standards are met. The ideal candidate will have 3-5 years of experience in the pharmaceutical... 

    6AM City, LLC

    New York, NY
    2 days ago
  •  ...seeking a Senior AI & Automation Engineer to drive efficiency and...  ...Workato, automation platforms, LLM-based tools, REST APIs and internal...  ...“AI use cases” and reusable prompts / GEMs Track automation ROI,...  ...implementation, or systems optimization within a SaaS environment... 
    Remote job
    Flexible hours

    Optro

    New York, NY
    2 days ago
  • $101.9k - $140k

     ...do here: As the Software Engineering Manager, you will manage and...  ...improvement. Reimagine and optimize content creation workflows using...  ...& multimodal models, prompt & context engineering, developing...  ...or monolithic architectures, migrating systems to modular, cloud-native... 
    Work experience placement
    Live in
    Local area
    Remote work
    Worldwide

    Cengage Group

    New York, NY
    1 day ago
  • $65 - $80 per hour

    A renowned AI collaboration firm is seeking LLM Mechanical Engineers for a short-term remote project. The role involves using mechanical design expertise to improve AI models, with responsibilities including solving manufacturing scenarios and collaborating with AI researchers... 
    Remote job
    Hourly pay
    Contract work
    Temporary work
    Flexible hours

    Crossing Hurdles

    New York, NY
    2 days ago
  • Overview Job Title: Prompt Engineer (Microsoft Co-Pilot) Location: Fully Remote Duration: 6 months contract to hire Company: CoSourcing...  ...Engineer, you will play a key role in designing, implementing, and optimizing AI-driven solutions that integrate with Microsoft Co-Pilot.... 
    Full time
    Contract work
    Remote work

    CoSourcing Partners - Enterprise-AI and IT Services Company

    New York, NY
    2 days ago
  • A leading AI career platform is seeking a skilled Prompt Engineer to design, optimize, and evaluate prompts that enhance AI performance. You will be crucial in shaping the user's AI interaction by developing and maintaining high-quality prompts. Ideal candidates have 2+... 
    Remote work
    Worldwide

    Lockedinai

    New York, NY
    4 days ago
  •  ...search results page, or a site in the Google Display Network. AI Prompt Engineer- (Remote Opportunity) We’re looking for a GenAI Prompt...  ...insights - Mine and analyze large datasets, identify trends, and optimize AI performance to drive business value. Build AI-powered... 
    Remote work

    Vertex Inc.

    New York, NY
    2 days ago
  •  ...Will Make: As a staff software engineer, you will lead two areas that...  ...systems and enhance AI prompt effectiveness. Drive the technical...  ...for workflow and backend optimization. Lead and contribute to the...  ...-tune AI capabilities for AI/LLM-driven scenarios. Expertise... 
    Work experience placement
    Remote work
    Flexible hours

    airbnb, Inc.

    New York, NY
    2 days ago
  • Freelanceshop is looking for a Senior Prompt Engineer to join their remote innovation team focused on Generative AI technologies. You will design and optimize prompts to enhance AI systems used across products globally. Ideal candidates should have 3-6+ years of relevant... 
    Remote job
    Flexible hours

    Freelanceshop

    New York, NY
    12 hours ago
  • Social Discovery Group is seeking a Senior NLP/LLM Engineer to enhance AI models' capabilities through experimentation and collaboration...  ...natural language processing principles. With tasks such as optimizing models and developing evaluation methodologies, the position... 
    Remote job

    Social-Discovery-Group

    New York, NY
    4 days ago
  • $110k - $140k

     ...meet the evolving needs of both public and private organizations throughout the United States. Job Title Reliability Engineer - Maintenance Optimization & Failure Analysis Job Description We’re looking for a Reliability Engineer to enhance operational performance and... 
    Full time
    Contract work
    Remote work
    Shift work

    AZH Consulting Corp

    New York, NY
    4 days ago
  •  ...mutual respect, and human dignity at the center. Job responsibilities include: Flow to work as part of the Value Stream Engineering Optimization Team. Expected to be able to support converting and manufacturing activities across all of Family Care. In the event of escalation... 
    Internship
    Local area
    Immediate start
    Relocation package

    Kimberly-Clark

    Brooklyn, NY
    3 days ago
  • $180k - $240k

     ...Overview We’re seeking an exceptional Senior Software Engineer to join our LLM team. This role is focused on building and maintaining...  ...success team to understand customer challenges, help optimize their prompt strategies, build features that address their pain points... 
    Full time
    Remote work
    Easy work

    AssemblyAI

    New York, NY
    11 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Prompt Engineer: LLM Migration & Optimization. Be the first to apply!