Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Prompt Engineer

$80k - $160k

Ova Technologies

Job Description

Job Description

Here's a sample AI Prompt Engineer Job Description (JD) that you can use for hiring or understanding the role.

AI Prompt Engineer

Location: Remote / Hybrid / On-site

Employment Type: Full-time

Job Summary

We are looking for an AI Prompt Engineer to design, test, and optimize prompts for large language models (LLMs) to improve the quality, accuracy, and efficiency of AI-generated outputs. The ideal candidate has strong analytical skills, excellent communication abilities, and experience working with generative AI tools.

Key Responsibilities
  • Design and optimize prompts for AI models such as GPT, Claude, Gemini, and other LLMs.

  • Develop prompt libraries, templates, and workflows.

  • Test, evaluate, and refine prompts based on model performance.

  • Collaborate with product, engineering, and business teams to understand requirements.

  • Build AI-assisted workflows for content generation, automation, and customer support.

  • Analyze AI outputs and recommend improvements.

  • Document prompt engineering best practices and standards.

  • Stay updated with the latest advancements in generative AI and prompt engineering.

Required Skills
  • Strong understanding of Large Language Models (LLMs).

  • Experience with prompt engineering techniques such as:

    • Zero-shot prompting

    • Few-shot prompting

    • Chain-of-thought (where appropriate)

    • Role prompting

    • Structured prompting

  • Excellent written and verbal communication skills.

  • Critical thinking and problem-solving abilities.

  • Basic understanding of APIs and AI integrations.

  • Familiarity with Python or JavaScript is an advantage.

  • Experience using AI platforms and automation tools.

Preferred Qualifications
  • Bachelor's degree in Computer Science, AI, Data Science, Linguistics, or a related field.

  • 1 3 years of experience working with generative AI tools.

  • Experience with prompt evaluation frameworks.

  • Knowledge of Retrieval-Augmented Generation (RAG), AI agents, embeddings, and vector databases.

  • Familiarity with cloud AI services and AI APIs.

Nice-to-Have Skills
  • Python

  • SQL

  • REST APIs

  • Git/GitHub

  • JSON

  • Markdown

  • AI workflow automation

  • Data analysis

Key Competencies
  • Creative thinking

  • Analytical mindset

  • Attention to detail

  • Communication skills

  • Experimentation mindset

  • Collaboration

  • Continuous learning

Tools
  • ChatGPT

  • Claude

  • Gemini

  • Microsoft Copilot

  • GitHub

  • Postman

  • Jupyter Notebook

  • VS Code

  • LangChain (preferred)

  • LlamaIndex (preferred)

  • Prompt management and evaluation tools

KPIs
  • Prompt accuracy and quality

  • Reduction in AI hallucinations

  • Improvement in user satisfaction

  • Time saved through AI automation

  • Prompt reusability

  • AI workflow efficiency

Salary (Typical)
  • India: 6 20 LPA (depending on experience and company)

  • United States: $80,000 $160,000 per year

This JD is suitable for organizations hiring AI Prompt Engineers to build, evaluate, and optimize generative AI applications across domains such as customer support, content creation, software development, and business automation.

Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the AI Prompt Engineer in New York, NY vacancy
  •  ...The Flywheel is seeking a detail-focused tester who designs prompts for AI agents to test our sites and apps. You will guide end-to-end...  ...and distinguish real issues from false alarms. Strong prompt-engineering and familiarity with AI tools like ChatGPT, Claude and Muse... 
    Suggested
    Remote job

    We The Flywheel

    New York, NY
    2 days ago
  • $94.4k - $266.3k

     ...That work changes the operating model an engineering organization runs on, the ways of working...  ...sets the target. What we design from it is AI-native by construction. We redesign...  ...Atlassian Rovo and LLMs. This role combines prompt engineering, knowledge orchestration, AI... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture Global

    New York, NY
    4 days ago
  •  ...Job Description Our NYC based financial client is seeking an AI Engineer for a long-term, hybrid contract role. Responsibilities include...  ...AI models for real-world use cases - Create and optimize prompts, embeddings, and retrieval strategies for AI applications -... 
    Suggested
    Long term contract

    Certified Network Specialists Inc

    New York, NY
    21 days ago
  • $85 - $95 per hour

     ...automation, and enterprise integration solutions using Azure AI Foundry, Azure OpenAI, Azure AI Search, Azure Functions, Azure...  ...services. Design GenAI solutions using LLM orchestration, prompt engineering, RAG, grounding, tool/function calling, evaluation frameworks,... 
    Suggested
    Hourly pay
    Remote work

    Phaxis LLC

    New York, NY
    22 days ago
  •  ...management firm, located in New York City is looking to hire an AI Engineer to join their Business Technology and Data Team. This is a...  ...augmented generation, natural language processing, model evaluation, prompt engineering, data pipelines, and production-ready software... 
    Suggested
    Full time
    Work at office

    Velocity Search Group Inc

    New York, NY
    22 days ago
  •  ...Description Job Description We build AI agents that actually work in enterprise environments...  ...— not prototypes, not demos. We need engineer's who can own the entire agent stack: a...  ...Vault), audit logging for agent actions, prompt injection defense, and data residency... 
    Temporary work

    Trilagen

    New York, NY
    12 days ago
  •  ...Senior Agentic AI Engineer Embedded Engineering Engagement We are hiring Senior Agentic AI Engineers to join a high-impact engineering...  ...engineering, context management, retrieval, memory, or prompt/tool architecture. Automated testing frameworks or AI-... 
    Remote work

    LinkedIn

    New York, NY
    4 days ago
  •  ...Are you a dynamic AI Engineer based in either NYC, Miami, or Chicago with 3-6 years' experience? Leadenhall Search & Selection are excited...  ...Responsibilities Build AI tools end to end, including prompts, retrieval, orchestration, user interfaces and integrations.... 
    Work at office

    Leadenhall Search & Selection

    New York, NY
    4 days ago
  •  ...Responsibilities Build an outbound engine covering lead sourcing, enrichment, scoring, and...  ...qualification, and nurture triggers Create an AI-assisted content pipeline for outbound...  ...Proficiency with LLM APIs (Claude, GPT), prompt engineering, agent frameworks, and RAG Strong... 

    Rwazi, Inc.

    New York, NY
    3 days ago
  • $200k

     ...We're looking for an experienced AI Engineer to join Optiver's Applied AI and Platform Engineering team. In this role, you'll design, build...  ...applications, with practical knowledge of model evaluation, prompt engineering, tool calling, context management, agent... 
    Work at office

    Optiver

    New York, NY
    5 days ago
  • $130k - $190k

     ...role. You'll embed directly with the cross functional AI team as a dedicated AI engineer. Your job isn't to write code faster with AI. It's to fundamentally...  ...Manage evals and regression testing after model updates, prompt changes, or upstream data shifts. Continuously improve... 
    Hourly pay
    Shift work

    CookUnity

    New York, NY
    11 days ago
  •  ...Description Job Description Palona’s AI agents operate in real restaurant environments...  ...are looking for an applied AI Modeling Engineer to improve the intelligence, accuracy,...  ...problems across model selection and routing, prompting and context, fine-tuning or post-training... 
    Temporary work
    Immediate start

    Palona AI

    New York, NY
    9 days ago
  •  ...Job Description Job Description Our client is seeking an AI Engineer – GenAI / Agentic Systems to design and build enterprise-grade...  ...rates. Apply LLMOps best practices including CI/CD, prompt/version management, automated testing, monitoring, and production... 

    Expert In Recruitment Solutions

    New York, NY
    22 days ago
  •  ...Services /Asset Management company is seeking an experienced AI Engineer to design and deploy enterprise AI solutions across business functions...  ...AI, Machine Learning, Azure AI services, Python, RAG, prompt engineering, embeddings, and production AI deployments . Top... 
    Worldwide

    Highbridge Consulting LLC

    New York, NY
    22 days ago
  • $210k - $250k

     ...Founding AI Engineer New York City, NY | In-Person | $210,000–$250,000 Base + Equity About the Company Shields Group Search is...  ...features into production. Hands-on experience with frontier model prompting and prompt engineering. Experience designing and deploying... 

    Shields Group Search

    New York, NY
    6 days ago
  • $120k - $145k

     ...Job Description Job Description Purpose of Position: The AI Engineer is responsible for developing, testing, deploying, and...  ...databases, APIs, and business applications. • Participate in prompt engineering, context management, tool integration, and agent orchestration... 
    Work experience placement
    Work at office
    Remote work
    Visa sponsorship
    Work visa

    Amalgamated Bank of NY

    New York, NY
    26 days ago
  •  ...Job Description Job Description AI Engineer (GenAI Workflows for OTC Derivatives) Location: New York City (SoHo) — In-Person...  ...judge and custom evaluators, and regression testing for model and prompt changes Strong context engineering skills: retrieval and grounding... 
    Work at office

    NxT Level

    New York, NY
    6 days ago
  • $210k - $250k

     ...both clients and candidates. Title of Role: Founding AI Engineer Location: New York City, NY (Flatiron District) Company...  ...ongoing improvement. Build reliable agent systems involving prompting, tool use, context management, and multi-step workflows. Develop... 
    Full time
    Work at office

    Recruiting from Scratch

    New York, NY
    11 days ago
  •  ...Founding Engineer (AI) NYC | In-Person | Founding Team We're looking for a rare builder who can ship products, build AI systems from...  ...experience with AI agents, tool calling, memory, RAG, evaluations, and prompt systems Proven track record of building and shipping... 
    Full time

    Stable10

    New York, NY
    3 days ago
  •  ...Build the Future of AI at a Leading Investment Firm We are a premier New York-based...  ...candidate to lead AI & Forward Deployed Engineering to lead the firm's enterprise AI...  ...Retrieval-Augmented Generation (RAG) Prompt Engineering Vector Databases Workflow... 
    Full time
    Work at office
    3 days per week

    Almond Partners (Buy-Side Executive Search)

    New York, NY
    3 days ago
  • $350k

     ...Senior AI Engineer sought to join a small, exceptionally fast-moving engineering team building an AI-native consumer platform. There is...  ...enterprise applications. ~ Strong applied AI experience across prompting, embeddings, RAG, agent memory and personalisation. ~... 
    Full time

    IT Recruitment Solutions

    New York, NY
    2 days ago
  •  ...Bachelor’s degree in computer science, Engineering, Mathematics, Finance, or a related field...  ...comparable LLM APIs). Strong understanding of prompt engineering, including prompt design,...  ...validation. Experience building AI or data-driven applications that use APIs... 
    H1b
    Local area

    Robotic Technologies Automation

    New York, NY
    2 days ago
  • $12.5k

     ...About the Company Ajaia is a rapidly growing AI consultancy and product studio dedicated...  ...pillars: AI Strategy and Advisory, AI Engineering and Automation, Workforce Training and Enablement...  ...into production systems: LLM APIs, prompt workflows, retrieval (RAG), agents, and... 
    Remote work
    Monday to Friday

    AJAIA

    New York, NY
    4 days ago
  • £50k per year

     ...AI ENGINEER – AGENTIC AI / GENERATIVE AI Salary up to £50,000 Chester based opportunity Python, LLMs, RAG, Azure, APIs Opportunity to build...  ...company data. You’ll work with Large Language Models (LLMs), prompt engineering, RAG and API integrations to develop intelligent... 

    Searchability

    New York, NY
    4 days ago
  • $161.8k - $184.6k

    AI Engineer 3 (AI Foundations) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years...  ...integrations, and fine-tuning workflows ~ Experience applying prompt-engineering strategies, safety guardrails, and red-teaming... 
    Full time
    Part time
    Work at office
    Local area

    Capital One

    New York, NY
    3 days ago
  •  ...Workplaces in Financial Services & InsuranceAI Evaluation Engineer PRIMARY PURPOSE: The AI Evaluation Engineer designs, builds, and operates the...  ...into CI/CD, with regression testing and quality gates for prompt, model, and retrieval changes. Implement offline... 
    Remote work

    Sedgwick

    New York, NY
    1 day ago
  •  ...Serotonin seeks an AI GTM Engineer to enhance marketing workflows using AI tools. This role is ideal for candidates skilled in prompt engineering and workflow automation, particularly in marketing contexts. In this position, you will audit and redesign marketing workflows... 

    Serotonin

    New York, NY
    17 hours ago
  •  ...Job Description Job Description Job Description: Generative AI Engineer Job Title: Generative AI Engineer Experience: 3–6 Years...  ...such as Pinecone, FAISS, Chroma, or Weaviate. Implement prompt engineering, context management, and model evaluation techniques... 
    Full time
    Remote work

    Ova Technologies

    New York, NY
    20 days ago
  • $95k - $140k

     ...compassion, and a strong work ethic. We're looking for an AI Engineer to build and deploy intelligent systems across asset management...  ..., and autonomous decision support RAG architecture, prompt engineering, and agent-based workflows Python as the backbone... 
    Work at office

    MONTICELLOAM

    New York, NY
    a month ago
  •  ...- we want you on our team! Job Description: Forward-Deployed AI Engineer Location India (Pune / Bangalore / Remote India) Reports To...  ...functions, ML model registry) Experience with LLMs in production (prompt engineering, RAG architectures, evaluation of generative... 
    Permanent employment
    Full time
    Contract work
    Remote work

    Bottomline

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Prompt Engineer. Be the first to apply!