Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Generative AI Engineer

Ova Technologies

Job Description

Job Description

Job Description: Generative AI Engineer

Job Title: Generative AI Engineer
Experience: 3–6 Years (with relevant GenAI experience)
Employment Type: Full-Time
Location: Hybrid / Remote / On-site
Department: AI / Machine Learning / Engineering

Job Summary

We are looking for a skilled Generative AI Engineer to design, develop, and deploy AI-powered applications using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), vector databases, and modern AI frameworks. The ideal candidate will have strong Python programming skills, experience integrating LLMs into production applications, and a solid understanding of machine learning, NLP, and cloud-based AI solutions.

Key Responsibilities
  • Design, develop, and deploy Generative AI applications using LLMs such as GPT, Claude, Gemini, and open-source models.
  • Build and optimize RAG pipelines, including document ingestion, chunking, embedding generation, retrieval, reranking, and response generation.
  • Develop AI agents and multi-agent workflows using frameworks such as LangChain, LangGraph, or Semantic Kernel.
  • Integrate vector databases such as Pinecone, FAISS, Chroma, or Weaviate.
  • Implement prompt engineering, context management, and model evaluation techniques to improve response quality.
  • Develop REST APIs and backend services using Python and frameworks such as FastAPI or Flask.
  • Work with structured and unstructured data, including PDFs, documents, databases, and enterprise knowledge bases.
  • Implement responsible AI practices, including guardrails, hallucination mitigation, security, and data privacy.
  • Optimize model performance, latency, token consumption, and inference costs.
  • Deploy and monitor AI applications using cloud platforms and MLOps/LLMOps practices.
  • Collaborate with data scientists, software engineers, product managers, and business stakeholders.
Required Skills and Qualifications
  • Strong programming experience in Python.
  • Hands-on experience building Generative AI applications using commercial or open-source LLMs.
  • Strong understanding of LLM architecture, transformer models, tokenization, embeddings, and context windows.
  • Practical experience implementing RAG-based applications.
  • Experience with prompt engineering, few-shot learning, and structured output generation.
  • Familiarity with vector databases and semantic search.
  • Experience with APIs, microservices, and backend development.
  • Knowledge of NLP, machine learning, and deep learning fundamentals.
  • Familiarity with Git, Docker, CI/CD, and software development best practices.
  • Experience with at least one cloud platform: AWS, Azure, or Google Cloud.
Preferred Skills
  • Experience building AI agents, tool-calling workflows, and multi-step reasoning applications.
  • Familiarity with LangChain, LangGraph, LlamaIndex, or Semantic Kernel.
  • Experience with fine-tuning, LoRA/QLoRA, or parameter-efficient model adaptation.
  • Knowledge of LLM evaluation frameworks and observability tools.
  • Experience with Hugging Face Transformers, PyTorch, or TensorFlow.
  • Familiarity with Kubernetes, MLflow, and production model-serving systems.
  • Experience implementing AI safety, access controls, and enterprise-grade security.
Education

Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, Information Technology, or a related field, or equivalent practical experience.

Key Deliverables
  • Production-ready Generative AI applications.
  • Scalable RAG pipelines and enterprise knowledge assistants.
  • Reliable AI agents and automated workflows.
  • Measurable improvements in response accuracy, latency, and operational cost.
  • Well-documented, secure, and maintainable AI services.
Success Criteria
  • Quality, relevance, and factual accuracy of AI-generated responses.
  • Retrieval accuracy and reduction in hallucinations.
  • Application performance, reliability, and scalability.
  • Cost-effective model usage and efficient inference.
  • Successful integration of AI solutions into business workflows.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Generative AI Engineer in New York, NY vacancy
  •  ...AI Engineer – Agentic AI / Generative AI Location: Mountain View, CA or New York, NY (Hybrid – 3 days onsite weekly) Employment Type: Contract (6 months with potential extensions) About the Opportunity Optomi is seeking an experienced AI Engineer for an exciting... 
    Suggested
    Contract work
    3 days per week

    Optomi

    New York, NY
    4 days ago
  •  ...We are Photon, one of the world's largest Digital Platform Engineering companies providing a combination of Strategy Consulting, Creative...  ...at least one year in GenAI ~ Design, develop, and deploy Generative AI applications using LLMs (OpenAI, Azure OpenAI, Claude, Llama)... 
    Suggested
    Full time

    Photon

    New York, NY
    1 day ago
  •  ...The Senior AI Engineer reports to the Lead AI Engineer and serves as their primary technical partner in designing and delivering secure...  ...Engineerures, engineering patterns, and standards for generative AI, machine learning, retrieval, and agentic workflows. Own... 
    Suggested
    Full time

    Atlantic Partners Corporation

    New York, NY
    3 days ago
  • $142.32k - $213.48k

     ...026-10-22 Location: New York, New York, United States Salary: $142,320.00 - $213,480.00 Category: Technology Company: Citi Generative AI Engineer At Citi, we are pioneering the future of enterprise operations through innovative technology. Our COO-Technology Engineering... 
    Suggested
    Full time
    Work at office
    Work from home
    Worldwide
    Flexible hours

    Citigroup Inc

    New York, NY
    15 hours ago
  • $102.5k - $170.9k

    Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant...  ...structured and unstructured data to identify patterns, generate insights, and support model development and validationCollaborate... 
    Suggested
    Local area

    Deloitte

    New York, NY
    3 days ago
  • $200k - $240k

     ...Job Description Job Description Genesis10 is currently seeking a Senior Generative AI Engineer - Remote for a direct hire opportunity with a Global Law Firm located in New York, NY. You will join as a Senior Generative AI Engineer on the AI Acceleration Team, reporting... 
    Remote job
    Permanent employment
    Contract work

    Genesis10

    New York, NY
    23 days ago
  •  ...Job Description Job Description Job Title: Senior AI Engineer – Generative AI & Agentic AI Location: New York or Sunrise, Florida Work Arrangement: Hybrid — three days per week at the client office Employment Type: Contract Visa : H1B candidates only... 
    Contract work
    H1b
    Work at office
    3 days per week

    iShare Inc

    New York, NY
    6 days ago
  • $65 - $85 per hour

     ...Job Description Job Description Job Summary: Our client is seeking a skilled Generative AI (GenAI) Engineer to join our team for a permanent, on-site role in New York City, NY or Alpharetta, GA . This position focuses on designing, building, and integrating... 
    Hourly pay
    Permanent employment

    Macpower Digital Assets Edge Private Limited

    New York, NY
    23 days ago
  • Zipporin is seeking an experienced AI & Generative LLM Solutions Engineer to spearhead the design and delivery of cutting-edge generative AI architectures for enterprise clients. Based in our New York, NY office on a hybrid schedule, you will serve as the technical bridge... 
    Temporary work
    Work at office

    Zipporin

    New York, NY
    16 days ago
  • $155k - $215k

     ...our Firm, enabling our clients and colleagues to redefine markets and shape the future of our communities. This is a Generative AI, Backend Engineering position at the Vice President level, which is part of the job family responsible for developing and maintaining software... 
    Temporary work

    Morgan Stanley

    New York, NY
    2 days ago
  •  ...Job Description Job Description Generative AI Engineer Job Description Job Title: Generative AI Engineer Job Type: Full-Time Experience: 2 6 Years Location: [Location / Remote / Hybrid] Department: Artificial Intelligence / Engineering Job Summary... 
    Full time
    Remote work

    Ova Technologies

    New York, NY
    23 days ago
  • $120k - $160k

     ...Job Description Job Description Genesis10 is currently seeking a Junior Generative AI Engineer - Remote position with a Global Law Firm located in New York, NY. This is a direct hire opportunity. You will join an internal AI Acceleration Team building bespoke AI... 
    Remote job
    Permanent employment
    Contract work
    Internship

    Genesis10

    New York, NY
    23 days ago
  • $229.9k - $262.4k

    AI Engineer 5 (MLXT) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital...  ...AI systems - including rule-based, retrieval-augmented, and generative components - into unified production pipelines ~ Experience... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    4 days ago
  •  ...AI Engineer (GenAI Workflows for OTC Derivatives) Location: New York City (SoHo) — In-Person About Our Client Our client is building the next-generation platform for institutional finance. The OTC derivatives market moves trillions of dollars daily on infrastructure... 
    Full time

    Nxt Level

    New York, NY
    10 hours ago
  • $60 - $70 per hour

     ...Immediate need for a talented AI Engineer . This is a 06+ Months Contract opportunity with long-term potential and is located in Mountain...  .... By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc.... 
    Contract work
    Local area
    Immediate start

    Pyramid Consulting, Inc

    New York, NY
    14 days ago
  •  ...Founding Engineer (AI) NYC | In-Person | Founding Team We're looking for a rare builder who can ship products, build AI systems from...  ...of building and shipping products that gained users or generated revenue Comfortable moving fast, wearing multiple hats, and... 
    Full time

    Stable10

    New York, NY
    4 days ago
  •  ...Senior AI Engineer Overview This well-funded, growth-stage healthcare technology company pairs healthcare expertise with AI to remove waste from the U.S. healthcare system. Its generative AI is already live, helping insurers find costly errors in medical payments... 
    Full time

    Discover International

    New York, NY
    4 days ago
  • Zipporin is seeking a forward-thinking AI & Generative LLM Solutions Engineer to join our team in New York, NY on a hybrid basis. In this role, you will bridge cutting-edge artificial intelligence research and enterprise-scale software engineering, architecting tailored... 
    Contract work
    Work at office

    Zipporin

    New York, NY
    22 days ago
  •  ...Job Description Our NYC based financial client is seeking an AI Engineer for a long-term, hybrid contract role. Responsibilities...  ...user productivity - Develop and deploy machine learning and generative AI models for real-world use cases - Create and optimize... 
    Long term contract

    Certified Network Specialists Inc

    New York, NY
    22 days ago
  • $160k - $200k

     ...AI Engineer [Senior Associate / AVP] Founded in 1992, Cerberus is a global leader in alternative investing with approximately $71 billion...  ...: Develop agents that can query data, perform analysis, generate structured outputs, validate information, and support repeatable... 

    Cerberus Capital Management

    New York, NY
    1 day ago
  • $180k - $250k

     ...AI Engineer – Agentic AI / LLM Systems New York | Series A Startup $180–$250k + Equity In office (5 days) No visa sponsorship...  ...developing AI agents that can understand how businesses operate, generate structured instructions, and take action across complex... 
    Full time
    Work at office
    Visa sponsorship

    Stott and May

    New York, NY
    4 days ago
  • $136k - $253k

     ...other related activities? Then Thomson Reuters Special Services (TRSS) is looking for you! About the Role As a Generative AI and Machine Learning Engineer, you will be responsible for supporting product development efforts that range from generative AI and machine... 
    Full time
    Contract work
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    New York, NY
    6 days ago
  •  ...Bachelor’s degree in computer science, Engineering, Mathematics, Finance, or a related field...  ...output validation. Experience building AI or data-driven applications that use...  ...Experience with retrieval-augmented generation, vector databases, embeddings, semantic... 
    H1b
    Local area

    Robotic Technologies Automation

    New York, NY
    3 days ago
  •  ...Workplaces in Financial Services & InsuranceAI Evaluation Engineer PRIMARY PURPOSE: The AI Evaluation Engineer designs, builds, and operates the...  ...and edge‑case suites, and synthetic test data generation approaches. Apply approved data‑handling practices (... 
    Remote work

    Sedgwick

    New York, NY
    3 days ago
  • $60 - $68 per hour

     ...Job Title: Python Developer/AI Engineer Duration: 18 Month W2 Contract  Location:NYC/Jersey City  Required Pay Scale: $60-$68/...  ...familiarity with Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and AI orchestration concepts is beneficial.... 
    Full time
    Contract work
    Internship

    Matlen Silver

    New York, NY
    4 days ago
  •  ...About Patlytics: Patlytics is the fastest-growing AI-native patent intelligence platform, transforming how IP is protected and monetized at scale. Our advanced LLMs and generative AI engine-custom-built for intellectual property-power every phase of the patent workflow... 
    Immediate start
    Remote work

    Patlytics

    New York, NY
    3 days ago
  •  ...Job Title: Agentic AI Engineer Location: NYC, NY (Hybrid) Job Summary: We are seeking an Agentic AI Engineer with hands-on...  ...capable of tool use, workflow orchestration, retrieval-augmented generation, reasoning, task automation, memory management, and multi-... 

    Jobs via Dice

    New York, NY
    2 days ago
  • $175k - $225k

     ...AI Enablement Engineer DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional...  ...: Own the support queue for enterprise generative AI tools. Troubleshoot IDE integrations (Cursor, Devin), chat... 
    Temporary work
    Flexible hours

    DRW

    New York, NY
    5 days ago
  • $120k - $145k

     ...00.00 To $145,000.00 Annually Purpose of Position: The AI Engineer is responsible for developing, testing, deploying, and supporting...  ...business process optimization while developing expertise in generative AI, agentic architectures, and responsible AI practices... 
    Work experience placement
    Work at office
    Remote work
    Visa sponsorship
    Work visa

    Amalgamated Bank

    New York, NY
    2 days ago
  • $103.75k - $174.75k

     ...AI Engineer III New York, NY, United States(Hybrid) Job Description Joining Amex Tech means discovering and shaping your contribution...  .... Help implement and maintain retrieval-augmented generation (RAG) pipelines over financial data, with an emphasis on correctness... 
    Full time
    Internship
    Visa sponsorship

    American Express

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Generative AI Engineer. Be the first to apply!