Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Prompt Engineer

$110k - $125k

latitude

Prompt Engineering & Ai Solutions Specialist

We are seeking a highly skilled Prompt Engineering & AI Solutions Specialist to design, develop, and optimize enterprise-grade AI solutions using frontier large language models (LLMs). The ideal candidate will have hands-on experience with Microsoft Copilot Studio, Azure OpenAI, and advanced prompt engineering techniques to build secure, scalable, and compliant AI-powered assistants and workflows for banking and financial services use cases. This role will work closely with product owners, architects, risk/compliance teams, and business stakeholders to operationalize Generative AI across infrastructure, operations, and business functions.

Primary Skills:

  • Strong hands-on experience with Microsoft Copilot Studio.
  • Proven experience using Azure OpenAI / OpenAI APIs.
  • Practical experience with frontier LLMs (GPT 4 class or equivalent).
  • Solid understanding of prompt engineering frameworks and design patterns.
  • Hands-on experience with RAG architectures and vector search technologies.
  • Strong knowledge of tokenization, context windows, and inference latency tradeoffs.
  • Proficiency in Python for AI integration and automation.
  • Experience working with REST APIs, JSON, and YAML. Experience with cloud platforms, preferably Microsoft Azure.
  • Familiarity with AI governance, Responsible AI, and model risk management.
  • Prior experience delivering enterprise copilots or chatbots at scale.

Secondary / Nice to Have Skills:

  • Experience with Power Platform (Power Apps, Power Automate).
  • Exposure to model evaluation, monitoring, and AI observability tools.
  • Knowledge of AI ethics and regulatory expectations in BFSI environments.

Experience: Minimum 6+ years

Roles & Responsibilities:

  • Design, test, and refine advanced system, user, and tool prompts for frontier LLMs (GPT‑4/4.1 class).
  • Apply prompt engineering patterns including few‑shot, zero‑shot, ReAct, and controlled chain‑of‑thought.
  • Implement Retrieval‑Augmented Generation (RAG) using vector search and enterprise knowledge sources.
  • Continuously optimize prompts for accuracy, consistency, latency, and cost efficiency.
  • Build and deploy AI assistants using Microsoft Copilot Studio.
  • Integrate copilots with enterprise APIs, workflows, and data sources.
  • Implement responsible AI controls including content filtering, grounding, and hallucination reduction.
  • Enforce data privacy, PII masking, and access control in AI workflows.
  • Collaborate with Risk, Legal, and Compliance teams to meet regulatory and audit requirements.
  • Support model governance, SDLC compliance, and production readiness reviews.
  • Document prompt frameworks, AI workflows, and operational standards.

TCS Employee Benefits Summary: Discretionary Annual Incentive. Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans. Family Support: Maternal & Parental Leaves. Insurance Options: Auto & Home Insurance, Identity Theft Protection. Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement. Time Off: Vacation, Time Off, Sick Leave & Holidays. Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing. Salary Range: $110,000-$125,000 a year Location Jersey City, NJ Job Function TECHNOLOGY Role Engineer

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the AI Prompt Engineer in Jersey City, NJ vacancy
  •  ...AI Prompt Engineer and RPA Implementation Specialist Work Location: Long Island City, NY Duration: 12+ Months Contract Position Summary: Interview Mode: Video and Face to Face Required Technical Skills Microsoft.NET Framework expertise, particularly... 
    Suggested
    Contract work
    Work at office

    InterSources

    Long Island City, NY
    2 days ago
  •  ...organization, apply now.We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United...  ...hallucination mitigation, bias monitoring, harmful-content controls, prompt injection defense, data leakage prevention, and human... 
    Suggested
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Jersey City, NJ
    1 day ago
  •  ...Distinguished AI Engineer Enterprise AI Architecture / LLM Platforms / Advanced AI Systems Level Distinguished...  ...mitigation, bias monitoring, harmful-content controls, prompt injection defense, data leakage prevention, and human oversight... 
    Suggested

    VBeyond

    Jersey City, NJ
    16 hours ago
  •  ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning, planning...  ...calling, chaining, and workflow orchestration. Work with prompt engineering teams to improve LLM response quality and... 
    Suggested

    2T Consulting

    Jersey City, NJ
    1 day ago
  • $90k - $120k

     ...Development in Python using FastAPI/ Flask framework - Working experience in Data Processing, AI enabled workflows using python - Knowledge of LLM, Prompt Engineering, RAG Architecture, Agentic AI. - Basic knowledge of Hybrid prompting technique... 
    Suggested
    Work experience placement

    Tata Consultancy Services

    Jersey City, NJ
    2 days ago
  •  ...Range: Submit at market rate Introduction Seeking an AI engineer to design and build AI-powered accelerators, agents, and...  ...automation frameworks. Develop RAG solutions, fine-tune prompts and agent behavior, and optimize tokens. Implement guardrails... 
    Work experience placement
    Immediate start

    Artech

    Jersey City, NJ
    5 days ago
  •  ...AI Engineers - Agentic Development & AI-Augmented Engineering Responsibilities Design and implement "loop engineering" workflows...  ...enforce security practices for agentic workflows, including prompt injection risk and tool-permission boundaries Mentor... 
    Contract work

    Omni Inclusive

    Hoboken, NJ
    4 days ago
  • $70k - $80k

     ...applications using Python with expert-level software engineering practices. • Work with Vector Databases for...  ..., memory, and cost optimization. • Apply prompt engineering, hallucination mitigation, and grounding techniques for AI solutions. • Build API-driven applications... 

    Tata Consultancy Services

    Jersey City, NJ
    4 days ago
  • $175k - $215k

     ...right place to build a fulfilling career.About the RoleAs an AI Engineer, you'll build the intelligence layer of the platform - the AI-...  ...Pipeline EngineeringBuild and optimize LLM pipelines including prompt engineering, context management, and RAG systems tailored to financial... 
    Full time
    Local area

    Brown Brothers Harriman

    Jersey City, NJ
    3 days ago
  •  ...opportunity for you to take your software engineering career to the next level.As an Software...  ...you will help design and deliver agentic AI platforms and large language model-enabled...  ...semantic search, grounding, summarization, and prompt/version managementEngineer cloud-native... 

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  • $142.32k - $213.48k

     ...Banking Technology organization is seeking a highly hands-on Senior AI Engineer to design, build, and deploy cutting‑edge AI solutions for...  ..., and multi‑agent systems.Hands‑on experience with LLMs, RAG, prompt engineering, MCPs, and agent frameworks (e.g., Google ADK).... 
    Full time

    Citigroup

    Jersey City, NJ
    1 day ago
  • $110.7k - $372.9k

     ...afford the care they need. Deloitte has a new AI-first effort, backed by $1B in committed...  ...months, not into a lab. As an Agentic AI Engineer, you will design, build, and...  ...providers, and life sciences. This is not a prompt-only role. We are looking for builders who... 
    Local area
    Visa sponsorship

    Deloitte

    Jersey City, NJ
    2 days ago
  •  ...transforms how the business operates. We build AI-first, agent-driven products that change...  ...our impact and are seeking an AVP, AI Engineering to lead the design and application of...  ...analysts on agentic AI, model evaluation, prompt engineering, and responsible AI practices... 
    Full time
    Temporary work
    Remote work

    Arch Capital Group

    Jersey City, NJ
    1 day ago
  •  ...organization, apply now. We are currently seeking a Distinguished AI Engineer to join our team in Jersey City, New Jersey (US-NJ), United...  ...mitigation, bias monitoring, harmful-content controls, prompt injection defense, data leakage prevention, and human oversight... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA, Inc.

    Jersey City, NJ
    28 days ago
  • As an Lead Software Engineer at JPMorganChase within Enterprise Technology, you will lead the...  ...large language model systems and agentic AI platforms for enterprise use cases...  ...semantic search, grounding, summarization, and prompt/version managementEngineer cloud-native... 

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  • $88.6k - $181.9k

    Position Summary As an Applied AI Engineer II, you will actively engage in your engineering craft, taking a hands-on approach to...  ...integration (OpenAI, Anthropic, or open-source models), RAG pipelines, prompt engineering, vector databases, evaluations, and AI agent... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    Jersey City, NJ
    2 days ago
  • $149 per hour

     ...provide more details.Vice President - Technical AI Foundation Model EngineerRole SummaryThe VP, Technical AI Foundation Model Engineer is responsible for designing, building,...  ...requirements.Implement model orchestration, prompt engineering, agent frameworks, and AI workflow... 
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    2 days ago
  • $210k - $260k

     ...impossible to change. We collapse it into a single AI-native platform that business users can operate without writing a ticket, while engineering teams retain the governance and security...  ...architecture, RAG system design, prompt engineering standards, and evaluation frameworksHelp... 
    Full time
    Local area
    Home office

    Brown Brothers Harriman

    Jersey City, NJ
    4 days ago
  •  ...ve come to the right place.As a Principal Software Engineer at JPMorganChase within the Corporate Sector - AI/ML & Data Platforms for LLM Suite, you will lead a...  ...critical-path code Create reusable components for prompt management, evaluators, safety filters, connectors,... 

    JP Morgan Chase

    Jersey City, NJ
    2 days ago
  • $141 - $180 per hour

     ...details.The Vice President, Global Red Team & AI Security Operations leads enterprise-wide...  ...reduction in partnership with defensive, engineering, and governance teams.Key...  ...adversarial testing of AI and LLM systems (e.g., prompt injection, tool misuse, data leakage, and... 
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    1 day ago
  • $102.5k - $188.9k

     ...reignite your professional career. Role Overview: As an Applied AI Engineer III, you will actively engage in your engineering craft,...  ...integration (OpenAI, Anthropic, or open-source models), RAG pipelines, prompt engineering, vector databases, evaluations, and AI agent... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    Jersey City, NJ
    12 hours ago
  • $151.4k - $311k

    Position Summary Director, Applied AI Engineering Role Overview: As a Director, Applied AI Engineering, you will shape and own the engineering...  ...(OpenAI, Anthropic, or open-source models), RAG pipelines, prompt engineering, vector databases, evaluations, and AI agent... 
    Work at office
    Local area
    Visa sponsorship
    3 days per week

    Deloitte

    Jersey City, NJ
    3 days ago
  • $128.03k - $261.63k

    Position Summary What You’ll Do As a Deloitte Tax, AI Engineer Manager, you will oversee the design, development, deployment, and...  ...Experience with agentic frameworks such as LangGraph.Advanced prompt engineering knowledge for LLM optimization.Exposure to multi-modal... 
    Work at office
    Local area
    Visa sponsorship
    2 days per week
    3 days per week

    Deloitte

    Jersey City, NJ
    2 days ago
  • $200k - $300k

    AI Architect, Principal Frontline AI Engineer - HealthcareAbout Brillio: Brillio is one of the fastest growing digital technology service providers and a...  ...understanding of Large Language Models (LLMs), AI agents, prompt engineering, RAG architectures, and AI application... 

    Brillio

    Jersey City, NJ
    1 day ago
  •  ...Job Description Role: Senior AI Software Engineer (Agentic AI / AI Agents) Location: Hybrid Duration: 12+ Months Interview:...  ...Systems ~ Tool Calling / Function Calling ~ Agent Memory ~ Prompt Engineering ~ Embeddings Experience with Vector... 
    Temporary work

    TMS LLC

    Jersey City, NJ
    19 days ago
  •  ...location is mandatory. Only USCs/GCs are eligible AI Foundation Model Engineer LLM / Agentic AI / Full-Stack AI Engineering Role...  ...continuous improvement. Reusable AI service components, APIs, prompts, retrieval logic, and observability patterns that can be... 

    TechnoGen

    Jersey City, NJ
    3 days ago
  •  ...location is mandatory. Only USCs/GCs are eligible AI Foundation Model Engineer LLM / Agentic AI / Full-Stack AI Engineering Level...  ...continuous improvement. Reusable AI service components, APIs, prompts, retrieval logic, and observability patterns that can be... 

    United Software Group

    Jersey City, NJ
    3 days ago
  •  ...AI Foundational Model Engineer NTT DATA Services is seeking an AI Foundational Model Engineer to join our team in Jersey City, New Jersey (US...  ...continuous improvement. Reusable AI service components, APIs, prompts, retrieval logic, and observability patterns that can be... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    Sierra Systems, An Ntt Data Company

    Jersey City, NJ
    2 days ago
  • $142.32k - $213.48k

     ...are seeking a Senior Full-Stack hands-on Engineer to be part of the Banking Technology team...  ...enterprise-grade web applications, leveraging AI development agents (e.g., Claude Code,...  ...- Ability to write structured prompts, engineer context, and decompose complex... 
    Full time

    Citigroup

    Jersey City, NJ
    4 days ago
  • $145.06k - $296.05k

     ...About the Role We are seeking an exceptional AI Engineer to join our growing team and take a leading role in building and evolving our...  ...refine multi-turn context handling, session memory strategies, and prompt structures to improve response reliability and reduce... 
    Full time
    Work at office

    Within

    Long Island City, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Prompt Engineer. Be the first to apply!