Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. AI Engineer - NYC NY

Full-time

SharpAtoms

W2 Role | Healthcare experience is preferred.

Sr. AI Engineer

NYC, NY (Full Onsite)

AI Engineer with strong hands-on experience in prompt engineering, LLM response optimization, and AI application development. The ideal candidate can design prompts, improve model output quality, help LLMs understand user input, and build reliable, context-aware AI solutions.

Key Responsibilities:

  • Design, develop, and optimize prompts for Large Language Models (LLMs) to improve accuracy, reliability, and business outcomes.
  • Build and configure Agentic AI solutions that leverage planning, reasoning, memory, and multi-step task execution capabilities.
  • Develop and integrate MCP (Model Context Protocol) tools, enabling AIagents to securely discover and interact with enterprise systems, APIs, and data sources.
  • Design agent architectures, tool-calling frameworks, retrieval mechanisms, and context management strategies.
  • Collaborate with product managers, architects, and engineering teams to translate business requirements into AI-driven solutions.
  • Implement Retrieval-Augmented Generation (RAG), knowledge grounding, and context orchestration patterns.
  • Define evaluation frameworks and prompt testing methodologies to measure agent performance, quality, and reliability.
  • Ensure AI solutions adhere to security, compliance, governance, and responsible AI standards.
  • Support deployment, monitoring, troubleshooting, and continuous improvement of AI agents and MCP-enabled workflows.
  • Contribute to architecture reviews, technical design documentation, and engineering best practices for AI platforms.

Required Skills:

  • Hands-on experience with LLMs such as GPT, Claude, Gemini, Llama, or similar models.
  • Strong prompt engineering skills, including prompt templates, system prompts, few-shot prompting, and response tuning.
  • Develop AI-powered applications using LLM APIs, RAG workflows, enterprise data sources, and backend services.
  • Experience with LLM APIs and application integration using Python, Java, JavaScript, or similar programming languages.
  • Knowledge of RAG, embeddings, vector databases, semantic search, and knowledge retrieval workflows.
  • Ability to evaluate and improve AI responses for accuracy, relevance, completeness, tone, and instruction following.
  • Understanding of NLP concepts, hallucination mitigation, prompt injection risks, guardrails, and responsible AI practices.
  • Knowledge of healthcare data privacy and secure sensitive-data handling, including HIPAA-aligned PHI/PII practices, data minimization, de-identification, masking, access controls, auditability, and responsible use of healthcare data in AI workflows.
  • Experience with MCP servers, cloud platforms, APIs, backend services, and production deployment is preferred.
  • Experience integrating AI agents with healthcare, health records, or regulated industry systems.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Sr. AI Engineer - NYC NY in New York, NY vacancy
  • $200k - $250k

     ...Circana is a leading provider of technology, AI, and data solutions for consumer packaged...  ...and retailers run on. AI Principal Engineers build the foundations of that ecosystem....  ...following area(s): Chicago, IL (Hybrid) or NYC, NY (Hybrid)   The below range reflects the... 
    Suggested
    Local area
    Flexible hours
    Shift work

    Circana, LLC.

    New York, NY
    11 days ago
  • $160k - $200k

     ...Circana is a leading provider of technology, AI, and data solutions for consumer packaged...  ...run on. This is a Forward Deployed Engineer (FDE) role. FDEs embed with the teams who...  ...following area(s): Chicago, IL (Hybrid) or NYC, NY (Hybrid)   The below range reflects the... 
    Suggested
    Local area
    Flexible hours
    Shift work

    Circana, LLC.

    New York, NY
    11 days ago
  • $150k - $190k

     ...Circana is a leading provider of technology, AI, and data solutions for consumer-packaged...  ...are seeking an experienced Senior DevOps Engineer to design, implement, automate, and...  ...following area(s): Chicago, IL (Hybrid) or NYC, NY (Hybrid) The below range reflects the range... 
    Suggested
    Local area
    Flexible hours
    Shift work

    Circana, LLC.

    New York, NY
    11 days ago
  •  ...doing well. Please find the job description below and Let me know if you are interested. Job Title :Sr. Salesforce Dev. Location : New York, NY (Hybrid) Responsibilities: • Lead development efforts by example, working with your other team members... 
    Senior

    A-1 Consulting Inc, Atlanta, GA

    New York, NY
    a month ago
  •  ...Apache Polaris and Apache Iceberg with data stored in Amazon S3 Glider Assessment (Y/N): Y Title: AWS Data Engineer – Open Data Platform Location: NYC, NY | Remote | Contract | We are seeking an experienced AWS Data Engineer to support the design and... 
    Senior
    Remote job
    Contract work
    For contractors

    Suncap Technology, Inc.

    New York, NY
    23 days ago
  •  ...Job Description Job Description Title: Snowflake Data Engineer Platform Optimization Location: NYC, NY | Remote | Contract We are seeking an experienced Snowflake Data Engineer to support workload optimization, platform performance, resiliency, and cost efficiency... 
    Senior
    Remote job
    Contract work
    For contractors

    Suncap Technology, Inc.

    New York, NY
    23 days ago
  •  ...Sr financial project manager nyc ny  Experience level: Mid-senior Experience required: 10 Years Education level: Bachelor’s degree Job function: Information Technology Industry: Insurance Pay rate : $75 per hour Total position: 1 Relocation assistance: No Visa sponsorship... 
    Senior
    Hourly pay
    Full time
    Visa sponsorship
    Relocation package

    ESR Healthcare

    New York, NY
    21 days ago
  • $200k - $300k

     ...Description Job Description Forward Deployed Engineer – AI & Engineering Automation Full-time | On-site | SoHo, New York City, NY $200,000–$300,000 base salary depending on...  ...people. The office is fully in-person in NYC, with purpose-driven travel to acquired... 
    Full time
    H1b
    Work at office
    Visa sponsorship

    Morgan Pinnacle Group

    New York, NY
    5 days ago
  •  ...across the data the world's largest brands and retailers run on. AI\Agentic Architects lead that work solution by solution. Embedded...  ...conversation to production use. Each architect anchors a pod of engineers and carries the technical direction for a solution family for... 
    Full time

    inf1019irinc

    New York, NY
    a month ago
  •  ...vital company, client provides a great opportunity for hard-working and skilled individuals.Job DescriptionTitle: Sr.Tax Manager/DirectorLocation: NEWYORK, NY Short Hills, NJType: Direct hireJob requirement:• Work directly with state auditors to resolve client audit... 
    Senior
    Local area

    Maganti IT Resources

    New York, NY
    4 days ago
  • $250k

     ...AI Software Engineer Location: New York City, NY Work Model: Hybrid, NYC office Compensation: Up to $250,000 base salary plus equity Authorization: No sponsorship available (if you need sponsorship post OPT, this cannot be provided) Job Description... 
    Senior
    Full time
    Work at office

    Stott and May

    New York, NY
    11 hours ago
  • $286.2k - $326.7k

    Sr. Staff AI Engineer (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years...  ...: $314,800 - $359,300 for Sr. Staff AI Engineer New York, NY: $343,400 - $392,000 for Sr. Staff AI Engineer San... 
    Senior
    Full time
    Part time
    Local area
    Remote work

    Capital One

    New York, NY
    4 days ago
  •  ...Position: Lead / Senior AI Engineer Location: NYC, NY “Hybrid Office BI-weekly “ Mode Of Hire: Long term Contract Role Overview The Senior AI Engineer designs, builds, and supports secure, reliable AI-enabled applications and backend services for firmwide... 
    Senior
    Long term contract
    Full time
    Work at office

    InfiCare Staffing

    New York, NY
    1 day ago
  • $65 - $75 per hour

    job summary: Senior AI Developer We're looking for a Senior AI Agent Developer to lead the design, build, and support of enterprise...  ...interfaces are built, tested, and released. You'll also mentor engineers and work closely with product, platform, and operations teams.... 
    Senior
    Hourly pay
    Contract work

    Randstad Digital

    New York, NY
    2 days ago
  •  ...intelligent systems that reason, plan, and act across the data the world's largest brands and retailers run on. Forward Deployed Engineers are the delivery core of that effort. Working in small pods alongside an architect and domain experts, they take agents from design... 
    Full time

    inf1019irinc

    New York, NY
    a month ago
  • $250k - $315k

     ...FULL-TIME ONLY, NO CONSULTANTS ~ ONLY local candidates from NYC, NJ, CT and must interview in-person ~5 day work week is a...  ...+ Performance Bonus + RSUs Job Title: Senior Agentic AI, AI/ML Engineers Employment Type: Full-Time Work Location: Midtown East... 
    Senior
    Full time
    Temporary work
    Local area

    SANS Consulting Services, Inc.

    New York, NY
    11 hours ago
  • Senior Jewelry Designer Catbird NYC is looking for a Senior Jewelry Designer to join our Design & Product Development team. This key creative...  ...’s values. About Catbird Founded over 21 years ago in Brooklyn, NY, Catbird has become an icon in the jewelry world. Both our brick‑... 
    Senior

    kozmetickesluzby.vecnakraska.sk - Jobboard

    New York, NY
    2 days ago
  • $123k - $215.25k

     ...Location: Phoenix, AZ, United States; New York, NY, United StatesSalary: $123000 - $215250 annually + bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeShift:...  ...and data insights.At American Express, AI is reshaping the future of commerce and redefining... 
    Senior
    Visa sponsorship

    American Express

    New York, NY
    3 hours ago
  •  ...Senior AI Engineer (Agentic AI Python & Risk Management) Location: New York City NY (Need local resource who can go for In-person) Contract Team: Firm Risk Management (FRM) Technology Additional Points : Strong Python and hands-on LangGraph experience including... 
    Senior
    Contract work
    Temporary work
    Local area
    Remote work

    BuzzClan LLC

    New York, NY
    4 days ago
  • $200k - $240k

     ...is currently seeking a Senior Generative AI Engineer - Remote for a direct hire opportunity with...  ...a Global Law Firm located in New York, NY. You will join as a Senior Generative...  ...municipalities) ~ Commuter Benefits (Dallas, NYC, SF, and Illinois) For multiple years... 
    Senior
    Remote job
    Permanent employment
    Contract work

    Genesis10

    New York, NY
    23 days ago
  • $229.9k - $262.4k

    Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation) At Capital One, we are creating responsible and reliable...  ...29,900 - $262,400 for Sr. Manager, AI Engineer New York, NY: $250,800 - $286,200 for Sr. Manager, AI Engineer San Francisco... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    4 days ago
  • $200k - $260k

     ...platform healthcare organizations use to build their own clinical AI agents. Our mission is to make excellent care accessible to...  ...Applied AI is where Concurrence meets the real world. Our core engineering team builds the platform. We take it into health systems and build... 
    Senior
    Full time
    Work at office
    Flexible hours

    Concurrence

    New York, NY
    13 days ago
  • $151k - $258k

     ...Job Description Job Description Senior AI Software Engineer NYC AI Labs – Investment Management J Harlan Group is currently conducting a search for a Senior AI Software Engineer to join the firm's AI Engineering team at a prominent global Investment Manager.... 
    Senior
    H1b
    Work from home
    Flexible hours
    3 days per week

    J Harlan Group, LLC

    New York, NY
    8 days ago
  •  ...profile will not be considered. We are looking for a Senior ML/AI Engineer  to build and deploy the intelligent systems at the core of an...  .... Details Schedule: Full-time Location: Hybrid (NYC) Type of collaboration: Full-time employment The platform... 
    Senior
    Full time

    PulseRise Technologies

    New York, NY
    15 hours ago
  • $119k - $299.93k

     ...ManagerJob Description & SummaryThe Opportunity As part of the AI Engineering team within the Digital Assurance & Technology team, you will play...  ...a secure and trusted workplace for all.SummaryLocation: NY-New York; CT-Stamford; CA-Los Angeles; IL-Chicago; DC-Washington... 
    Senior
    Full time
    H1b

    PwC

    New York, NY
    3 days ago
  •  ...Job Title: Agentic AI Engineer Location: NYC, NY (Hybrid) Job Summary: We are seeking an Agentic AI Engineer with hands-on experience in building AI agents, LLM-powered applications, and intelligent workflow automation solutions using platforms such as AWS Bedrock... 

    Jobs via Dice

    New York, NY
    2 days ago
  •  ...We’re a team of ex‑Google engineers who built some of the largest defensive platforms on the planet — Safe Browsing and reCAPTCHA. Now, we...  ...an even bigger challenge: stopping the new wave of adversarial AI attacks already hitting organizations today. We’re still in... 
    Flexible hours

    Aegis AI

    New York, NY
    3 days ago
  • $110 - $150 per hour

     ...tech, and the best job fit for every candidate we place. Our client, an investment firm, is seeking a Senior AI Engineer to join their team in New York, NY! This role is ideal for an experienced software engineer who understands how to design and build enterprise... 
    Senior

    Eleven Recruiting

    New York, NY
    a month ago
  •  ...Description Hybrid 3 days onsite in New York, NY Our client is seeking a Senior AI Enablement Engineer to design, build, integrate, and operationalize AI-powered tools and workflows across the business. This hands-on individual contributor role focuses on transforming... 
    Senior

    Eliassen Group

    New York, NY
    15 days ago
  •  ...one of the Fastest-Growing and Well-Known Fin-Tech Start-Ups in NYC This young and agile company, building a cutting-edge commerce...  ...This is an excellent opportunity for an experienced Mobile Engineer with start-up experience to take the next step into a challenging... 
    Senior
    Full time

    Orbis Group

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. AI Engineer - NYC NY. Be the first to apply!