Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distinguished AI Engineer

Compunnel Inc.

Job Summary

Set the architecture, engineering standards, platform strategy, and technical governance for enterprise AI and GenAI capabilities. This role guides senior engineering teams and ensures AI platforms are scalable, reusable, observable, cost‑efficient, and compliant with enterprise risk expectations.

Key Responsibilities

  • Define target‑state architecture for LLM platforms, model hubs, AI gateways, RAG services, agent frameworks, orchestration layers, and model‑serving infrastructure.
  • Establish enterprise standards for AI SDLC, LLMOps, MLOps, evaluation, release management, operational resilience, and production support.
  • Guide architecture for secure, scalable, and cost‑efficient inference across cloud, hybrid, private, and containerized environments.
  • Define guardrail patterns for hallucination mitigation, bias monitoring, harmful‑content controls, prompt injection defense, data leakage prevention, and human oversight.
  • Lead design reviews for critical AI systems and provide technical assurance to architecture and risk forums.
  • Partner with cybersecurity, risk, compliance, legal, audit, product, and business teams to align AI designs with enterprise controls.
  • Mentor principal engineers and establish reusable design patterns, reference implementations, and engineering playbooks.
  • Assess emerging AI technologies and recommend adoption based on business value, maturity, risk, cost, and regulatory fit.

Required Qualifications

  • 10+ years in AI/ML systems, distributed systems, enterprise architecture, or platform engineering.
  • Deep experience with LLMs, RAG, embeddings, model serving, AI orchestration, evaluation frameworks, and AI infrastructure.
  • Proven track record defining architecture and technical standards across multiple engineering teams.
  • Strong understanding of distributed training, GPU infrastructure, inference optimization, observability, model governance, and resiliency.
  • Ability to influence senior stakeholders and operate across business, technology, risk, compliance, and architecture forums.

Preferred Qualifications

  • Global bank, fintech, financial‑services, or regulated‑enterprise platform experience.
  • Experience with enterprise AI platforms, private LLM deployments, internal model hubs, AI gateways, or multi‑cloud AI strategy.
  • Familiarity with Responsible AI, model risk management, audit expectations, and technology risk controls.
#J-18808-Ljbffr

Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Distinguished AI Engineer in Jersey City, NJ vacancy
  • $75 - $85 per hour

     ...Job Description Intellibus designs and engineers technology platforms for established FinTech and financial-services firms. We build production...  ...technologies. We are looking for engineers who can turn AI capabilities into practical, reliable applications that deliver... 
    Suggested

    Intellibus

    Jersey City, NJ
    2 days ago
  •  ...Job Description Job Description Tiger Analytics is seeking a highly skilled Senior AI Engineer to join our dynamic team. In this role, you will design, develop, and implement cutting-edge AI solutions that drive business value for our clients. You will leverage advanced... 
    Suggested
    Remote work

    Tiger Analytics Inc.

    Jersey City, NJ
    21 days ago
  • # Generative AI EngineerApply**Job#: 3053758****Job Description:**Generative AI Engineer**Location:** Jersey City, New Jersey (Onsite)**Alternate Location:** Charlotte, NCRole OverviewWe are seeking a Generative AI Solution Developer to design, develop, and implement advanced... 
    Suggested
    Hourly pay
    Contract work

    Apex Systems

    Jersey City, NJ
    2 days ago
  •  ...NJ or Charlotte, NC Contract to hire W2 only Hybrid on site About the Role Sharp Decisions is recruiting for a senior, hands-on AI engineer to join the technology organization of a major global bank. This is a forward-looking role focused on agentic AI: designing, coding... 
    Suggested
    Contract work
    Work at office
    Flexible hours

    LinkedIn

    Jersey City, NJ
    14 hours ago
  •  ...AI/ML Engineer | Hedge Fund | New York We are currently working with a leading hedge fund who are looking to hire an experienced AI/ML Engineer to join their growing technology team This is an opportunity to work on some interesting AI/ML projects, with a particular... 
    Suggested

    Cititec

    Jersey City, NJ
    3 days ago
  • $65 per hour

     ...Our client, banking Cybersecurity organization is seeking a AI Engineer to join their team. As a AI Engineer, you will be part of the Cybersecurity organization supporting Security Operations and threat-detection initiatives. The ideal candidate will have strong Python... 
    Weekly pay
    Temporary work
    Flexible hours

    Experis Technology Group

    Jersey City, NJ
    4 days ago
  •  ...Job Description: Position: AI Engineer Skills: ~ Python APIs, ML frameworks, and AI tools (GitHub Copilot, Codex, Claude, Code Lang Chain, ADK, Chat GPT, MS Copilot). Here are the details: Programming & Frameworks: Python, APIs, ML frameworks, and AI tools... 
    Local area

    Robotic Process Automation

    Jersey City, NJ
    2 days ago
  •  ...AI Engineers - Agentic Development & AI-Augmented Engineering Responsibilities Design and implement "loop engineering" workflows using Claude Code and similar tools, defining how agents plan, execute, test, and iterate on code changes Architect Model Context... 
    Contract work

    TechDigital Group

    Hoboken, NJ
    3 days ago
  •  ...Job Overview Job ID: J53196 Job Title: AI Engineer Location: Jersey City, NJ Duration: 16 Months + Extension Domain Exposure: Healthcare,Insurance,Education Work Authorization: US Citizen,Green Card,OPT-EAD,CPT,H-1B,H4-EAD,L2-EAD,GC-EAD Client: To... 
    H1b
    Local area

    Machine Learning Technologies LLC

    Jersey City, NJ
    2 days ago
  • $80k - $90k

     ...AI Engineer Benefits: 401(k), Bonus based on performance, Training & development Key Responsibilities Apply AI/ML technologies such as machine learning models, LLMs, embeddings, and basic agentic or RAG workflows under guidance from senior engineers. Design... 

    Triunity Software

    Jersey City, NJ
    4 days ago
  • $60 - $68 per hour

     ...Job Title: Gen AI Engineer Duration: 18 Month W2 Contract Location: Jersey City | NYC Required Pay Scale: $60-$68/hour Job Description: Senior Python Developer / AI Engineer - GenAI Platform Role Overview We are seeking a highly skilled Senior Python Developer / AI Engineer... 
    Contract work
    Internship

    The Matlen Silver Group , Inc.

    Jersey City, NJ
    2 days ago
  •  ...concepts and models/technologies (e.g., transformer models, prompt engineering, model fine-tuning) - Experience delivering and scaling...  ...technical solutions - Strong knowledge of: - vLLM - OpenShift AI - Prometheus - Grafana - Aqua - Automation of... 

    3B Staffing LLC

    Jersey City, NJ
    3 days ago
  •  ...Job Description Job Description LLM / Agentic AI / Full-Stack AI Engineering Level Senior Individual Contributor Target / alternate titles LLM Engineer; GenAI Engineer; Machine Learning Engineer - LLM; AI Platform Engineer; NLP Engineer; Applied ML Engineer;... 

    Echo IT Solutions, Inc

    Jersey City, NJ
    15 days ago
  •  ...Job Description Job Description Introduction We are seeking a hands-on AI Engineer to work on a high visibility Generative AI project. This project involves summarization and chatbot development to support a large volume of documents from various lines of business... 
    Work experience placement
    Immediate start

    Artech LLC

    Jersey City, NJ
    15 days ago
  • $116.2k - $229.1k

    Position Summary Physical & Spatial AI, OT Connectivity Engineer IIIJoin our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant impact on our clients’ success. You’ll work alongside talented professionals... 
    Local area
    Remote work
    Visa sponsorship

    Deloitte

    Jersey City, NJ
    3 days ago
  •  ...AvePoint is seeking a Forward Deployed Engineer (AI) to act as the technical face of the company with client organizations. You will translate business problems into scoped AI builds, wireframe prototypes, and own engagements end-to-end. You will advise on AI trust... 

    AvePoint

    Jersey City, NJ
    3 days ago
  •  ...Job Role- Gen AI Engineer- Full Time Job Type- Full Time Job Location- Jersey City, NJ Technical Skills Python or Java programming. Fundamentals of Machine Learning and AI. Basic understanding of LLMs and Generative AI concepts. REST APIs and microservices... 
    Full time

    Maveric Systems

    Jersey City, NJ
    1 day ago
  • $50 per hour

     ...Senior AI Engineers - Agentic Development & AI-Augmented Engineering- Hoboken, NJ About the Role We're looking for a Staff Software Engineer who can define and scale how our engineering organization builds software with AI agents. This role requires deep fluency in... 
    Full time
    Contract work
    Local area

    HCLTech

    Hoboken, NJ
    4 days ago
  • $175k - $215k

     ...year legacy and a shared passion for what’s next, this is the right place to build a fulfilling career. About the Role As an AI Engineer, you'll build the intelligence layer of the platform - the AI-powered features that allow financial services users to generate... 
    Local area

    Brown Brothers Harriman

    Jersey City, NJ
    4 days ago
  •  ...Entry-Level Generative AI Engineer / AI Engineer We are looking for a motivated *Entry-Level Generative AI Engineer / AI Engineer* to join our team. You will work alongside experienced engineers to build, test, and improve AI-powered applications using Python, large... 
    Full time
    Internship

    nexacode

    Jersey City, NJ
    4 days ago
  •  ...RapidCanvas is a pioneer in hybrid enterprise AI. We combine autonomous agents with human expertise to make enterprise-grade AI accessible...  ...For We are seeking a highly motivated and skilled AI Engineer. You will have strong fundamentals in applied machine learning.... 

    RapidCanvas

    Jersey City, NJ
    2 days ago
  •  ...DTCC in Jersey City seeks a Senior AI Engineer to architect and deploy enterprise-grade AI solutions. You will design, build, and operationalize Generative AI and agentic workflows, leveraging Bedrock, AWS, Snowflake, and OpenShift within production environments. You... 

    The Depository Trust & Clearing Corporation

    Jersey City, NJ
    3 days ago
  •  ...in This Role Join our team to help deliver next-generation AI capabilities that transform how business processes are automated...  ...Agentic AI solutions. We are seeking a highly skilled Senior AI Engineer with hands-on experience designing, building, integrating, and... 
    Remote work
    Flexible hours

    The Depository Trust & Clearing Corporation

    Jersey City, NJ
    3 days ago
  • $140.5k - $205k

     ...career with opportunities to learn, grow, and make an impact. Join us! Position Summary The Artificial Intelligence (AI) Sr. Data Engineer will design, build, validate, and operationalize AI-enabled solutions that improve infrastructure, technology operations, and... 
    Work at office
    Flexible hours
    Shift work
    Day shift

    HITEC

    Jersey City, NJ
    2 days ago
  • $142.32k - $213.48k

     ...00Category: TechnologyCompany: CitiWe're searching for a highly skilled and experienced senior engineer and Python expert to lead the design and development of the various AI-related technologies as part of Services Tech AI team. The ideal candidate has an excellent track... 
    Full time

    Citigroup

    Jersey City, NJ
    14 hours ago
  • $176.72k - $265.08k

     ...technology innovation. We are building a cutting-edge, agentic AI platform designed to revolutionize the end-to-end credit risk model...  ...objectives.Serve as the primary technical liaison between the engineering team and its users, ensuring a tight feedback loop and... 
    Full time

    Citigroup Inc

    Jersey City, NJ
    14 hours ago
  •  ...technical competencies. Job Profile Summary: Generative AI (GenAI) presents an exciting opportunity to derive valuable...  ...and practices (planning and estimation, peer reviews, and other engineering practices) Develops and trouble-shoots high-performance APIs... 
    Full time
    Work experience placement
    Remote work

    SANS Consulting Services, Inc.

    Jersey City, NJ
    2 days ago
  • $142.32k - $213.48k

     ...,480.00Category: TechnologyCompany: CitiRole Overview:Citi’s Banking Technology organization is seeking a highly hands-on Senior AI Engineer to design, build, and deploy cutting‑edge AI solutions for Investment, Corporate, and Commercial Banking.This role focuses on implementing... 
    Full time

    Citigroup

    Jersey City, NJ
    3 days ago
  • $142.32k - $213.48k

     ...& Partnerships team is the forward scout of the Citi's Head of AI Organization. Our mandate: identify, evaluate, and rapidly onboard...  ...of a global institution behind us.The Opportunity:As an AI Engineer on the Startups & Partnerships team, you will be at the tip of the... 
    Full time

    Citigroup

    Jersey City, NJ
    14 hours ago
  • $122k - $240.5k

    Position Summary Position Summary Software Engineer III- AI & Engineering/Software as a Service Join our AI & Engineering team transforming technology platforms, driving innovation, and helping make a significant impact on our clients' success. You’ll work alongside... 
    Local area
    Visa sponsorship
    Flexible hours

    Deloitte

    Jersey City, NJ
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distinguished AI Engineer. Be the first to apply!