AI Engineer
$90.9k - $254.1kWithin
About the Role We are seeking an exceptional AI Engineer to join our growing team and take a leading role in building and evolving our internal AI-powered agent platform used across the organization. In this role, you will design, build, and improve AI-powered applications that integrate large language models (LLMs) with internal tools, SQL databases, advertising APIs (Google Ads, Meta), and stateful code execution environments. You will play a critical role in improving reliability, context orchestration, evaluation maturity, and expanding Rai into document and workflow automation use cases. Your work will directly impact 200-500 employees and potentially clients, making AI a core productivity multiplier across the organization. Responsibilities include but are not limited to:
Join Our Network! Stay connected with us and be the first to know about new opportunities, industry insights, and updates. Follow us on:
- LLM Application Development Design, build, and maintain AI-powered applications leveraging LLM APIs, tool calling, and structured outputs.
- Agent & Tool Orchestration Develop and improve agent architectures that integrate tools such as SQL execution, Python code execution, and marketing platform APIs through MCP-style integrations.
- Context & Memory Management Design and refine multi-turn context handling, session memory strategies, and prompt structures to improve response reliability and reduce hallucinations.
- Reliability & Guardrails Implement safeguards for tool execution, SQL queries, and code execution. Improve retry logic, structured validation, and hallucination mitigation strategies.
- Evaluation & Quality Assurance Contribute to building structured evaluation frameworks for LLM-powered systems, including multi-turn testing, regression testing, and task-based success metrics.
- Product Expansion Support expansion of Rai into document generation, tables, slide decks, and potential Google Workspace integrations.
- Collaboration Work closely with Machine Learning Engineers, Product Managers, and Full-Stack Engineers to ensure AI systems are robust, maintainable, and aligned with business goals.
- Continuous Innovation Stay current with advances in LLM systems, agent architectures, and applied AI tooling to continuously improve Rai's capabilities.
- Strong programming skills in Python with experience building production systems.
- Experience building applications powered by LLM APIs (OpenAI, Anthropic, Vertex AI, etc.).
- Deep understanding of:
- Context windows and token limits
- Multi-turn conversation behavior
- Tool/function calling
- Structured outputs (JSON schema)
- Prompt design and failure modes
- Experience integrating external APIs into production systems.
- Proficiency in SQL.
- Experience working with cloud platforms (GCP, AWS, or Azure).
- Strong problem-solving skills and ability to debug complex system behavior.
- Excellent communication and cross-functional collaboration skills.
- Experience designing evaluation frameworks for LLM-powered systems.
- Understanding of embeddings, vector search, and RAG architectures.
- Experience building agent or multi-agent workflows.
- Experience with stateful execution environments or sandboxed code execution.
- Experience with document automation (Google Docs, Slides, PDFs).
- Experience building internal developer tools or productivity platforms.
- TypeScript.
- Python
- SQL
- Cloud Platforms (GCP, AWS, Azure)
- LLMs / AI APIs
- Git / GitHub
- Data Warehouses (BigQuery, Snowflake, Redshift)
- Data Transformation (dbt)
- Semantic Layers (Cube, Looker, dbt Metrics)
- TypeScript
- Excel and Typing Test
- Unlimited vacation policy
- Monthly Phone Stipend
- Comprehensive Medical, Dental, and Vision insurance options
- 401(K) plan with matching
- Dog friendly office
- Hybrid work opportunity
- Professional Development Program
- Bonus Perk - Seamless allowance
- Level 1 - Possesses essential capabilities
- $90,900-$123,540
- Level 2 - Possesses developing capabilities
- $123,540-$156,180
- Level 3 - Possesses notable capabilities.
- $156,180-$188,820
- Level 4 - Possesses strong capabilities.
- $188,820-$221,460
- Level 5 - Possesses advanced capabilities.
- $221,460-$254,100
Join Our Network! Stay connected with us and be the first to know about new opportunities, industry insights, and updates. Follow us on:
- WhatsApp Community
- Tik Tok
- New York City: 43-01 22nd St, Suite 602, Queens, NY 11101, United States
- Bogotá: WeWork Av. Carrera 19 #100-45 Usaquén, Piso (Floor) 10, Bogotá, Distrito Capital de Bogotá 110111, Colombia
- Mexico City: Av. Insurgentes Sur 1082, Piso (Floor) 2, Oficina 2008, Ciudad de México, CDMX 03100, México
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Engineer in New York, NY vacancy
$342.7k
...strategy for Splunk and Cisco, and we are building best-in-class AI capabilities into our platform, security and observability... ...journey to digital resilience. We are looking for a Distinguished Engineer with outstanding technical leadership in the AI/ML area to drive...SuggestedFull timeTemporary workWork at officeLocal areaRemote workFlexible hours- Job ID: 25701612Reference Number: 25-00639Title: AI EngineerLocation: NYC, NY, 08830Posted Date: 2025-06-12Company: HAN Staffing Job Title: AI Engineer - Azure AI Foundry & LLM SolutionsLocation: NYC, NYType: FTE ( no subcontracting )Mode: HybridJob Description:We are...Suggested
$175k - $250k
AI EngineerAbout MillenniumMillennium is a global, diversified alternative investment firm, founded in 1989. Defined by evolution,... ...and business impactPartner closely with product managers, data engineers, and business stakeholders to translate business needs into scalable...SuggestedFlexible hours- Job-ID31175163Reference25-262131TypeContract Job Title: AI Engineer Employment Type: Contract (W2 Only) Number of Positions: 4 Location: New York, NY (Highly Preferred) Additional Locations: Chicago (Preferred), Atlanta, Dallas, Miami (Backup Locations)OverviewWe are seeking...SuggestedContract work
$120k - $165k
...markets and shape the future of our communities. This is a Software Engineering III position at the Director level, which is part of the job... ....Partner with the Advanced Analytics, Machine learning and Gen AI Platform team(s), across multiple project areas, and work in...SuggestedTemporary work- Job Description:This is a fullstack engineering role with a strong frontend emphasis. You’ll have ownership across the product stack, from users interfaces to infrastructure supporting AI models. Location: New York, NY or Boston, MA or San Francisco, CA (3 days/week)Salary...3 days per week
- ...business processes and identify opportunities for automation and AI-driven enhancement.Design, develop, and maintain automation... ...workflow orchestration.Exposure to Generative AI (LLMs, prompt engineering, copilots, or AI assistants).Experience building or supporting...
$200k
We're looking for an experienced AI Engineer to join Optiver's Applied AI and Platform Engineering team. In this role, you'll design, build, and deploy production-grade AI systems that automate workflows, augment decision-making, and accelerate engineering across the firm...Work at office- Role/Responsibilities:We are seeking a NLP engineer for a NLP research team within Point72. The ideal candidate has a track record of developing modern NLP solutions, including the use of LLMs, agents, RAG, open-source models fine-tuning and deployment, etc.Responsibilities...Worldwide
- .... If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Gen AI Engineer to join our team in a hybrid basis either out of our NYC or Richardson, TX office 3 days/week. Job Duties:· Build agentic AI systems...Work at officeRemote workFlexible hours3 days per week
- ...promised to change everything across a business—until generative AI. Today, AI is the number one driver of business reinvention. And... ...and help lead that change.You Are:As a Snowflake Advanced AI Engineer, you will design, build, and operationalize artificial intelligence...Full timeWork experience placementLive inWork at officeLocal areaShift work
$200k - $250k
...Description New York City - $200,000-$250,000 + equity Define how AI agents actually learn in production. This team is building the... ...involving reasoning, memory, and tool use Strong Python engineering and systems thinking Clear ownership of end-to-end AI systems...$100k
...bn+ in annual invoice volume and growing fast. We're building the AI-powered revenue platform for modern finance teams, replacing... ...about the quality of the product we're building. We're looking for engineers who are ambitious and take ownership end-to-end: from...Live inWork at officeVisa sponsorshipFlexible hours$175k - $300k
...s how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus. As an AI Engineer at DRW, you will be an integral member of a collaborative multi-asset trading team. You'll work on high-impact machine learning...Temporary workFlexible hours$130k - $185k
...integrity. East West Bank gives people the confidence to reach further. Overview East West Bank is seeking an experienced Senior AI Engineering to design, build, and operationalize enterprise-grade AI and Generative AI solutions across the Bank. This senior technical...$269.1k - $307.2k
Distinguished AI Engineer Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments...Full timePart timeLocal area- ...tech, crypto infrastructure, digital assets, venture capital, and AI since its launch in 2020. Delivering end-to-end go-to-market... ...role sits at the intersection of competitive intelligence, data engineering, and agentic AI. You'll pull signals from social platforms, on-...Remote work
- ...We build AI agents that actually work in enterprise environments — not prototypes, not demos. We need engineer's who can own the entire agent stack: a production frontend, a robust backend, a properly secured API and identity layer, a memory architecture that scales, and...Temporary work
$155k - $200k
...experiment and innovate. Learn more about how you can be part of the disciplined collaboration and transcendent thinking as an AI Engineer at Capstone Investment Advisors here. Responsibilities and Impact: Design and implement AI/ML/LLM-driven models, tools...Minimum wage- ...We're a team of ex-Google engineers who built some of the largest defensive platforms on the planet - Safe Browsing and reCAPTCHA . Now... ...an even bigger challenge: stopping the new wave of adversarial AI attacks already hitting organizations today. We're still in...Flexible hours
- ...Labs Tessera Labs is a new category of enterprise software: an AI platform that changes how the world's largest companies run. Every... ...cost of being large. We don't. Tessera is a transformation engine: a governed, multi-agent platform that understands an enterprise'...
- ...AI Engineer Location: Hybrid (New York, NY) Duration: Long-term Primary skills: AI, ML, Generative AI, GitHub CoPilot, Prompt Engineering About the job: We are looking for an experienced AI Engineer with a strong background in Artificial Intelligence, Machine...
- AI Engineer Who we are Makai Labs builds software that automates entire companies. We work across a diversified portfolio, which means our systems touch a wide range of domains, processes, and operational constraints. Our engineering team is small, senior, and high-output...InternshipLocal areaRemote workFlexible hours
$35k
...Job Description Core Skill Set: Python (advanced, production-grade coding) Generative AI (LLMs, prompt engineering, fine-tuning, RAG) Agent development using frameworks such as ADK, LangGraph, LangChain Additional Relevant Skills: Experience...Full timeFor contractorsShift work- ...AI Engineer StatusNeo is a global AI-native transformation firm helping enterprises design, engineer, and govern AI-led systems with trust at the core. We work with global enterprises across BFSI, retail, healthcare, airlines, and platform-driven industries to transform...
- ...AI Engineer WRITER is where the world's leading enterprises orchestrate AI-powered work. Our vision is to expand human capacity through superintelligence. And we're proving it's possible – through powerful, trustworthy AI that unites IT and business teams together to...Full timeWork at officeLocal areaFlexible hours
$150k - $275k
...revenue slips through the cracks. Joyful Health is building the AI-powered financial operating system for healthcare practices. Our... ...We're looking for a talented and ambitious machine learning engineer with 5+ years of experience building production AI systems who's...Full timePrivate practiceWork at office3 days per week$190k - $200k
...national origin, disability status, protected veteran status or any other characteristic protected by law. Description Job Title: AI Engineer Location: New York, NY Department: Technology/Revenue Strategy Reports To: Chief Executive Officer FLSA Status: Exempt Work Type:...Full timePart timeWork at officeRemote workShift workNight shift$150k - $250k
...Distyl AI Job Opportunity Distyl is an applied AI technology company partnering with the world's most ambitious institutions to... ...improving, and trusting AI behavior in production. AI Evaluation Engineers focus on designing and implementing the evaluation systems that...Work at officeFlexible hours3 days per week- ...The Senior Software Engineer operates as a senior/lead team member of a team, assisting assigned Insurance Carrier project teams ("our clients... ...Be a leading voice in the design and implementation of AI based solutions for the insurance industry Provide guidance to...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Engineer. Be the first to apply!
Related searches

