AI Engineer
$90.9k - $254.1kWithin
About the Role We are seeking an exceptional AI Engineer to join our growing team and take a leading role in building and evolving our internal AI-powered agent platform used across the organization. In this role, you will design, build, and improve AI-powered applications that integrate large language models (LLMs) with internal tools, SQL databases, advertising APIs (Google Ads, Meta), and stateful code execution environments. You will play a critical role in improving reliability, context orchestration, evaluation maturity, and expanding Rai into document and workflow automation use cases. Your work will directly impact 200-500 employees and potentially clients, making AI a core productivity multiplier across the organization. Responsibilities include but are not limited to:
Join Our Network! Stay connected with us and be the first to know about new opportunities, industry insights, and updates. Follow us on:
- LLM Application Development Design, build, and maintain AI-powered applications leveraging LLM APIs, tool calling, and structured outputs.
- Agent & Tool Orchestration Develop and improve agent architectures that integrate tools such as SQL execution, Python code execution, and marketing platform APIs through MCP-style integrations.
- Context & Memory Management Design and refine multi-turn context handling, session memory strategies, and prompt structures to improve response reliability and reduce hallucinations.
- Reliability & Guardrails Implement safeguards for tool execution, SQL queries, and code execution. Improve retry logic, structured validation, and hallucination mitigation strategies.
- Evaluation & Quality Assurance Contribute to building structured evaluation frameworks for LLM-powered systems, including multi-turn testing, regression testing, and task-based success metrics.
- Product Expansion Support expansion of Rai into document generation, tables, slide decks, and potential Google Workspace integrations.
- Collaboration Work closely with Machine Learning Engineers, Product Managers, and Full-Stack Engineers to ensure AI systems are robust, maintainable, and aligned with business goals.
- Continuous Innovation Stay current with advances in LLM systems, agent architectures, and applied AI tooling to continuously improve Rai's capabilities.
- Strong programming skills in Python with experience building production systems.
- Experience building applications powered by LLM APIs (OpenAI, Anthropic, Vertex AI, etc.).
- Deep understanding of:
- Context windows and token limits
- Multi-turn conversation behavior
- Tool/function calling
- Structured outputs (JSON schema)
- Prompt design and failure modes
- Experience integrating external APIs into production systems.
- Proficiency in SQL.
- Experience working with cloud platforms (GCP, AWS, or Azure).
- Strong problem-solving skills and ability to debug complex system behavior.
- Excellent communication and cross-functional collaboration skills.
- Experience designing evaluation frameworks for LLM-powered systems.
- Understanding of embeddings, vector search, and RAG architectures.
- Experience building agent or multi-agent workflows.
- Experience with stateful execution environments or sandboxed code execution.
- Experience with document automation (Google Docs, Slides, PDFs).
- Experience building internal developer tools or productivity platforms.
- TypeScript.
- Python
- SQL
- Cloud Platforms (GCP, AWS, Azure)
- LLMs / AI APIs
- Git / GitHub
- Data Warehouses (BigQuery, Snowflake, Redshift)
- Data Transformation (dbt)
- Semantic Layers (Cube, Looker, dbt Metrics)
- TypeScript
- Excel and Typing Test
- Unlimited vacation policy
- Monthly Phone Stipend
- Comprehensive Medical, Dental, and Vision insurance options
- 401(K) plan with matching
- Dog friendly office
- Hybrid work opportunity
- Professional Development Program
- Bonus Perk - Seamless allowance
- Level 1 - Possesses essential capabilities
- $90,900-$123,540
- Level 2 - Possesses developing capabilities
- $123,540-$156,180
- Level 3 - Possesses notable capabilities.
- $156,180-$188,820
- Level 4 - Possesses strong capabilities.
- $188,820-$221,460
- Level 5 - Possesses advanced capabilities.
- $221,460-$254,100
Join Our Network! Stay connected with us and be the first to know about new opportunities, industry insights, and updates. Follow us on:
- WhatsApp Community
- Tik Tok
- New York City: 43-01 22nd St, Suite 602, Queens, NY 11101, United States
- Bogotá: WeWork Av. Carrera 19 #100-45 Usaquén, Piso (Floor) 10, Bogotá, Distrito Capital de Bogotá 110111, Colombia
- Mexico City: Av. Insurgentes Sur 1082, Piso (Floor) 2, Oficina 2008, Ciudad de México, CDMX 03100, México
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Engineer in New York, NY vacancy
- Job ID: 25701612Reference Number: 25-00639Title: AI EngineerLocation: NYC, NY, 08830Posted Date: 2025-06-12Company: HAN Staffing Job Title: AI Engineer - Azure AI Foundry & LLM SolutionsLocation: NYC, NYType: FTE ( no subcontracting )Mode: HybridJob Description:We are...Suggested
$120k - $165k
...markets and shape the future of our communities. This is a Software Engineering III position at the Director level, which is part of the job... ....Partner with the Advanced Analytics, Machine learning and Gen AI Platform team(s), across multiple project areas, and work in...SuggestedTemporary work- Job-ID31175163Reference25-262131TypeContract Job Title: AI Engineer Employment Type: Contract (W2 Only) Number of Positions: 4 Location: New York, NY (Highly Preferred) Additional Locations: Chicago (Preferred), Atlanta, Dallas, Miami (Backup Locations)OverviewWe are seeking...SuggestedContract work
$175k - $250k
AI EngineerAbout MillenniumMillennium is a global, diversified alternative investment firm, founded in 1989. Defined by evolution,... ...and business impactPartner closely with product managers, data engineers, and business stakeholders to translate business needs into scalable...SuggestedFlexible hours- ...business processes and identify opportunities for automation and AI-driven enhancement.Design, develop, and maintain automation... ...workflow orchestration.Exposure to Generative AI (LLMs, prompt engineering, copilots, or AI assistants).Experience building or supporting...Suggested
$200k
We're looking for an experienced AI Engineer to join Optiver's Applied AI and Platform Engineering team. In this role, you'll design, build, and deploy production-grade AI systems that automate workflows, augment decision-making, and accelerate engineering across the firm...Work at office- ...promised to change everything across a business—until generative AI. Today, AI is the number one driver of business reinvention. And... ...and help lead that change.You Are:As a Snowflake Advanced AI Engineer, you will design, build, and operationalize artificial intelligence...Full timeWork experience placementLive inWork at officeLocal areaShift work
- Role/Responsibilities:We are seeking a NLP engineer for a NLP research team within Point72. The ideal candidate has a track record of developing modern NLP solutions, including the use of LLMs, agents, RAG, open-source models fine-tuning and deployment, etc.Responsibilities...Worldwide
- .... If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Gen AI Engineer to join our team in a hybrid basis either out of our NYC or Richardson, TX office 3 days/week. Job Duties:· Build agentic AI systems...Work at officeRemote workFlexible hours3 days per week
$157k - $200k
Reference: 329191Applied AI Engineer | New York CityHybrid, 4 days onsite | $157,000-$200,000Please note * Must be authorized to work in the U.S. without current or future employer sponsorship/visa transfer.* Lawrence Harvey has been engaged by a global engineering and...- Job Description:This is a fullstack engineering role with a strong frontend emphasis. You’ll have ownership across the product stack, from users interfaces to infrastructure supporting AI models. Location: New York, NY or Boston, MA or San Francisco, CA (3 days/week)Salary...3 days per week
$342.7k
...strategy for Splunk and Cisco, and we are building best-in-class AI capabilities into our platform, security and observability... ...journey to digital resilience. We are looking for a Distinguished Engineer with outstanding technical leadership in the AI/ML area to drive...Full timeTemporary workWork at officeLocal areaRemote workFlexible hours- ...AI Engineer Location: Hybrid (New York, NY) Duration: Long-term Primary skills: AI, ML, Generative AI, GitHub CoPilot, Prompt Engineering About the job: We are looking for an experienced AI Engineer with a strong background in Artificial Intelligence, Machine...
$150k - $275k
...revenue slips through the cracks. Joyful Health is building the AI-powered financial operating system for healthcare practices. Our... ...We're looking for a talented and ambitious machine learning engineer with 5+ years of experience building production AI systems who's...Full timePrivate practiceWork at office3 days per week$190k - $200k
...national origin, disability status, protected veteran status or any other characteristic protected by law. Description Job Title: AI Engineer Location: New York, NY Department: Technology/Revenue Strategy Reports To: Chief Executive Officer FLSA Status: Exempt Work Type:...Full timePart timeWork at officeRemote workShift workNight shift- ...The Senior Software Engineer operates as a senior/lead team member of a team, assisting assigned Insurance Carrier project teams ("our clients... ...Be a leading voice in the design and implementation of AI based solutions for the insurance industry Provide guidance to...Flexible hours
$175k - $300k
...s how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus. As an AI Engineer at DRW, you will be an integral member of a collaborative multi-asset trading team. You'll work on high-impact machine learning...Temporary workFlexible hours- AI Engineer Who we are Makai Labs builds software that automates entire companies. We work across a diversified portfolio, which means our systems touch a wide range of domains, processes, and operational constraints. Our engineering team is small, senior, and high-output...InternshipLocal areaRemote workFlexible hours
- ...AI Engineer StatusNeo is a global AI-native transformation firm helping enterprises design, engineer, and govern AI-led systems with trust at the core. We work with global enterprises across BFSI, retail, healthcare, airlines, and platform-driven industries to transform...
- ...AI Engineer WRITER is where the world's leading enterprises orchestrate AI-powered work. Our vision is to expand human capacity through superintelligence. And we're proving it's possible – through powerful, trustworthy AI that unites IT and business teams together to...Full timeWork at officeLocal areaFlexible hours
$150k - $250k
...Distyl AI Job Opportunity Distyl is an applied AI technology company partnering with the world's most ambitious institutions to... ...improving, and trusting AI behavior in production. AI Evaluation Engineers focus on designing and implementing the evaluation systems that...Work at officeFlexible hours3 days per week$35k
...Job Description Core Skill Set: Python (advanced, production-grade coding) Generative AI (LLMs, prompt engineering, fine-tuning, RAG) Agent development using frameworks such as ADK, LangGraph, LangChain Additional Relevant Skills: Experience...Full timeFor contractorsShift work$125k - $250k
...Senior AI Engineering East West Bank is seeking an experienced Senior AI Engineering to design, build, and operationalize enterprise-grade AI and Generative AI solutions across the Bank. This senior technical leader will translate emerging AI capabilities into secure...- ...AI Engineer We're hiring for our first AI Engineer. Someone who's excited to own and build all things AI at Coast. You'll be responsible for designing and building features that make it faster and more powerful to create functional demos. You should have strong instincts...
$130k - $190k
...future-state process, build it, and keep it running. That's this role. You'll embed directly with the cross functional AI team as a dedicated AI engineer. Your job isn't to write code faster with AI. It's to fundamentally redesign how work gets done. You'll map existing...Hourly payShift work- ...Legalist manages over $1.7 billion for endowments, foundations, and family offices. Summary Legalist is looking for an AI Native Engineer to join our team and work directly with our Co-founder to build AI-powered products and workflows. This is a hands-on,...Local area
- ...We have a contract opportunity for AI Engineer with one of our clients. Detailed job descriptions are provided below. Title: AI Engineer Location: New York, NY Duration: 12 Months (Onsite) J O B P U R P O S E We are seeking an...Contract work
$110k - $150k
Description Your role at GEI. The AI Engineer is responsible for the development of AI solutions, typically leveraging pretrained models and copilots, to support GEI's priority digital and AI initiatives. This role focuses on building, deploying, and integrating AI capabilities...Work at officeFlexible hours$269.1k - $307.2k
...Distinguished AI Engineer Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our...Full timePart timeLocal area$70 - $75 per hour
...Position: AI Engineer Location: New York, New York Duration: Contract Job ID: 177525 Job Overview: We are seeking a highly skilled and experienced AI Engineer to join our team. The role involves building an enterprise-grade Generative AI (GenAI) workflow...Full timeContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Engineer. Be the first to apply!
Related searches

