AI Senior Engineer - $220k-$280k

Job Description

Job Description

AI Senior Engineer

Senior AI Engineer - LLM Systems

We are building production-grade AI products that tackle complex, high-stakes problems in (fintech / accounting / legaltech), and we need a senior engineer who can take LLM-powered systems from prototype all the way to reliable, monitored, production services - not just demos.

What you'll do

• Design and ship end-to-end LLM-driven features and services using clean-code, CI/CD, and observability best practices

• Architect and build retrieval-augmented generation (RAG) pipelines and vector retrieval systems that stay accurate, low-latency, and fresh

• Develop agent frameworks and tool-calling pipelines that coordinate multiple models and external systems for complex multi-step workflows

• Define and run evaluation frameworks - automated evals, human-in-the-loop annotation, and regression suites - to measure accuracy, safety, and bias

• Instrument production models with monitoring, alerting, and A/B testing to catch regressions before users do

• Partner with product, design, security, and domain experts to translate business requirements into actionable technical specs

• Mentor engineers through code reviews and establish best practices for model development, deployment, and post-deployment maintenance

What you need

• 5+ years of production backend or systems engineering experience; strong Python and modern practices (testing, CI/CD, containerization)

• Hands-on experience with LLMs and transformer architectures including fine-tuning, prompt engineering, or adapting foundation models for production

• Demonstrated experience designing and integrating retrieval systems (vector databases, dense/sparse retrieval, similarity search) with LLMs

• Practical experience building agent and tool-calling pipelines with multi-step orchestration and state management

• Experience with cloud platforms (AWS, GCP, or Azure), MLOps tooling, and cost-effective inference scaling

Nice to have

• Domain experience in fintech, accounting, audit, or legaltech - especially regulatory, privacy, or compliance considerations

• Familiarity with specific tooling: LangChain, LlamaIndex, Weaviate, FAISS, Pinecone, Ray, or MLflow

• Experience designing human annotation workflows and managing eval suites at scale

• Background collaborating with security and privacy teams to implement guardrails and access controls in regulated environments

Pay & benefits

$220k-$280k base - $300k-$600k Equity 

Location & schedule

Manhattan, NY - Onsite 

Benefits

Benefits

• Unlimited PTO

• Wellhub Platinum membership

• Comprehensive health, dental, and vision coverage

• Free company dinner every day

- For this position, you must be currently authorized to work in the United States without the need for sponsorship for a non-immigrant visa. This job was first posted by CyberCoders on 08/26/2026 and applications will be accepted on an ongoing basis until the position is filled or closed. Everforth CyberCoders is proud to be an Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, sexual orientation, gender identity or expression, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, status as a crime victim, disability, protected veteran status, or any other characteristic protected by law. Our hiring process includes AI screening for keywords and minimum qualifications, and a virtual recruiter as part of the application process. A human recruiter reviews all results. Click here for details on our virtual recruiter . Everforth CyberCoders will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable state and local law, including but not limited to the Los Angeles County Fair Chance Ordinance, the San Francisco Fair Chance Ordinance, and the California Fair Chance Act. Everforth CyberCoders is committed to working with and providing reasonable accommodation to individuals with physical and mental disabilities. Individuals needing special assistance or an accommodation while seeking employment can contact a member of our Human Resources team at View email address on us.fitly.work to make arrangements.

Salary

$220000 - $280000 USD per year