Staff Software Engineer - AI Applications

Role Description

Vanilla is seeking a Staff Software Engineer - AI Applications with a strong background in software development, data science, machine learning, and artificial intelligence. You will be utilizing existing Large Language Models to build applied AI applications focused on producing high accuracy rates. Your software engineering skills will come into play here as you’ll take ownership in constructing services to ingest structured results. If you’re a proactive problem-solver who lives to disrupt archaic processes with cutting-edge technology, this is the job for you.

As a Staff Software Engineer, you will work collaboratively with engineering and subject matter experts to find innovative and disruptive uses of AI to streamline (or replace) workflows.

Responsibilities

• Machine learning and AI:
  • You are passionate and knowledgeable about the current and future state of AI.
  • You will be utilizing existing Large Language Models to build applied AI applications focused on producing high accuracy rates.
  • You will work with product and engineering teams and build models/services that can ingest data, extract key information, and surface insights.
  • You can build tooling to support model training, evaluation, inference serving, monitoring, and alerting.
  • You want to use the latest ML frameworks and open source tools to develop new model training pipelines.
• Hands On Coding:
  • You have direct experience with software engineering and are familiar with modern languages like Python, Javascript, Go, Rust.
  • You have experience building microservices and understand the tradeoffs of the approach.
• Data handling:
  • You can identify, extract, transform, and load data from disparate sources into a centralized system.
  • You are able to normalize, cleanse, and validate this data.
• Database management:
  • You are able to design and implement schemas, optimize queries, and manage database performance.
• Project management:
  • You must be an effective self-organizer: prioritize tasks, manage resources, and communicate effectively with non-technical stakeholders.
• Collaboration:
  • We are one team. You must be able to collaborate with engineers, subject matter experts, product managers, and designers to ensure the success of projects.

Qualifications

• Bachelor's degree in Computer Science, Engineering, a related field, or equivalent practical experience.
• 8+ years relevant work experience.
• Proficiency in modern programming languages such as Python or Javascript.
• Experience with OpenAI, Anthropic, or similar for both chat and API interfaces.
• Deep understanding of machine learning and AI technologies, including the ability to design, train, and implement machine learning models and use natural language processing techniques for automation.
• Production experience with scalability and best-practices of AI infrastructure.
• Must have experience with AI observability, monitoring, and signaling using tools like LangChain or LangGraph.
• Hands-on experience using RAG and chunking to tune LLM performance.
• Experienced with LLM orchestration tooling and decision frameworks.
• Experience or exposure building agentic capabilities and workflows.
• Experience or exposure to evaluation testing frameworks.
• Ability to effectively articulate technical challenges and solutions.
• Deal well with ambiguous/undefined problems; ability to think abstractly.
• Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
• Candidates must be legally authorized to work in the United States without the need for sponsorship now or in the future. Vanilla is unable to provide visa sponsorship at this time.

Benefits

• Flexible paid time off policy and 10 company-wide paid holidays.
• Parental leave, 6 weeks for all full-time employees and up to 14 weeks for birthing parents.
• Medical, dental, and vision benefits coverage for employees and their families.
• 401K eligibility after one month of employment.
• Free estate planning documents.
• Budget for learning & development and home office setup.
• Paid parking or transit for hybrid and in-office employees.