Senior AI Platform Engineer

Type: W2 Full-time, not offering sponsorship Pay Range: $180,000-200,000 per year Location: San Francisco, CA - Hybrid (must be onsite 6 times per month) Title: Senior AI Platform Engineer Job Description We are building a next-generation Agentic AI Framework that integrates Model Context Protocol (MCP), Agent-to-Agent (A2A) communication, Machine Learning, and advanced orchestration on top of our enterprise big data platform. We are looking for Senior AI Platform Engineers to join our R&D team. These engineers will design and implement the core AI framework, ensuring it seamlessly integrates with our big data infrastructure, and enabling scalable, intelligent, and autonomous data-driven systems. What You Will Get to Do Design and build a scalable Agentic AI framework on top of our data platform. Implement MCP- and A2A-based architectures for agent collaboration and orchestration. Integrate AI services with data pipelines (Airflow, Spark, Trino, StarRocks, DBT). Build APIs, SDKs, and tooling to enable other teams to use the framework. Work with platform and application teams to ensure secure, reliable, and multi-tenant deployment of AI agents. Evaluate new agentic AI, LLM, and orchestration technologies and recommend adoption. Mentor other engineers and contribute to AI engineering best practices. Core Skills (Must-Have) Strong programming skills in Python with 5+ years of experience Proven experience with data engineering or distributed systems (Spark, Hive, Trino, StarRocks, DBT, Airflow, Kubernetes). Deep understanding of LLM-based systems and agent frameworks (LangChain, LlamaIndex, DSPy, OpenAI MCP, A2A). Hands-on experience with API design & integration (REST, GraphQL, gRPC). Knowledge of cloud infrastructure & container orchestration (Kubernetes, Docker). Strong understanding of IAM, security, and multi-tenancy in enterprise systems. Track record of building production-grade AI/data platforms. Desired Skills (Nice-to-Have) Experience in Information Security. Experience with vector databases (pgvector, Pinecone, Weaviate, Milvus, Vespa). Familiarity with event-driven architectures (Kafka, Pulsar). Understanding of retrieval-augmented generation (RAG) patterns. Background in authorization/identity systems (ReBAC, RBAC, Zanzibar-style). Familiarity with observability (OpenTelemetry, DataHub, MLflow, Prometheus). Experience in enterprise AI governance (audit, lineage, compliance). Contributions to open-source AI frameworks (LangChain, OpenAI MCP, Hugging Face, etc.). Vaco by Highspring values a diverse workplace and strongly encourages women, people of color, LGBTQ+ individuals, people with disabilities, members of ethnic minorities, foreign-born residents, and veterans to apply. EEO Notice Vaco by Highspring is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment because of race (including but not limited to traits historically associated with race such as hair texture and hair style), color, sex (includes pregnancy or related conditions), religion or creed, national origin, citizenship, age, disability, status as a veteran, union membership, ethnicity, gender, gender identity, gender expression, sexual orientation, marital status, political affiliation, or any other protected characteristics as required by federal, state or local law. Vaco by Highspring and its parents, affiliates, and subsidiaries are committed to the full inclusion of all qualified individuals. As part of this commitment, Vaco by Highspring and its parents, affiliates, and subsidiaries will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact View email address on click.appcast.io . Vaco by Highspring also wants all applicants to know their rights that workplace discrimination is illegal. By submitting to this position, you agree that you will be giving Vaco by Highspring the exclusive right to present your as a candidate for the foregoing employment opportunity. You further agree that you have represented information about yourself accurately and have not affirmatively misrepresented your qualifications. You also agree to maintain as confidential, to the fullest extent permitted by law, any information you learn from Vaco by Highspring about the position and you will limit disclosure of information about the position only to the extent necessary to perform any obligations in furtherance of your application. In exchange, Vaco by Highspring agrees to exercise reasonable efforts to represent you through all solicitation, job screening and resume dispersal. Privacy Notice Vaco by Highspring and its parents, affiliates, and subsidiaries (“we,” “our,” or “Vaco by Highspring”) respects your privacy and are committed to providing transparent notice of our policies. California residents may access Vaco by Highspring HR Notice at Collection for California Applicants and Employees here. Virginia residents may access our state specific policies here. Residents of all other states may access our policies here. Canadian residents may access our policies in English here and in French here. Residents of countries governed by GDPR may access our policies here. Pay Transparency Notice Determining compensation for this role (and others) at Vaco by Highspring depends upon a wide array of factors including but not limited to: the individual’s skill sets, experience and training; licensure and certification requirements; office location and other geographic considerations; other business and organizational needs. With that said, as required by local law, Vaco by Highspring believes that the following salary range referenced above reasonably estimates the base compensation for an individual hired into this position in geographies that require salary range disclosure. The individual may also be eligible for discretionary bonuses.