AI Platform Engineer
Prophecy Technologies
Role Overview:
This role involves building and scaling a production multi-agent AI platform designed to serve thousands of internal users across various business units. The platform will operate with a monthly release cadence, addressing real-world challenges related to user experience, latency, and cost efficiency.
Key Responsibilities:
This role involves building and scaling a production multi-agent AI platform designed to serve thousands of internal users across various business units. The platform will operate with a monthly release cadence, addressing real-world challenges related to user experience, latency, and cost efficiency.
Key Responsibilities:
- Develop an LLM-driven orchestrator for routing user intent across a portfolio of specialized agents, managing delegation, memory, response validation, and capability discovery.
- Implement an agent selection layer utilizing hybrid retrieval (vector RAG over a capability registry) and closed-set LLM selection with JSON-schema-constrained outputs.
- Build a multi-agent SDK/gateway using FastAPI, hosting multiple agents behind path-prefix routing, managing per-agent tool registries, and session-scoped conversational context.
- Create tool-driven agents with 15-30 dynamically composed tools by an LLM, ensuring tool contracts, guardrails, and evaluation.
- Design and implement a data API layer with parameterized endpoints between agents and databases, ensuring LLMs do not directly interact with databases.
- Facilitate partner-team onboarding, including versioned A2A contracts, bring-your-own-agent registration, and auto re-embedding.
- Proficiency in production LLM systems, including RAG, tool/function-calling loops, structured outputs, hallucination guards, and closed-set selection.
- Experience with multi-agent orchestration, A2A protocols, session affinity, human-in-the-loop gating, kill switches, and graceful degradation.
- Expertise in vector search and embeddings at scale, achieving sub-second retrieval over thousands of documents.
- Knowledge of evaluation & safety practices: PII/PHI masking, audit trails, feedback-loop instrumentation, and offline + online evaluation.
- Strong programming skills in Python 3.11+, FastAPI, async I/O, and Pydantic.
- Familiarity with modern LLM stacks such as Gemini, GPT, Claude, and agent frameworks like LangGraph and other Agent SDKs.
- Cloud platform experience (GCP or AWS), including Kubernetes, object storage, workflow orchestration, and Vertex/Bedrock-class services.
- Database and caching experience with Redis, MongoDB, Oracle/Postgres, and knowledge of SSO + RBAC.
- Understanding of observability tools and practices: Prometheus, structured JSON logs, per-decision audit trails, and p95 latency SLOs.
- Skills in Machine Learning, Artificial Intelligence (AI), and Generative AI.
- 4-6 years of experience in a relevant engineering role.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Platform Engineer in Dallas, TX vacancy
- ...learn, grow, and make an impact. Join us!Position Summary :This is a hands-on software engineering role focused on building enterprise-grade Generative AI, Data Science, and AI Platform capabilities within Bank of America's strategic AI ecosystem. The engineer will work...SuggestedFull timeWork at officeFlexible hoursDay shift
- ...package, along with the opportunity to work within an innovative and collaborative environment. Join our Technology Team as an AI Platform Engineer located in various offices.We are seeking a professional who thrives in a fast-paced, deadline-driven environment. The ideal...SuggestedFull time
- Job DescriptionPrincipal Consultant - AI Platform & Governance Engineer - Infosys ConsultingInfosys Consulting's Tech Transformation Advisory Practice is seeking a Principal Consultant specializing in AI Platform & Governance EngineerPosition Overview:As a Principal Consultant...SuggestedFull timeTemporary workLocal area
$112.8k - $153.7k
...listen to your ideas. This is a senior engineering role. You will architect, operate, and continuously... ...improve cloud data and analytics platforms (e.g., Microsoft Fabric, Snowflake,... ..., Databricks, etc.) are a plus.Hands-on AI/ML/GenAI enablement experience (model lifecycle...SuggestedFull timeContract workLocal areaFlexible hours$91.3k - $124.4k
...listen to your ideas. This is an early-career engineering role focused on building, operating, and improving cloud data/analytics platforms (e.g., Microsoft Fabric, Snowflake,... ...Databricks, etc)Demonstrated experience with AI/ML/GenAI enablement (model lifecycle, AI Search...SuggestedFull timeContract workInternshipLocal areaFlexible hours- ...OpportunityJoin a team building the data foundations that support the firm’s AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data use...
$158.2k - $237.4k
...deploy, and optimize secure, scalable data platforms and analytical applications that... ...decision support solutions. Apply modern data engineering, software development, cloud... ...support reporting, predictive analytics, AI capabilities, and interactive applications...Temporary workWork at officeLocal areaRelocation- ...Job Description Make AI Possible Invited Clubs is building an enterprise AI Factory to transform how work gets done across the organization. The AI Platform Engineer is responsible for creating the foundation that enables AI to scale by connecting enterprise systems...
- ...AI Platform Engineer Location: Dallas, TX, Charlotte, NC We are looking for an AI Platform Engineer builder who can architect the "factory" where AI is made. Our goal is to build an internal, on-premises AI ecosystem that mimics the capabilities of...
- ...largest Telecom customers is seeking a skilled software engineer to join their Data Platform team within the Chief Data Office. This Software Engineer... ...role in building, operating, and scaling a production-grade AI inferencing platform that supports high-throughput, low-...Work at office
- ...Job Title - AI Platform Engineer Location - Addison, TX Role - Contract Responsibilities: Key Responsibilities # Platform Architecture: Design and develop a "Model-as-a-Service" platform that allows non-experts to use drag-and-drop components...Contract work
$139.23k - $163.8k
...from Day One. Job Description Job Summary The Lead Engineer (Generative AI) is a senior technical role responsible for designing, developing... ...feedback mechanisms for production AI systems 3. Cloud, Platform & Scalability Engineering Architect and deploy GenAI...Temporary workWork experience placementLocal area3 days per week- ...Vice President of Software Engineering, Cloud, Platform & AI Engineering About the Company A leading global financial institution expanding cloud modernization, platform engineering, and AI enablement. Industry Financial Services Type Public Company...
- HeartCentrix Solutions seeks an AI Platform Software Engineer to build core services powering enterprise AI applications. You will develop scalable Python-based APIs and microservices for LLM workflows and AI agent orchestration. Collaborate with platform, ML, and software...
- ALIS Software LLC is seeking an AI Platform Administrator to govern and scale enterprise AI platforms across Azure environments. The role focuses on production-ready AI operations with Azure OpenAI, Databricks, and AI Gateway, aligned with security, reliability, and cost...
- BNY is seeking a hands-on, senior software engineer to join its Loans Platform team. You will own a portion of the platform, work across backend services (Java/Python), frontend tooling (React), AI orchestration, smart contracts, and policy logic to deliver real financial...
- ...Overview Employer: Southern Glazer’s Wine and Spirits LLC Job Title: Principal AI/ML Operations Platform Engineer Locations: 2300 SW 145th Avenue, Miramar, FL 33027 14911 Quorum Drive, Dallas, TX 75254 Duties Design, build, and deploy machine...Work at officeLocal areaRemote work
$130k - $185k
..., we’ve reimagined strategic consulting to work in a world of increasing complexity. Key Responsibilities The EY Growth Platforms AI ML Engineering Senior Associate/Consultant will play a critical role building and maintaining our core advanced analytics platform and serving...For contractorsWork experience placementSummer holidayFlexible hours- ...technology and leadership in cloud, data and AI with unmatched industry experience,... ...industry knowledge and applied AI and data engineering. We help the world’s leading Resources... ...— designing the data foundations, AI platforms, and governance models that turn data into...Full timeWork experience placementLive inWork at officeLocal area
$130k - $190k
...We are modernizing our data and analytics ecosystem by embedding AI and Generative AI across core insurance platforms (Policy, Claims, Billing, and Enterprise systems). We are hiring a Lead AI Engineer to build and scale production-grade AI solutions on AWS. This role...Full timeTemporary workWork at officeRemote workHome officeFlexible hours$107.92k - $148.39k
AI DevOps EngineerYou must be authorized to work in the U.S. without any current or future... ...for:We are looking for an AI DevOps Engineer to support Atkore’s newly established AI... ...Atkore strategy into executable and scalable platforms, delivering secure, resilient integration...Full timeH1bWork at officeLocal areaShift work$110k - $140k
...developing, and deploying production-grade AI solutions including autonomous agents,... ...output generation. Integrate with AI platforms including Snowflake Cortex, OpenAI,... ...code reviews and maintain high-quality engineering standards. Keep updated with advances...Full timeWork from home- ...Role Summary The Agentic AI Platform Engineer builds scalable, reusable, production-grade agentic infrastructure components. This role focuses on creating standardized Agentic AI constructs — including MCP servers, connectors, agent orchestration templates, memory...Contract workTemporary work
- ...leveraging advanced technologies such as AI, cloud, and data-led innovation to help our... ...., OpenAI, Anthropic, Cohere) and prompt engineering.• Strong proficiency in Python and ML... ...Technical/Domain Skill 2Technology|Cloud Platform|AWS App Development Technical/Domain Skill...Full timeTemporary workRelocation
- ...forward-thinking organization, apply now.We are currently seeking a AI Engineer (Corp Functions & Supply Chain) to join our team in Dallas,... ...as TensorFlow, PyTorch, LangChain, and LlamaIndex.Enterprise Platforms: 5+ years of familiarity with modern data and ML platforms (e....Contract workFor subcontractorWork at officeRemote workFlexible hours
$137.4k - $161.7k
Are you ready to make an impact?Senior AI Software Engineer - Technology & Experience (TechEx) West Monroe is seeking a Senior AI Software... ...Claude, and Gemini Integrate AI capabilities into existing platforms and engineering workflows Collaborate directly with clients...Local areaImmediate startFlexible hours- ...thinking services company at the forefront of AI-native innovation. We partner with... ...next-generation, agent-powered workflows engineered to scale in real-world settings. Our engineers... ...at the intersection of cutting-edge AI platforms, enterprise systems, and real-world...Full timeWork experience placementLive inWork at officeLocal area
- OverviewThe Infosys Engineering unit is dedicated to amplifying product-centric value delivery through innovative engineering solutions. We... ...of value. Our team leverages advanced technologies such as AI, ML, and predictive analytics to drive continuous improvement,...Full timeTemporary workRelocation
- ...deep expertise across software design and development, cloud-native architectures, enterprise platforms, data engineering, and emerging technologies, including generative AI and agentic AI.Members of the STG unit play a strategic role in shaping technology direction, solving...Full timeTemporary workRelocation
- ...promised to change everything across a business—until generative AI. Today, AI is the number one driver of business reinvention. And... ...and help lead that change.You Are:As a Snowflake Advanced AI Engineer, you will design, build, and operationalize artificial intelligence...Full timeWork experience placementLive inWork at officeLocal areaShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Platform Engineer. Be the first to apply!
Related searches



