Senior AI Solutions Developer, AI CoE (Hybrid Onsite)

Job Title

Senior AI Solutions Developer, AI CoE (Hybrid Onsite)

Rutherford, NJ

6 Months

$70/hr on C2C / 1099 all inclusive (OR) $65/hr on W2

Virtual / In-Person

hybrid; three days in office per week; frequent travel to New York City office

Who You Are

l You are a hands-on developer with strong experience building AI-enabled applications, assistants, workflows, and integrations. You have strong software engineering fundamentals, deep Python experience, and the ability to connect systems, data, APIs, and services into practical working solutions.

l You are comfortable working directly with business stakeholders, application teams, and domain experts. You can move from an ambiguous business problem to a working prototype by understanding the workflow, systems, data, exceptions, and operational constraints involved.

l You bring an agile mindset to an enterprise environment. You are comfortable building quickly, learning through prototypes, documenting what works, and helping shape repeatable patterns for a growing AI Center of Excellence. You understand that successful AI solutions require not only strong engineering, but also practical governance, risk, security, data access, evaluation, and adoption considerations.

What You'll Do

l Prototype and Solution Development

l Work directly with business teams, application teams, and domain experts to understand workflows, pain points, systems, data, exceptions, and operational constraints.

l Build rapid prototypes and proof-of-concepts for AI-enabled workflows, assistants,agents, automations, and features in close partnership with users and stakeholders, testing ideas against real business processes and enterprise environments.

l Rapidly validate what is technically feasible, what is operationally useful, and what should not move forward.

l Translate prototype learnings into solution recommendations, technical patterns, implementation considerations, and governance inputs for the AI CoE.

l Help move successful prototypes toward scalable delivery by partnering with application, architecture, data, security, and platform teams.

Engineering and Integration

l Use Python, APIs, databases, and services to connect systems, data, documents, and workflows.

l Integrate with enterprise systems while following security, privacy, architecture, and technology standards.

l Work with authentication, authorization, secure data access, and permission aware integration patterns.

l Design solutions that are practical, maintainable, and appropriate for enterprise use.

AI Application Development

l Work with LLM-based tools and platforms to build applications that support business workflows.

l Implement orchestration approaches for multi-step workflows, tool usage, and agentic patterns.

l Apply retrieval, structured data access, and workflow automation where appropriate.

l Build AI-enabled workflows that include appropriate human review, guardrails, error handling, and escalation paths.

Governance, Risk, and CoE Enablement

l Support practical governance, risk, and compliance considerations based on lessons learned from AI prototypes and proof-of-concepts.

l Help identify common risks, controls, review points, and documentation needs for AI-enabled solutions.

l Partner with security, privacy, legal, data, architecture, and governance stakeholders to support responsible AI solution development.

Evaluation and Observability

l Implement logging, testing, monitoring, and basic observability for prototypes and workflows.

l Use evaluation and tracing tools to measure performance, identify failure modes, and improve solutions.

l Support structured testing and iteration of AI-enabled solutions with business users and technical stakeholders.

l Help define practical evaluation approaches for accuracy, usefulness, reliability, latency, cost, risk, and user experience.

You'll Need to Have

l Bachelor's degree or equivalent experience in Computer Science, Engineering, Information Systems, or a related field.

l 5 to 8 years of experience in software development, application development, systems engineering, or related engineering roles.

l Strong proficiency in Python.

l Strong experience with APIs, system integration, and service-based architectures.

l Solid knowledge of SQL and working with data in enterprise environments.

l Experience building AI-enabled applications, assistants, agents, automations, or workflows using modern LLM tools and platforms.

l Experience working directly with business stakeholders or end users to design, prototype, and iterate on software or AI-enabled solutions.

l Experience working with tool integration patterns, including exposing or consuming internal tools and services within application workflows.

l Understanding of orchestration approaches for multi-step workflows, tool usage, and agentic patterns.

l Experience implementing logging, testing, and basic observability.

l Understanding of authentication, authorization, secure data access, and enterprise integration considerations.

l Ability to identify practical risks, controls, dependencies, and trade-offs when developing AI-enabled solutions.

l Strong problem-solving skills and the ability to work through ambiguity.

l Strong written and verbal communication skills.

l Ability to manage multiple priorities in a fast-paced environment.

We'd Love to See

l Experience in a forward-deployed engineering, solutions engineering, applied AI engineering, innovation lab, consulting engineering, or internal product/prototype development environment.

l Experience building or working with MCP servers, for example using FastMCP or similar tools.

l Experience with orchestration frameworks such as LangGraph or similar tools.

l Experience with evaluation and observability platforms such as LangSmith, Weights & Biases, or OpenTelemetry-based tracing.

l Experience with retrieval patterns and working with structured and unstructured data.

l Familiarity with enterprise AI governance considerations, including privacy, security, data access, HITL design, and responsible use.

l Experience working with security, privacy, legal, architecture, data governance, or risk stakeholders.

Skills & Competencies

l Software engineering fundamentals

l Python development

l API and system integration

l Data and SQL proficiency

l AI application development

l Agentic workflow development

l Workflow orchestration

l Secure enterprise integration

l Rapid prototyping

l Technical feasibility assessment

l Testing, evaluation, and observability

l Governance, risk, and compliance awareness

l Business and stakeholder collaboration

l Clear technical communication

l Strong execution and ownership

Contact: Sohail - View email address on us.fitly.work