Software AI Engineer Mid-Level, Context Engineering [Remote]

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Software AI Engineer Mid-Level, Context Engineering in the United States.

This role sits at the intersection of software engineering and applied AI infrastructure, focused on building the “context layer” that powers modern LLM-driven systems. You will help design and develop the foundational services that connect enterprise data to AI agents in a secure, scalable, and efficient way. Working in a cloud-native environment, you will contribute to data retrieval systems, agent tool integrations, and AI workflow automation. The position is highly hands-on, requiring strong backend engineering skills and a curiosity for emerging AI architectures. You will collaborate with cross-functional teams to ensure reliable data flow into AI systems used across enterprise applications. This is an opportunity to shape the operational backbone of next-generation AI platforms while working on production-grade systems at scale.

Accountabilities

In this role, you will be responsible for building and maintaining core AI platform components that enable intelligent data access and agentic workflows across enterprise systems. You will design, implement, and optimize backend services that support LLM-driven applications, ensuring performance, scalability, and reliability. Key responsibilities include:

• Developing and maintaining core services for AI data infrastructure and retrieval systems, including optimized storage and access patterns for AI workloads.
• Building and supporting CI/CD pipelines to automate deployment of AI models, prompts, and infrastructure changes.
• Designing tool execution interfaces and APIs that allow AI agents to safely interact with enterprise systems.
• Contributing to context retrieval systems, including RAG-based architectures and secure data access patterns.
• Supporting cloud infrastructure management across AWS and Azure with a focus on security, scalability, and cost efficiency.
• Participating in operational support, including troubleshooting, testing, documentation, and on-call reliability efforts.

Requirements

The ideal candidate brings a solid software engineering foundation combined with growing experience in AI systems and cloud-native development. You are comfortable writing production-grade code and eager to work on emerging AI infrastructure challenges. Key qualifications include:

• 3+ years of professional software engineering experience with strong backend development skills.
• Proficiency in Python and either Java or Scala, with a focus on clean, maintainable code.
• Experience building and consuming RESTful APIs or gRPC services.
• Familiarity with relational databases (Postgres/MySQL) and distributed data systems.
• Hands-on experience with AWS or Azure, including core services such as IAM, compute, and object storage.
• Working knowledge of CI/CD tools (GitHub Actions, GitLab CI, or Jenkins) and basic Infrastructure-as-Code (Terraform).
• Exposure to observability tools such as Prometheus, Grafana, or cloud-native monitoring platforms.
• Interest or experience in LLMs, RAG systems, vector databases, and agentic workflows (e.g., LangChain, LlamaIndex).
• Strong collaboration skills and ability to thrive in agile, fast-paced environments.
• Bachelor’s degree in Computer Science, Software Engineering, or related field.

Benefits

• Competitive base salary range: $124,700 – $148,800 annually
• Comprehensive health, dental, and vision insurance coverage
• Retirement savings plan with employer contributions
• Paid time off, holidays, and flexible spending accounts
• Life, disability, and additional insurance options
• Tuition reimbursement and professional development support
• Exposure to cutting-edge AI, cloud, and data infrastructure technologies
• Hybrid of innovation-focused engineering culture and real-world production impact

How Jobgether works:

We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.