AI/ML Software Engineer

AI/ML Software Engineer

We are seeking an experienced AI/ML Software Engineer to design and build production-grade tools for the Maryland Judiciary. The successful candidate will integrate AI/ML techniques to automate tasks, assist internal staff, and enhance the digital experience for external users. This role focuses on developing intelligent systems within hybrid cloud environments, often optimizing for resource-constrained settings.

Location: Remote (Annapolis, MD - Requires 2 initial days onsite)

Salary Range: $120,000 - $149,000 USD

Industry: Public Sector / Government

Key Responsibilities:

• Design and implement software systems that integrate AI/ML techniques to automate specific tasks with high accuracy.
• Develop agent architectures, workflows, and system designs in collaboration with cross-functional teams.
• Build and deploy containerized applications within hybrid cloud environments.
• Determine optimal approaches for technical challenges, including the selection between LLM-based and non-LLM techniques.
• Optimize system performance for environments with limited computational resources and minimal GPU availability.
• Create robust testing and evaluation pipelines, including the generation of synthetic data for benchmarking.
• Develop unit and integration tests for AI-enabled workflows and backend data pipelines.
• Document all system designs, technical decisions, and workflows to ensure production-grade quality.
• Contribute to high-level decision-making regarding data processing and retrieval strategies.

Minimum Requirements:

• Bachelor of Science in Computer Science, Engineering, Data Science, Mathematics, or a related field.
• At least 3 years of experience in data science, machine learning, or applied AI development.
• At least 3 years of experience in software engineering, architecture, or web development.
• Proven proficiency in Python for developing production-grade backend services, APIs, and middleware.

Preferred Experience:

• Collaborating with Large Language Models (LLMs) via API-based integration and local deployment.
• Implementing RAG systems using embedding models, vector similarity, re-ranking, and graph retrieval.
• Working with SQL/relational databases (e.g., PostgreSQL) and graph databases (e.g., Neo4j, Apache AGE).
• Fine-tuning small language models or embedding models.
• Designing multi-agent or task-oriented AI systems.
• Utilizing version control (Git) and containerization (Docker) within service-oriented architectures.