AI-Assisted Workflow Evaluator (Software Engineering & DevOps)
Temporary
Gramian Consulting
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
We are looking for experienced professionals from software engineering, DevOps, SRE, cloud, platform, or infrastructure engineering backgrounds to test and evaluate AI-assisted workflows across modern developer and workplace tools. The role focuses on assessing technical accuracy, workflow realism, command and configuration quality, platform interactions, and practical usability . No prior AI evaluation experience is required, but hands-on use of AI coding or productivity agents is highly relevant.
Responsibilities
- Test and validate AI-assisted developer and infrastructure workflows .
- Evaluate commands, configurations, and outputs across cloud and platform engineering scenarios.
- Review workflows involving GitHub, GitLab, JIRA, AWS, Azure, GCP, Kubernetes, Docker, and Terraform .
- Identify technical inaccuracies, broken steps, unrealistic assumptions, or workflow gaps.
- Assess how AI agents interact with connected workplace tools such as Slack, Google Drive, and Microsoft 365 .
- Document observations and provide clear, actionable technical feedback.
- Recommend workflow improvements based on real-world engineering standards.
- Participate in asynchronous review and virtual discussions to clarify task requirements.
- Evaluate whether AI-generated solutions are practical, reproducible, and technically sound.
- Maintain clear documentation across all submitted evaluations.
Requirements
- Professional experience in software engineering, DevOps, SRE, cloud, platform, or infrastructure engineering .
- Hands-on experience with at least one major cloud platform: AWS, Azure, or GCP .
- Practical experience with Kubernetes, Docker, Terraform , or comparable infrastructure tooling.
- Familiarity with developer platforms such as GitHub, GitLab, or JIRA .
- Experience with CI/CD pipelines and modern infrastructure or platform workflows.
- Professional experience using AI agents such as ChatGPT, Claude Code, Claude Cowork, Codex , or similar tools.
- Ability to evaluate technical workflows and identify incorrect or inefficient implementations.
- Strong written and spoken English .
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the AI-Assisted Workflow Evaluator (Software Engineering & DevOps) in Remote vacancy
- ...professional services and engineering talent solutions. With a strong background in software engineering and leadership,... ...from software engineering, DevOps, SRE, cloud, platform, or infrastructure... ...backgrounds to test and evaluate AI-assisted workflows across modern developer and...DevopsTemporary work
Gramian Consulting
Remote6 days ago $123k - $177.5k
...cloud, platform engineering, data, and AI capabilities to... ...and operational workflows while improving... ...technology domains.Evaluate emerging... ...experience.10+ years of software engineering,... ...services, Azure DevOps, OpenShift, Kubernetes... ...01(k) Education Assistance: MFS contributes...DevopsFull timeLocal areaRemote workFlexible hours$86.9k - $198k
Full Stack Software EngineerThe Opportunity:As... ..., tools, workflows, site maintenance,... ...experience in software engineering in lieu of a degreeNice... ...development, and DevOps techniques for... ...development, tuition assistance, work-life programs... ...fraud.Candidate AI Usage PolicyAI is...DevopsFull timeContract workPart timeWork at officeLocal areaRemote work- ...IT security and platform engineering to architecture, software development, and infrastructure... ...support efficient workflows and enable automation to... ...Visual Studio 2026, and AI-assisted or “vibe coding” workflows... ...automated testing and modern DevOps practicesExperience...DevopsInternshipSecond jobRemote workRelocation package
- DescriptionSoftware Engineer - TS/SCIXcelerate... ...next TS/SCI cleared Software Engineer supporting... ...and collaborative workflows (PRs, reviews)Experience with DevOps practices and tools... ...Language Models, Agentic AI About Xcelerate... ...Employer. We evaluate qualified applicants...DevopsContract workRemote workFlexible hours
$123k - $170k
...is seeking a Senior Full Stack Software Engineer to support a Department of War... ...platforms and mission-ready AI to federal agencies at commercial... ...pipeline using Azure DevOps, managing source control, builds, and secure CI/CD workflows.Support the re-engineering and...DevopsCivilian ContractorContract workRemote work- ...Software Engineer 2 The Software Engineer 2 role is focused on supporting... .... Experience using approved AI-assisted engineering tools... ...documentation, log analysis, and workflow improvement while following... ...experience in platform engineering, DevOps, release engineering,...DevopsRemote work
Sophos
United States2 days ago $142.5k - $264.7k
...Roche.Advances in AI, data, and computational... ...(AI) to assist our scientists in... ...The Analytics and Workflows group within the Center... ...science, biology, and engineering to build... ...motivated Bioinformatics Software Engineer with... ...genomics data. You will evaluate, refine, and...Full timeLocal areaWorldwideRelocation package3 days per week$130.4k - $195.6k
...company and a leading AI platform for... ...code generation, AI-assisted code review, agentic workflows, and enterprise-wide... ...work in enterprise software, we'd love to hear from... ...looking for a software engineer who's excited to build... ...- Familiarity with DevOps practices and CI/CD...DevopsFull timeWork at officeRemote workHome officeFlexible hours$104.5k - $174.2k
...Position DetailsAs a Senior Software Engineer (Software Engineer III)... ...cost visibility, FinOps workflows, and multi-cloud... ...Scrum methodologies and DevOps practicesExperience with AI/ML concepts or integrating... ...please advise us so that we can provide appropriate assistance.DevopsFull timeH1bLocal areaRemote workWorldwide$129.3k - $172.3k
...Full Stack Senior Software Engineer to design and... ...Architecture, UX, DevOps, and Security, to... ...develop, and integrate AI-enabled... ...applications, and using AI-assisted development tools... ..., RAG, agentic workflows, and intelligent... ...applications.Evaluate and prototype emerging...DevopsFull timeLocal areaRemote work$92.3k - $153.9k
AVEVA is creating software trusted by over 90% of leading... .... Software Development Engineer - Performance &... ...performance science, and AI-driven automation — ideal... ...architecturesBuild Agentic AI workflows that automate test... ...performance pipelines in Azure DevOps with quality gates and...DevopsFull timeWork at officeLocal areaRemote workFlexible hours- ...seeking a Senior Full-Stack Software Engineer to join our high-performance... ...and APIs through frontend and DevOps. We are looking for an engineer... ...marketplace data.Modern Workflow Innovation: Leverage and champion the adoption of AI-assisted development tools (e.g., Claude...DevopsFull timeWork at officeLocal area
- ...seeking a Sr. Backend Software Engineer — News & Insights (T3)... ...including our upcoming AI-powered hyperlocal... ...schemas/persisted query workflows, and API surfaces connecting... ...rapid data freshness.DevOps, AWS Infrastructure &... ...velocity while evaluating generated code for security...DevopsLocal area
$119.8k - $234.7k
...than 25%Profession: Software... ...ads.As a Software Engineer on our team, you will... ..., 2026, Microsoft AI (MAI) employees who... ...experience with Azure DevOps and familiarity with... ...efficiently, prioritize workflow, ramp quickly, and... ...ordinances. If you need assistance with religious...DevopsOngoing contractWork at officeLocal areaRemote workWork from home$86.8k - $198k
Scientific Software EngineerThe Opportunity: As a back... ...with the software engineering skills it takes to identify... ...and scientific DevOps workflows to modernize complex... ...development, tuition assistance, work-life programs,... ...prevent fraud.Candidate AI Usage PolicyAI is a...DevopsFull timeContract workPart timeWork at officeLocal areaRemote work$116k - $174k
...own their own destiny.Software Engineer II - Recommendations (... ...search to power agentic workflows. We are evolving to... ...capabilities needed to evaluate recommendation quality... ...recommendation stack.Integrate AI into your and the team... ...at home with modern DevOps practices (CI/CD,...Devops- ...ExperienceRequired:6+ years’ experience in software development with expert level... ...-C) Experience leveraging AI-assisted development tools to accelerate software engineering workflows, including code generation,... ...or SAFe Experience with DevOps tools such as Git, JIRA,...DevopsFull timeTemporary workRemote workFlexible hours
$200.4k - $343.5k
...advanced data analytics and AI to cybersecurity, we use innovative... ....As the Vice President of Software Engineering for Utilization Management,... ...to modernize utilization workflows, empower engineering teams... ...architectural standards and DevOps practices, and oversee technology...DevopsMinimum wageFull timeWork experience placementWork at officeLocal areaRemote work$323k - $428k
...groups within Advertising Engineering to deliver high-impact... ..., we are exploring AI-driven measurement... ...highly skilled Senior Software Engineer with deep expertise... ...and analytics workflows. • Write clean, maintainable... ...of CI/CD pipelines, DevOps practices, and infrastructure...DevopsWork at officeLocal areaRemote workMonday to ThursdayFlexible hours- ...IT security and platform engineering to architecture, software development, and infrastructure... ...Publix.Join our Data and AI team as a Sr Software... ...solutions support efficient workflows and enable automation to improve... ...TFS/Git code management, DevOps Integration, DevOps...DevopsInternshipSecond jobRemote workRelocation package
$121k - $206k
...seeking a Senior Software Engineer to join our integrated... ...in modern AI-enabled engineering... ...product, design, DevOps, and enterprise security... ...and apply AI-assisted engineering... ...delivery, development workflows, and solution... ...internal teams to evaluate or support intelligent...DevopsFull timeTemporary workLocal areaRemote work3 days per week$99.6k - $166.6k
...extensive professional software engineering experience, including a... ...similar) backends.Cloud & DevOps — GCP (Cloud Run,... ...NoSQL (e.g., MongoDB).AI/LLM tooling — MCP servers or integrating AI assistants into developer and engineering workflows.Nice to haveAutomotive...DevopsImmediate startRemote workFlexible hours- Senior Software EngineerLocation: Hybrid - Exton,... ...exceptional Software Engineer to build industry-... ...intelligent cloud services, AI-native development workflows, and products that... ...-moving, AI-paced, DevOps-oriented environment... ...with AI agents, AI-assisted development...DevopsWorldwide
- ...payments.As a Sr. Mgr. Software Engineering in Norcross, GA, you... ...Software Engineering, DevOps/Platform, Support and... ...experience delivering AI-enabled initiatives and... ...Kubernetes-native release workflows. Ensure secure,... ...like), such as: GenAI-assisted developer workflows with...DevopsFull timeLocal areaRemote workWorldwideShift work
- ...DoAt Goldman Sachs, our Engineers don't just make things... ...build massively scalable software and systems, architect... ...redefine finance using AI, and seize... ...scalable systems and embrace DevOps practices to ensure continuous... ...-enhanced engineering workflows: building developer or...DevopsFull timeTemporary workPart timeImmediate startRemote work
$109.2k - $174.6k
...impact-driven DevSecOps Software Engineer to build and evolve... ...manage internal services, AI agents, and cloud... ...management of existing DevOps tooling to our target,... ..., improving developer workflows, and documenting remediation... ...automation. Enable AI-assisted development across the...DevopsPermanent employmentFull timeWork at officeImmediate startRemote workWork from homeWorldwide$158.4k - $237.6k
About the RoleAs a Senior Software Engineer at Hinge Health, you... ...the integration of AI-driven solutions to automate... ...continuous deployment DevOps culture, and take... ...Apollo, and Redux. Our workflow is trunk-based CI/CD,... ...If you feel you need assistance or an accommodation due...DevopsFull timeTemporary workInternshipWork at officeLocal areaRemote workWorldwide3 days per week- Software Engineer IILocation: Hybrid - Exton/Philadelphia, PA, US Position... ...that data through rich workflows. This is a high-impact... ...out:Experience with Azure DevOps, CI/CD, GitHub, GitHub Copilot... ...integrating or building AI/Copilot-assisted features Familiarity with...DevopsFor contractorsWork experience placementWorldwide
$101.5k - $169.1k
...DevelopmentJob ProfileSr Software... ...non-wholesale workflows. Our inspection... ...Senior Software Engineer applies secure... ...maintenance, and evaluation of software and... ...cloud-native, DevOps-focused software... ...corporate wide AI transformation... ...responsible use of AI-assisted development...DevopsFull timeRemote workVisa sponsorshipFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI-Assisted Workflow Evaluator (Software Engineering & DevOps). Be the first to apply!
