AI-Assisted Workflow Evaluator (Software Engineering & DevOps)
Temporary
Gramian Consulting
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
We are looking for experienced professionals from software engineering, DevOps, SRE, cloud, platform, or infrastructure engineering backgrounds to test and evaluate AI-assisted workflows across modern developer and workplace tools. The role focuses on assessing technical accuracy, workflow realism, command and configuration quality, platform interactions, and practical usability . No prior AI evaluation experience is required, but hands-on use of AI coding or productivity agents is highly relevant.
Responsibilities
- Test and validate AI-assisted developer and infrastructure workflows .
- Evaluate commands, configurations, and outputs across cloud and platform engineering scenarios.
- Review workflows involving GitHub, GitLab, JIRA, AWS, Azure, GCP, Kubernetes, Docker, and Terraform .
- Identify technical inaccuracies, broken steps, unrealistic assumptions, or workflow gaps.
- Assess how AI agents interact with connected workplace tools such as Slack, Google Drive, and Microsoft 365 .
- Document observations and provide clear, actionable technical feedback.
- Recommend workflow improvements based on real-world engineering standards.
- Participate in asynchronous review and virtual discussions to clarify task requirements.
- Evaluate whether AI-generated solutions are practical, reproducible, and technically sound.
- Maintain clear documentation across all submitted evaluations.
Requirements
- Professional experience in software engineering, DevOps, SRE, cloud, platform, or infrastructure engineering .
- Hands-on experience with at least one major cloud platform: AWS, Azure, or GCP .
- Practical experience with Kubernetes, Docker, Terraform , or comparable infrastructure tooling.
- Familiarity with developer platforms such as GitHub, GitLab, or JIRA .
- Experience with CI/CD pipelines and modern infrastructure or platform workflows.
- Professional experience using AI agents such as ChatGPT, Claude Code, Claude Cowork, Codex , or similar tools.
- Ability to evaluate technical workflows and identify incorrect or inefficient implementations.
- Strong written and spoken English .
Vacancy posted 10 days ago
Similar jobs that could be interesting for youBased on the AI-Assisted Workflow Evaluator (Software Engineering & DevOps) in India vacancy
- .... Title and Summary Software Engineer II Overview Mastercard... ..., automation, AI-enabled productivity,... ...pipelines using Jenkins and DevOps tools. Implement... ...Productivity Utilise AI-assisted development tools to... ..., and Operational workflows using AI-driven solutions...DevopsFull timeWorldwide
Mastercard
India28 days ago - ...Title and Summary Senior Software Engineer Who is Mastercard? Mastercard... ...Senior Software Engineer - DevOps to join the Payments... ...management, and deployment workflows using tools such as Ansible... ...delivery practices, and emerging AI-assisted engineering capabilities....DevopsFull timeWorldwide
Mastercard
India16 days ago - ...parts of the engineering system that help... ..., developer workflows, self-service... ...capabilities, and AI-enabled... ...directly improve how software gets built and... ...platform, DevOps, SRE, or infrastructure... ...with AI-assisted software... ...agentic workflows, evaluation frameworks, or...DevopsFull timeWork at officeLocal areaWorldwideFlexible hours2 days per week3 days per week
Ping Identity
India27 days ago - ...looking for a Senior Software Engineer who is passionate... ...to leverage AI-powered development... ...use modern AI-assisted development practices... ...-critical workflows. Collaborate with... ...testing, and modern DevOps practices. ~... ...Ability to critically evaluate, validate, and...DevopsFull timeFlexible hours
Everbridge
India10 days ago - ...Title and Summary Senior Software Engineer Role Overview We are... ...collaborative development workflows. Experience using Maven... ...field. Good to Have AI-Assisted Development Experience using... ...analytics platforms. Cloud & DevOps Experience with Docker...DevopsFull timeWorldwide
Mastercard
India16 days ago - ...Title and Summary Senior Software Engineer-Database Engineer Overview... ...initiatives and leverage AI-assisted development tools to improve... ...Skills to orchestrate release workflows and pipelines, and apply... ...technologies, automation, and DevOps practices. • Experience...DevopsFull timeWorldwide
Mastercard
India16 days ago - ...the stack. Define engineering standards across the team... ...decisions on LLM workflows , RAG pipelines ,... ...integrations , and AI cost management .... ...infrastructure maturity with the DevOps Engineer: IaC... ...Haves ~7+ years of software engineering, with a track...DevopsFull timeRemote workFlexible hours
Emergence Software
India29 days ago - ...infrastructure. You will guide engineering teams, drive... ...across the full software development... ...Experience leveraging AI tools and building... .... Cloud & DevOps Deploy, manage,... ...where relevant. Evaluate opportunities to integrate... ...products and workflows. Qualifications...DevopsFull time
Juniper Square
Indiaa month ago - ...The Senior Software Engineer, Full-Stack owns features end-to-end across Epic's web application... ...and architecture discussions. Use AI-assisted development tools to accelerate... ...~ Comfort with Git , pull-request workflows, and CI/CD. Preferred Qualifications...Full timeRemote work
Epic
India20 days ago - ...Title and Summary Senior Software Engineer-2 All About Us MasterCard... ...We are looking for a Senior AI Java Engineer (Hands-on IC)... ...them, contributing to model workflows that support training/tuning... ...safeguards (e.g., monitoring, evaluation, and operational controls...Full timeWorldwide
Mastercard
India16 days ago - ...Building AI-native products is a different problem than building deterministic software: the same input won't always produce the same output. Good product engineering here means designing experiences that stay... ...) as a real part of your workflow ~ High agency and a...Full timeShift work
dscout
India12 days ago - ...potential. Title and Summary Senior Software Engineer Senior Software Engineer Overview... ...tools (GitHub Actions, Jenkins, Azure DevOps, etc.).Knowledge of Agile/Scrum... ...services or payments domain experience.AI-assisted testing and test automation experience...DevopsFull timeWork experience placementWorldwide
Mastercard
India20 days ago - ...Senior Site Reliability Engineer Overview The... ...practices • Plan and execute software releases across... ...strategies, and development workflows Observability,... ...maintainability, and scalability AI & Innovation •... ...as Code, DevOps, and GitOps practices...DevopsFull timeWorldwide
Mastercard
India16 days ago - ...looking for a highly motivated Full Stack Software Engineer to join our engineering team and... ...mentoring activities. Leverage modern AI-assisted and Agentic Development... ...automation, test generation, and developer productivity workflows is highly desirable....Full time
Sophos
Indiaa month ago - ...Collaborate with frontend and QA engineers to ship end-to-end features... ...version control workflows Good to Have Exposure to... ...required Exposure to relevant AI tools (e.g., GitHub Copilot,... ...Claude, Cursor, or similar AI-assisted coding tools) Eligibility...Full timeInternshipWork at officeWork from homeFlexible hours3 days per week
Merkle Science
India27 days ago - ...Health is seeking a Senior Software Engineer for building applications that... ...systems Skilled in AI-first development practices utilizing... ..., accelerated development workflows, and enhanced productivity... ...comprehensive understanding of DevOps practices Exceptional problem...DevopsFull timeFlexible hours
XO Health
India29 days ago - ...love for you to join us. AI native product is fundamentally different engineering problem than building deterministic software: the same input won't... ...based systems and agentic workflows, and you know how to... ...solutions. You care about evaluation, iteration speed, and making...Full timeFlexible hoursShift work
dscout
India12 days ago - ...Our client is supporting the development of advanced AI systems by incorporating high-quality software engineering expertise into training and evaluation workflows. We are looking for experienced Java backend engineers with strong hands-on expertise in Spring Boot...Temporary work
Gramian Consulting
India12 days ago - ...potential. Title and Summary Senior Software Engineer-1 Overview • Responsible for the analysis... ..., Spring Batch and Kafka • Cloud and DevOps Architecture – Kubernetes, Docker, Chef... ...• Has skills to orchestrate release workflows and pipelines, and apply standardized...DevopsFull timeContract workWorldwide
Mastercard
India16 days ago - ...Title and Summary Senior Software Engineer Overview: The Mastercard... ...lifecycle management, tool evaluations, and deprecation of redundant... ...one. Implement and advance AI-augmented development... ...agentic coding tools, code assistants, and automated quality pipelines...Full timeWorldwide
Mastercard
India9 days ago - ...potential. Title and Summary Senior Software Engineer Experience Minimum 8+ years of... ..., tooling, and engineering workflows Required Skills Strong expertise... ...Awareness or exposure to Agentic AI concepts / AI-assisted development workflows Solid understanding...Full timeWorldwide
Mastercard
India16 days ago - ...at the intersection of AI and fintech. At Ocrolus... ...help lenders automate workflows with confidence—streamlining... ...financial institutions evaluate borrowers and enabling... ...-the-loop verification engine, Ocrolus captures data... ...skilled Senior Software Engineer - Backend with...Full timeRemote work
Differential Ventures
India26 days ago - ...greatest potential. Title and Summary Software Engineer II Who is Mastercard? Mastercard... ...Influence the decisions made by the team. Assist peers and less experienced members.... ...(Scrum/Kanban/Continuous Delivery/DevOps/Quality engineering) and the delivery situations...DevopsFull timeWorldwide
Mastercard
India9 days ago - ...realize their greatest potential. Title and Summary Senior Software Engineer Overview Mastercard powers economies and empowers people... ...practices including CI/CD, automated testing, and DevOps principles. Troubleshoot and resolve complex production issues...DevopsFull timeWorldwide
Mastercard
India21 days ago - ...potential. Title and Summary Senior Software Engineer Job Description Summary Who is Mastercard... ...(Scrum/Kanban/Continuous Delivery/DevOps/Quality engineering) and the delivery... ...· Has skills to orchestrate release workflows and pipelines, and apply standardized pipelines...DevopsFull timeContract workWorldwide
Mastercard
India16 days ago - ...high-impact talent who see AI as a teammate – leveraging it... ...for an AI Fullstack Senior Software Engineer with strong MERN stack expertise... ...APIs, and cloud-integrated workflows, while helping shape... ...production readiness. • Apply AI-assisted engineering tools such as...Full timeFlexible hours
MoneyLion
India26 days ago - ...access management. We are seeking a Staff Software Engineer to lead the evolution of our global,... ...Excellence: Partner with SRE and DevOps to enhance CI/CD pipelines, automated scaling... ...of high-quality, maintainable code. AI Adoption : Passionate about the technical...DevopsFull timeLocal areaWorldwideFlexible hours
- ...Summary Principal Applied AI App Engineer Who is Mastercard? Mastercard... ...based) into APIs, services, workflows, and UIs • Collaborate... ...applications that leverage evaluation, observability and monitoring • Strong experience in software engineering (Python, Java,...Full timeWorldwide
Mastercard
India16 days ago - ...management. We are seeking a Principal Software Engineer to lead the evolution of our global,... ...Operational Excellence: Partner with SRE and DevOps to enhance CI/CD pipelines, automated... ...of high-quality, maintainable code. AI Adoption : Lead the technical adoption...DevopsFull timeLocal areaWorldwideFlexible hours
- ...potential. Title and Summary Lead Software Engineer Overview: Mastercard’s... ...on modern technologies and AI-driven capabilities, and... ...development and deployment workflows. Drive automation and... ...skills related to technology evaluation, architecture, and framework...Full timeWorldwide3 days per week
Mastercard
India24 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI-Assisted Workflow Evaluator (Software Engineering & DevOps). Be the first to apply!
