AI-Assisted Workflow Evaluator (Contract)
Gramian Consulting Group
About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
We are looking for experienced professionals from software engineering , DevOps , SRE , cloud , platform , or infrastructure engineering backgrounds to test and evaluate AI-assisted workflows across modern developer and workplace tools. The role focuses on assessing technical accuracy , workflow realism, command and configuration quality, platform interactions, and practical usability. No prior AI evaluation experience is required, but hands-on use of AI coding or productivity agents is highly relevant.
Responsibilities
- Test and validate AI-assisted developer and infrastructure workflows .
- Evaluate commands, configurations, and outputs across cloud and platform engineering scenarios.
- Review workflows involving GitHub , GitLab , JIRA , AWS , Azure , GCP , Kubernetes , Docker , and Terraform .
- Identify technical inaccuracies, broken steps, unrealistic assumptions, or workflow gaps.
- Assess how AI agents interact with connected workplace tools such as Slack , Google Drive , and Microsoft 365 .
- Document observations and provide clear, actionable technical feedback.
- Recommend workflow improvements based on real-world engineering standards.
- Participate in asynchronous review and virtual discussions to clarify task requirements.
- Evaluate whether AI-generated solutions are practical, reproducible, and technically sound.
- Maintain clear documentation across all submitted evaluations.
Requirements
- Professional experience in software engineering , DevOps , SRE , cloud , platform , or infrastructure engineering .
- Hands-on experience with at least one major cloud platform: AWS , Azure , or GCP .
- Practical experience with Kubernetes , Docker , Terraform , or comparable infrastructure tooling.
- Familiarity with developer platforms such as GitHub , GitLab , or JIRA .
- Experience with CI/CD pipelines and modern infrastructure or platform workflows.
- Professional experience using AI agents such as ChatGPT , Claude Code , Claude Cowork , or Codex .
- Ability to evaluate technical workflows and identify incorrect or inefficient implementations.
- Strong written and spoken English .
- ...students, residents, physicians, and professionals with equivalent biomedical expertise to create and evaluate challenging medical questions designed to test advanced AI systems. The work focuses on diagnosis, disease mechanisms, pharmacology, clinical guidelines, and...Contract work
- ...in building and optimizing Lakehouse -based data and AI solutions. This is a contract role based in Singapore, offering flexibility to work on... ...Proficiency in Python or Scala for data engineering and ML workflows. Strong understanding of AWS , Azure , or GCP...Contract workTemporary workRemote work
- ...and backend evolve together, how API contracts are designed for external consumers, and... ..., more enterprise customers, more AI-powered workflows—the application layer has to evolve without... ...into the platform—agents, LLM-assisted credentialing, intelligent data surfacing...Contract workFull time
- ...We're looking for a Centralised Advertising Operations Assistant to join one of our amazing clients in the music and entertainment industry... ...~ Exceptional verbal and written English communication and presentation skills. Contract Type: 12-months Fixed Term Contract...Contract workTemporary workFixed term contractShift work
- ...a project focused on improving how advanced AI systems understand and work with modern technical platforms. You will evaluate tools used across software engineering, cloud... ..., data analysis, monitoring, and workflow automation. The work includes designing realistic...Contract work
- ...Our client is supporting the development of advanced AI systems by incorporating high-quality software engineering expertise into training and evaluation workflows. We are looking for experienced Java backend engineers with strong hands-on expertise in Spring Boot...Contract work
- ...As a Lead Risk Advisor Assistant , you will serve as a senior support partner to one or more Risk Advisors, playing a key role in overseeing... ...and supporting Risk Advisors through complex placement workflows, while also providing guidance or quality oversight to junior...Contract work
- ...automation engineering and AI-powered tooling . From the laptop... ..., vendor relationships, contract negotiations, and SaaS cost optimization... ..., with the ability to evaluate, adapt, and deploy AI-... ...administration experience, including workflows, automation rules, and custom...Contract workFull timeRemote work
- About the Project TSMG is looking for contributors to support an AI language project focused on improving speech recognition systems. You will review AI-generated transcripts and convert them into a natural, readable text format by applying punctuation, capitalization,...Contract work
- ...About the Project TSMG is looking for contributors to support an AI language project focused on improving speech recognition systems. You will review AI-generated transcripts and convert them into a natural, readable text format by applying punctuation, capitalization...Contract work
- ...living ~ Great Schools in the area ~ Paid malpractice ~ Our services are free for you ~ We help negotiate your salary and contract ~ We coordinate interviews and help with licenses ~ Specialized recruiters match your career preferences ~ Experienced support...Contract workWeekly payPermanent employmentFull timeImmediate start
- ...teams by matching them with professionals who truly fit their needs. The Role Our client is building advanced evaluation benchmarks for frontier AI browsing agents . We are looking for highly skilled investigative researchers who can design research...Contract workWork at office
- ...GoGlobal is seeking a proactive and experienced HR Specialist/ Assistant Manager to support our client employees in India . This... ...onboarding, probation management, Time and Attendance management, contract renewal, resignation/termination-related including data entry...Contract workFull timeWork at officeLocal areaTrial period
$80 - $130 per hour
...and create realistic materials-engineering scenarios. You will also evaluate scientific deliverables for accuracy, consistency, and technical quality . Previous AI experience is not required. CONTRACT: Freelance contractor, paid per completed task COMMITMENT: Flexible,...Contract workHourly payFor contractorsFreelanceRemote workFlexible hours- This is a full-time remote role for a Data Entry Clerk at a growing US based company. You'll be responsible for accurately inputting and maintaining various types of business data in our systems. This position requires strong attention to detail, consistency, and the ability...Contract workFull timeRemote work
- ...Collaborate with Legal/Risk Management to develop and maintain contract templates. Review packets for new vendors to ensure that... ...programs Professional Growth Community Involvement Employee Assistance Program (EAP) Paid Sick Time Employee Discount Program...Contract workFull timeFor contractorsWork at office
- ...reliability of training data used for robotics AI models. What You'll Do Review... ...inaccurately described or "smoothed over." Evaluate annotations for adherence to the style... ...with annotation tools such as Label Studio , including review/approval workflows....Contract work
- ...independently, and is eager to learn from data and feedback. Comfortable with CMS tools . This is a full-time 40-hour-a-week contract position, Monday through Friday, with the ability to work remotely. Contracts are 3 months to start with the potential opportunity...Contract workFull timeTemporary workRemote workMonday to Friday
$80 - $130 per hour
...and create realistic materials-engineering scenarios. You will also evaluate scientific deliverables for accuracy, consistency, and technical quality . Previous AI experience is not required. CONTRACT: Freelance contractor, paid per completed task COMMITMENT:...Contract workHourly payFor contractorsFreelanceRemote workFlexible hours$20 - $30 per hour
...summaries, and help train next-generation AI systems by providing high-quality, real-... ...correct application of statutory rules. Evaluate individual tax returns (Form 1040) in the... ...Must be located in India and able to contract as an independent contractor. Must hold...Contract workRemote jobHourly payFor contractors- ...: Information Technology, Software, and AI Content Experience : No previous linguistic... ...suitable for remote, independent contract work. Attention to Quality: Exceptional... ...experience working with advanced localization workflows, AI-driven translation tools, and global...Contract workFreelanceRemote workFlexible hours
- ...Expert (SME), ensuring robust validation of complex trade finance workflows, system integrations, Straight-Through Processing (STP), maker... ...experience is highly desirable. Note: This is a 3-month short-term contract position . Immediate joiners are preferred....Contract workTemporary workImmediate start
- ...business requirements, developing business cases, and translating business needs into actionable solutions • Knowledge of Salesforce, contract management, partner management, or similar enterprise platforms • Experience developing and delivering training programs,...Contract workWorldwide
$68k - $80k
...drives, one‑on‑one outreach, sign‑up efforts, and leader development on campuses and in worksites statewide. Assist in preparing for bargaining through contract and issue surveys, data collection and analysis, and member engagement strategies. Campaign Planning &...Contract workFull timeWork at officeAfternoon shift- ...waivers, and claw backs. Responsibilities Review executed contracts and create customers, deals and incentives in the Mastercard... ...forecast • Preparation of various analytics, metric reports and assisting in quarterly reporting for corporate team • Assist with...Contract workWork experience placementWorldwide
- ...project delivery, reporting, and adherence to established processes. • Support procurement activities, consultant engagements, contract administration, and project change management • Maintain strong relationships with internal and external stakeholders working together...Contract workFull timeFor contractorsWorldwide
- ...Onboarding Engineer, you will bridge the gap between a signed contract and a production-ready ecosystem. You will serve as the trusted... ...optimization , connection pooling , and retry logic . Assist customers in configuring enterprise observability tools for logs...Contract workFull time
- ...architecture, judgment, and cutover, on dates we commit to in the contract. Mactores runs two entities, one in India and one in the US.... ...the day they land. The founders query the ledger directly using AI tools, which means the data has to be clean continuously, not tidied...Contract workFull timeDay shift
- ...within Sales and Service Clouds, optimizing complex automated workflows, large data volumes ( LDV ), and highly customized Service Console... ...Automation Governance: Define the integration strategy for contract lifecycle management ( CLM ) and document automation tools (...Contract workFull time
- ...valuations, ensuring they reflect fair value.Collaborate with internal departments to ensure compliance with policies and procedures. Assist in front office initiatives, providing analysis and support for key projects. Work with cross-functional teams to resolve issues...Full timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI-Assisted Workflow Evaluator (Contract). Be the first to apply!












