AI-Assisted Workflow Evaluator (Contract)

Temporary

Gramian Consulting Group

About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are looking for experienced professionals from software engineering , DevOps , SRE , cloud , platform , or infrastructure engineering backgrounds to test and evaluate AI-assisted workflows across modern developer and workplace tools. The role focuses on assessing technical accuracy , workflow realism, command and configuration quality, platform interactions, and practical usability. No prior AI evaluation experience is required, but hands-on use of AI coding or productivity agents is highly relevant.

Responsibilities

Test and validate AI-assisted developer and infrastructure workflows .
Evaluate commands, configurations, and outputs across cloud and platform engineering scenarios.
Review workflows involving GitHub , GitLab , JIRA , AWS , Azure , GCP , Kubernetes , Docker , and Terraform .
Identify technical inaccuracies, broken steps, unrealistic assumptions, or workflow gaps.
Assess how AI agents interact with connected workplace tools such as Slack , Google Drive , and Microsoft 365 .
Document observations and provide clear, actionable technical feedback.
Recommend workflow improvements based on real-world engineering standards.
Participate in asynchronous review and virtual discussions to clarify task requirements.
Evaluate whether AI-generated solutions are practical, reproducible, and technically sound.
Maintain clear documentation across all submitted evaluations.

Requirements

Professional experience in software engineering , DevOps , SRE , cloud , platform , or infrastructure engineering .
Hands-on experience with at least one major cloud platform: AWS , Azure , or GCP .
Practical experience with Kubernetes , Docker , Terraform , or comparable infrastructure tooling.
Familiarity with developer platforms such as GitHub , GitLab , or JIRA .
Experience with CI/CD pipelines and modern infrastructure or platform workflows.
Professional experience using AI agents such as ChatGPT , Claude Code , Claude Cowork , or Codex .
Ability to evaluate technical workflows and identify incorrect or inefficient implementations.
Strong written and spoken English .

Apply

Vacancy posted 20 days ago

Similar jobs that could be interesting for youBased on the AI-Assisted Workflow Evaluator (Contract) in Brazil vacancy

Medical Content Creator & AI Evaluator (Biomedical Expertise)
...students, residents, physicians, and professionals with equivalent biomedical expertise to create and evaluate challenging medical questions designed to test advanced AI systems. The work focuses on diagnosis, disease mechanisms, pharmacology, clinical guidelines, and...
Contract work
Gramian Consulting Group
Brazil
20 days ago
Biology Expert for AI Training Data Creation
...the role We create high-quality STEM training data for frontier AI models used by leading AI labs to improve model reasoning in scientific... .... Problems should reflect authentic scientific and analytical workflows and be submitted with complete, verified solutions. Depending on...
Contract work
Anyone AI
Brazil
a month ago
Engineering & Data Tools Specialist
...a project focused on improving how advanced AI systems understand and work with modern technical platforms. You will evaluate tools used across software engineering, cloud... ..., data analysis, monitoring, and workflow automation. The work includes designing realistic...
Contract work
Gramian Consulting
Brazil
a month ago
Senior HR Generalist
...design, implement, and execute improved HR workflows across the entire employee lifecycle... ...integrity, and reporting for leadership Assist with compensation and benefits... ...environments Benefits Contractor type of contract with payment in USD Flexible Paid Time...
Contract work
Temporary work
For contractors
Work at office
Remote work
Flexible hours
Insightassurance
Brazil
26 days ago
Junior SDET
...Microcks , and validating contracts between services. Help maintain... ...~ Hands-on experience with AI-assisted engineering tools, for... ...coding agents, agent skills, or evaluation harnesses as part of your testing or development workflow. ~ Working knowledge of JavaScript...
Contract work
Full time
OrderMesh
Brazil
16 days ago
Lead Security Engineer
...solid as we've scaled. As we grow a $100M+ marketplace that processes payments, holds customer and pro data, and runs on AWS — and as AI agents let us ship faster than ever — we're ready to take security to the next level with a dedicated leader. You'd be that person...
Contract work
For contractors
Remote work
LawnStarter
Brazil
23 days ago
AI Personalization Evaluation Project
...We are looking for a native Portugese speaker to support a 16-week AI personalization evaluation project for professional users. Using your primary Google Workspace business Gmail account, you will assess whether AI-generated responses are relevant, accurate, helpful,...
Contract work
Gramian Consulting
Brazil
a month ago
Python Developer
Anyone AI is recruiting skilled Python Developers to work on a project with a leading AI lab. Qualifications: Advanced professional... ...refactoring, and production migrations Contributors will design and evaluate realistic software engineering tasks, including bug resol...
Contract work
Anyone AI
Brazil
a month ago
Investigative Researcher (AI Browsing Agents Benchmarking)
...teams by matching them with professionals who truly fit their needs. The Role Our client is building advanced evaluation benchmarks for frontier AI browsing agents . We are looking for highly skilled investigative researchers who can design research...
Contract work
Work at office
Gramian Consulting Group
Brazil
18 days ago
Video Data Entry Specialist (LATAM)
$6 per hour
...synchronized video data using your smartphone to train next-generation AI systems. This contractor role focuses on precise sensor and... ...experience with mobile devices and sensor-based data collection workflows. Physical ability to perform repetitive movement tasks safely...
Remote job
Hourly pay
For contractors
Local area
Immediate start
10 hours per week
SaidGig
Brazil
1 day ago
Customer Success Manager (Growth)
$3,000 - $5,000 per month
...Onboarding Ownership Take immediate ownership of accounts upon contract signature, ensuring zero missed or delayed kickoff calls .... ...boundaries. Technical Comfort: Familiarity with CRM systems, workflow automation, and managing multi-site deployment setups....
Contract work
Full time
Immediate start
Remote work
Panoptyc
Brazil
19 days ago
Customer Success Manager - Latin America (Brazil)
...Management, or related roles ~ Understanding of public sector workflows, procurement processes, and funding cycles. ~ Ability to... ...Google Earth Engine . Experience navigating data-sharing agreements or government contract mechanisms. Fluency in Spanish...
Contract work
Full time
Work at office
Remote work
3 days per week
Planet Labs
Brazil
21 days ago
AEM Content & Production Manager
...What You’ll Do AEM Content Management Serve as a trusted resource for AEM authors, guiding content authoring best practices, workflows, and efficient ways of working. Proactively review authoring processes and identify opportunities to improve quality,...
Contract work
For contractors
Remote work
Stack Builders
Brazil
a month ago
Operations Specialist (Early Career)
...business hours. Fluency in Spanish is ideal. Why Gratia is Your Next Step Flexible Freelance Model: This is a long-term contract/freelance role designed for independent professionals who want the freedom of private practice without the isolation of working...
Long term contract
Full time
Temporary work
Part time
Freelance
Private practice
Flexible hours
Gratia
Brazil
a month ago
Amazon FBA Wholesale Product Sourcer/Searcher
...vendor/supplier catalogs to identify profitable wholesale products for Amazon FBA Use Keepa , RevSeller , or similar tools to evaluate product profitability, sales rank, and pricing history Prepare and compile purchase orders based on sourcing analysis...
Contract work
Hourly pay
For contractors
Remote work
Whitecollars
Brazil
20 days ago
Onboarding Success Manager
...with our Sales, Product, Legal and Finance teams; Supporting contract customization operations in alignment with internal... ...to influence global change and employment opportunities; ~ AI & Workflow Automation: Actively embraces emerging AI technologies, with...
Contract work
Remote work
Oyster
Brazil
19 days ago
Temu Store Manager
...stock levels and timely replenishment Utilize the 4Seller ERP system for order management, inventory syncing, and operational workflows Optimize product listings for visibility, conversion, and competitiveness on the Temu marketplace Monitor store performance...
Contract work
Hourly pay
Remote work
Whitecollars
Brazil
20 days ago
Shopify Web Developer
...A portfolio of past Shopify builds or landing pages you can share Clear communication and reliable turnaround — this is a contract role and dependability matters Why You Will Love This You'll have real ownership over how the FYS website evolves — this isn...
Contract work
Temporary work
Shadow Light Studios
Brazil
a month ago
Associate Medical Director
...questions from study team and/or site, assist with protocol interpretation and medical... ...study and in accordance to deliverables contracted. Review Serious Adverse Events, SUSARs... ...from senior colleagues as needed in client evaluations, visits and bid defenses Requirements...
Contract work
Full time
Work experience placement
Local area
Allucent
Brazil
a month ago
Live Creator Account Manager
...consistent adherence to production standards across your full portfolio Performance & KPI Management Track streaming commitments and contract compliance across all 25 creators Monitor engagement metrics and identify underperformance trends early Escalate risks...
Contract work
Full time
Remote work
Afternoon shift
Darkroom
Brazil
a month ago
Senior Social Media Manager
...industries such as MarTech, FinTech, EdTech, and AI . Unlike traditional outsourcing... ...team expands. Benefits Competitive contract compensation Fully remote work... ...role with creative autonomy Predictable, structured workflow and reporting rhythms...
Contract work
Remote work
Huzzle
Brazil
20 days ago
Senior Fullstack Software Engineer (Backend-focused)
...with automated testing for backend services (unit, integration, contract) and Playwright / Jest awareness for E2E coordination. ~... ...architecture. Incorporate stakeholder feedback and real-world retail workflows into system design. Benefits ~ Certified as a Great Place...
Contract work
Full time
Work from home
Flexible hours
FusionHit
Brazil
16 days ago
Project Manager
Position Summary NextLink Labs is hiring a Project Manager to join our growing consulting practice. The ideal candidate brings a strong project management background in software and technology consulting, combined with the empathy, customer-obsession, and organizational...
Contract work
NextLink Labs
Brazil
a month ago
Senior Native Mobile Developer
...and Kotlin . This is not a cross-platform role; strong production experience with both native ecosystems is essential. This is a full-time, long-term contract with an initial three-month trial period. You will collaborate closely with a Florida-based client and an En...
Long term contract
Full time
Trial period
Workana
Brazil
a month ago
Semi Senior Performance Media Manager
...professional who combines strong hands-on platform expertise with analytical thinking and a passion for driving measurable business results. The ideal candidate is also curious about emerging technologies and motivated to leverage AI-enabled tools and platform capabil...
Contract work
Valtech
Brazil
a month ago
Support Engineer
About Truelogic At Truelogic we are a leading provider of nearshore staff augmentation services headquartered in New York. For over two decades, we’ve been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, ...
Contract work
Truelogic
Brazil
a month ago
Customer Support Engineer
360dialog is the leading Whatsapp platform for Independent Software Providers. We are hosting the Whatsapp channels for more than 800 software solutions and 45000+ B2B clients. As a bootstrapped and profitable company with no investors in the cap table, we are free to do...
Contract work
360dialog
Brazil
a month ago
Product Marketing Manager
...Builder to optimize website traffic, CRM AI features to convert that traffic into bookings... .... Benefits ~ Full-time - Fixed Term Contract (as International Contractor). ~... ...to offer visa sponsorship or relocation assistance at this time. Equal Opportunities WeTravel...
Full time
For contractors
Fixed term contract
Remote work
Relocation package
Wetravel
Brazil
24 days ago
Billing & Collections Specialist
...commercial laundry serving the global airline industry is looking for a Billing & Collections Specialist to own end-to-end billing workflows in Microsoft Business Central and protect revenue data integrity across a complex, multi-site operation. The company operates...
Full time
For subcontractor
Work at office
Remote work
Worldwide
Pearl Talent
Brazil
17 days ago
3D Render Artist
Magic Media is a pioneering media, entertainment and tech group powered by creativity and innovation. We work with leading developers and publishers within the games and tech industry, providing support and solutions designed around individual needs and carried out by global...
Contract work
Magic Media
Brazil
a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI-Assisted Workflow Evaluator (Contract). Be the first to apply!