AI-Assisted Workflow Evaluator (Contract)

Temporary

Gramian Consulting Group

About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

Role Overview

We are looking for experienced professionals from software engineering , DevOps , SRE , cloud , platform , or infrastructure engineering backgrounds to test and evaluate AI-assisted workflows across modern developer and workplace tools. The role focuses on assessing technical accuracy , workflow realism, command and configuration quality, platform interactions, and practical usability. No prior AI evaluation experience is required, but hands-on use of AI coding or productivity agents is highly relevant.

Responsibilities

Test and validate AI-assisted developer and infrastructure workflows .
Evaluate commands, configurations, and outputs across cloud and platform engineering scenarios.
Review workflows involving GitHub , GitLab , JIRA , AWS , Azure , GCP , Kubernetes , Docker , and Terraform .
Identify technical inaccuracies, broken steps, unrealistic assumptions, or workflow gaps.
Assess how AI agents interact with connected workplace tools such as Slack , Google Drive , and Microsoft 365 .
Document observations and provide clear, actionable technical feedback.
Recommend workflow improvements based on real-world engineering standards.
Participate in asynchronous review and virtual discussions to clarify task requirements.
Evaluate whether AI-generated solutions are practical, reproducible, and technically sound.
Maintain clear documentation across all submitted evaluations.

Requirements

Professional experience in software engineering , DevOps , SRE , cloud , platform , or infrastructure engineering .
Hands-on experience with at least one major cloud platform: AWS , Azure , or GCP .
Practical experience with Kubernetes , Docker , Terraform , or comparable infrastructure tooling.
Familiarity with developer platforms such as GitHub , GitLab , or JIRA .
Experience with CI/CD pipelines and modern infrastructure or platform workflows.
Professional experience using AI agents such as ChatGPT , Claude Code , Claude Cowork , or Codex .
Ability to evaluate technical workflows and identify incorrect or inefficient implementations.
Strong written and spoken English .

Apply

Vacancy posted 21 hours ago

Similar jobs that could be interesting for youBased on the AI-Assisted Workflow Evaluator (Contract) in Poland vacancy

AI Coding Agent Evaluator
We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks. You'll create challenging tasks and evaluation criteria within realistic simulated environments: Build realistic developer environments - a virtual company with...
Contract work
Mindrift
Poland
20 days ago
AI Coding Agent Evaluator
...We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks. You'll create challenging tasks and evaluation criteria within realistic simulated environments: Build realistic developer environments - a virtual company...
Contract work
Mindrift
Poland
28 days ago
Medical Content Creator & AI Evaluator (Biomedical Expertise)
...students, residents, physicians, and professionals with equivalent biomedical expertise to create and evaluate challenging medical questions designed to test advanced AI systems. The work focuses on diagnosis, disease mechanisms, pharmacology, clinical guidelines, and...
Contract work
Gramian Consulting Group
Poland
21 hours ago
AI-Native Software Engineer - Early Career - Europe
...AI-Native Software Engineer - Early Career Location: Remote... ...ready. Learn how to direct, evaluate, and control AI coding agents... ...Explore new AI development workflows and help the team move faster... ...(NDA), execute an employment contract, and fulfill any additional legal...
Contract work
Full time
Temporary work
For contractors
Local area
Remote work
Flexible hours
ChainGPT
Poland
17 days ago
Senior Full-Stack Engineer and Technical Leader
...scalable full-stack features using Next.js, React, TypeScript, Prisma, and PostgreSQL Use Cursor IDE and AI coding assistants to accelerate development workflows and productivity Architect systems, design database schemas, and optimize performance-critical queries...
Contract work
For contractors
Remote work
Work from home
Home office
ERG Media
Poland
7 days ago
AI Architect
...About the project Join Neurons Lab as the AI Architect on a flagship engagement with... ...(a process miner that reads real workflows from the digital footprint, then optimizer... ...redeployed for the next client. Stage : pre-contract / design-partner negotiation. Duration...
Contract work
Full time
Work at office
Neurons Lab
Poland
20 days ago
Engineering & Data Tools Specialist
...a project focused on improving how advanced AI systems understand and work with modern technical platforms. You will evaluate tools used across software engineering, cloud... ..., data analysis, monitoring, and workflow automation. The work includes designing realistic...
Contract work
Gramian Consulting
Poland
20 days ago
Senior Full-Stack Engineer and Technical Leader
...scalable full-stack features using Next.js, React, TypeScript, Prisma, and PostgreSQL Use Cursor IDE and AI coding assistants to accelerate development workflows and productivity Architect systems, design database schemas, and optimize performance-critical queries Integrate...
Contract work
ERG Media
Poland
20 days ago
Blockchain Data Analyst & Researcher
...normalize raw, disparate blockchain data (transaction logs, smart contract events, state changes) into consistent, structured relational... ...relational schemes for consumption by analytics, machine learning, and AI tools. This role requires a unique blend of expertise in...
Contract work
Temporary work
Lukka
Poland
18 days ago
Creative Developer
...Explore new technologies: leverage AI , and emerging tools to increase production speed and creativity Contract setup: This is a full-time freelance... ...concepts Bonus: experience with AI-assisted creative/development workflows , Blender , Photoshop , shaders,...
Contract work
Full time
Freelance
Flexible hours
Homa Games
Poland
21 hours ago
Senior Project Manager
$92.62k - $148.17k
...Lead multiple complex projects from contract award through project closeout Develop... ...Project Managers and Project Coordinators Assist leadership with balancing workloads and... ...across departments to optimize workflow and project outcomes Quality, Safety...
Contract work
Full time
For contractors
For subcontractor
Work at office
Poland
28 days ago
Technical AI Product Manager
...Ruby Labs, we are building Direct-to-Consumer products in the AI category. We’re looking for a Technical AI Product Manager... ...engineers on prompt systems, structured outputs, agentic workflows, and evaluation, and collaborating closely with product, growth, data, and billing...
Full time
For contractors
Remote work
Flexible hours
Ruby Labs
Poland
3 days ago
Staff Node.js Developer - Architecture
€42 per hour
...risk trade-offs during design and review rather than after launch. Also required: Reading and being able to explain every line of AI-generated code you ship — no merging what you can't explain. Testing that actually covers edge and failure cases, not just happy-...
Contract work
Full time
Remote work
Netguru
Poland
3 days ago
Vendor & Partner Relationship Manager
...partnership management Continuously evaluate vendor fit and performance as... ...Lead commercial discussions, contract negotiations, and partnership... ...audit and refine workflows and ways of working to reduce... ...quality. Actively leverage AI responsibly to maximize personal...
Contract work
Temporary work
Oyster
Poland
20 days ago
Senior Ecommerce Platform Engineer
$35 - $48 per hour
...ecommerce problems will come to you: checkout friction, returns workflows, performance bottlenecks, data consistency, and third-party... ...solid understanding of UI and UX principles, with the ability to evaluate frontend work on more than just whether it functions. You do...
Contract work
Hourly pay
For contractors
Casual work
Self employment
Work at office
Remote work
Work from home
Apex Wheels
Poland
7 hours ago
Senior Engineering Manager
...across teams and reduction of technical debt. Define the domain's AI adoption strategy, represent the domain in the AI Steering... ...convenient deliveries, and the circular economy every day. Excellent working environment and flexible hours We offer B2B type of contract...
Contract work
Local area
Worldwide
Flexible hours
Inpost
Poland
a month ago
Senior Counsel, Governance
Role Summary Are you a governance-minded lawyer who thrives on ambiguity, ownership, and building something from scratch? As our Senior Counsel, Governance , you'll join Oyster's Legal team as the dedicated governance and entity-formation counsel supporting Global Expansions...
Temporary work
Fixed term contract
Local area
Oyster
Poland
25 days ago
Onboarding Success Manager
...with our Sales, Product, Legal and Finance teams; Supporting contract customization operations in alignment with internal... ...to influence global change and employment opportunities; ~ AI & Workflow Automation: Actively embraces emerging AI technologies, with...
Contract work
Remote work
Oyster
Poland
1 day ago
Media Buyer
About Us At Creatunity LLC , we're not just a Marketing and Advertising firm—we're innovators, strategists, and creative thinkers who are passionate about helping our business thrive. Imagine working in a space where your ideas come to life, where every campaign you...
Contract work
For contractors
Remote work
Work from home
Home office
Flexible hours
Creatunity
Poland
a month ago
Customer Success Manager
...quarters Business Support the AM's commercial objectives by serving as the customer’s advocate throughout the duration of the contract lifecycle, from successful completion of the onboarding process to the identification and development of upsell opportunities...
Contract work
Full time
Remote work
Weekend work
Afternoon shift
Keywords Studios
Poland
20 days ago
Sales Excellence Specialist
...PayU. Supporting merchant registration and activation. Assisting partners and the Sales team with the implementation of new products... ...multitasking skills. What we offer Employment under a contract of employment. Benefits: ability to develop one’s own...
Contract work
Full time
PayU
Poland
18 days ago
Tech Support Specialist (Dynamic Web Ads)
...demand-side platform (DSP) that uses proprietary Deep Learning AI algorithms to help brands grow. The company is the market leader... ...all the necessary knowledge and tools to excel; Stable, long-term cooperation based on a B2B contract or contract of mandate....
Contract work
Full time
Remote work
RTB House
Poland
29 days ago
Senior Sales Executive
...Romanian native speaker, fully proficient in English (employment in Romania or Poland) What we offer: Full-time employment under a contract of employment. Benefits: ability to develop one’s own package in MyBenefit system. Possibility to work in a hybrid model...
Contract work
Full time
Work at office
PayU
Poland
18 days ago
(804) Unity Support Engineer
...Identify and flag breaking changes that may impact integration with Django Assess the impact of each release on the existing API contract Perform reactive compatibility patching on the Unity client side when: SDK updates introduce incompatibilities...
Contract work
Part time
Remote work
Shift work
Altoros
Poland
7 days ago
Product Manager
...Accountability for outcomes, Proactivity, Adaptability in complex environments. What we offer Employment under a contract of employment , Benefits: ability to develop one’s own package in MyBenefit system , Access to an internal training platform...
Contract work
Full time
PayU
Poland
18 days ago
Product Manager
...engineering and QA teams make data-informed product decisions and evaluate the impact of delivered initiatives You may be the perfect... ...with complex, distributed SaaS platforms Salary range: contract of employment: 10 000 - 17 000 PLN gross/month B2B contract:...
Contract work
Full time
Remote work
Home office
Flexible hours
GetResponse
Poland
a month ago
In-House Lawyer
...Read on to learn more about the role and apply today! Responsibilities and key activities: Drafting, reviewing, and negotiating contracts Collaborating with the Legal, Risk, Compliance, and Privacy teams Advising the company on corporate matters Overseeing...
Contract work
Full time
PayU
Poland
18 days ago
Customer Service Specialist 24/7 (Polish native)
...WHAT WE OFFER Work in an international organization operating in a rapidly changing industry, Full-time employment under a contract of employment, Benefits : ability to develop one’s own package in MyBenefit system, Series of training , Friendly...
Contract work
Full time
Work at office
Weekend work
PayU
Poland
18 days ago
Senior Specialist, Global Benefits
...knowledge, hosting highly engaging AMAs, and leveraging modern AI tools to scale your impact on a worldwide scale. Strategic Vendor... ...worldwide. Continuous Improvement & High Performance Workflow Optimization: Continuously audit and refine global benefits delivery...
Contract work
Local area
Worldwide
Shift work
Oyster
Poland
26 days ago
NetSuite Engineer
..., HTML). Hands-on experience with NetSuite customizations (workflows, custom fields, custom records, roles, permissions, internal controls... ...is a plus. What we offer: Full-time employment under a contract of employment, Benefits: ability to develop one’s own...
Contract work
Full time
PayU
Poland
17 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI-Assisted Workflow Evaluator (Contract). Be the first to apply!