Cloud Infrastructure Evaluation Specialist [Remote]
AuraOne Human Data
- Remote job
Cloud Infrastructure Evaluation Specialist is a remote review track for evaluating AI outputs across cloud infrastructure evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.
Why this role matters
Cloud Infrastructure Evaluation specialist operations AI has to fit into an actual day at work. AuraOne uses experienced operators to grade outputs the way a senior peer would — checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.
Responsibilities
- Review AI outputs against current cloud infrastructure evaluation specialist operations workflows, playbooks, and firm policy for Cloud Infrastructure Evaluation Specialist assignments.
- Grade tone, escalation logic, and stakeholder fit on a structured rubric.
- Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
- Capture the right next step so the modeling team can train on it.
- Adjudicate disputed treatments against published playbooks or firm guidance.
- Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
- Direct working experience in cloud infrastructure evaluation specialist operations on real teams for Cloud Infrastructure Evaluation Specialist work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the policy or workflow being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
Example tasks
- Grade a model's response to a real cloud infrastructure evaluation specialist operations ticket and rate workflow, tone, and escalation.
- Flag a missed escalation with the right severity tag and corrected next step.
- Adjudicate a disputed playbook call between two reviewers using firm guidance.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
Nice to have
- Prior experience training, calibrating, or QA-ing operations teams.
- Familiarity with AI-assisted workflow tooling and its failure modes.
- Bilingual experience for cross-region operations.
Skills
- Operational review
- Policy adherence
- Workflow judgment
- Stakeholder communication
- Cloud Infrastructure Evaluation specialist operations
- Code review
- Software testing
- Agent evaluation
- Cloud
- Infrastructure
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
$103.8k - $218.1k
Job Title: Network Infrastructure SpecialistJob Category: Information TechnologyTime... ...As a Network Infrastructure Specialist, you will support the... ..., firewall, wireless, and cloud networking solutions.... ...continuity of operations activities.Evaluate emerging networking...CloudContract workWork experience placementLocal areaImmediate startRemote workFlexible hours- Opening for Infrastructure Security and Network SpecialistPlease submit... ...Infrastructure Security and Network Specialist is a hands-on position... ...concepts and ensure secure cloud practices are followed. The... ...Key Responsibilities:Oversee, evaluate, and support the...CloudImmediate startWork from home
- ...qualifications.Job SummaryThe Staff, IT Infrastructure Platform Specialist, serves as a technical anchor for... ..., and platform modernizationHybrid Cloud InfrastructureMaintain and optimize... ...delivered to internal customers Ability to evaluate emerging platforms and make forward-...CloudContract workFor contractorsWork at officeLocal areaRemote work2 days per week
- ...looking for a highly motivated AI Infrastructure Procurement Specialist to help expand our AI infrastructure... ...be responsible for identifying, evaluating, and securing data center capacity... ...negotiation AI/HPC infrastructure Cloud infrastructure ecosystem Entry...CloudContract workLocal areaRemote work
$130k - $160k
We are seeking a Senior Infrastructure Specialist to support the design, implementation, troubleshooting, and support of enterprise and industrial... ...routing, switching, firewall, wireless, LTE/cellular, cloud, remote access, and general infrastructure connectivity issues...CloudWork at officeLocal areaRemote work$81k - $120k
...just found it.Job OverviewThe Azure Infrastructure & Hardware Engineering Specialist is responsible for the design,... ...infrastructure spanning on‑premises, cloud, and product‑based environments.... ...related information to develop and evaluate options and implement solutions. Judgment...CloudLocal areaRemote workWorldwideMonday to FridayFlexible hoursShift workWeekend work$120k - $160k
...We are looking for a Datacenter Infrastructure Specialist to be the operational linchpin of our global fleet. Reporting to the Manager of Infrastructure... ...-closing. You will work directly with cutting-edge GPU cloud technologies, advanced RDMA fabrics, and modern...CloudFull timeRemote workHome officeFlexible hours- ...organization. We build AI-native experiences, agentic systems, models, evaluation frameworks, and data platforms that power Atlassian’s AI... ..., and using results to guide improvements.Familiarity with cloud-based ML and data platforms such as AWS or Databricks.Ability to...CloudWork at officeLocal area
- ...Description InfoSight is seeking a full-time Security & Infrastructure Solution Specialist in the Tampa Bay Area to support client environments across... ...systems, networking, virtualization, cybersecurity, and cloud technologies who wants to continue developing into a...CloudFull timeWork from homeFlexible hours
- ...Description Job Description:\n\nJob Title: Senior IT Systems & Infrastructure Specialist – Manufacturing\nTitle of Supervisor: Plant Manager\nJob... ...enterprise servers, storage, virtualization, and cloud-connected services.\n Strong understanding of cybersecurity...CloudFor contractorsLocal areaImmediate startRemote work
$96.4k - $120.5k
Position Information:Job Title: Senior Infrastructure SpecialistLocation: Binghamton, NYSalary Range: $96,400 - $120,500Schedule: On Site... ...implementation plans in support of infrastructure technologies.Lead the evaluation, selection, and testing of hardware and software products....For contractorsLocal area- ...the industry. Job Purpose: We're hiring a Customer Infrastructure Specialist! This role ensures the stability, security and resilience of... ...related backup/recovery strategies Strong experience in cloud technologies such as M365, Azure, Intune, SharePoint . Excellent...CloudFull time
$125k - $145k
...technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United... ...tremendous career growth potential. Job Title: SAP Infrastructure Specialist Location: 100% Remote (U.S.) Position Type: Full-time,...CloudFull timeH1bLocal areaImmediate startRemote workVisa sponsorship$100k
...highly scalable and differentiated ML infrastructure is key to accelerating this innovation.... ...fine-tuning, model transformation and evaluations workflows and use cases from the entire... ...learning use cases Experience with cloud computing providers, preferably AWS...CloudHourly payFull timeImmediate startFlexible hours- ...8 Months is also acceptable) Description: Provide cloud software research, development, and engineering services to include... ...analysis, software development, installation, integration, evaluation, enhancement, sustainment, testing, validation, and issue diagnosis...CloudFull time
- ...of their careers. Software Engineer, Infrastructure The Role This is a staff-level infrastructure... ...and executed; and how our systems use cloud compute, storage, and networking.... ..., and deployment architecture. Evaluate build-versus-buy decisions and make tradeoffs...CloudWork at officeFlexible hours
- ...Architect to lead the end-to-end architecture of our AI-enabled Health Cloud Platform, supporting clinical, pharmacy, and operational... ...between transactional and analytical ecosystems.Lead evaluation and integration of RPA/CUA tools, APIs, orchestration platforms...CloudFull timeWork from home
- YO AI Labs seeks an experienced Developer & Infrastructure Expert for remote contract work. You will evaluate AI-powered workflows across DevOps, cloud infrastructure, SRE, and platform engineering, testing AI-generated commands and configurations against real-world engineering...CloudRemote jobContract work
$32 - $35 per hour
...years of experience in IT support, systems administration, or infrastructure support.2. Strong Microsoft 365 (M365) administration... ...parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications,...Contract workTemporary workLocal areaRemote work- ...Azure Cloud Architect With AI/ML The Cloud Architect will be a key contributor to designing, evolving... .... Selecting Technologies and Services Evaluate and choose optimal cloud services, AI/ML platforms, infrastructure components (compute, storage, orchestration),...CloudRemote work
- ...Staff Software Engineer - AI Research Infrastructure P-1215 At Databricks, we are obsessed... ...(e.g., HPC clusters, GPU fleets, or cloud‑based systems) Enable researchers to go... ...shaping how Databricks AI Research train, evaluate, and ship models to customers. Serve...CloudFull time
- ...times faster than GPU-based hyperscale cloud inference services. This order of magnitude... ...Provision, monitor, and optimize cloud infrastructure supporting CI workloads, balancing cost,... ...to identify architectural bottlenecks, evaluate tradeoffs, and drive long-term...CloudFull time
- ...fabric controller, insights, orchestration)Cloud Networking ExperienceAWS, Azure, GCP in... ...solutions, cybersecurity, and next-gen infrastructure, we enable businesses to stay ahead in... ...Opportunity Employer Disability/Vets. We evaluate qualified applicants without regard to race...CloudFull timeFor contractorsRemote work
- ...which describes what’s being done? AWS Cloud Migration of legacy .Net Components What... ...applications, systems, and associated infrastructures. Translates business requirements into... ...informed of emerging cloud technologies and evaluates the value to the organizations...CloudRemote workShift work
$116.35k - $210.33k
...Business Area within the Homeland Sector is seeking a Test and Evaluation (T&E) Lead to define the strategy and lead execution of the test... ...-critical, future-ready automation platform built on a hybrid cloud data mesh architecture, enabling next-generation air traffic management...CloudFull timeTemporary workWork from home$32 - $35 per hour
...years of experience in IT support, systems administration, or infrastructure support. 2. Strong Microsoft 365 (M365) administration... ...parts of our hiring process, including sourcing, screening, and evaluating candidates. AI helps assess applications and qualifications,...Contract workTemporary workLocal areaRemote work- ...At Render, we’re building the modern cloud platform for developers creating AI-native... ..., and focus on their product, not infrastructure. Unlike complex hyperscalers or ephemeral... ...employment decisions including hiring, evaluation, termination, promotional, and training...CloudFull timeRemote workWorldwideHome office
$106.6k - $192.7k
...globally.As a Senior Product Manager for Evaluation Applications, you will define and... ...of tests per request and supporting the infrastructure that transforms raw results into meaningful... ...analytics technology stack, including cloud data and data infrastructure Ability to...CloudFull timeWork at officeLocal areaWork from home$140k - $165k
...advancing mobile technology, empowering cloud computing, and pioneering future... ...most advanced electronic devices and IT infrastructure, enabling enhanced performance and user... ...retrieval strategies (hybrid, re-ranking), and evaluation of retrieval accuracy and latency....CloudFull time- ...determine optimal input formats for AI models. • Model Building and Evaluation: Develop, train, and evaluate a variety of machine learning... ...to improve existing systems and solve complex problems. • Cloud Platforms: Have experience with the Amazon Web Services (AWS) cloud...CloudFull timeImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Cloud Infrastructure Evaluation Specialist [Remote]. Be the first to apply!
- oracle cloud financials consultant Remote
- cloud security analyst Remote
- salesforce marketing cloud consultant Remote
- salesforce marketing cloud specialist Remote
- cloud consultant Remote
- salesforce service cloud consultant Remote
- cloud specialist Remote
- oracle cloud technical Remote
- cloud admin Remote
- cloud administrator Remote



