AWS Serverless and Infrastructure-as-Code Task Auditor

Role Overview

Review AWS serverless and infrastructure-as-code tasks that support the training and evaluation of advanced AI models. You will assess the quality, technical correctness, and cloud-architecture soundness of multi-service implementations, then deliver clear written feedback using defined evaluation rubrics.

Key Responsibilities

• Evaluate multi-service AWS serverless designs, infrastructure-as-code fidelity, and cross-service integration correctness.
• Assess event-driven architecture behavior, IAM and permission boundaries, and failure and retry semantics.
• Review how local emulation and testing environments, such as LocalStack, align with actual AWS behavior.
• Provide structured, rubric-based written feedback on task quality and correctness.

Qualifications

• At least 3 years of hands-on experience building multi-service AWS serverless applications using Lambda, API Gateway, DynamoDB and DynamoDB Streams, S3, EventBridge, SNS/SQS, and Step Functions.
• Strong infrastructure-as-code experience with AWS CDK, CloudFormation, or SAM.
• Demonstrated ability to evaluate event-driven architectures, IAM and permission boundaries, and failure and retry behavior.
• Familiarity with the differences between local emulation and testing fidelity and real AWS behavior.

Preferred Qualifications

• AWS Solutions Architect or Developer certification.
• Experience with serverless observability and cost optimization.
• Prior experience reviewing code or grading technical tasks.

Work Terms

• Remote role open to candidates located in the United States.
• Hourly engagement.

Compensation

$70 to $90 per hour.