Data Engineer II [Remote]

Job Responsibilities:

• Design, build, and maintain scalable data pipelines for structured and unstructured data across AWS and Google Cloud, using Python, SQL, and Apache Airflow
• Build and manage Apache Iceberg tables on AWS S3 with AWS Glue, and deliver data to Google BigQuery for downstream analytics and agent use
• Build curated business tables for structured data to support reporting, analytics, and AI agents
• Integrate REST APIs for data ingestion and external system connectivity
• Build, deploy, and maintain Google agents using Google ADK and Agent Studio
• Work with large data sets and high-frequency data, optimizing pipelines for performance, reliability, and cost
• Apply cloud architecture best practices and CI/CD practices for testing, deployment, and version control
• Configure and manage Google IAM permissions to support secure, least-privilege access
• Document architecture components, workflows, and technical decisions to support transparency and knowledge sharing
• Monitor and troubleshoot pipeline performance and failures using logging and observability tools

Skills:

• Technical Stack
• Primary Tools & Technologies:
• Python
• Snowflake (Tasks, UDFs)
• Google BigQuery
• AWS Glue
• ServiceNow REST API
• Airflow
• Preferred Experience:
• Minimum 2+ years in data engineering
• AI Integration
• Importance: High priority — candidates must have working knowledge of AI endpoints and automation.
• Team Collaboration
• Team Structure: This role will be part of a larger data and analytics team
• Rounds: 1 technical interview (virtual, camera required)
• Interviewers: COS see annotations
• Manager, Customer Data Science
• Senior Engineer, Data Analyti

Education/Experience:

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related fields
• 3+ years of experience in data engineering, including cloud-based pipeline development
• Experience with AWS S3 and AWS Glue, including building and maintaining Apache Iceberg tables
• Experience with Google Cloud services, including BigQuery and Google IAM permissions
• Experience building and maintaining agents with Google ADK and Agent Studio
• Proficient in Python and SQL, with experience in PostgreSQL
• Experience with workflow orchestration using Apache Airflow
• Knowledge of storing and retrieving structured and unstructured data at scale
• Knowledge of REST APIs and authentication (OAuth2, key pair authentication)
• Knowledge of cloud architecture and CI/CD practices
• Strong documentation and communication skills; able to work independently in a contract capacity