Data Engineer

Data Engineer

On-site role in Phoenix, AZ US citizenship or green card required. Not eligible for OPT or visa sponsorship.

Our client is a fast-growing global software company with 4,000 employees and a 27-year track record of innovation for the worlds leading travel brands. The company provides a broad range of industry-leading products and services that manage mission-critical operations of airlines, airports, cruise lines, hospitality partners, tour operators, and oil & gas companies. These products improve safety, revenue, and workflow efficiency while managing growth and reducing operating costs. Certified as a Great Place to Work, our client has a culture built on the values of precision, commitment, passion, integrity, and respect for the individual.

Our client is currently seeking an experienced, dynamic, organized self-starter to join as a Data Engineer for its Consulting and Digital Transformation (CDx) line of business. An AWS Data Engineer is responsible for designing, building, and maintaining robust and scalable data architectures leveraging Amazon Web Services (AWS). This role plays a vital part in transforming raw data into actionable insights, enabling data-driven decision-making within the organization.

Key responsibilities:

• Lead the design and development of robust ETL/ELT data pipelines, ensuring efficient data ingestion, processing, and transformation from diverse sources into AWS data warehouses and data lakes, including batch and streaming data and formats such as JSON, CSV, Parquet, and Avro.
• Architect, build, and optimize scalable data architectures, including data lakes (e.g., S3, Delta Lake, Iceberg) and data warehouses (e.g., Redshift, Snowflake) on AWS, ensuring optimal performance and data accessibility.
• Collaborate closely with data scientists, analysts, and other stakeholders to understand data requirements, design appropriate data models and schemas, and deliver tailored data solutions that enable data-driven decision-making.
• Implement advanced data quality and governance practices, ensuring data accuracy, consistency, and compliance with relevant regulations.
• Optimize data retrieval and develop dashboards and reports using various tools, leveraging deep understanding of data warehousing and analytics concepts.
• Mentor and guide junior data engineers, fostering a culture of technical excellence and continuous improvement within the team.
• Proactively identify and resolve operational issues, troubleshoot complex data pipeline failures, and implement recommendations for system improvements.

Required experience and skills:

• 68 years of hands-on experience as a Data Engineer, with a strong focus on AWS cloud services for data solutions.
• Expertise in designing, developing, optimizing, and troubleshooting complex data pipelines, leveraging AWS services like Glue, Lambda, EMR, S3, Redshift, Athena, Kinesis, Step Functions, DynamoDB, and Lake Formation.
• Proficiency in programming languages such as Python (including PySpark) and SQL (including advanced SQL, PL/SQL, query tuning), with the ability to write and optimize complex queries and scripts for data manipulation and transformation.
• Experience with big data technologies like Apache Spark, Hadoop, Kafka, and potentially real-time streaming platforms like Kinesis or Flink.
• In-depth knowledge of data modeling techniques, including relational and dimensional (star schema, snowflake schema), and schema design for data warehouses and data lakes.
• Experience with containerization technologies like Docker and Kubernetes for scalable deployments.
• Strong understanding of data security and compliance principles and best practices.
• Familiarity with DevOps practices for managing data infrastructure and CI/CD pipelines using tools like AWS CodePipeline, Jenkins, or others.
• Demonstrated experience in supporting ML/AI projects, including deploying pipelines for feature engineering and model inference.
• Excellent problem-solving, analytical, and communication skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
• Experience with version control systems like Git.

Educational background and certifications:

• Bachelors degree in Computer Science, Information Systems, or a related field is typically required or preferred.
• Masters degree preferred.
• AWS certifications such as AWS Certified Data Analytics Specialty or AWS Certified Solutions Architect Associate are a plus.

Desired soft skills:

• Strong communication and collaboration skills to interact with various stakeholders.
• Ability to mentor and support junior team members.
• Strong analytical and problem-solving skills, with a focus on data quality and operational efficiency.
• Ability to adapt and thrive in a fast-paced, agile environment.

Work Authorization:

• Must be authorized to work in the United States and hold a valid passport.

Travel:

• This position requires frequent travel, up to 50%. Most travel is outside the local area and overnight, with some international travel.

At our client you can look forward to:

• Operating with some of the brightest minds in the hotel software industry.
• Receiving global exposure.
• Benefitting from continuous learning programs.
• Performance-based career growth.
• Competitive compensation that includes fixed compensation, variable compensation based on achieving set goals, company-paid employee benefits, vacation, sick and personal leave, and a company-matched 401(k).