Senior Data Engineer, Amazon Security Experience

The Amazon Security Experiences (ASE) organization is the data intelligence backbone of Amazon Security. We build and operate the data platform that powers security insights builder experience analytics and tooling decisions across Amazons security ecosystem. Every insight surfaced to security leadership from builder productivity trends to security issue quality metrics flows through systems our team designs builds and maintains.

We operate at scale processing large volumes of security and operational data daily through hundreds of pipelines consisting of transformations reporting queries ingestions and infrastructure management scripts. Our engineers work directly with source systems across AWS and SDO (Security Developer and Operations) data domains to procure data convert it into structured formats build large-scale processing pipelines design analytical data models and maintain infrastructure with the highest security and compliance standards.

We are seeking a Senior Data Engineer to join our Security Data Intelligence (SDI) team. This individual will own multiple data domains end-to-end operate hundreds of pipelines and drive architectural improvements that impact how security leadership makes decisions. You will partner with teams across ASE BizOps MapSec and other security organizations to design data contracts build ingestion flows and deliver analytical models that serve the broader Amazon Security organization

Key job responsibilities
Identify limitations and opportunities in data processing tools drive improvements and innovation define data processing guidelines and ensure best practices in all pipelines designed and reviewed. For example: redesigning ingestion frameworks to handle new security telemetry data or building reusable transformation patterns adopted across multiple teams.

Define and own data architecture at the team and organization level ensuring architecture effectively matches business problems and data challenges with security scalability and cost effectiveness. Show good judgment making technical trade-offs between short-term technology needs and long-term business needs.

Produce exemplary code solutions that are easily usable by customers inventive secure easily maintainable appropriately scalable and extensible. Build solutions that are easy for others to contribute to. Work to simplify optimize and remove bottlenecks.

Define and own infrastructure architecture at the team level. Anticipate data management and access patterns evolve the technology stack to remove bottlenecks and deliver systems that are secure scalable and long lasting. Define team-level guidelines and best practices for infrastructure management and automation.

Solve complex ambiguous problems for example designing cross-domain data models that unify AWS and SDO data where definitions schemas and ownership vary across multiple security programs or combining multiple datasets to solve problems that couldnt be solved before. Spot areas that might lead to customer confusion data misinterpretation or gaps in data contracts.

Effectively split project work into parallel tasks that can be performed by themselves and others and reassembled successfully. Drive to completion projects with dependencies on peers or other teams.

Influence related teams data architecture and software design. Provide technical assessments for promotions. Actively mentor and develop others. Build consensus when confronted with discordant views.

Drive data engineering best practices Data Discovery Naming Conventions Operational Excellence Data Security. Ensure teams data is auditable available and accessible.

Proactively fix data architecture deficiencies and propose larger projects which may require the work of other teams. Drive improvements through code review design discussions team planning and operational reviews.

Participate in on-call rotation and own operational health of data systems establish monitoring alarming runbooks and SLA tracking. Drive continuous improvement in reliability and incident response.

- 7 years of data engineering experience
- Experience with data modeling warehousing and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language such as Python Java Scala or NodeJS
- Experience mentoring team members on best practices
- Experience with MPP databases such as Amazon Redshift
- Experience building/operating highly available distributed systems of data extraction ingestion and processing of large data sets

- Experience with big data technologies such as: Hadoop Hive Spark EMR
- Experience operating large data warehouses
- Experience providing technical leadership and mentoring other engineers for best practices on data engineering
- Bachelors degree in computer science engineering analytics mathematics statistics IT or equivalent
- Knowledge of distributed systems as it pertains to data storage and computing

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status disability or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process including support for the interview or onboarding process please visit for more information. If the country/region youre applying in isnt listed please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience qualifications and location. Amazon also offers comprehensive benefits including health insurance (medical dental vision prescription Basic Life & AD&D insurance and option for Supplemental life plans EAP Mental Health Support Medical Advice Line Flexible Spending Accounts Adoption and Surrogacy Reimbursement coverage) 401(k) matching paid time off and parental leave. Learn more about our benefits at TX Austin - 154600.00 - 209100.00 USD annually
USA WA Seattle - 154600.00 - 209100.00 USD annually

Required Experience:

Senior IC

]]><