Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Development Engineer - Big Data, AWS Elastic MapReduce (EMR), EMR EKS

$165.2k - $223.6k

Amazon Locker

Want to change the world with Big Data and Analytics? Come join us on the Amazon Web services (AWS) Elastic MapReduce (EMR) team!EMR is a massively scaled distributed service that gives users fast and predictable Big Data performance with clusters running Hadoop, Hive, Pig, Impala, Spark, Presto, HBase and more, with the ability to effortlessly scale up and down as needed. We run millions of customer clusters, enabling processing on vast datasets.We are developing innovative new features including the next-generation cluster management system, real-time processing for big data and intuitive ways of interacting with data, and we’re looking for top engineers to build them from the ground up.This is a hands-on position where you will be do everything from designing and building extremely stable components and features for the savviest customers in the business to help them get the best results.You will have a chance to work with the open source community and contribute significant portions its software to open source projects possibly including Hadoop, Spark, Pig and Hbase. You need to not only be a top software developer with excellent programming skills, an understanding of big data and parallelization, and a stellar record of delivery but also excel at leadership and customer obsession and have a real passion for massive-scale computing. If you want to truly test your mettle against the hardest challenges in distributed systems to build solutions for large scale problems in a wide variety of domains, come join our group.Utility Computing (UC)AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization, you’ll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for customers who require specialized security solutions for their cloud services.Key job responsibilities- Translation of complex functional and technical requirements into detailed architecture and design- Deliver systems and features with top-notch quality, on time- Develop new technologies for monitoring production clusters- Own the software development process end-to-end, including: working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying, and operating the production EMR systems.About the teamAbout AWS AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.Basic qualifications- 3+ years of non-internship professional software development experience- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience- Experience programming with at least one software programming languagePreferred qualification - 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience- Bachelor's degree in computer science or equivalentAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .USA, CA, East Palo Alto - 165,200.00 - 223,600.00 USD annually

Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Software Development Engineer - Big Data, AWS Elastic MapReduce (EMR), EMR EKS in East Palo Alto, CA vacancy
  • $165.2k - $223.6k

     ...best full-stack engineers at Amazon. We...  ...campaigns on their 1P Data.Key job...  ..., and suite of AWS products for ML...  ...SageMaker, and S3/EMR/Glue/Quicksight...  ...analytics) for big data analysis....  ...goals into working software solutions. You...  ...software development experience- 2+... 
    Amazon Web Service
    Big data
    Internship
    Local area
    Immediate start
    Flexible hours

    Amazon

    Palo Alto, CA
    3 days ago
  •  ...About the job Lead Data Engineer Role: Lead Data Engineer Location: Fremont...  ...~ Good to have knowledge on AWS services such as S3, Athena, Glue, EMR/Spark with major emphasis on S3 and Glue ~ Experience with Big Data Tools and technologies Key... 
    Amazon Web Service
    Big data
    Full time
    Work from home

    Inizio Partners

    Fremont, CA
    3 days ago
  • $90k - $110k

     ...Big Data Engineer – Remote Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United...  ...Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks. Familiarity... 
    Amazon Web Service
    Big data
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Redwood City, CA
    1 day ago
  •  ...virtual driver software for factory-built...  ...optimal data processing pipeline...  ...using SQL and big data technologies...  ...the Executive, Engineering, and Operation...  ...data centers and AWS regions...  ...database design and development, data mining and...  ...processing, e.g. MapReduce, Spark, Kafka... 
    Amazon Web Service
    Big data

    PlusAI

    Santa Clara, CA
    16 days ago
  • $70 - $95 per hour

     ...Description Job Description Data Engineer The Cloud services...  ...focused on the rapid development of cloud based end-to-end...  ...Looking for world class server software engineers with Big Data Infrastructure and Data...  ...• Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, &... 
    Amazon Web Service
    Big data
    Hourly pay

    Cypress HCM

    Mountain View, CA
    16 days ago
  • $175k - $221k

     ...If you're inspired to dream big, innovate fast, and make a difference...  ...ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch...  ...cloud environment, preferably AWS (S3, EMR, Glue, Redshift). ~ Track record... 
    Amazon Web Service
    Big data
    Full time
    Local area
    Work from home

    NewsBreak

    Mountain View, CA
    10 days ago
  • $150k - $200k

     ...in neuroscience and engineering from Stanford University...  ...cloud-based big-data-driven medical analysis software in the cloud and management...  ...in both software development and systems, familiarity with AWS and Linux servers, and...  ...multi-cluster EKS. Setting up CI/CD... 
    Amazon Web Service
    Big data
    Full time
    Work at office

    LVIS

    Palo Alto, CA
    18 days ago
  • $165.2k - $223.6k

     ...and other runtime engines. We are scaling the...  ...: - Be part of big data revolution in cloud...  ...workloadsUtility Computing (UC)AWS Utility Computing...  ...(S3) and Amazon Elastic Compute Cloud (EC2...  ...’ll support the development and management of...  ...professional software development... 
    Amazon Web Service
    Big data
    Internship
    Local area
    Flexible hours

    Amazon

    East Palo Alto, CA
    4 days ago
  • $148k - $222k

    SummaryJoin Guidewire’s Data Platform and Analytics...  ...the latest in Big Data and cloud technologies...  ...customers. As a Senior Software Engineer (EMR Spark) on the Cloud Data...  ...cloud environment (AWS, Azure, or GCP).Strong...  ...incentive programsContinual development and internal career... 
    Amazon Web Service
    Big data
    Full time
    Part time
    Flexible hours

    Guidewire Software, Inc.

    San Mateo, CA
    4 days ago
  • $150.4k - $277.6k

     ...Software Data Engineer Join Apple's Analytics Platforms & Experiences (APX)...  ...backend services that integrate big data technologies with...  ...Hadoop ~ Exposure to AI-driven development practices with a genuine...  ...and cloud platforms such as AWS, GCP, or Azure Familiarity... 
    Amazon Web Service
    Big data
    Relocation

    Apple

    Cupertino, CA
    2 days ago
  •  ...high-agency, hands-on Lead Data Platform Engineer to architect, optimize,...  ...a focus on Databricks vs EMR (AWS) cloud optimization (cost...  ...Data Platform Engineering or Software Engineering with a proven...  ...containerization/orchestration (EKS) for elastic compute management. GPU/... 
    Amazon Web Service
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    8 days ago
  •  ...Big Data Engineer Location: Mountain view CA (3 days onsite) Skill Set: ~ Minimum of 5+ years working with Apache Flink or Spark Structured...  ...with Java or Scala ~ Strong experience working with micro services and Kubernetes ~ Strong experience with AWS Stack... 
    Amazon Web Service
    Big data

    Kasmo Global

    Mountain View, CA
    4 days ago
  • $165.2k - $223.6k

     ...regretSearch Science Data Infrastructure (SSDI)...  ...responsibilitiesAs an ML Engineer you will:Lead development of services and...  ...of machine learning, big data, and distributed...  ...and operations using AWS AI services, DL compute...  ...internship professional software development... 
    Amazon Web Service
    Big data
    Internship
    Local area
    Worldwide
    Flexible hours

    Amazon

    Palo Alto, CA
    6 days ago
  •  ...through research and development, technology...  ...innovation or solution engineering, our team members...  ...platforms, like AWS Bedrock ~...  ...including Docker, EKS, and GitLab CI/CD...  ...~1-2 years of software development or data science experience...  ...Familiarity with big data platforms and... 
    Amazon Web Service
    Big data
    Local area
    Flexible hours

    EchoStar

    San Mateo, CA
    16 days ago
  • $116.13k - $157.12k

     ...through research and development, technology...  ...innovation or solution engineering, our team members...  ...platforms, like AWS Bedrock ~...  ...including Docker, EKS, and GitLab CI/CD...  ...~1-2 years of software development or data science experience...  ...Familiarity with big data platforms and... 
    Amazon Web Service
    Big data
    Local area
    Flexible hours

    Dish

    San Mateo, CA
    26 days ago
  •  ...here.We’re looking for a senior staff software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be...  ...Python)Experiences in Kubernetes and AWS technologiesExceptional collaboration... 
    Amazon Web Service
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    Palo Alto, CA
    5 days ago
  • $224k - $321k

     ...of scientists, engineers, and physicians...  ...computer science and data science to...  ...Director of Software Engineering to...  ...technical expertise in big data, cloud...  ...on AWS, driving structural...  ...optimization and system elasticity. Big Data...  ...: Oversee the development of high-throughput... 
    Amazon Web Service
    Big data
    Full time
    Work at office
    Local area
    Flexible hours

    GRAIL

    Sunnyvale, CA
    11 days ago
  •  ...Big Data Engineer: Must Have: • Proficiency in managing and...  ...on the cloud (GCP preferred, AWS, Azure etc.) to build batch...  ...translate that to pipeline development / data solution work • Strong...  ...on Apache Druid, Redis, Elastic search, GraphQL or similar technologies... 
    Amazon Web Service
    Big data

    Trinity Technology Solutions

    Sunnyvale, CA
    1 day ago
  • $61k - $101k

     ...site reliability engineering, along with 5+ years...  ...application development, automation, and infrastructure...  ...and awareness of data sensitivity. We...  ...knowledge of software applications and...  ...: experience with big data technologies,...  ...certifications such as AWS, Azure, or GCP.... 
    Amazon Web Service
    Big data
    Full time

    J.P. Morgan

    Palo Alto, CA
    9 days ago
  •  ...seeking an exceptional engineer with a background in large scale software development and delivery in hyper-scale...  ...technologies to build data intensive systems, designing...  ...+ years experience with big data platforms ~...  ...environments like OpenStack, AWS, and Azure ~... 
    Amazon Web Service
    Big data

    Apple

    Sunnyvale, CA
    4 days ago
  •  ...Job Title: AWS Data Engineer Location: Foster City, CA/Raleigh, NC || Onsite Job Type: Contract Job Description:...  ...Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies... 
    Amazon Web Service
    Big data
    Contract work
    Work experience placement

    Trinity Technology Solutions

    San Mateo, CA
    1 day ago
  •  ...Job Title: DevOps Engineer Location: Cupertino,...  ...PayPal, Netflix, Meta, AWS, Product Companies, Startups...  ...Work closely with software developers, QA, and...  ...bridge the gap between development and operations and to...  ...Azure, Spark, Hadoop, or Big Data technologies.... 
    Amazon Web Service
    Big data
    Immediate start

    RIT Solutions, Inc.

    Cupertino, CA
    20 hours ago
  •  ...Data Science Engineer Job Location: Boston, MA - 4 days to office. ( Local...  ...team and contribute to the development and implementation of advanced...  ...using technologies such as AWS Glue, Python, Spark,...  ...computing frameworks like Spark for big data processing. •... 
    Amazon Web Service
    Big data
    Work at office
    Local area

    Info Way Solutions

    Fremont, CA
    1 day ago
  • $127.1k - $185k

     ...startup acquired by AWS in 2015 and is...  ...spans silicon engineering, hardware...  ...verification, software, and operations...  ...for a Software Development Engineer to help...  ...Experience with data structure implementation...  ...AWS services (EKS, EC2, Lambda, S...  ...systems or big data... 
    Amazon Web Service
    Big data
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    3 days ago
  •  ...AI/Machine Learning Engineer Fremont, CA, United States About...  ...a cross-functional team of data scientists, software engineers, and domain...  ...with cloud platforms (e.g., AWS, Azure, or GCP) and distributed...  ...models at scale. Knowledge of big data technologies, such as... 
    Amazon Web Service
    Big data

    4 Staffing Corp

    Fremont, CA
    1 day ago
  •  ...Software Engineer – Java, Big Data & Cloud Infrastructure We are looking for an experienced Software Engineer...  ...systems (Git) and Agile/Scrum development practices. ~ Strong problem-solving...  ...Experience with cloud platforms (AWS, Azure, or GCP). Familiarity with... 
    Amazon Web Service
    Big data

    Futran Tech Solutions Pvt. Ltd.

    Sunnyvale, CA
    1 day ago
  • $180k - $210k

     ...company dedicated to freeing data from data platform lock-...  ...to any downstream query engine and use case (from...  ...including Uber, Snowflake, AWS, Linkedin, Confluent and...  ...~ Working knowledge of Big Data Technologies...  ...services such as Amazon EMR, Amazon Redshift, Amazon... 
    Amazon Web Service
    Big data
    Work at office
    Remote work

    Onehouse

    Sunnyvale, CA
    16 days ago
  •  ...1 Title: Senior Platform Software Engineer Location: Sunnyvale, CA...  ...Requirements • 6+ years of software development experience • Strong...  ...experience • Hands-on AWS experience • Databases and...  ...Postgres, Kafka, Redis • Big data stack - data warehousing, MPP... 
    Amazon Web Service
    Big data

    Artech

    Sunnyvale, CA
    3 days ago
  • $146.2k - $233.7k

     ...Description As a Staff Data Engineer, you'll join our Value Added...  ...token platform within an agile development environment, collaborating with...  ...Architect solutions using big data technologies such as Hadoop...  ..., TensorFlow, Triton, and AWS services. • Skilled in Unix... 
    Amazon Web Service
    Big data
    Work experience placement
    Work at office
    Local area
    Immediate start

    Visa

    Foster, CA
    20 hours ago
  •  ...Role : Software Developer (Contractor working on site) Locations...  ...~3+ years of solid software development experience ~ Strong command...  ...Kubernetes experience Hands-on AWS experience Databases and...  ...— Postgres, Kafka, Redis Big data stack — data warehousing, MPP... 
    Amazon Web Service
    Big data
    For contractors
    Immediate start

    Infosys

    Cupertino, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Development Engineer - Big Data, AWS Elastic MapReduce (EMR), EMR EKS. Be the first to apply!