Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Development Engineer - Big Data, AWS Elastic MapReduce (EMR), EMR EKS

$165.2k - $223.6k
Full-time

Amazon

Want to change the world with Big Data and Analytics? Come join us on the Amazon Web services (AWS) Elastic MapReduce (EMR) team!EMR is a massively scaled distributed service that gives users fast and predictable Big Data performance with clusters running Hadoop, Hive, Pig, Impala, Spark, Presto, HBase and more, with the ability to effortlessly scale up and down as needed. We run millions of customer clusters, enabling processing on vast datasets.We are developing innovative new features including the next-generation cluster management system, real-time processing for big data and intuitive ways of interacting with data, and we’re looking for top engineers to build them from the ground up.This is a hands-on position where you will be do everything from designing and building extremely stable components and features for the savviest customers in the business to help them get the best results.You will have a chance to work with the open source community and contribute significant portions its software to open source projects possibly including Hadoop, Spark, Pig and Hbase. You need to not only be a top software developer with excellent programming skills, an understanding of big data and parallelization, and a stellar record of delivery but also excel at leadership and customer obsession and have a real passion for massive-scale computing. If you want to truly test your mettle against the hardest challenges in distributed systems to build solutions for large scale problems in a wide variety of domains, come join our group.Utility Computing (UC)AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS’s services and features apart in the industry. As a member of the UC organization, you’ll support the development and management of Compute, Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for customers who require specialized security solutions for their cloud services.Key job responsibilities- Translation of complex functional and technical requirements into detailed architecture and design- Deliver systems and features with top-notch quality, on time- Develop new technologies for monitoring production clusters- Own the software development process end-to-end, including: working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying, and operating the production EMR systems.About the teamAbout AWS AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS? Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Inclusive Team Culture Here at AWS, it’s in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon conferences, inspire us to never stop embracing our uniqueness. Mentorship & Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.Basic qualifications- 3+ years of non-internship professional software development experience- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience- Experience programming with at least one software programming languagePreferred qualification - 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience- Bachelor's degree in computer science or equivalentAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Los Angeles County applicants: Job duties for this position include: work safely and cooperatively with other employees, supervisors, and staff; adhere to standards of excellence despite stressful conditions; communicate effectively and respectfully with employees, supervisors, and staff to ensure exceptional customer service; and follow all federal, state, and local laws and Company policies. Criminal history may have a direct, adverse, and negative relationship with some of the material job duties of this position. These include the duties and responsibilities listed above, as well as the abilities to adhere to company policies, exercise sound judgment, effectively manage stress and work safely and respectfully with others, exhibit trustworthiness and professionalism, and safeguard business operations and the Company’s reputation. Pursuant to the Los Angeles County Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .USA, CA, East Palo Alto - 165,200.00 - 223,600.00 USD annually

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Software Development Engineer - Big Data, AWS Elastic MapReduce (EMR), EMR EKS in Palo Alto, CA vacancy
  • $165.2k - $223.6k

     ...change the world with Big Data and Analytics? Come...  ...Web services (AWS) Elastic MapReduce (EMR) team!EMR is a massively...  ...’re looking for top engineers to build them from the...  ...portions its software to open source projects...  ...you’ll support the development and management of Compute... 
    Amazon Web Service
    Big data
    Internship
    Local area

    Amazon

    East Palo Alto, CA
    4 days ago
  • $165.2k - $223.6k

     ...best full-stack engineers at Amazon. We...  ...campaigns on their 1P Data.Key job...  ..., and suite of AWS products for ML...  ...SageMaker, and S3/EMR/Glue/Quicksight...  ...analytics) for big data analysis....  ...goals into working software solutions. You...  ...software development experience- 2+... 
    Amazon Web Service
    Big data
    Internship
    Local area
    Immediate start
    Flexible hours

    Amazon

    Palo Alto, CA
    1 day ago
  • $175k - $221k

     ...intelligence.If you’re inspired to dream big, innovate fast, and make a...  ...ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch...  ...cloud environment, preferably AWS (S3, EMR, Glue, Redshift).Track record of... 
    Amazon Web Service
    Big data
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    2 days ago
  • $70 - $95 per hour

     ...Description Job Description Data Engineer The Cloud services...  ...focused on the rapid development of cloud based end-to-end...  ...Looking for world class server software engineers with Big Data Infrastructure and Data...  ...• Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, &... 
    Amazon Web Service
    Big data
    Hourly pay

    Cypress HCM

    Mountain View, CA
    19 days ago
  • $262.5k - $394k

     ...Principal Data Engineering Lead - Services Special...  ...California, United States Software and Services...  ...standards for development, testing, deployment...  ...Experience with AWS: e.g., S3, EMR, Lambda, Glue,...  ...experience with big data lake architectures...  ..., Kubernetes/EKS) and CI/CD tooling... 
    Amazon Web Service
    Big data
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $155k - $185k

     ...are looking for an experienced Software Engineer with a passion for building robust and scalable data infrastructure to join our Data...  ...experience with streaming and big data processing frameworks (e.g...  ...with cloud platforms (preferably AWS) and containerization tools (e.... 
    Amazon Web Service
    Big data
    Permanent employment

    Otter.ai

    Mountain View, CA
    4 days ago
  • $202.5k - $274k

     ...and Lending Platform as a Staff Software Engineer in Data. You will join an innovative and...  ...PySpark, Spark, SQL, Data Bricks, Big Data fundamentals, AWS, Elastic Search, Kafka, to build...  ...to drive forward results.Agile Development, SCRUM, or Extreme Programming methodologies... 
    Amazon Web Service
    Big data
    Worldwide

    Intuit

    Mountain View, CA
    1 day ago
  • $135k - $180k

     ...Clara, CAData Engineering - Backend Engineering...  ...virtual driver software for factory-...  ...optimal data processing pipeline...  ...using SQL and big data technologies...  ...data centers and AWS regionsRequired...  ...design and development, data mining and...  ...processing, e.g. MapReduce, Spark,... 
    Amazon Web Service
    Big data
    Full time

    Plus.ai

    Santa Clara, CA
    21 hours ago
  • $116k - $174k

     ...talented and experienced Software Engineer to join our data engineering and infrastructure...  ...contribute to the design, development, and maintenance of our...  ...infrastructure components using AWS cloud services and...  ...Preliminary experience with big data processing frameworks... 
    Amazon Web Service
    Big data
    Work at office
    Local area
    3 days per week

    Aurora Innovation

    Mountain View, CA
    1 day ago
  • $165.2k - $223.6k

     ...regretSearch Science Data Infrastructure (SSDI)...  ...responsibilitiesAs an ML Engineer you will:Lead development of services and...  ...of machine learning, big data, and distributed...  ...and operations using AWS AI services, DL compute...  ...internship professional software development... 
    Amazon Web Service
    Big data
    Internship
    Local area
    Worldwide
    Flexible hours

    Amazon

    Palo Alto, CA
    3 days ago
  •  ...here.We’re looking for a senior staff software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be...  ...Python)Experiences in Kubernetes and AWS technologiesExceptional collaboration... 
    Amazon Web Service
    Big data
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    Palo Alto, CA
    4 days ago
  • $193.3k - $261.5k

     ...about solving real world data management and...  ...analytics in the cloud. AWS Lake Formation is a service...  .... We are looking for software engineers to join our growing...  ...problems in areas of Big Data, Distributed Systems...  ...to maintain our high development standards- Mentor other... 
    Amazon Web Service
    Big data
    Internship
    Local area
    Flexible hours
    Night shift
    Day shift

    Amazon

    East Palo Alto, CA
    3 days ago
  • $180k - $220k

    Harness is the AI Software Delivery Platform company, led by technologist...  ...a talented and experienced Data Platform Engineer to join our team as the...  ..., or Scala.Experience with big data technologies such as...  ...with cloud platforms such as AWS, Azure, or Google Cloud.Strong... 
    Amazon Web Service
    Big data
    Local area
    Immediate start
    Flexible hours
    Shift work
    3 days per week

    Harness

    Mountain View, CA
    4 days ago
  • $64.9 - $86.54 per hour

    Santa Clara, CAData Engineering - Data Infrastructure /...  ...virtual driver software for factory-built...  ...data using SQL and big data technologies...  ...data centers and AWS regionsRequired...  ...database design and development, data mining and...  ...processing, e.g. MapReduce, Spark,... 
    Amazon Web Service
    Big data
    Full time

    Plus.ai

    Santa Clara, CA
    11 hours ago
  • $150k - $200k

     ...in neuroscience and engineering from Stanford University...  ...cloud-based big-data-driven medical analysis software in the cloud and management...  ...in both software development and systems, familiarity with AWS and Linux servers, and...  ...multi-cluster EKS. Setting up CI/CD... 
    Amazon Web Service
    Big data
    Full time
    Work at office

    LVIS

    Palo Alto, CA
    21 hours ago
  •  ...automate tasks, analyze data, and enhance team...  ...compliance. Job title Software Engineer - Platform...  ...technologies, especially AWS, and big data systems, your role...  ...closely with the development team to integrate cloud...  ...not limited to Kafka, EMR, and data pipelines,... 
    Amazon Web Service
    Big data
    Flexible hours

    Brevian.ai

    Sunnyvale, CA
    3 days ago
  • $127.1k - $185k

     ...startup acquired by AWS in 2015 and is...  ...spans silicon engineering, hardware...  ...verification, software, and operations...  ...for a Software Development Engineer to help...  ...Experience with data structure implementation...  ...AWS services (EKS, EC2, Lambda, S...  ...systems or big data... 
    Amazon Web Service
    Big data
    Internship
    Local area
    Flexible hours

    Amazon

    Cupertino, CA
    1 day ago
  • $230k - $277k

     ...high-agency, hands-on Lead Data Platform Engineer to architect, optimize,...  ...a focus on Databricks vs EMR (AWS) cloud optimization (cost...  ...Data Platform Engineering or Software Engineering with a proven...  ...containerization/orchestration (EKS) for elastic compute management. GPU/... 
    Amazon Web Service
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    21 hours ago
  • $130.6k - $285k

     ...that powers the company's data, analytics, and ML...  ...About the Role As a Software Engineer on Spark Platform, you...  ...Spark at scale on Amazon EMR, Databricks, or an in-...  ...Familiarity with batch or big-data schedulers (...  ...in a cloud environment (AWS preferred) — VPC networking... 
    Amazon Web Service
    Big data
    Hourly pay
    Full time
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    DoorDash USA

    Sunnyvale, CA
    2 days ago
  •  ...Job Title: Data Engineer . Location: Sunnyvale...  ...design and development experience with Relational...  ...for database and software. ~ Experience...  ...(DM) is a big plus. ~ Ability...  ...computing platforms like AWS, Google Cloud ....  ..., Dremio, Hadoop, MapReduce, Hive etc.... 
    Amazon Web Service
    Big data

    Numeric

    Sunnyvale, CA
    3 days ago
  •  ...Sr. Data EngineerMountain View, CA / Denver, CO /...  ...looking for a Sr. Data Engineer to join our growing Data...  ...many sourcesExperience in big data, data mining and...  ...computing, especially AWS technologies (S3, EC2,...  ...experience in object-oriented development with PythonOther... 
    Amazon Web Service
    Big data

    1872 Consulting

    Mountain View, CA
    4 days ago
  •  ...Data Pipeline Engineer ByteDance is a technology company operating a range of content platforms that...  .... Taking advantage of cutting-edge big data and AI technologies, we are aiming...  ...with Cloud platforms such as GCP and AWS is a plus. Experience with Docker &... 
    Amazon Web Service
    Big data

    Adapt Talent

    Mountain View, CA
    2 days ago
  •  ...Sr. Data Engineer Mountain View, CA / Denver, CO / Remote Full-Time...  ...sources Experience in big data, data mining and statistical...  ...Cloud computing, especially AWS technologies (S3, EC2, etc.)...  ...experience in object-oriented development with Python Other languages... 
    Amazon Web Service
    Big data
    Full time
    Remote work

    1872 Consulting

    Mountain View, CA
    1 day ago
  •  ...Data Platform EngineerThe Digital Media...  ...Our research and development include TV analytics...  ...adept at enterprise software development using...  ...closely with other data engineers to implement data...  ...data processes in AWS environmentDesign...  ...knowledge of big data technology landscape... 
    Amazon Web Service
    Big data

    Omega Solutions Inc

    Mountain View, CA
    4 days ago
  •  ...InterviewMandatory Skills: NodeJS, AWS, Backend APIRequired Skills:·...  ...experience developing web, software applications· 5+ years of...  ...Experience with the entire Software Development Life Cycle (SDLC)· 5+ years...  ...social, mobile, cloud/SaaS, big data, or analytics· Experience... 
    Amazon Web Service
    Big data
    Work experience placement

    Argyle Infotech

    Mountain View, CA
    4 days ago
  • $184.7k - $277.6k

     ...Sr. Software Engineer (Data Solutions), IS&T Ai & Data Platforms Sunnyvale,...  ...together data, application development, and machine learning — including...  ...databases like SnowFlake, Big Query or Cloudera ~ Programming...  ...on platforms like AWS, Microsoft Azure, Google Cloud... 
    Amazon Web Service
    Big data
    Work experience placement
    Relocation

    Apple

    Sunnyvale, CA
    1 day ago
  • $165.2k - $223.6k

     ...fully managed cloud data warehouse and data...  ...for innovative engineers to help shape the...  ...that powers multiple AWS services and...  ...Service (S3) and Amazon Elastic Compute Cloud (EC2...  ...’ll support the development and management of...  ...responsibilitiesAs a Software Development... 
    Amazon Web Service
    Work experience placement
    Internship
    Local area
    Flexible hours

    Amazon

    East Palo Alto, CA
    1 day ago
  •  ...looking for a Senior MLOps engineer to work closely with Data Scientists to build and...  ...activities vital for model development, testing and deployment in...  ...and which are deployed in AWS. These applications power...  ...Operational experience in big data/ML tools such as Ray,... 
    Amazon Web Service
    Big data

    JP Morgan Chase

    Palo Alto, CA
    1 day ago
  • $90k - $110k

     ...Big Data Engineer – Remote Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United...  ...Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks. Familiarity... 
    Amazon Web Service
    Big data
    Full time
    H1b
    Local area
    Immediate start
    Remote work
    Visa sponsorship

    Bright Vision Technologies

    Foster, CA
    8 days ago
  • $83.98 - $111.27 per hour

     ...experienced Senior Manager of Data Engineering to lead our data engineering...  ...Functions: Team Leadership and Development: Lead, mentor, and manage...  ...data platforms (e.g., GCP, AWS, Azure) and data warehousing...  ...). Proficiency with big data technologies (e.g., Spark... 
    Amazon Web Service
    Big data
    Hourly pay
    Full time

    Stanford Health Care

    Palo Alto, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Development Engineer - Big Data, AWS Elastic MapReduce (EMR), EMR EKS. Be the first to apply!