Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer (PySpark & AWS)

NTT America

Who We Are

Our client is a world-leading reinsurance and risk management company, delivering comprehensive solutions across insurance, underwriting, and data-driven risk assessment. With a strong focus on innovation and long-term stability, they support clients in addressing complex risks and driving sustainable value in an ever-changing global landscape.

We are seeking a highly skilled AWS Data Engineer to enhance our data and analytics environment. The successful candidate will play a pivotal role in designing, developing, and managing data solutions that leverage cloud technologies and big data frameworks. This role will involve creating efficient data pipelines, optimizing data storage solutions, and implementing robust data processing workflows to ensure high-quality data availability for analytics and business intelligence.

What you'll be doing

  • Build and maintain large-scale ETL pipelines using AWS Glue, Lambda, and Step Functions.

  • Design and manage data lakes on Amazon S3, implementing robust schema management and lifecycle policies.

  • Work with Apache Iceberg and Parquet formats to support efficient and scalable data storage.

  • Develop distributed data processing workflows using PySpark.

  • Implement secure, governed data environments using AWS Lake Formation.

  • Build and maintain integrations using AWS API Gateway and data exchange APIs.

  • Automate infrastructure provisioning using Terraform or CDK for Terraform (CDKTF).

  • Develop CI/CD pipelines and containerized solutions within modern DevOps practices.

  • Implement logging, observability, and monitoring solutions to maintain reliable data workflows.

  • Perform root cause analysis and optimize data processing for improved performance and quality.

  • Collaborate with business intelligence teams and analysts to support reporting and analytics needs.

  • Work in cross-functional, Agile teams and actively participate in sprint ceremonies, backlog refinement, and planning.

  • Provide data-driven insights and recommendations that support business decision-making.

What you'll bring along

  • Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience).

  • Minimum 3–5 years of experience in a Data Engineering role.

  • Strong knowledge of AWS services: Glue, Lambda, S3, Athena, Lake Formation, Step Functions, DynamoDB.

  • Proficiency in Python and PySpark for data processing, optimization, and automation.

  • Hands-on experience with Terraform or CDKTF for Infrastructure as Code.

  • Solid understanding of ETL development, data lakes, schema evolution, and distributed processing.

  • Experience working with Apache Iceberg and Parquet formats (highly valued).

  • Experience with CI/CD pipelines, automation, and containerization.

  • Familiarity with API Gateway and modern integration patterns.

  • Strong analytical and problem-solving skills.

  • Experience working in Agile Scrum environments.

  • Good understanding of data governance, security, and access control principles.

  • Experience with visualization/BI tools such as Power BI or AWS QuickSight is a plus.

  • Excellent command of both spoken and written English.

What’s in it for you

✔ New beginnings can be a challenge. We promise a smooth integration and a supportive mentor

✔ Pick your working style: choose from Remote, Hybrid or Office work opportunities

✔ Early bird or night owl? Our projects have different working hours to suit your needs

✔ Nobody is born an expert. Sharpen your tech skills with our sponsored certifications, trainings and top e-learning platforms

✔ We want you to stay healthy! Enjoy our Private Health Insurance ⁠– it’s custom-made for you

✔ A clear mind is a healthy mind. Attend individual coaching sessions or go one step further by joining our accredited Coaching School

✔ Make the most of our epic parties or themed events – they’re lovingly designed for our people and their families

✔ NTT DATA recruiters will never ask job seekers and candidates for payment or banking information during the recruitment process, for any reason. Please remain vigilant of third parties that may try to impersonate NTT DATA recruiters, either in writing or by phone, in an attempt to deceptively obtain personal data or money from you. All email communications from an NTT DATA recruiter will be associated with an @nttdata.com email address. NTT DATA will not use any non-NTT DATA or personal email domains (Gmail, Yahoo, etc.) or personal communication channels (WhatsApp, Facebook etc) at any time during the recruitment process. If you suspect any fraudulent activity, please contact us.

NTT DATA Romania is an equal opportunity employer and considers all applicants regardless to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees.

Not the job for you? Perhaps you have a friend who would be a perfect fit. Send them this link!

What’s in it for you

  • New beginnings can be a challenge. We promise a smooth integration and a supportive mentor

  • Pick your working style: choose from Remote, Hybrid or Office work opportunities

  • Early bird or night owl? Our projects have different working hours to suit your needs

  • Nobody is born an expert. Sharpen your tech skills with our sponsored certifications, trainings and top e-learning platforms

  • We want you to stay healthy! Enjoy our Private Health Insurance ⁠– it’s custom-made for you

  • A clear mind is a healthy mind. Attend individual coaching sessions or go one step further by joining our accredited Coaching School

  • Make the most of our epic parties or themed events – they’re lovingly designed for our people and their families

Make this the place you grow

Your unique talent is what matters. NTT DATA Romania is an equal opportunity employer and considers all applicants regardless to race, color, religion, citizenship, national origin, ethnicity, age, gender, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic.

Third parties fraudulently posing as NTT DATA recruiters

NTT DATA recruiters will never ask job seekers and candidates for payment or banking information during the recruitment process, for any reason. Please remain vigilant of third parties that may try to impersonate NTT DATA recruiters, either in writing or by phone, in an attempt to deceptively obtain personal data or money from you. All email communications from an NTT DATA recruiter will be associated with an @nttdata.com email address. NTT DATA will not use any non-NTT DATA or personal email domains (Gmail, Yahoo, etc.) or personal communication channels (WhatsApp, Facebook etc) at any time during the recruitment process. If you suspect any fraudulent activity, please contact us.

#LI-CB1

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer (PySpark & AWS) in United States vacancy
  •  ...Skills and Experience You Will Need: PySpark: Hands-on experience with Data Frames, RDDs, joins, transformations, and actions. Databricks...  ..., repartitioning, and Shuffle mechanics AWS: S3 buckets, IAM, CloudWatch, and integration with Databricks... 
    Amazon Web Service
    Remote work

    Saxon Global

    United States
    3 days ago
  • $50 - $65 per hour

     ...Job Title: Senior Data Engineer (PySpark & AWS & Agentic AI ) Location: Malvern, PA ( Onsite ) Position : ( C2C Role ) Duration : ( 6+ Months) Pay Range : $50 - 65/Hr Skills: Amazon Web Service(AWS), Cloud Computing, Python, Agentic AI, PySpark.... 
    Amazon Web Service

    Diverse Lynx

    Malvern, PA
    1 day ago
  • A technology services company is seeking a Senior Data Engineer to create scalable ETL pipelines and work with vast datasets. The role...  ...Python and SQL skills, along with experience in tools like PySpark and AWS. This full-time position is remote, offering flexibility and... 
    Amazon Web Service
    Full time
    Remote work

    Lumenalta

    Tampa, FL
    2 days ago
  •  ...Job Title: Data Engineer (PySpark + AWS + Iceberg) Location : Chicago, IL Exp: 10+ Yrs RTTO - 5 Days Onsite Job Description: Job Summary We are looking for a skilled Data Engineer to design and build scalable data solutions... 
    Amazon Web Service

    Diverse Lynx

    Chicago, IL
    1 day ago
  • $120k - $140k

     ...Job : PySpark Data Engineer Location : Irving, TX(Onsite) Fulltime Only Salary Range: $120000 to $140000/Annum + Full Time Benefits...  ...based data pipelines • Migrate On Prem workloads into Cloud(AWS, Databricks, Snowflake) based on use cases. • Collaborate with... 
    Amazon Web Service
    Full time
    Work experience placement

    Diverse Lynx

    Irving, TX
    1 day ago
  •  ...Senior Data Engineer Remote (any state in India) About Us Our client is the top-performing...  ...Data Engineer with deep expertise in Spark/PySpark/SQL to join our data team. This is a...  ...infrastructure across cloud platforms (GCP and AWS). Build and maintain real time and... 
    Amazon Web Service
    Remote work

    iTCO Solutions

    United States
    4 days ago
  •  ...Strong hands-on expertise with: PySpark (RDD, Data Frames, Spark SQL, performance tuning)...  ...Proficiency in Python for data engineering workflows. Experience with distributed...  ...ETL/ELT pipelines on cloud platforms (AWS / Azure / GCP). Familiarity with CI... 
    Amazon Web Service

    Purple Drive

    Jersey City, NJ
    3 days ago
  •  ...Technical/Functional Skills • Programming Languages: Proficient in SQL, Pyspark, Python • Data Pipeline & ETL: Proficiency in building ETL/ELT pipelines using tools like Apache Airflow, AWS EC2, EMR, S3, dbt, Azure Data factory • Database Management: Expertise in... 
    Amazon Web Service

    Centraprise

    Pontiac, MI
    2 days ago
  •  ...Overview: Title: Data Engineer (PySpark / AWS) Location: Wilmington, DE - Onsite Type: Contract Job Overview We are seeking a highly skilled Data Engineer with strong expertise in PySpark, ETL pipelines, and AWS services to join our onsite team... 
    Amazon Web Service
    Contract work

    Purple Drive

    Wilmington, DE
    1 day ago
  •  ...Role: Sr. PySpark Data Engineer - Fulltime Location: Irving, TX Job Description: We are seeking a skilled PySpark Data...  ...Deploy and manage data workflows in cloud platforms (AWS, Azure, GCP). Utilize SQL and NoSQL databases for data... 
    Amazon Web Service
    Full time

    SARIAN Co

    Irving, TX
    2 days ago
  • A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance...  ...data pipelines using Python/PySpark. Candidates should have strong experience with AWS services and data warehousing tools... 
    Amazon Web Service
    Full time

    Quadrant IQ Solutions LLC

    New York, NY
    2 days ago
  • A prominent tech company seeks a skilled Data Engineer to design and implement data integration solutions. The role demands proficiency in Python and PySpark, along with experience in AWS services. Responsibilities include developing ETL pipelines, collaborating with teams... 
    Amazon Web Service

    Compunnel, Inc.

    Charlotte, NC
    5 days ago
  • S&P Global is looking for a Data Engineer to build and maintain scalable data processing pipelines...  .... This role involves working in an AWS-based environment, focusing on data pipeline...  ...Python, SQL, and data ecosystems like PySpark and Databricks. You will contribute to... 
    Amazon Web Service

    S&P Global

    New York, NY
    5 days ago
  • $109.3k - $180.2k

     ...Job Title Data Engineer Job Category Technology Compensation Overview The annual...  ...building data pipelines using AWS Services (S3, Lambda, IAM) and Databricks...  ...development experience with Python and PySpark. Experience with ETL development in data... 
    Amazon Web Service
    Work experience placement
    H1b
    Local area
    Immediate start

    Travelers

    Atlanta, GA
    1 day ago
  •  ...Lead Data Engineer Candidate should have 12+ years of experience in Data Engineering. Must have strong work experience with onshore-offshore...  ...How do you do Data profiling Hands-on experience with PySpark, Redshift (SQL) and Airflow at minimum Strong hands-on with... 
    Amazon Web Service
    Work experience placement
    Flexible hours

    Zortech Solutions

    Jericho, NY
    2 days ago
  •  ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate...  ...environments. Experience with cloud platforms (AWS, Azure, or GCP) and related data services (e.g., S3, Snowflake... 
    Amazon Web Service
    Remote work

    VBeyond

    Jersey City, NJ
    3 days ago
  •  ...Job title FOUNDARY DATA ENGINEER Job summary Foundary Data Engineer Experience 8to11yrs Required Skills Technical Skills- Python PySpark Domain Skills- Nice to have skills Technical Skills- Domain...  ...in PySpark to build data pipes in AWS environments. - Should be able to... 
    Amazon Web Service
    Shift work

    3B Staffing LLC

    San Francisco, CA
    2 days ago
  •  ...Job Title: Technology Lead | Big Data - Data Processing | Spark -- Senior Data Engineer Work Location & Reporting Address...  ...? Python ? Big Data ? AWS Nice to Have Skills: Detailed...  ...and a strong background in Python, PySpark, and Object-oriented programming.... 
    Amazon Web Service
    Hourly pay
    Contract work
    Immediate start
    Relocation

    eTeam

    Charlotte, NC
    1 day ago
  • $125k - $135k

     ...Data Engineer - Python/PySpark Location: Dallas/Irving TX (3 Days onsite/week) Fulltime Salary Range: $125,000-$135,000/Year Job Description...  ...(Bitbucket / GitHub). Experience working with AWS, Azure, or GCP environments. Strong understanding of database... 
    Amazon Web Service
    Full time
    3 days per week

    Diverse Lynx

    Dallas, TX
    4 days ago
  •  ...Overview: Senior Data Engineer - Python & PySpark Job Summary We are seeking an experienced Senior Data Engineer with strong expertise...  ...and manage data solutions on cloud platforms such as: AWS Azure GCP Work with orchestration tools like... 
    Amazon Web Service

    Purple Drive

    Jersey City, NJ
    1 day ago
  •  ...Infinitive: Infinitive is a data and AI consultancy that...  ...highly skilled and motivated Data Engineer to join our dynamic team. As a...  ...infrastructure. Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins...  ...of cloud platforms such as AWS, Azure, or Google Cloud.... 
    Amazon Web Service
    Local area

    Infinitive

    Ashburn, VA
    3 days ago
  •  ...Job Title: Technical Lead – Data Engineering (Palantir, Spark, PySpark, Python) Please dont apply if you dont have PALANTIR experience Onsite work...  ...store analytics) Experience with cloud platforms (Azure, AWS, or GCP) Familiarity with orchestration tools (... 
    Amazon Web Service
    Work from home
    Flexible hours

    CLOUDSCOUTS SOFTWARE SOLUTIONS LLC

    Frisco, TX
    3 days ago
  • $120k

     ...and Osmania profiles for my any open role. Title: Python PySpark/ Data Engineer Location: Plano, TX and Wilmington, DE H1B...  ...of experience migrating/developing data solutions in the AWS cloud is required. ~2+ years of experience building/implementing... 
    Amazon Web Service
    Work experience placement
    H1b
    Local area
    Relocation

    Texas State Library and Archives Commision

    Plano, TX
    12 hours ago
  • $70k - $105k

    UST is seeking a Senior Data Engineer to design and optimize scalable data pipelines and platforms. This role requires strong expertise in Python, PySpark, and AWS, with responsibilities that include developing ETL/ELT pipelines and ensuring data quality. The compensation... 
    Amazon Web Service

    UST

    Chicago, IL
    2 days ago
  •  ...Pyspark / Python Data Engineer – Tech Lead Role We are seeking a seasoned professional with expertise in building data engineering and analytics solutions within AWS ecosystems. The ideal candidate should have deep experience in PySpark, Python, and end-to-end data... 
    Amazon Web Service
    Remote work

    Cardinal Integrated

    United States
    11 days ago
  • $125k - $145k

     ...evolving industry. Job Summary The Senior Data Engineer will design and develop scalable data...  ...Key Responsibilities Build and maintain PySpark pipelines in Databricks Develop scalable...  ...Qualifications Databricks certification AWS or Azure certification Compensation Salary... 
    Amazon Web Service
    Local area

    AmeriLife

    Florida, NY
    5 days ago
  • A data solutions company is seeking an Analytics Data Engineer with deep expertise in building scalable data solutions on the AWS platform. Ideal candidates have at least 5 years of experience in...  ...are 10/10 experts in Python and PySpark. Responsibilities include designing... 
    Amazon Web Service

    Revel IT

    Columbus, OH
    2 days ago
  •  ...The primary role of the Data Engineer-Developer is to function as a critical member of a data team by designing data integration solutions...  ...transformation/loading into large data domains using Python/Pyspark and AWS tools. Responsibilities: • Provide scoping,... 
    Amazon Web Service

    Insight Global

    Charlotte, NC
    5 days ago
  • LTM is seeking a Senior Developer to focus on PySpark and Python data engineering tasks. The role includes designing and optimizing large-scale data processing...  ...is proficient in utilizing cloud services like Azure and AWS. Comprehensive perks including a medical plan, 401(k)... 
    Amazon Web Service

    LTM

    Cincinnati, OH
    1 day ago
  •  ...Senior Data Engineer Teams – we have an exclusive backfill for an SOW with Deloitte. We can...  ...Date: 4/11/2022 Require Technologies: Pyspark, Azure Databricks, SparkSQL, Azure,...  ...Hadoop ecosystem using HDFS, ADLS Gen2, or AWS S3 ~ Experienced with data visualization... 
    Amazon Web Service
    Remote work

    Software Technology Inc

    United States
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer (PySpark & AWS). Be the first to apply!