Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AWS Data Engineer with Databricks Exp.

Magicforce

Overview:

Senior-level engineer responsible for designing, building, and supporting cloud-based data pipelines and health insurance applications using AWS and Databricks. Role involves complex system integrations, data engineering, and working closely with distributed agile teams.

Duties:

  • Design, build, and maintain scalable data pipelines using AWS and Databricks
  • Implement ETL/ELT processes to load data into data lakes and downstream systems
  • Ensure data quality, accuracy, reliability, and observability
  • Build and automate unit, integration, and performance tests
  • Integrate internal systems, external vendors, mobile apps, and data marts
  • Support and enhance retail health insurance applications
  • Monitor pipelines and proactively resolve production issues
  • Participate in all SAFe/Agile ceremonies
  • Collaborate with engineering, business, architecture, security, and infrastructure teams
Required:
  • 8+ years experience designing and architecting solutions from scratch
  • Strong expertise in AWS Cloud Services , including:
    • Glue, ECS/EKS, Fargate
    • Redshift, Aurora, DocumentDB
    • S3, Lambda, SNS, IAM, ECR
  • Databricks expertise:
    • Delta Live Tables (DLT)
    • SQL, Spark, Python/PySpark
    • Java
    • Databricks workflows or Apache Airflow
  • Strong understanding of:
    • Data integration strategies
    • ETL / ELT techniques
    • Data warehousing principles
    • Data transformation, quality, and observability
  • Experience with DevOps practices , design patterns, and performance tuning
  • Familiarity with BI & Governance Tools :
    • Tableau
    • Alation, Collibra
Desired:
  • Migration of large-scale on-prem data pipelines to Databricks (cloud)
  • Experience with:
    • Delta Lake, Iceberg, Apache Hudi
    • Partitioning strategies & metadata management
    • JSON/XML, document databases, real-time ingestion
    • Lakehouse architecture, dimensional modeling, Data Vault
Skills:
  • Strong analytical and problem-solving abilities
  • Excellent written and verbal communication
  • Customer-facing, consultant mindset
  • Ability to lead technically and influence architecture decisions
  • Collaborative team player in distributed agile environments
Education:
  • Bachelor's degree in Information Systems or related field
  • Advanced degree (e.g., MBA) is a plus
  • Equivalent experience accepted

Skills:

Databricks,AWS,ETL/ELT,data pipelines,ECS/EKS
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AWS Data Engineer with Databricks Exp. in Jersey City, NJ vacancy
  •  ...Title: Data Engineer Location: Jersey City, NJ (Day 1...  ...min 6-7 years of exp good in python and...  ...good knowledge of AWS AWS services - data...  ...data is stored in cloud with data warehousing concept...  ...AI/ML knowledge Databricks NoSQL Database.... 
    Databricks
    Amazon Web Service

    InterSources

    Jersey City, NJ
    4 days ago
  •  ...Position Responsibilities Data Engineer Location : Jersey City, NJ / Columbus...  ...Skills: Python/Spark/PySpark/AWS Job Description: THE...  ...Migration project - MUST BE STRONG IN AWS. Databricks is a plus, if it's on the resume they... 
    Databricks
    Amazon Web Service
    Remote work

    Apex Informatics

    Jersey City, NJ
    5 days ago
  •  ...Big Data Engineer Mandatory skills: Apache Spark/ Hive/ Kafka/ Amazon...  ...Hadoop/ Presto/ Strong experience with MySQL, PostgreSQL, MongoDB,...  ...using Apache Spark, Talend, AWS Glue, Google Dataflow, Apache...  ...: Work with AWS, Azure, GCP, Databricks. Store and manage data with S... 
    Databricks
    Amazon Web Service

    Omni Inclusive

    Jersey City, NJ
    3 days ago
  •  ...Sr. Data Engineer Location: New York, NY Required Skills:...  ...lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), at...  ...similar) Proficiency with data structures, data...  ...lines for each skill on your exp.) Python - 5 - 10 - I have... 
    Databricks
    Amazon Web Service

    Damco

    New York, NY
    1 day ago
  •  ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where...  ...compliance, and governance in line with industry and client standards...  ...with cloud platforms (AWS, Azure, or GCP) and related data...  ...services (e.g., S3, Snowflake, Databricks). Should be familiar... 
    Databricks
    Amazon Web Service
    Remote work

    VBeyond

    Jersey City, NJ
    3 days ago
  •  ...bring deep expertise in Data Science, Machine Learning...  ...seeking an experienced Data Engineer to join our data team. In...  ...data infrastructure on AWS cloud. You will collaborate closely with data scientists, analysts...  ...transformation workflows using Databricks, Apache Spark, and SQL to... 
    Databricks
    Amazon Web Service
    Local area

    Tiger Analytics

    Jersey City, NJ
    3 days ago
  • $65 - $70 per hour

     ...Position: Data Engineer- AWS Location: Jersey City, New Jersey Duration: Contract Job...  ...data scientists. Ensure compliance with data governance requirements and alignment...  ...platforms such as AWS Data Lake, Databricks, or Hadoop. Proficiency in relational... 
    Databricks
    Amazon Web Service
    Full time
    Contract work

    Pinnacle Group

    Jersey City, NJ
    5 days ago
  • $65 - $68.26 per hour

     ...Data Engineer Location: Jersey City, New Jersey (hybrid) Employment Type: Contract...  ...workflows using Snowflake and Databricks. You will collaborate with data scientists, platform engineers...  ...scalable ETL/ELT pipelines across AWS, GCP, and Azure. Analyze business... 
    Databricks
    Amazon Web Service
    Hourly pay
    Contract work

    Apex Systems

    Jersey City, NJ
    5 days ago
  • $83.12 - $87.12 per hour

     ...Genesis10 is currently seeking a QA Data Engineer - Hybrid position (3 days onsite)...  ...experience as a Data Engineer with a focus on Quality Assurance...  ...Experience with cloud data tools (e.g., AWS Glue, Azure Data Factory, Azure DataBricks) Experience working with QA analysts... 
    Databricks
    Amazon Web Service
    Hourly pay
    Permanent employment
    Contract work
    Remote work
    Flexible hours

    Genesis10

    Jersey City, NJ
    4 days ago
  • $106.9k - $176.5k

     ...in to shape your future with confidence.  We’ll help...  ...world. Technology – Data and Decision Science – Data Engineering – Senior We are seeking...  ..., specifically Databricks. The ideal candidate will...  ...on cloud platforms (e.g., AWS, Azure, GCP). Collaborate... 
    Databricks
    Amazon Web Service
    Summer holiday
    Flexible hours

    EY

    Hoboken, NJ
    5 days ago
  •  ...Must Have skills: 1. Databricks 2. Snowflake 3. Designing...  ...& pricing reference data to over 400+ consuming...  ...for a hands on Data Engineer who is fluent in building...  .../ELT pipelines across AWS, GCP, and Azure. You'll...  ...and Databricks (Spark), with strong working... 
    Databricks
    Amazon Web Service
    Immediate start

    Artech

    Jersey City, NJ
    4 days ago
  • $125.5k - $230.2k

     ...in to shape your future with confidence.  We’ll help...  ...world. Technology – Data and Decision Science – Data Engineering – Manager We are looking...  ...with a strong focus on Databricks. The ideal candidate will...  ...cloud platforms (e.g., AWS, Azure, GCP). Oversee... 
    Databricks
    Amazon Web Service
    Summer holiday
    Flexible hours

    EY

    Hoboken, NJ
    2 days ago
  •  ...Applied AI/ML Engineer Are you ready to play a pivotal role in shaping the future of Data & Analytics? As a valued member...  ...work in close coordination with various teams in Data & Analytics...  ...: ~ Experience with AWS Cloud Platform and Databricks for deploying and... 
    Databricks
    Amazon Web Service
    Work experience placement

    Chase

    Jersey City, NJ
    1 day ago
  • $55 per hour

     ...Data Engineer Location - New York, NY (Hybrid 2-3 days onsite) Rate...  ...Scala and Java Experience with SQL and NoSQL databases (Teradata...  ...Familiarity with cloud infrastructure (AWS, Azure, or GCP) Experience with Apache Spark, Kafka, Databricks, and Airflow... 
    Databricks
    Amazon Web Service

    Georgia IT Inc

    New York, NY
    6 days ago
  •  ...Prism is seeking a highly skilled Data Engineer to work in a cloud-based team, primarily...  ...for large datasets using Databricks on platforms like Azure and AWS. The ideal candidate will possess...  ...experience in Data Engineering, along with a strong understanding of ETL processes... 
    Databricks
    Amazon Web Service
    Remote work

    Nps-Prism

    New York, NY
    2 days ago
  •  ...A premier recruitment agency is seeking a Lead Data Engineer for a remote role focused on delivering complex data solutions for enterprise...  ...of experience in data engineering, strong expertise in Databricks and AWS, and a proficiency in Python and SQL. This opportunity... 
    Databricks
    Amazon Web Service
    Remote work

    KDR Talent Solutions USA

    New York, NY
    2 days ago
  •  ...Job Title- Data Engineer Location- New York, NY 10112...  ...solutions in an agile environment, with a focus on rapid iteration and...  ...experience building pipelines in AWS and cloud databases....  ...into S3 as well as tabular schemas. Databricks experience preferred.
    Databricks
    Amazon Web Service

    campus4tech

    New York, NY
    1 day ago
  •  ...NPS Prism is looking for a Data Engineer with 3-6 years of experience to work remotely. The ideal candidate should have...  ...SQL, and PySpark, along with proven experience in Databricks and cloud platforms like Azure and AWS. Responsibilities include designing ETL workflows,... 
    Databricks
    Amazon Web Service
    Remote work

    NPS Prism

    New York, NY
    2 days ago
  •  ...Data Engineer Location: NJ / NY onsite USA (local to NJ or NY) Must have: (AWS, Azure, or GCP), and/or on-prem (MS SQL, SSIS, Oracle) and (RedShift, Snowflake, Databricks, Informatica, SSAS etc.) Requirements:...  ...~ Expertise working with platforms (AWS, Azure,... 
    Databricks
    Amazon Web Service
    Local area

    Damco

    Passaic, NJ
    1 day ago
  •  ...Data Engineer – Gen AI & RAG We are seeking an experienced Data Engineer with strong expertise in Generative AI, RAG architecture, and...  ...PySpark Work extensively with Databricks and Snowflake for enterprise...  ...environments such as Azure, AWS, or GCP Excellent troubleshooting... 
    Databricks
    Amazon Web Service

    Group Nine LLC

    New York, NY
    5 days ago
  •  ...Data Foundations Engineer The Data Foundations Engineer designs and scales modern...  ...analytics and ML use cases, with strong fundamentals in data...  ...). ~ Experience with AWS, Azure, or GCP. ~ Comfortable...  ...Experience with Snowflake, Databricks, Trino, OLAP/NRT systems, Superset... 
    Databricks
    Amazon Web Service

    Apolis

    New York, NY
    4 days ago
  •  ...technology research organization is seeking an AI Data Engineer to build scalable data pipelines and collaborate with data scientists on impactful AI...  ...and familiarity with cloud platforms like AWS and tools such as Databricks. The position offers the opportunity to contribute... 
    Databricks
    Amazon Web Service
    Remote work

    Pro Search

    New York, NY
    2 days ago
  •  ...EPAM Systems, Inc. is seeking a Lead Data Software Engineer (Python+AWS) to drive the design and development of...  ...Python and SQL, and expertise in AWS and Databricks. You will work in a dynamic environment while collaborating with multi-national teams. #J-18808-Ljbffr... 
    Databricks
    Amazon Web Service

    EPAM Systems Inc

    New York, NY
    2 days ago
  • A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal...  ...will possess a deep knowledge of AWS services and data orchestration tools like... 
    Databricks
    Amazon Web Service

    VySystems

    New York, NY
    5 days ago
  •  ...modern technology and data-driven decision-making....  ...Backed by a leadership team with deep industry expertise...  ...Skills 3+ years’ Data Engineering experience Strong SQL...  ...Cloud expertise (AWS, Azure, or GCP) Familiarity with Snowflake, Databricks, or BigQuery Knowledge... 
    Databricks
    Amazon Web Service
    Remote work

    Conscia Talent

    New York, NY
    2 days ago
  •  ...Data Engineer The Data Engineer will be building and improving our data...  ...and quality. Collaborate with senior engineers and cross-functional...  ...e.g., Google Cloud Platform, AWS, or Azure). ~ Understanding...  ...Hands-on experience with Databricks platform. Experience in Ad... 
    Databricks
    Amazon Web Service

    Software Technology Inc

    New York, NY
    1 day ago
  •  ...Job Description The Sr. Data Engineer will contribute to the Company's success by partnering with business, analytics and infrastructure...  ...Spark Snowflake Databricks Airflow or Prefect ~...  ...at least one cloud platform (AWS / Azure / GCP) Nice to have... 
    Databricks
    Amazon Web Service

    Tavant

    New York, NY
    4 days ago
  •  ...optimizing and maintaining data pipelines using...  ...the ground up. The Data Engineer will support software developers...  ...of Colombia or Argentina with the right to work in that...  ...transforming data using Databricks. 3+ years of experience with AWS. Experience with Git (CI/... 
    Databricks
    Amazon Web Service
    Remote work

    Workstate

    New York, NY
    2 days ago
  • $150k

     ...seeking a highly skilled Senior Data Engineer who can balance deep technical execution with growing leadership responsibilities...  ...expertise in SQL, PySpark, and Databricks, including job scheduling and...  ...understanding of cloud data ecosystems (AWS preferred) and data warehousing... 
    Databricks
    Amazon Web Service

    Soni Resources

    New York, NY
    4 days ago
  • Qualifications Strong expertise in Databricks Lakehouse architecture on AWS. Advanced hands-on experience with PySpark, Spark SQL, Delta Lake, and performance tuning. Experience...  ...Strong knowledge of AWS services used in data platforms Familiarity with data reconciliation... 
    Databricks
    Amazon Web Service

    VySystems

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AWS Data Engineer with Databricks Exp.. Be the first to apply!