AWS Data Engineer with Databricks Exp.
Magicforce
Overview: Senior-level engineer responsible for designing, building, and supporting cloud-based data pipelines and health insurance applications using AWS and Databricks. Role involves complex system integrations, data engineering, and working closely with distributed agile teams. Duties:
- Design, build, and maintain scalable data pipelines using AWS and Databricks
- Implement ETL/ELT processes to load data into data lakes and downstream systems
- Ensure data quality, accuracy, reliability, and observability
- Build and automate unit, integration, and performance tests
- Integrate internal systems, external vendors, mobile apps, and data marts
- Support and enhance retail health insurance applications
- Monitor pipelines and proactively resolve production issues
- Participate in all SAFe/Agile ceremonies
- Collaborate with engineering, business, architecture, security, and infrastructure teams
- 8+ years experience designing and architecting solutions from scratch
- Strong expertise in AWS Cloud Services , including:
- Glue, ECS/EKS, Fargate
- Redshift, Aurora, DocumentDB
- S3, Lambda, SNS, IAM, ECR
- Databricks expertise:
- Delta Live Tables (DLT)
- SQL, Spark, Python/PySpark
- Java
- Databricks workflows or Apache Airflow
- Strong understanding of:
- Data integration strategies
- ETL / ELT techniques
- Data warehousing principles
- Data transformation, quality, and observability
- Experience with DevOps practices , design patterns, and performance tuning
- Familiarity with BI & Governance Tools :
- Tableau
- Alation, Collibra
- Migration of large-scale on-prem data pipelines to Databricks (cloud)
- Experience with:
- Delta Lake, Iceberg, Apache Hudi
- Partitioning strategies & metadata management
- JSON/XML, document databases, real-time ingestion
- Lakehouse architecture, dimensional modeling, Data Vault
- Strong analytical and problem-solving abilities
- Excellent written and verbal communication
- Customer-facing, consultant mindset
- Ability to lead technically and influence architecture decisions
- Collaborative team player in distributed agile environments
- Bachelor's degree in Information Systems or related field
- Advanced degree (e.g., MBA) is a plus
- Equivalent experience accepted
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AWS Data Engineer with Databricks Exp. in Jersey City, NJ vacancy
- ...Title: Data Engineer Location: Jersey City, NJ (Day 1... ...min 6-7 years of exp good in python and... ...good knowledge of AWS AWS services - data... ...data is stored in cloud with data warehousing concept... ...AI/ML knowledge Databricks NoSQL Database....DatabricksAmazon Web Service
- ...Position Responsibilities Data Engineer Location : Jersey City, NJ / Columbus... ...Skills: Python/Spark/PySpark/AWS Job Description: THE... ...Migration project - MUST BE STRONG IN AWS. Databricks is a plus, if it's on the resume they...DatabricksAmazon Web ServiceRemote work
- ...Big Data Engineer Mandatory skills: Apache Spark/ Hive/ Kafka/ Amazon... ...Hadoop/ Presto/ Strong experience with MySQL, PostgreSQL, MongoDB,... ...using Apache Spark, Talend, AWS Glue, Google Dataflow, Apache... ...: Work with AWS, Azure, GCP, Databricks. Store and manage data with S...DatabricksAmazon Web Service
- ...Sr. Data Engineer Location: New York, NY Required Skills:... ...lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), at... ...similar) Proficiency with data structures, data... ...lines for each skill on your exp.) Python - 5 - 10 - I have...DatabricksAmazon Web Service
- ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where... ...compliance, and governance in line with industry and client standards... ...with cloud platforms (AWS, Azure, or GCP) and related data... ...services (e.g., S3, Snowflake, Databricks). Should be familiar...DatabricksAmazon Web ServiceRemote work
- ...bring deep expertise in Data Science, Machine Learning... ...seeking an experienced Data Engineer to join our data team. In... ...data infrastructure on AWS cloud. You will collaborate closely with data scientists, analysts... ...transformation workflows using Databricks, Apache Spark, and SQL to...DatabricksAmazon Web ServiceLocal area
$65 - $70 per hour
...Position: Data Engineer- AWS Location: Jersey City, New Jersey Duration: Contract Job... ...data scientists. Ensure compliance with data governance requirements and alignment... ...platforms such as AWS Data Lake, Databricks, or Hadoop. Proficiency in relational...DatabricksAmazon Web ServiceFull timeContract work$65 - $68.26 per hour
...Data Engineer Location: Jersey City, New Jersey (hybrid) Employment Type: Contract... ...workflows using Snowflake and Databricks. You will collaborate with data scientists, platform engineers... ...scalable ETL/ELT pipelines across AWS, GCP, and Azure. Analyze business...DatabricksAmazon Web ServiceHourly payContract work$83.12 - $87.12 per hour
...Genesis10 is currently seeking a QA Data Engineer - Hybrid position (3 days onsite)... ...experience as a Data Engineer with a focus on Quality Assurance... ...Experience with cloud data tools (e.g., AWS Glue, Azure Data Factory, Azure DataBricks) Experience working with QA analysts...DatabricksAmazon Web ServiceHourly payPermanent employmentContract workRemote workFlexible hours$106.9k - $176.5k
...in to shape your future with confidence. We’ll help... ...world. Technology – Data and Decision Science – Data Engineering – Senior We are seeking... ..., specifically Databricks. The ideal candidate will... ...on cloud platforms (e.g., AWS, Azure, GCP). Collaborate...DatabricksAmazon Web ServiceSummer holidayFlexible hours- ...Must Have skills: 1. Databricks 2. Snowflake 3. Designing... ...& pricing reference data to over 400+ consuming... ...for a hands on Data Engineer who is fluent in building... .../ELT pipelines across AWS, GCP, and Azure. You'll... ...and Databricks (Spark), with strong working...DatabricksAmazon Web ServiceImmediate start
$125.5k - $230.2k
...in to shape your future with confidence. We’ll help... ...world. Technology – Data and Decision Science – Data Engineering – Manager We are looking... ...with a strong focus on Databricks. The ideal candidate will... ...cloud platforms (e.g., AWS, Azure, GCP). Oversee...DatabricksAmazon Web ServiceSummer holidayFlexible hours- ...Applied AI/ML Engineer Are you ready to play a pivotal role in shaping the future of Data & Analytics? As a valued member... ...work in close coordination with various teams in Data & Analytics... ...: ~ Experience with AWS Cloud Platform and Databricks for deploying and...DatabricksAmazon Web ServiceWork experience placement
$55 per hour
...Data Engineer Location - New York, NY (Hybrid 2-3 days onsite) Rate... ...Scala and Java Experience with SQL and NoSQL databases (Teradata... ...Familiarity with cloud infrastructure (AWS, Azure, or GCP) Experience with Apache Spark, Kafka, Databricks, and Airflow...DatabricksAmazon Web Service- ...Prism is seeking a highly skilled Data Engineer to work in a cloud-based team, primarily... ...for large datasets using Databricks on platforms like Azure and AWS. The ideal candidate will possess... ...experience in Data Engineering, along with a strong understanding of ETL processes...DatabricksAmazon Web ServiceRemote work
- ...A premier recruitment agency is seeking a Lead Data Engineer for a remote role focused on delivering complex data solutions for enterprise... ...of experience in data engineering, strong expertise in Databricks and AWS, and a proficiency in Python and SQL. This opportunity...DatabricksAmazon Web ServiceRemote work
- ...Job Title- Data Engineer Location- New York, NY 10112... ...solutions in an agile environment, with a focus on rapid iteration and... ...experience building pipelines in AWS and cloud databases.... ...into S3 as well as tabular schemas. Databricks experience preferred.DatabricksAmazon Web Service
- ...NPS Prism is looking for a Data Engineer with 3-6 years of experience to work remotely. The ideal candidate should have... ...SQL, and PySpark, along with proven experience in Databricks and cloud platforms like Azure and AWS. Responsibilities include designing ETL workflows,...DatabricksAmazon Web ServiceRemote work
- ...Data Engineer Location: NJ / NY onsite USA (local to NJ or NY) Must have: (AWS, Azure, or GCP), and/or on-prem (MS SQL, SSIS, Oracle) and (RedShift, Snowflake, Databricks, Informatica, SSAS etc.) Requirements:... ...~ Expertise working with platforms (AWS, Azure,...DatabricksAmazon Web ServiceLocal area
- ...Data Engineer – Gen AI & RAG We are seeking an experienced Data Engineer with strong expertise in Generative AI, RAG architecture, and... ...PySpark Work extensively with Databricks and Snowflake for enterprise... ...environments such as Azure, AWS, or GCP Excellent troubleshooting...DatabricksAmazon Web Service
- ...Data Foundations Engineer The Data Foundations Engineer designs and scales modern... ...analytics and ML use cases, with strong fundamentals in data... ...). ~ Experience with AWS, Azure, or GCP. ~ Comfortable... ...Experience with Snowflake, Databricks, Trino, OLAP/NRT systems, Superset...DatabricksAmazon Web Service
- ...technology research organization is seeking an AI Data Engineer to build scalable data pipelines and collaborate with data scientists on impactful AI... ...and familiarity with cloud platforms like AWS and tools such as Databricks. The position offers the opportunity to contribute...DatabricksAmazon Web ServiceRemote work
- ...EPAM Systems, Inc. is seeking a Lead Data Software Engineer (Python+AWS) to drive the design and development of... ...Python and SQL, and expertise in AWS and Databricks. You will work in a dynamic environment while collaborating with multi-national teams. #J-18808-Ljbffr...DatabricksAmazon Web Service
- A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal... ...will possess a deep knowledge of AWS services and data orchestration tools like...DatabricksAmazon Web Service
- ...modern technology and data-driven decision-making.... ...Backed by a leadership team with deep industry expertise... ...Skills 3+ years’ Data Engineering experience Strong SQL... ...Cloud expertise (AWS, Azure, or GCP) Familiarity with Snowflake, Databricks, or BigQuery Knowledge...DatabricksAmazon Web ServiceRemote work
- ...Data Engineer The Data Engineer will be building and improving our data... ...and quality. Collaborate with senior engineers and cross-functional... ...e.g., Google Cloud Platform, AWS, or Azure). ~ Understanding... ...Hands-on experience with Databricks platform. Experience in Ad...DatabricksAmazon Web Service
- ...Job Description The Sr. Data Engineer will contribute to the Company's success by partnering with business, analytics and infrastructure... ...Spark Snowflake Databricks Airflow or Prefect ~... ...at least one cloud platform (AWS / Azure / GCP) Nice to have...DatabricksAmazon Web Service
- ...optimizing and maintaining data pipelines using... ...the ground up. The Data Engineer will support software developers... ...of Colombia or Argentina with the right to work in that... ...transforming data using Databricks. 3+ years of experience with AWS. Experience with Git (CI/...DatabricksAmazon Web ServiceRemote work
$150k
...seeking a highly skilled Senior Data Engineer who can balance deep technical execution with growing leadership responsibilities... ...expertise in SQL, PySpark, and Databricks, including job scheduling and... ...understanding of cloud data ecosystems (AWS preferred) and data warehousing...DatabricksAmazon Web Service- Qualifications Strong expertise in Databricks Lakehouse architecture on AWS. Advanced hands-on experience with PySpark, Spark SQL, Delta Lake, and performance tuning. Experience... ...Strong knowledge of AWS services used in data platforms Familiarity with data reconciliation...DatabricksAmazon Web Service
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AWS Data Engineer with Databricks Exp.. Be the first to apply!
Related searches
- junior big data engineer Jersey City, NJ
- senior data engineer Jersey City, NJ
- sr information security engineer Jersey City, NJ
- senior data integration developer Jersey City, NJ
- data developer Jersey City, NJ
- data engineer Jersey City, NJ
- data infrastructure engineer Jersey City, NJ
- entry level big data engineer Jersey City, NJ
- data engineer analytics Jersey City, NJ
- big data engineer Jersey City, NJ

