Senior Databricks Data Engineer
Full-time
SFE
Must Have Technical/Functional Skills:
- Databricks, PySpark, Spark SQL and Delta Lake
- Auto Loader, Structured Streaming, AWS S3 and ETL/ELT
- Workflow orchestration, Git/CI/CD and performance tuning
- Data validation, reconciliation and production support
Roles & Responsibilities:
- Design and build production Databricks ingestion and transformation pipelines
- Implement batch/streaming processing and Delta Lake optimization
- Automate deployment and scheduling through CI/CD and workflows
- Monitor, reconcile and troubleshoot data pipelines
In addition, should be able to do the following
1. Play the role of onsite co-Ordinator for offshore
2. Able to conduct RCA and provide and Implement solutions
Generic Managerial Skills, If any
Customer-facing communication and concise executive reporting
Onsite offshore coordination across distributed teams
Structured ownership, prioritization, risk escalation and collaboration
Ability to work independently while following enterprise governance and security standards
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Databricks Data Engineer in New York, NY vacancy
- ...rapidly growing global financial services firm is looking for a Senior Data Engineer as they expand their Enterprise Data Team in the US.... ...engineering architecture Work with a modern tech stack including Databricks, AWS, Python, SQL, Spark and CI/CD Build scalable data...DatabricksSeniorFull time
twentyAI
New York, NY1 day ago - ...Senior Data Engineer The ideal candidate is a hands-on engineer with strong experience across Snowflake, dbt, Apache Airflow, SQL, Python... ...lakehouses / data warehouses . Exposure to platforms such as Databricks, AWS, Azure, Power BI, Sigma, iLevel, or similar financial/...DatabricksSeniorFull time
The Phoenix Group
New York, NY3 days ago - ...EXL is seeking a Senior Data Engineer to join our Data & Analytics practice and support strategic client engagements. This role will be responsible... ...PySpark. ~ Extensive experience working with Snowflake, Databricks, or similar cloud-native data platforms. ~ Proven...DatabricksSeniorFull timeLocal areaRelocation
EXL
New York, NY2 days ago - ...Summary They are looking for a skilled Data Engineer with 5–7 years of experience to join... ...Stack: Work extensively with PySpark and Databricks to execute complex data transformations... ...Professionals: Join forces with senior talent. All of our team members are seasoned...DatabricksSeniorRemote work
Truelogic Software LLC
New York, NY1 day ago $10k
...find a relationship, for all. About the Role: As a Senior Data Engineer at Hinge, you will create essential data processes and... ...Dataflow, BigQuery). and CI/CD technologies (CircleCI), Spark, Databricks Factors such as scope and responsibilities of the position...DatabricksSeniorFull timeWork experience placementHinge
New York, NY3 days ago- ...Data Engineers – Global Investment Firm | New York & London Build the data platform behind... .... One Lead Data Engineer and three mid/senior individual contributors. London: one... ...on experience with both Snowflake and Databricks ~ Excellent Python (including PySpark...DatabricksSeniorFull timeVisa sponsorship
$30 Global Investment Firm
New York, NY3 days ago - Truelogic is seeking a Data Engineer with 5-7 years of hands-on experience to join our client’s team. You will design, build, and maintain... ...pipelines for large‑scale data processing using PySpark and Databricks. You will optimize performance, ensure data quality and...DatabricksSeniorRemote job
- OpenKrill is seeking a Data Engineer with 5-7 years of hands-on experience to join our client team. You will design, build, and optimize ETL pipelines using PySpark and Databricks, delivering scalable data solutions across business units. You’ll collaborate with engineering...DatabricksSeniorRemote job
- Talantir in the United States is seeking a data engineer specialized in ML feature engineering and pipeline development. You will build and maintain feature pipelines in Databricks, integrate multiple data sources, and support ML model training and deployment with MLflow...DatabricksSenior
- Truelogic is seeking a Data Engineer with 5-7 years of hands-on experience to join our client’s team. You will design and optimize ETL pipelines... ...ensure scalable, fault-tolerant workflows using PySpark and Databricks. You will collaborate with cross-functional teams, implement...DatabricksSeniorRemote job
$140k - $155k
...Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy... ...seeking a highly skilled and experienced Senior Data Engineer to join our dynamic... ...users. Python/SQL Server/Snowflake/Databricks application development and system...DatabricksSeniorFull timeTemporary workFlexible hoursSynechron
New York, NY4 days ago- ...Senior Consultant, Data Engineering (L4) About Vivanti Vivanti is a home for high-performing technologists who drive measurable impact for... ...Demonstrated proficiency in SQL, Python, AWS, Azure, GCP, Databricks, Snowflake, GIt, CI/CD, ML/AI, Spark, Airflow, ETL/ELT...DatabricksSeniorFull timeWork at officeWork from homeFlexible hoursShift work
Vivanti Consulting
New York, NY1 day ago - Stermedia .ai is seeking an experienced Senior Data Engineer to join a global data platform for a leading pharmaceutical organization. You will design and build scalable data pipelines on Databricks, integrating data from laboratories, manufacturing, logistics, and operations...DatabricksSeniorRemote job
- Accord Technologies Inc in New York, NY seeks a Senior Data Integration Engineer with Credit Risk experience to own end-to-end data pipelines for... ...requirements into robust, scalable data solutions using Databricks, PySpark, and cloud #J-18808-Ljbffr Accord Technologies...DatabricksSenior
$180k - $210k
...overview of this opportunity below. Senior Analytics Engineer Hybrid- Midtown Direct Hire $1... ...growing Fintech in NYC is scaling its data team and hiring a Senior Analytics... ...warehouse (BigQuery, Snowflake, Redshift, or Databricks). BigQuery is the actual stack, but...DatabricksSeniorContract workConsultNet Technology Services and Solutions
New York, NY4 days ago- Senior Data Engineer - Remote job vacancy in South Africa. A well establish international software development company is looking for a Senior... ...for you. Requirements: Experience with Python, SQL, Spark, Databricks (Unity Catalog and Delta), Apache Airflow and GCP (GCS and...DatabricksSeniorRemote jobPermanent employmentContract workWork at office1 day per week
- ..., and governance mechanisms across enterprise data platforms. Key Responsibilities Develop... ...handling. Required Technical Skills Data Engineering Python SQL PySpark Scala Data Platforms Databricks Delta Lake Integration REST APIs Git...DatabricksSenior
Ampcus Incorporated
New York, NY5 days ago - Stermedia .ai is looking for an experienced Senior Data Engineer with strong Databricks expertise to join a data platform team building a global analytics environment for a leading pharmaceutical organization. The platform integrates data from more than 80 facilities worldwide...DatabricksSeniorRemote workWorldwideFlexible hours
$3,000 per month
Become a Senior Data Engineer at Bloomreach Bloomreach is building the world’s premier agentic platform for personalization.We’re revolutionizing... ...domain) — making Bloomreach data first‑class in customer Databricks. The strategic goal for 27 is to use Databricks to...DatabricksSeniorFull timeRemote workFlexible hours$124k - $280k
...Health Services Specialism Data, Analytics & AI Management Level Senior Manager Job Description &... ...our people in data and analytics engineering focus on leveraging advanced technologies... ...including Snowflake or Databricks Experience working with...DatabricksSeniorH1bPricewaterhouseCoopers
New York, NY3 days ago- Blue Orange Digital is hiring a Solutions Architect/Sales Engineer to own engagements from discovery to production. You will run technical... ...and build reference architectures and PoCs with Snowflake and Databricks. Remote-first with client travel as needed. Expect 5+ years in...DatabricksSeniorRemote work
- ...Description Job Description We are seeking a hands-on Senior AI / Data Engineer to build and deploy production-grade Agentic AI and multi-... ...integration, and enterprise AI applications. Experience with Databricks, Azure, AWS, or GCP. Strong Python and data engineering...DatabricksSenior
Highbridge Consulting LLC
New York, NY3 days ago $200k - $275k
...Job Description Job Description Founding Data Engineer — AI Healthcare The Opportunity Our client is building an AI-powered healthcare... ...ML training datasets and feature pipelines SageMaker, Databricks, or Jupyter environments ClickHouse or high-volume event...DatabricksSeniorImmediate start- ...Job Description Job Description Role: Senior Data Engineer (Databricks) Location: NYC, NY (or), Seattle, WA (or), Irvine, CA (or), Los Angeles, CA (Hybrid) Project description We are seeking a seasoned professional whose role sits at the intersection of platform...DatabricksSeniorFor contractors
$190.8k - $238.8k
...Raleigh, London, and Amsterdam. Making data-driven decisions is key to Plaid's... ...golden datasets and tooling to teams across engineering, product, and business and help them explore... ...and data lakes; Redshift, Snowflake, Databricks. ~ You have experience building...DatabricksSeniorRemote jobFull timeWork experience placementLocal areaFlexible hours- ...thrilled to welcome you aboard. LET’S GO! Sr. Manager Analytics Engineer, Content Data Req - 46420 Overview And Responsibilities Paramount... ...: Build scalable, performant datasets in platforms such as Databricks, Looker, and Snowflake to enable self-service analytics for...DatabricksSenior
- ...harness Internet of Things (IoT) data to develop actionable... ...Marketing Data and Analytics (MDA) Engineering team, you will shape the... ...peers. You will architect core Databricks pipelines, Gold Layer tables,... ...of what ships. - Serve as the senior technical lead for the team's...DatabricksSeniorFull time
- ...Data Engineers - this is one worth paying attention to. I’m working on a Data Engineering opportunity in NYC where you’ll help build... ...global data platform from the ground up. The big focus? Databricks. You’ll take real ownership of the data environment, building...DatabricksFull time
Saragossa
New York, NY2 days ago - ...Senior/Lead Machine Learning Engineer | New York, NY Lawrence Harvey has been engaged by a fast-growing technology company operating at the intersection... ...software, with exposure to technologies such as AWS, Databricks, Kubernetes, and real-time model serving environments....DatabricksSeniorFull time
Lawrence Harvey
New York, NY2 days ago $229.9k - $262.4k
...Overview Data Engineer 5 (Senior Manager, IC) Do you love building and pioneering in the technology space? Do you enjoy solving complex... ..., and cloud-based data warehousing platforms including Databricks and Snowflake Share your passion for staying on top of...DatabricksSeniorFull timePart timeInternshipLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Databricks Data Engineer. Be the first to apply!
Related searches
- junior big data engineer New York, NY
- principal data engineer New York, NY
- data visualization developer New York, NY
- junior data engineer New York, NY
- senior data center engineer New York, NY
- senior data engineer New York, NY
- data infrastructure engineer New York, NY
- data engineering intern summer New York, NY
- big data developer New York, NY
- staff data engineer New York, NY