DataBricks Data Engineer
Globalchannelmanagement
Job Description
Job Description
DataBricks Data Engineer requires:
- Must have functional and technical experience with Sales Incentive Compensation (SIC) including incentive plan design, quota allocation, attainment tracking, commission calculations, and payout processing.
- At least 7 years of experience in data engineering, with a minimum of 3 years hands-on experience building and managing Databricks solutions.
- Extensive experience with Databricks platform components: Delta Lake, Delta Live Tables, Unity Catalog and Databricks Workflows.
- Strong proficiency in Python and/or Scala for data engineering; SQL expertise required.
- Strong experience with core data engineering practices including data ingestion, transformation (ETL/ELT), data modeling, and pipeline orchestration.
- Experience integrating Databricks with cloud platforms (Azure, AWS, or GCP) and data sources such as Azure Data Factory, Event Hubs, Kafka, or equivalent.
- Passion and ability to create holistic, end-to-end, integrated data solutions.
- Familiarity with SIC platforms (e.g., Anaplan, Oracle ICM, Varicent) and experience integrating them with data engineering platforms is a strong plus.
- Ability to understand complex incentive compensation rules and model them accurately in data pipelines and transformation logic
Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the DataBricks Data Engineer in New York, NY vacancy
- ...Data Engineers - this is one worth paying attention to. I’m working on a Data Engineering opportunity in NYC where you’ll help build... ...global data platform from the ground up. The big focus? Databricks. You’ll take real ownership of the data environment, building...DatabricksFull time
Saragossa
New York, NY2 days ago $74 per hour
DescriptionKforce's client in NYC is seeking a highly skilled Data Engineer with strong hands-on experience in Apache Spark/PySpark, AWS EMR, Databricks, and Snowflake. The Data Engineer will be responsible for designing and building scalable, high-volume data pipelines...DatabricksKForce
New York, NY1 day ago- Job ID: 25546234Reference Number: 25-00476Title: Data EngineerLocation: New York, NYPosted Date: 2025-05-19Contact: Rishabh PandeyContact... ...data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (...Databricks
HAN Staffing
New York, NY5 days ago - ...This role sits at the foundation of a brand-new data engineering function at a boutique global hedge fund entering its next phase of growth... ...series or tick data specifically Familiarity with Spark, Databricks, or other large-scale processing frameworks Prior...DatabricksFull timeImmediate start
Mondrian Alpha
New York, NY4 days ago - ...growing global financial services firm is looking for a Senior Data Engineer as they expand their Enterprise Data Team in the US. With... ...architecture Work with a modern tech stack including Databricks, AWS, Python, SQL, Spark and CI/CD Build scalable data pipelines...DatabricksFull time
twentyAI
New York, NY1 day ago - ...As a Senior Data Engineer you will own the design and delivery of complex data engineering solutions that power enterprise analytics, AI... ...of ELT/ETL frameworks using SQL, Python, Azure Data Factory, Databricks, and Azure Synapse Analytics. Establish pipeline reliability...DatabricksFull time
PRI Technology
New York, NY2 days ago - ...Senior Data Engineer The ideal candidate is a hands-on engineer with strong experience across Snowflake, dbt, Apache Airflow, SQL, Python... .../ data warehouses . Exposure to platforms such as Databricks, AWS, Azure, Power BI, Sigma, iLevel, or similar financial/data...DatabricksFull time
The Phoenix Group
New York, NY3 days ago - ...EXL is seeking a Senior Data Engineer to join our Data & Analytics practice and support strategic client engagements. This role will be... ...and PySpark. ~ Extensive experience working with Snowflake, Databricks, or similar cloud-native data platforms. ~ Proven experience...DatabricksFull timeLocal areaRelocation
EXL
New York, NY2 days ago $45 per hour
...Summer 2027 Data Engineer Intern – Alternative Data Location: New York, NY | Hybrid Program Duration: Summer 2027 (10-12 Weeks) (... ...retrieval systems. Work with cloud-based technologies (AWS, Databricks, Snowflake) to process structured and unstructured datasets....DatabricksHourly payPart timeSummer workInternshipSummer internshipWork at officeM Science
New York, NY4 days ago$100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders OnlyNo c2c - W2 OnlyQualifications:A Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering...DatabricksRemote workOpen Systems Technologies
New York, NY4 days ago- ...3 Must Have Skills:Informatica workflow design and implementation requiredAWS data engineering (Glue, Lambda, EventBridge Cradle, S3) highly preferredFormer Informatica experience, Databricks, SnowflakeNice to Haves:Apache AirflowSomeone who is fun and exciting with lots...DatabricksWork at office
Ampcus
New York, NY5 days ago $10k
...relationship, for all. About the Role: As a Senior Data Engineer at Hinge, you will create essential data processes and contribute... ..., BigQuery). and CI/CD technologies (CircleCI), Spark, Databricks Factors such as scope and responsibilities of the position...DatabricksFull timeWork experience placementHinge
New York, NY3 days ago$140k - $155k
...Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and... ...and business users. Python/SQL Server/Snowflake/Databricks application development and system design. Develop and...DatabricksFull timeTemporary workFlexible hoursSynechron
New York, NY4 days ago- ...you'll doYou will build the foundational data infrastructure that powers cutting-edge... ...learn to translate simple hypotheses into engineered features, manage secure data... ...reliability with commonly used data platforms (Databricks, Snowflake, BigQuery, PSQL, etc.) and data...DatabricksApprenticeshipWork at officeLocal areaEasy work
McKinsey & Company
New York, NY2 days ago - ...Senior Consultant, Data Engineering (L4) About Vivanti Vivanti is a home for high-performing technologists who drive measurable impact... ...~ Demonstrated proficiency in SQL, Python, AWS, Azure, GCP, Databricks, Snowflake, GIt, CI/CD, ML/AI, Spark, Airflow, ETL/ELT ~6–...DatabricksFull timeWork at officeWork from homeFlexible hoursShift work
Vivanti Consulting
New York, NY1 day ago $100k - $140k
...bonusesResponsibilitiesWe are hiring a hands-on senior level Data Engineer to build trustworthy, well governed data products and turn them... ...with modern lakehouse platforms (e.g., Microsoft Fabric, Databricks, Snowflake, AWS)Experience building data solutions in cloud environments...DatabricksWork at officeRemote work3 days per weekGUARD Insurance Group
New York, NY3 days ago$180k - $210k
...Senior Analytics Engineer Hybrid- Midtown Direct Hire $180,000-$210,000 A rapidly... ...growing Fintech in NYC is scaling its data team and hiring a Senior Analytics Engineer... ...(BigQuery, Snowflake, Redshift, or Databricks). BigQuery is the actual stack, but the...DatabricksFull timeContract workConsultNet Technology Services and Solutions
New York, NY6 hours ago$175k - $240k
...successful and growing investment management firm seeking a Senior Data Engineer to help modernize and transform its enterprise data platform.... ...dbt experienceExperience with Azure, Azure Data Factory, Databricks, or SynapsePower BI or similar business intelligence...DatabricksRemote workSolomon Page
New York, NY5 days ago- ...Peraton seeks a Junior Data Engineer to support a federal data migration program, developing and deploying ETL pipelines in a cloud data lakehouse, focusing on Databricks Delta Live Tables, GIS and geospatial data. This fully remote role requires U.S. citizenship and ability...DatabricksRemote work
Peraton
New York, NY16 hours ago - ...Position: Senior Databricks Architect – MS Fabric & P&C Insurance Location: New York, NY – Hybrid (3 Days/Week Onsite) |... ...Senior Databricks Architect with 12+ years of experience in data architecture, engineering, and cloud-based data platforms. Candidate should have...Databricks3 days per week
J RAM IT Consulting
New York, NY3 days ago $190k - $220k
...role and will be assessed during the interview process.The Data Engineering team builds tools and systems that make Gusto's data consistent... ...on cloud platforms like Snowflake, Redshift, BigQuery, or Databricks.Experience implementing CI/CD pipelines, automated testing,...DatabricksFull timeWork at officeLocal area2 days per week3 days per weekGusto
New York, NY3 days ago$128.01k - $152.18k
...with confidence.Job DescriptionAI-First Data Strategy for P&C Insurance Carrier | Lead... ...SolutionsWe are seeking a Senior Data Engineer to spearhead our transition to a modern,... ...modern data platforms (e.g., Snowflake; Databricks, big data, analytics) relevant to P&C insurance...DatabricksFull timeWork at officeLocal areaArgo Group
New York, NY2 days ago- ...ResponsibilitiesOur Product DE organization is looking for a Senior Data Engineer reporting to the Senior Data Engineering Manager. You will be... ...framework or similar scheduling tools.Experience with Databricks and its APIs.Experience with modern databases (Redshift, Dynamo...DatabricksWork at officeLocal area
Atlassian
New York, NY4 days ago - ...Fluent, Inc. is seeking a seasoned Data Engineer to design and operate data pipelines, models, and data products powering Audience Solutions... ...translate business needs into scalable pipelines within the Databricks Lakehouse. Ideal candidates have 4+ years of data engineering...DatabricksRemote work
Fluent
New York, NY1 day ago - ...Truelogic is seeking a Data Engineer with 5–7 years of hands-on experience to join our client’s team. You will design, build, and maintain... ...pipelines for large‑scale data processing using PySpark and Databricks. You will optimize performance, ensure data quality and...DatabricksRemote work
TrueLogic Company
New York, NY1 day ago - ...Peraton is seeking a Junior Data Engineer with ETL development and geospatial data experience to support the data engineering workstream... ...(DOI) and agencies leverage your skills to build integrated ESA datasets, working with Python/SQL and Databricks, #J-18808-Ljbffr...DatabricksRemote work
Royper Royco LLC
New York, NY19 hours ago - RESPONSIBILITIES: Kforce's client in NYC is seeking a highly skilled Data Engineer with strong hands-on experience in Apache Spark/PySpark, AWS EMR, Databricks, and Snowflake. The Data Engineer will be responsible for designing and building scalable, high-volume data...DatabricksHourly payContract work
- ...Truelogic is seeking a skilled Data Engineer with 5–7 years of hands-on experience to join a nearshore team delivering data solutions.... ...in a fully remote capacity. The role emphasizes PySpark and Databricks proficiency, strong problem-solving, and clear communication...DatabricksRemote work
TrueLogic Company
New York, NY1 day ago $180k - $220k
...unlocks the magic of frictionless experiences.We’re looking for a Data Engineer II to help us build the next generation of products which... ..., Luigi, etcBig data tools like Spark, Kafka, Snowflake, Databricks, etcCollaboration, integration, and deployment tools like Github...DatabricksCasual workWork at officeFlexible hoursSecure Identity
New York, NY3 days ago- ...Data Engineers – Global Investment Firm | New York & London Build the data platform behind trading, research and risk at a top-tier investment... ...Must-haves ~ Hands-on experience with both Snowflake and Databricks ~ Excellent Python (including PySpark) and SQL, plus Spark,...DatabricksFull timeVisa sponsorship
$30 Global Investment Firm
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DataBricks Data Engineer. Be the first to apply!
Related searches
- data systems engineer New York, NY
- finance data engineer New York, NY
- data engineer contract New York, NY
- big data devops engineer New York, NY
- sr data engineer New York, NY
- senior data engineer New York, NY
- entry level big data engineer New York, NY
- principal data engineer New York, NY
- data engineer graduate New York, NY
- etl data engineer New York, NY