DataBricks Data Engineer
Globalchannelmanagement
Job Description
Job Description
DataBricks Data Engineer requires:
- Must have functional and technical experience with Sales Incentive Compensation (SIC) including incentive plan design, quota allocation, attainment tracking, commission calculations, and payout processing.
- At least 7 years of experience in data engineering, with a minimum of 3 years hands-on experience building and managing Databricks solutions.
- Extensive experience with Databricks platform components: Delta Lake, Delta Live Tables, Unity Catalog and Databricks Workflows.
- Strong proficiency in Python and/or Scala for data engineering; SQL expertise required.
- Strong experience with core data engineering practices including data ingestion, transformation (ETL/ELT), data modeling, and pipeline orchestration.
- Experience integrating Databricks with cloud platforms (Azure, AWS, or GCP) and data sources such as Azure Data Factory, Event Hubs, Kafka, or equivalent.
- Passion and ability to create holistic, end-to-end, integrated data solutions.
- Familiarity with SIC platforms (e.g., Anaplan, Oracle ICM, Varicent) and experience integrating them with data engineering platforms is a strong plus.
- Ability to understand complex incentive compensation rules and model them accurately in data pipelines and transformation logic
Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the DataBricks Data Engineer in New York, NY vacancy
- ...Databricks is seeking a Forward Deployed Engineer (FDE) to collaborate with customers to design, build, and productionize data and AI solutions on the Databricks platform. You will own the architecture, lead design decisions, and implement end-to-end systems spanning...Databricks
Menlo Ventures
New York, NY1 day ago - ...Data Engineer Key skills are very strong SQL capability, data pipelines management, Python, and Airflow. Location is New York, mandatory... ...to develop DAGS. Expert in data warehouses like BigQuery, Databricks Deltalakehouse and how to programmatically ingest, cleanse,...Databricks3 days per week
Yochana
New York, NY1 day ago - ...Required Skills and Experience: Proven experience as a Data Engineer or in a similar role with a focus on Snowflake, Python, Pyspark... ...Preferred Qualifications: Good Knowledge in Azure and Databricks in highly preferred. Knowledge of Apache Kafka or other...Databricks
Saxon Global
New York, NY3 days ago - ...Job Title: Data Engineer Duration: 12 months contract with high possibility of extension Location: New York City, NY 10003 (Onsite... ...banking and treasury data from Kyriba into Snowflake and Databricks. Develop and own canonical data models and schemas for cash positions...DatabricksContract work
Tech Providers
New York, NY3 days ago - Data Modeling Specialist Candidate should have strong understanding of Medallion Architecture in Databricks. Design and maintain conceptual, logical, and physical data models. Ability to handle large-scale, enterprise-wide domains (cross-functional data). Define and enforce...Databricks
- Job Details: • Databricks, Azure Data Factory, Databricks workflows, PySpark, Python, Databricks SQL • Data Modeling • Databricks, Azure Data Factory, Databricks workflows, PySpark, Python, Databricks SQL • Config driven data pipelines • Databricks Genie conversational...Databricks
- ...Job Description: Job Title: Databricks Data Engineer We are seeking a skilled and experienced Databricks Data Engineer to join our team. As a Databricks Data Engineer, you will be responsible for designing, developing, and implementing data engineering...Databricks
GCB Services LLC
New York, NY2 days ago - ...Graph Data Engineer NYC, NY - 3 days on site Long Term Consulting Assignment **Onsite Interview Required Position Overview... ...with full stack development lifecycle including Integration and UI development. Experience with Spark and Databricks....Databricks
3B Staffing LLC
New York, NY2 days ago - Qualifications Strong expertise in Databricks Lakehouse architecture on AWS. Advanced hands-on experience with PySpark, Spark SQL, Delta... ...and scheduling Strong knowledge of AWS services used in data platforms Familiarity with data reconciliation, observability,...Databricks
$100 - $130 per hour
...A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hr US Citizens or GC Holders Only No c2c - W2 Only Qualifications: A Bachelor's Degree in Computer Science, Management Information...DatabricksRemote workOpen Systems Technologies
New York, NY1 day ago- ...Razor is looking for a Data Engineer with experience in clinical data who designs and builds scalable data ingestion pipelines to normalize... ...with RAF/HCC, HEDIS, Stars Experience with Snowflake, Databricks, Redshift, BigQuery, Airflow, dbt Knowledge of CMS/HIPAA requirements...DatabricksFull timeTemporary workImmediate startRemote work
Razor USA
New York, NY4 days ago $108.8k - $136k
...to transform pharmacy benefits and healthcare navigation as a Data Engineer II (Analytics Engineer). You will build and maintain reliable... ...) and scheduling best practices • Familiarity with Spark/Databricks and cloud data warehouses (Snowflake preferred) • CI/CD for...DatabricksLocal areaFlexible hoursCapital Rx
New York, NY2 days ago- Job Description: Senior ML Data Engineer Feature Engineering ETL Qualifications 7 years in data engineering and at least 4 years focusing... ...preparation for ML Proven experience managing pipelines on Databricks using Apache Spark with a strong understanding of the...DatabricksRemote job
- ...Senior/Lead Data Engineer Remote - CST 50/hr on W2 Position Summary Seeking a hands-on Senior/Lead Data Engineer with... ...ELT, dimensional data warehousing, Python, CI/CD, and AWS or Databricks, with technical ownership expected at the Lead level. Key...DatabricksRemote work
Diverse Lynx
New York, NY10 hours ago - A technology solutions firm is looking for a Lead Data Engineer to work remotely on building end-to-end data solutions. The ideal candidate... ...with AI/ML teams. The position requires strong skills in Databricks, Python, and SQL, along with relevant experience in cloud environments...DatabricksRemote job
- ...successful and growing investment management firm seeking a Senior Data Engineer to help transform and modernize its enterprise data platform.... ...Experience with Azure, Azure Data Factory, Databricks, or Synapse. Experience migrating data platforms from SQL...DatabricksWork at officeImmediate startWork from home
Solomon Page
New York, NY4 days ago $73k - $98k
...competitive portfolio of benefits to its employees. Role Description We are seeking a Databricks Engineer with AWS expertise to build, optimize, and maintain our enterprise data Lakehouse infrastructure. In this role, you will be responsible for designing high-...DatabricksWork at officeLocal areaWork from homeWorldwideSumitomo Mitsui Financial Group, Inc.
New York, NY3 days ago$175k - $250k
...leveraging innovations in technology and data science to solve complex problems for... ...portfolio managers, risk managers and other engineers to develop data intensive and multi-... ...such as Snowflake, ClickHouse, Spark, or Databricks, along with monitoring and observability...DatabricksFlexible hoursMillennium
New York, NY1 day ago- Overview We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams... ...with modern data engineering technologies such as Spark, Databricks, Trino, Iceberg, Snowflake, Parquet, Apache Arrow, Polars, and...Databricks
- Data Engineer Company: Penn Foster Group Work Type: Remote Employment: Full Time Location: US Seniority: Senior Level Technologies: Databricks, SQL, Python, Spark, MLOps, Jira, Git, Tableau Requirements: 5+ years data engineering, SQL, Python, Spark; Databricks; Azure;...DatabricksFull timeRemote work
- Data Engineer Company: Prominence Advisors Work Type: Remote Employment: Full Time Location: US Seniority: Mid Level Technologies: Snowflake, Databricks, Azure Data Factory, AWS Redshift, Google BigQuery, dbt, Apache Airflow Requirements: 2-5+ years in data engineering...DatabricksFull timeRemote work
$110k - $130k
...technical lead for CLEARBROOK s enterprise data platform, responsible for end to end... ...on expertise in Snowflake, strong data engineering fundamentals, and the ability to integrate... ...Integration with external ML platforms (Databricks / SageMaker / Azure ML where applicable)...DatabricksTata Consultancy Services
New York, NY4 days ago- Job Details Job Title: Snowflake Data Engineer Location: Cincinnati, OH Duration: 6 months Experience Required: 8-10 years Role Overview... ...with cloud and data technologies, including: Azure Snowflake Databricks Microsoft Fabric Proven ability to deliver: High-quality data...Databricks
$135k - $160k
...well-being. How can you make an impact? The Senior Data Engineer in Data and Analytics is responsible for advancing McGraw-Hill... ...as S3, Glue, Redshift, Lambda, EMR, and Step Functions) and Databricks (leveraging Delta Lake, Unity Catalog, and MLflow where applicable...DatabricksRemote workMcGraw-Hill Education
New York, NY1 day ago- Mandatory Skills: Ability to interpret, modify and write scripts and SQL queries Apps/.Net Developer Azure Cloud Data Engineer Azure Databricks Azure Data Factory Azure logic App Power BI Report Server PythonDatabricks
RIT Solutions, Inc.
New York, NY4 days ago - ...Data Engineer Opportunity At Independence Pet Holdings Established in 2021, Independence Pet Holdings is a corporate holding company... ...ecosystem. Implement modern data solutions using tools like dbt, Databricks, ELT frameworks, and other cloud platforms (AWS, Snowflake)....DatabricksTemporary workWork at officeRemote workFlexible hours
Independence Pet Group
New York, NY20 hours ago $220k - $300k
...Overview The Data Engineer, Mortgage Servicing on the Nebula team acts as the mortgage servicing data subject matter expert and plays... ...or lakehouse platforms such as Snowflake, BigQuery, Redshift, Databricks, or equivalent technologies. Experience with streaming and...DatabricksLocal areaRemote workFlexible hoursLakeview Loan Servicing
New York, NY3 days ago- ...Agency is partnered with an established client to fill a remote Data Engineer IV position on a team we have successfully supported for a... ...architectures. Expert-level proficiency with SQL, Spark, Python, Databricks, Delta Lake, Azure Data Factory, and distributed processing....DatabricksRemote jobPermanent employment
- Data Engineer Location: Bellevue, WA (Remote) Job Type: Full time Permanent Roles & Responsibilities: Automated Incident Detection & Remediation... ...data platform services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Microsoft Fabric Experience...DatabricksPermanent employmentFull timeRemote workShift work
- Sr. Data Engineer Type: Remote Duration: Long Term Requirement: Candidate must have: Proficiency in Python, SQL, GCP tools, clean rooms (Google, Databricks), Kafka or similar streaming tools, and strong understanding of retail media and campaign KPIs. Nice to have: Experience...DatabricksLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DataBricks Data Engineer. Be the first to apply!
Related searches
- aws data engineer New York, NY
- director data engineering New York, NY
- data platform engineer New York, NY
- data engineer machine learning New York, NY
- data science developer New York, NY
- senior data engineer New York, NY
- finance data engineer New York, NY
- bi data engineer New York, NY
- principal data engineer New York, NY
- big data devops engineer New York, NY