DataBricks Data Engineer
Globalchannelmanagement
Job Description
Job Description
DataBricks Data Engineer requires:
- Must have functional and technical experience with Sales Incentive Compensation (SIC) including incentive plan design, quota allocation, attainment tracking, commission calculations, and payout processing.
- At least 7 years of experience in data engineering, with a minimum of 3 years hands-on experience building and managing Databricks solutions.
- Extensive experience with Databricks platform components: Delta Lake, Delta Live Tables, Unity Catalog and Databricks Workflows.
- Strong proficiency in Python and/or Scala for data engineering; SQL expertise required.
- Strong experience with core data engineering practices including data ingestion, transformation (ETL/ELT), data modeling, and pipeline orchestration.
- Experience integrating Databricks with cloud platforms (Azure, AWS, or GCP) and data sources such as Azure Data Factory, Event Hubs, Kafka, or equivalent.
- Passion and ability to create holistic, end-to-end, integrated data solutions.
- Familiarity with SIC platforms (e.g., Anaplan, Oracle ICM, Varicent) and experience integrating them with data engineering platforms is a strong plus.
- Ability to understand complex incentive compensation rules and model them accurately in data pipelines and transformation logic
Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the DataBricks Data Engineer in New York, NY vacancy
- ...Databricks is seeking a Forward Deployed Engineer (FDE) to collaborate with customers to design, build, and productionize data and AI solutions on the Databricks platform. You will own the architecture, lead design decisions, and implement end-to-end systems spanning...Databricks
Menlo Ventures
New York, NY1 day ago - ...Data Engineer Key skills are very strong SQL capability, data pipelines management, Python, and Airflow. Location is New York, mandatory... ...to develop DAGS. Expert in data warehouses like BigQuery, Databricks Deltalakehouse and how to programmatically ingest, cleanse,...Databricks3 days per week
Yochana
New York, NY1 day ago - ...Required Skills and Experience: Proven experience as a Data Engineer or in a similar role with a focus on Snowflake, Python, Pyspark... ...Preferred Qualifications: Good Knowledge in Azure and Databricks in highly preferred. Knowledge of Apache Kafka or other...Databricks
Saxon Global
New York, NY3 days ago - ...Job Title: Data Engineer Duration: 12 months contract with high possibility of extension Location: New York City, NY 10003 (Onsite... ...banking and treasury data from Kyriba into Snowflake and Databricks. Develop and own canonical data models and schemas for cash positions...DatabricksContract work
Tech Providers
New York, NY3 days ago - ...GCP preferred!! but Azure, AWS are okay. ETL, ELT, Data Streaming, Data Sharing Strong data engineering background Python preferred or Scala Retail Data Experience... ...Information Data is the focus. Understand the Databricks platform and how it works inside and out - data...Databricks
- Job Details: • Databricks, Azure Data Factory, Databricks workflows, PySpark, Python, Databricks SQL • Data Modeling • Databricks, Azure Data Factory, Databricks workflows, PySpark, Python, Databricks SQL • Config driven data pipelines • Databricks Genie conversational...Databricks
- Senior Databricks Data Engineer (Azure Databricks | Lakehouse | ETL/ELT) Austin, Texas (Hybrid - 3 Days Remote | Onsite Every Monday & Thursday) Experience: Minimum 12+ Years Mandatory Requirements • Databricks Certified Data Engineer (Associate or Professional) • Azure...DatabricksLocal areaRemote work
- Data Modeling Specialist Candidate should have strong understanding of Medallion Architecture in Databricks. Design and maintain conceptual, logical, and physical data models. Ability to handle large-scale, enterprise-wide domains (cross-functional data). Define and enforce...Databricks
- ...Job Description: Job Title: Databricks Data Engineer We are seeking a skilled and experienced Databricks Data Engineer to join our team. As a Databricks Data Engineer, you will be responsible for designing, developing, and implementing data engineering...Databricks
GCB Services LLC
New York, NY2 days ago - ...Graph Data Engineer NYC, NY - 3 days on site Long Term Consulting Assignment **Onsite Interview Required Position Overview... ...with full stack development lifecycle including Integration and UI development. Experience with Spark and Databricks....Databricks
3B Staffing LLC
New York, NY2 days ago - Qualifications Strong expertise in Databricks Lakehouse architecture on AWS. Advanced hands-on experience with PySpark, Spark SQL, Delta... ...and scheduling Strong knowledge of AWS services used in data platforms Familiarity with data reconciliation, observability,...Databricks
$100 - $130 per hour
...A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hr US Citizens or GC Holders Only No c2c - W2 Only Qualifications: A Bachelor's Degree in Computer Science, Management Information...DatabricksRemote workOpen Systems Technologies
New York, NY1 day ago- ...Razor is looking for a Data Engineer with experience in clinical data who designs and builds scalable data ingestion pipelines to normalize... ...with RAF/HCC, HEDIS, Stars Experience with Snowflake, Databricks, Redshift, BigQuery, Airflow, dbt Knowledge of CMS/HIPAA requirements...DatabricksFull timeTemporary workImmediate startRemote work
Razor USA
New York, NY4 days ago - Plaid is seeking a Data Engineer to scale our data systems and deliver trusted datasets and insights. You’ll own core SQL and Python pipelines... ...work with tools like DBT, Airflow, Redshift, Snowflake, and Databricks, focusing on data quality, performance, and governance while...Databricks
- Senior Data Engineer This position is all about extracting RAW data. Must have solid ELT (extract, load, transact) experience. Experience... ...the infrastructure underlying our data pipeline: Spark, AWS, Databricks, and Airflow. Know the internals of these technologies....Databricks
- Enterprise Data And Analytics Platform Architect Candidate would be working on the Enterprise... ...Experience with software and cloud engineering and architecture in building enterprise... ...solutions using Azure Data lake, Azure Databricks and PowerBI Experience creating data...Databricks
- Job Description: Senior ML Data Engineer Feature Engineering ETL Qualifications 7 years in data engineering and at least 4 years focusing... ...preparation for ML Proven experience managing pipelines on Databricks using Apache Spark with a strong understanding of the...DatabricksRemote job
- Job Title Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake. Integrate data from various sources into the Databricks platform. Implement data integration and ETL processes using Azure Data Factory. Develop and optimize data...Databricks
- Data Engineer II We are seeking a Data Engineer II to design, build, and maintain scalable data pipelines and data infrastructure that support... ...cloud providers: AWS (Glue, S3, Redshift), Azure (Data Lake, Databricks), or GCP. Experience with workflow orchestration tools such...Databricks
- Top Buy Side firm is looking for a Data Engineer to work with large and complex data sets. Qualified candidates must have: Financial industry... ...Strong SQL experience AWS or Azure, EKS/Kubernetes, Kafka, Databricks and NoSQL experience a plus Seniority level Mid-Senior level...DatabricksFull time
- Data Engineer Baton Rouge, LA 6 - 12 Months with Possible Extension Visa: USC, GC Note - During COVID 19 candidate will be working remote... ...Lake external stage using Snow pipe, using the, using Azure Databricks. Work on projecting the semi-structured data loaded to Snowflake...DatabricksRemote work
- A technology solutions firm is looking for a Lead Data Engineer to work remotely on building end-to-end data solutions. The ideal candidate... ...with AI/ML teams. The position requires strong skills in Databricks, Python, and SQL, along with relevant experience in cloud environments...DatabricksRemote job
$108.8k - $136k
...to transform pharmacy benefits and healthcare navigation as a Data Engineer II (Analytics Engineer). You will build and maintain reliable... ...) and scheduling best practices • Familiarity with Spark/Databricks and cloud data warehouses (Snowflake preferred) • CI/CD for...DatabricksLocal areaFlexible hoursCapital Rx
New York, NY2 days ago- ...Senior/Lead Data Engineer Remote - CST 50/hr on W2 Position Summary Seeking a hands-on Senior/Lead Data Engineer with... ...ELT, dimensional data warehousing, Python, CI/CD, and AWS or Databricks, with technical ownership expected at the Lead level. Key...DatabricksRemote work
Diverse Lynx
New York, NY7 hours ago $110k - $130k
...technical lead for CLEARBROOK s enterprise data platform, responsible for end to end... ...on expertise in Snowflake, strong data engineering fundamentals, and the ability to integrate... ...Integration with external ML platforms (Databricks / SageMaker / Azure ML where applicable)...DatabricksTata Consultancy Services
New York, NY4 days ago- The Phoenix Group is seeking a Senior Data Engineer to join our growing data and technology team in the financial services space. You will... .... You will work with Python, SQL, Snowflake, dbt, Airflow, Databricks, and AWS to enable reliable data-driven decisions, data quality...Databricks
- ...successful and growing investment management firm seeking a Senior Data Engineer to help transform and modernize its enterprise data platform.... ...Experience with Azure, Azure Data Factory, Databricks, or Synapse. Experience migrating data platforms from SQL...DatabricksWork at officeImmediate startWork from home
Solomon Page
New York, NY4 days ago $73k - $98k
...competitive portfolio of benefits to its employees. Role Description We are seeking a Databricks Engineer with AWS expertise to build, optimize, and maintain our enterprise data Lakehouse infrastructure. In this role, you will be responsible for designing high-...DatabricksWork at officeLocal areaWork from homeWorldwideSumitomo Mitsui Financial Group, Inc.
New York, NY3 days ago- Data Engineer Company: Prominence Advisors Work Type: Remote Employment: Full Time Location: US Seniority: Mid Level Technologies: Snowflake, Databricks, Azure Data Factory, AWS Redshift, Google BigQuery, dbt, Apache Airflow Requirements: 2-5+ years in data engineering...DatabricksFull timeRemote work
$175k - $250k
...leveraging innovations in technology and data science to solve complex problems for... ...portfolio managers, risk managers and other engineers to develop data intensive and multi-... ...such as Snowflake, ClickHouse, Spark, or Databricks, along with monitoring and observability...DatabricksFlexible hoursMillennium
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DataBricks Data Engineer. Be the first to apply!
Related searches
- aws data engineer New York, NY
- director data engineering New York, NY
- data platform engineer New York, NY
- data engineer machine learning New York, NY
- data science developer New York, NY
- senior data engineer New York, NY
- finance data engineer New York, NY
- bi data engineer New York, NY
- principal data engineer New York, NY
- big data devops engineer New York, NY