DataBricks Data Engineer
Artech Information Systems LLC
Data Engineering Solutions Specialist
We are seeking a skilled and experienced professional to join our team, responsible for designing, developing, and implementing data engineering solutions using the Databricks platform. Your work will support data ingestion, transformation, performance reporting, analytics, sales incentive compensation processing, and enterprise data pipeline processes.
Required Skills & Qualifications
- At least 7 years of experience in data engineering, with a minimum of 3 years hands-on experience building and managing Databricks solutions.
- Extensive experience with Databricks platform components: Delta Lake, Delta Live Tables, Unity Catalog, and Databricks Workflows.
- Strong proficiency in Python and/or Scala for data engineering; SQL expertise required.
- Strong experience with core data engineering practices including data ingestion, transformation (ETL/ELT), data modeling, and pipeline orchestration.
- Functional and technical experience with Sales Incentive Compensation (SIC) — including incentive plan design, quota allocation, attainment tracking, commission calculations, and payout processing.
- Applicants must be able to work directly for Artech on W2.
Preferred Skills & Qualifications
- Familiarity with SIC platforms (e.g., Anaplan, Oracle ICM, Varicent) and experience integrating them with data engineering platforms is a strong plus.
- Experience integrating Databricks with cloud platforms (Azure, AWS, or GCP) and data sources such as Azure Data Factory, Event Hubs, Kafka, or equivalent.
- Databricks Certified Data Engineer Associate or Professional certification is a plus.
Day-to-Day Responsibilities
- Collaborate with business stakeholders to understand their data requirements and translate them into scalable technical solutions.
- Design and develop Databricks-based data pipelines, including data models, Delta Lake tables, and dashboards/notebooks.
- Maintain and optimize all current Databricks workspaces and pipelines; capture and deliver requirements for new or improved functionality.
- Design and implement data pipelines to support Sales Incentive Compensation (SIC) processes, including quota management, attainment calculations, commission processing, and payout reporting.
- Provide technical support and troubleshooting for Databricks-based solutions, working closely with end-users and analysts to address their needs and resolve any data-related problems.
Company Benefits & Culture
- Opportunity to work on a new team and project.
- Collaborative and supportive team environment.
- Exposure to cutting-edge data engineering technologies and practices.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the DataBricks Data Engineer in New York, NY vacancy
- Job ID: 25546234Reference Number: 25-00476Title: Data EngineerLocation: New York, NYPosted Date: 2025-05-19Contact: Rishabh PandeyContact... ...data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (...Databricks
$100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders OnlyNo c2c - W2 OnlyQualifications:A Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering...DatabricksRemote work$120k - $135k
Full Time, Fully Remote Sr. Azure Data Engineer opportunity with rapidly growing financial corporation Employee testimonials: Great company... ...at the center of a modern Azure-based data platform built on Databricks. The focus is on designing and evolving a lakehouse...DatabricksFull timeRemote work- ...successful and growing investment management firm seeking a Senior Data Engineer to help transform and modernize its enterprise data platform.... ...QualificationsExperience with Azure, Azure Data Factory, Databricks, or Synapse.Experience migrating data platforms from SQL...DatabricksWork at officeImmediate startWork from home
- ...Position: Data Engineer Employment Type: Full-Time, Permanent Location: NYC Qualifications & Requirements... ...data engineering experience, with at least 3+ years of hands-on Databricks experience in production environments. ~ Migration Expertise...DatabricksPermanent employmentFull time
Parkar Global Technologies Pvt. Ltd.
New York, NY1 day ago - QUALIFICATIONSDegree in Computer Science, Business Analytics, Engineering, Mathematics, or related field2+ years of professional experience in data engineering, software engineering, or... ..., and Delta LakePractical experience with Databricks, AWS Glue, and transformation frameworks...DatabricksApprenticeshipEasy work
$100k - $140k
...bonusesResponsibilitiesWe are hiring a hands-on senior level Data Engineer to build trustworthy, well governed data products and turn them... ...with modern lakehouse platforms (e.g., Microsoft Fabric, Databricks, Snowflake, AWS)Experience building data solutions in cloud environments...DatabricksWork at officeRemote workWeekend work3 days per week$190k - $220k
...role and will be assessed during the interview process.The Data Engineering team builds tools and systems that make Gusto's data consistent... ...on cloud platforms like Snowflake, Redshift, BigQuery, or Databricks.Experience implementing CI/CD pipelines, automated testing,...DatabricksFull timeWork at officeLocal area2 days per week3 days per week- ...WithAt Slalom, we co-create custom software, data, and cloud products with clients who are... ...true change.Our Data Architecture & Engineering team sees data as the foundation for... ...Data & Streaming — Apache Spark, Presto, Databricks, Amazon Kinesis, Apache Kafka* Workflow...DatabricksTemporary workLocal area
$110k - $130k
.... About the Role:At The New York Times, data powers decisions across the entire company... ...possible, and we're looking for a Data Engineer to help us build them. You'll own and... ...Cloud Data Warehouse (BigQuery, Snowflake, DataBricks)Familiarity with foundational cloud...DatabricksFull timeLocal areaFlexible hours- ...Job Title- Data Engineer Location- New York, NY 10112 Reporting Type- Onsite Duration: 10 months Summary... ...databases. Structured and unstructured data sets. Loading of data into S3 as well as tabular schemas. Databricks experience preferred.Databricks
campus4tech
New York, NY3 days ago $137.4k - $161.7k
...you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design... ...and business intelligence. Working with technologies such as Databricks, Snowflake, and Microsoft Fabric, you will help clients modernize...DatabricksLocal areaImmediate startFlexible hours$110k - $190k
Senior Data Management Professional - Data Engineering - Entities Location New York Business Area Data Ref # 10052582 Description... ...services such as S3, EMR, Glue, ADLS, Data Factory, or Databricks.• Experience implementing data observability tools...DatabricksTemporary workFor contractorsWork experience placement- ...RolePolymarket is looking for a Senior Analytics Engineer to own the modeling layer that sits between our raw data and the decisions the business makes with it.... ...solutions, and a modern cloud warehouse such as Databricks, Snowflake, BigQuery, or ClickHouseStrong instincts...Databricks
- ...Instacart, Atlassian, Synopsys, Stripe, Databricks, and Waymo use Pave, transforming every... ...Venture Partners, and Craft Ventures.The Data Team @ PaveAs part of the Data team at Pave... ..., product managers and software engineers to translate product needs into insights...DatabricksFlexible hours3 days per week
- ...description Manage and support batch processes and data pipelines in Azure Databricks and Azure Data Factory. Integrate and process Bloomberg... ...data workflows. 10+ years of experience in data engineering or production support within financial services or trading...Databricks
Cloud Analytics Technologies LLC
New York, NY5 days ago - ...Data Engineer Location: NJ / NY onsite USA (local to NJ or NY) Must have: (AWS, Azure, or GCP), and/or on-prem (MS SQL, SSIS, Oracle) and (RedShift, Snowflake, Databricks, Informatica, SSAS etc.) Requirements: ~ Bachelor's degree in Computer Science, Data...DatabricksLocal area
Damco
New York, NY5 days ago - ...Description Our client is a hedge fund in NYC looking for a talented Data Engineer to join their team. Qualified candidates will have 5-10+... ...building data pipelines, ETL processes, and any exposure to Databricks would be a plus. Financial services experience is required,...Databricks
The Cypress Group
New York, NYmore than 2 months ago - ...At New York Life will join a team of analytics engineers focused on delivering clean, well-structured, and reliable data to power various business and AI solutions... ...catalog integration.• Strong working knowledge of Databricks, including SQL, notebooks, and distributed...DatabricksLocal area3 days per week
- ...Your Role The Data Services team is responsible for technical design and end-to... ...data products for the enterprise. The Data Engineer,Senior will report to the Sr Manager,... ...data stack tools such as dbt, Snowflake, Databricks, Airflow, or Tidal Solid knowledge...Databricks
Blue Shield of CA
New York, NY3 days ago - ...Title: Data Engineer Location: Remote (EST hours preferred) Duration: 4 Month Contract (through end of 2026) Pay Range: $70-80/hour... ..., moving our legacy data warehouse (Azure MS SQL) into Databricks, which will become the underlying data source for a new segmentation...DatabricksContract workTemporary workRemote work
Mondo
New York, NY4 days ago - ...Job Title: Data Engineer Location: New York City, NY (Hybrid, 3 days in a week) In-person Interview is required Job Description... ...Advanced proficiency in Python, SQL Server, Snowflake, Azure Databricks, and PySpark. Strong understanding of relational...Databricks3 days per week
Argyllinfotech
New York, NY1 day ago $100k - $143k
Location Designation: Hybrid - 3 days per week Role Overview:The Data Governance Engineer plays a key role in advancing New York Life’s data... ...Validate and maintain lineage for key data assets across dbt, Databricks, and BI tools.• Perform metadata tagging, glossary...DatabricksLocal area3 days per week$140k - $175k
...the lookout for a skilled Senior Analytics Engineer with strong software development skills who is passionate about games and big data. This is a full-time, in-office position... ...infrastructure. Experience working in Databricks & Azure environment (or other cloud equivalents...DatabricksFull timeWork at office- ...days per week We are seeking energetic and passionate Senior Data Engineer to design and execute our company’s modern data management strategy... ...data architecture. Experience with Redshift, Snowflake, Databricks SQL, Oracle, Postgres, MySQL, and understanding of best...DatabricksLocal area3 days per week
$215.2k - $244.7k
...opportunity to work with clients developing Big Data strategy and roadmaps, while gaining... ...and platform selection advice for Databricks, Snowflake, and/or Microsoft FabricDesign... ...with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and...DatabricksLocal areaImmediate startFlexible hours- ...Title: Data Engineer Location: Remote Duration: 12 Months Contract Work with business and technical leadership to... ...using Teradata SQL, Hive SQL and Spark SQL against Teradata and DataBricks Unity Catalog. Implementing dev-ops pipelines to deploy...DatabricksContract workWork experience placementRemote work
Conch Technologies Inc
New York, NY1 day ago - ...Senior Data Engineer Join our mission to transform pharmacy benefits and healthcare navigation as a Senior Data Engineer (Analytics... ...Airflow) and scheduling best practices ~ Familiarity with Spark/Databricks and cloud data warehouses (Snowflake preferred) ~ CI/CD for...DatabricksLocal areaFlexible hours
Judi Health
New York, NY1 day ago - ...career in Advisory.KPMG is currently seeking a Sr. Associate, Data Science Engineer to join our Consulting practice.Responsibilities:Translate... ...MLOps, with hands-on expertise in Python, PySpark, SQL, Databricks, and Snowflake, while partnering with clients and cross-functional...DatabricksH1bLocal area
- ...Databricks Data Engineer New York, New York, United States About The Job Our client provides data-driven, action-oriented solutions to business problems through statistical data mining, cutting-edge analytics techniques, and a consultative approach. Leveraging...Databricks
Inizio Partners
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DataBricks Data Engineer. Be the first to apply!
Related searches
- data platform engineer New York, NY
- aws data engineer New York, NY
- azure data engineer New York, NY
- data engineer graduate New York, NY
- big data devops engineer New York, NY
- big data developer New York, NY
- software data engineer New York, NY
- data center engineer New York, NY
- big data cloud engineer New York, NY
- director data engineering New York, NY