Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr.Databricks/Data Engineering

Diverse Lynx

Candidate Profile:
The ideal candidates are not just practitioners but experts in the Databricks ecosystem.
Optiver is a highly technical organization with years of experience on the Databricks platform candidates must be comfortable defending architectural decisions and writing production-grade code in a high-performance environment.

Key Qualifications:
Strong experience with Apache Spark, including different techniques for optimizing Spark workloads
Strong experience with Spark Structured Streaming
Strong experience with Spark SQL and query performance optimization
Experience with Terraform and Databricks Asset Bundles

Nice to Have:
Experience with application development and Databricks Apps
Comfort working in Linux environments
Background in financial markets, such as market making, trading, or related domains

Working Style:
Able to work independently, prioritize effectively, and proactively identify opportunities for improvement
Comfortable operating in a loosely defined scope, where they are expected not only to execute tasks but also help define priorities and drive work forward. "

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Sr.Databricks/Data Engineering in New York, NY vacancy
  •  ...Job Title Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake. Integrate data from various sources into the Databricks platform. Implement data integration and ETL processes using Azure Data Factory. Develop and... 
    Databricks
    Senior

    Omni Inclusive

    New York, NY
    2 days ago
  •  ...Role: Sr. Data Engineer Skillset: • Data engineer with 10+ Years of experience • Good exposure in Azure environment • Good...  ...Experience in Azure devops (CI/CD) • Good to have certification in Databricks Diverse Lynx LLC is an Equal Employment Opportunity... 
    Databricks
    Senior

    Diverse Lynx

    New York, NY
    23 hours ago
  •  ...Job Description The Sr. Data Engineer will contribute to the Company's success by partnering with business, analytics and infrastructure...  ...or Advanced SQL queries Python Spark Snowflake Databricks Airflow or Prefect ~ Experience with at least one... 
    Databricks
    Senior

    Tavant

    New York, NY
    4 days ago
  •  ...Title: Sr. Data Engineer Location: New York, NY Job Description Required Skills: Proficiency in data engineering...  ...data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (... 
    Databricks
    Senior

    Damco Solutions

    New York, NY
    1 day ago
  •  ...Job Role: Data Engineer Job Location: Dallas, TX & NYC, NY Experience: Max 8 Years Job type : Fulltime Skills: SQL, Tableau, Python , Databricks , ETL Pipeline Job Responsibilities Design, develop & implement ETL processes... 
    Databricks
    Senior
    Full time
    Work experience placement

    VDart

    New York, NY
    2 days ago
  •  ...Public Trust Job Description: We’re looking for an experienced data engineer who thrives on solving applied problems with code, modern...  ...ELT pipelines, and optimize data flows using technologies like Databricks, Spark, and Kafka. In this role, you’ll grow your technical expertise... 
    Databricks
    Senior
    Contract work
    For contractors
    Remote work

    MBO Partners

    New York, NY
    2 days ago
  • Title: Sr. Data Engineer Location: NYC, NY Duration: long term Position type: W2 contract Job Description Data Engineer with Python and...  ...The ideal candidate will have experience working with MLflow, Databricks, and open-source machine learning frameworks, enabling... 
    Databricks
    Senior
    Contract work

    Accord Technologies Inc

    New York, NY
    23 hours ago
  • $75 - $82 per hour

     ...fit with just the right company. Currently, we are seeking a Sr Data Engineer- Agentic AI for an exciting career growth opportunity. Make...  ...Manufacturing Data Platforms & Engineering Advanced proficiency with Databricks, Spark, SQL, Delta Lake, and Python to ingest, structure,... 
    Databricks
    Senior
    Contract work
    Remote work

    Mindlance

    New York, NY
    1 day ago
  • $128.14k - $252.19k

     ...are looking for a highly experienced Sr. Manager to join our Data Service team at Mercury Insurance....  ..., you will partner closely with our Engineering organization to implement data technology...  .../Warehouse technologies (Redshift, Databricks, Snowflake, or BigQuery) and layered... 
    Databricks
    Senior
    Local area

    Mercury General

    New York, NY
    2 days ago
  • $122.43k - $183.64k

     ...support are not available for this position. The Senior Data Infrastructure Engineer designs, builds, and scales reliable data platforms that...  ...Experience with real-time or streaming data platforms (Kafka, Databricks). Exposure to data governance, lineage, and compliance... 
    Databricks
    Senior
    Full time
    Visa sponsorship

    Lyric

    New York, NY
    2 days ago
  •  ...As a Sr. Big Data Engineer in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform . You will provide data engineering, data science, and cloud technology projects... 
    Databricks
    Senior
    Temporary work
    Worldwide

    Databricks

    New York, NY
    2 days ago
  •  ...type of part-time job for the experienced data folks out there that take pride in...  ...Responsibilities: Generally speaking, a Sr Data Engineering Consultant will be helping the client build...  ...databases, and driving the adoption of DataBricks across the organization. You will be an... 
    Databricks
    Senior
    Part time
    Second job
    10 hours per week
    Flexible hours

    Kruse Consulting, Inc.

    New York, NY
    2 days ago
  • $148.7k - $199.4k

     ...Sr Data Engineer Disney Entertainment and ESPN Product & Technology Technology is at the heart of Disney's past, present, and future...  ...Python with frameworks like Spark, primarily deployed via Databricks and Airflow. Establish and enforce rigorous standards for... 
    Databricks
    Senior
    Work experience placement

    Disney

    New York, NY
    1 day ago
  • $141.9k - $190.3k

     ...Senior Data Engineer Technology is at the heart of Disney's past, present, and future. Disney Entertainment and ESPN Product & Technology...  ...and marketing analytics use cases. You will work across AWS, Databricks, Unity Catalog, Snowflake and Airflow to create reliable,... 
    Databricks
    Senior

    The Walt Disney Studios

    New York, NY
    1 day ago
  • The Sr System Analyst, Data Activation Engineer, Enterprise Data & Analytics is responsible for building the data integration pipelines and data contracts...  ..., other supported platforms are C3.ai, and Azure Databricks) to source systems and middleware. The role owns the... 
    Databricks
    Senior

    Con Edison

    New York, NY
    4 days ago
  •  ...Sr Azure Data Engineer Location: New York City, NY (Local Must & Hybrid) Duration: 6+ Month Contract / C2C Experience: 10+ yrs must...  ...services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build... 
    Databricks
    Senior
    Contract work
    H1b
    Local area

    Damco

    New York, NY
    1 day ago
  •  ...Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role The candidate should have hands-on experience with various Azure...  ...services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design,... 
    Databricks
    Senior

    Hudson Data

    New York, NY
    3 days ago
  •  ...Master's Degree in Computer Science, Engineering, Math, Business, or technology-centric field...  ...-on experience designing and building data integration pipelines across batch, streaming...  ...Data Practitioner Preferred Other: Databricks Associate Data Engineer Preferred... 
    Databricks
    Senior
    Full time
    Work experience placement
    Flexible hours
    Night shift

    Con Edison

    New York, NY
    3 days ago
  • $150k - $200k

     ...and Singapore. POSITION OVERVIEW We are hiring a Sr. Manager Data Engineering & Analytics to define our data strategy and build a high-...  ...technologies (e.g., Fabric, dbt, Snowflake, Azure Data Factory, Databricks, Airflow).  ~ Expertise in SQL and at least one... 
    Databricks
    Senior
    Work at office

    UpClear

    New York, NY
    3 days ago
  • $159.6k - $296.4k

     ...Sr. Staff Data Engineer CNN is seeking a Sr. Staff Data Engineer to serve as the technical authority for CNN's Data Platform — the foundation...  ..., and SQL ~ Previous experience working with Snowflake, Databricks, or other modern enterprise data warehouses ~... 
    Databricks
    Senior
    Temporary work
    Local area

    Warner Bros.

    New York, NY
    1 day ago
  •  ...A new consulting start-up is looking for a part-time Sr Data Engineering Consultant based in the United States. This role requires a minimum...  ...enhancing data infrastructure and driving the adoption of DataBricks. Candidates should be entrepreneurial-minded and highly... 
    Databricks
    Senior
    Part time
    Flexible hours

    Kruse Consulting, Inc.

    New York, NY
    2 days ago
  •  ...Techvariable is looking for a passionate Senior Software Engineer (Data) to join their dynamic team in the United States. You will design...  ...strong proficiency in Python and SQL, along with knowledge of Databricks and Azure services. This opportunity is perfect for data... 
    Databricks
    Senior

    Techvariable

    New York, NY
    2 days ago
  •  ...HTEC Group is seeking an experienced Data Engineer to enhance their data infrastructure. The ideal candidate will have over 7 years of relevant experience, strong hands-on capabilities with Databricks and Apache Spark, and proficiency in Python or Scala. Responsibilities... 
    Databricks
    Senior

    HTEC Group Inc

    New York, NY
    2 days ago
  •  ...EPAM Systems, Inc. is seeking a skilled Senior Data Engineer in the United States to lead the design and optimization of data pipelines. You will ensure efficient data processing while enabling the aggregation of commerce data into a centralized platform. The ideal candidate... 
    Databricks
    Senior
    Remote work

    EPAM Systems Inc

    New York, NY
    4 days ago
  •  ...Synoptek is seeking an experienced Data Engineer in the United States to design and manage scalable ETL/ELT pipelines leveraging Medallion Architecture. The role requires strong expertise in Databricks, Delta Lake, and extensive experience with PySpark and SQL to build... 
    Databricks
    Senior

    Synoptek

    New York, NY
    2 days ago
  •  ...Taskus India is looking for a Senior Data Engineer to support their data strategy. The role involves building resilient pipelines, optimizing...  .... Hands-on experience with modern data stacks like Databricks or Snowflake is essential. This role offers the opportunity to... 
    Databricks
    Senior

    Taskus India

    New York, NY
    2 days ago
  •  ...A premier recruitment agency is seeking a Lead Data Engineer for a remote role focused on delivering complex data solutions for enterprise...  ...years of experience in data engineering, strong expertise in Databricks and AWS, and a proficiency in Python and SQL. This... 
    Databricks
    Senior
    Remote work

    KDR Talent Solutions USA

    New York, NY
    2 days ago
  •  ...Required Skills and Experience: Proven experience as a Data Engineer or in a similar role with a focus on Snowflake, Python, Pyspark...  ...Preferred Qualifications: Good Knowledge in Azure and Databricks in highly preferred. Knowledge of Apache Kafka or other... 
    Databricks
    Senior

    Saxon Global

    New York, NY
    23 hours ago
  •  ...FullStack is looking for a Senior Data Engineer to connect with U.S. clients for flexible, project-based development work. The ideal candidate...  ...5 years of Data Engineering experience, strong skills in Databricks and SQL Server, and the ability to work on complex datasets... 
    Databricks
    Senior
    Remote work
    Flexible hours

    Full Stack LLC

    New York, NY
    2 days ago
  •  ...Kinsley Power Systems is looking for a skilled Data Engineer to support enterprise data management and develop ETL pipelines. The ideal candidate should have at least 4 years of experience in data analysis and data engineering, and proficiency in SQL, Python, and data... 
    Databricks
    Senior

    Kinsley Power Systems

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr.Databricks/Data Engineering. Be the first to apply!