Sr.Databricks/Data Engineering
Diverse Lynx
Candidate Profile:
The ideal candidates are not just practitioners but experts in the Databricks ecosystem.
Optiver is a highly technical organization with years of experience on the Databricks platform candidates must be comfortable defending architectural decisions and writing production-grade code in a high-performance environment.
Strong experience with Apache Spark, including different techniques for optimizing Spark workloads
Strong experience with Spark Structured Streaming
Strong experience with Spark SQL and query performance optimization
Experience with Terraform and Databricks Asset Bundles Nice to Have:
Experience with application development and Databricks Apps
Comfort working in Linux environments
Background in financial markets, such as market making, trading, or related domains Working Style:
Able to work independently, prioritize effectively, and proactively identify opportunities for improvement
Comfortable operating in a loosely defined scope, where they are expected not only to execute tasks but also help define priorities and drive work forward. " Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Sr.Databricks/Data Engineering in New York, NY vacancy
- ...Job Title Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake. Integrate data from various sources into the Databricks platform. Implement data integration and ETL processes using Azure Data Factory. Develop and...DatabricksSenior
- ...Role: Sr. Data Engineer Skillset: • Data engineer with 10+ Years of experience • Good exposure in Azure environment • Good... ...Experience in Azure devops (CI/CD) • Good to have certification in Databricks Diverse Lynx LLC is an Equal Employment Opportunity...DatabricksSenior
- ...Job Description The Sr. Data Engineer will contribute to the Company's success by partnering with business, analytics and infrastructure... ...or Advanced SQL queries Python Spark Snowflake Databricks Airflow or Prefect ~ Experience with at least one...DatabricksSenior
- ...Title: Sr. Data Engineer Location: New York, NY Job Description Required Skills: Proficiency in data engineering... ...data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data stores (...DatabricksSenior
- ...Job Role: Data Engineer Job Location: Dallas, TX & NYC, NY Experience: Max 8 Years Job type : Fulltime Skills: SQL, Tableau, Python , Databricks , ETL Pipeline Job Responsibilities Design, develop & implement ETL processes...DatabricksSeniorFull timeWork experience placement
- ...Public Trust Job Description: We’re looking for an experienced data engineer who thrives on solving applied problems with code, modern... ...ELT pipelines, and optimize data flows using technologies like Databricks, Spark, and Kafka. In this role, you’ll grow your technical expertise...DatabricksSeniorContract workFor contractorsRemote work
- Title: Sr. Data Engineer Location: NYC, NY Duration: long term Position type: W2 contract Job Description Data Engineer with Python and... ...The ideal candidate will have experience working with MLflow, Databricks, and open-source machine learning frameworks, enabling...DatabricksSeniorContract work
$75 - $82 per hour
...fit with just the right company. Currently, we are seeking a Sr Data Engineer- Agentic AI for an exciting career growth opportunity. Make... ...Manufacturing Data Platforms & Engineering Advanced proficiency with Databricks, Spark, SQL, Delta Lake, and Python to ingest, structure,...DatabricksSeniorContract workRemote work$128.14k - $252.19k
...are looking for a highly experienced Sr. Manager to join our Data Service team at Mercury Insurance.... ..., you will partner closely with our Engineering organization to implement data technology... .../Warehouse technologies (Redshift, Databricks, Snowflake, or BigQuery) and layered...DatabricksSeniorLocal area$122.43k - $183.64k
...support are not available for this position. The Senior Data Infrastructure Engineer designs, builds, and scales reliable data platforms that... ...Experience with real-time or streaming data platforms (Kafka, Databricks). Exposure to data governance, lineage, and compliance...DatabricksSeniorFull timeVisa sponsorship- ...As a Sr. Big Data Engineer in our Professional Services team, you will work with clients on short to medium-term customer engagements on their big data challenges using the Databricks Platform . You will provide data engineering, data science, and cloud technology projects...DatabricksSeniorTemporary workWorldwide
- ...type of part-time job for the experienced data folks out there that take pride in... ...Responsibilities: Generally speaking, a Sr Data Engineering Consultant will be helping the client build... ...databases, and driving the adoption of DataBricks across the organization. You will be an...DatabricksSeniorPart timeSecond job10 hours per weekFlexible hours
$148.7k - $199.4k
...Sr Data Engineer Disney Entertainment and ESPN Product & Technology Technology is at the heart of Disney's past, present, and future... ...Python with frameworks like Spark, primarily deployed via Databricks and Airflow. Establish and enforce rigorous standards for...DatabricksSeniorWork experience placement$141.9k - $190.3k
...Senior Data Engineer Technology is at the heart of Disney's past, present, and future. Disney Entertainment and ESPN Product & Technology... ...and marketing analytics use cases. You will work across AWS, Databricks, Unity Catalog, Snowflake and Airflow to create reliable,...DatabricksSenior- The Sr System Analyst, Data Activation Engineer, Enterprise Data & Analytics is responsible for building the data integration pipelines and data contracts... ..., other supported platforms are C3.ai, and Azure Databricks) to source systems and middleware. The role owns the...DatabricksSenior
- ...Sr Azure Data Engineer Location: New York City, NY (Local Must & Hybrid) Duration: 6+ Month Contract / C2C Experience: 10+ yrs must... ...services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design, build...DatabricksSeniorContract workH1bLocal area
- ...Sr. Azure Data Engineer Location: NYC, NY Duration: Long Term W2 Role The candidate should have hands-on experience with various Azure... ...services including but not limited to Azure Data Factory, Databricks, Data Lake, and Power BI. They should be able to design,...DatabricksSenior
- ...Master's Degree in Computer Science, Engineering, Math, Business, or technology-centric field... ...-on experience designing and building data integration pipelines across batch, streaming... ...Data Practitioner Preferred Other: Databricks Associate Data Engineer Preferred...DatabricksSeniorFull timeWork experience placementFlexible hoursNight shift
$150k - $200k
...and Singapore. POSITION OVERVIEW We are hiring a Sr. Manager Data Engineering & Analytics to define our data strategy and build a high-... ...technologies (e.g., Fabric, dbt, Snowflake, Azure Data Factory, Databricks, Airflow). ~ Expertise in SQL and at least one...DatabricksSeniorWork at office$159.6k - $296.4k
...Sr. Staff Data Engineer CNN is seeking a Sr. Staff Data Engineer to serve as the technical authority for CNN's Data Platform — the foundation... ..., and SQL ~ Previous experience working with Snowflake, Databricks, or other modern enterprise data warehouses ~...DatabricksSeniorTemporary workLocal area- ...A new consulting start-up is looking for a part-time Sr Data Engineering Consultant based in the United States. This role requires a minimum... ...enhancing data infrastructure and driving the adoption of DataBricks. Candidates should be entrepreneurial-minded and highly...DatabricksSeniorPart timeFlexible hours
- ...Techvariable is looking for a passionate Senior Software Engineer (Data) to join their dynamic team in the United States. You will design... ...strong proficiency in Python and SQL, along with knowledge of Databricks and Azure services. This opportunity is perfect for data...DatabricksSenior
- ...HTEC Group is seeking an experienced Data Engineer to enhance their data infrastructure. The ideal candidate will have over 7 years of relevant experience, strong hands-on capabilities with Databricks and Apache Spark, and proficiency in Python or Scala. Responsibilities...DatabricksSenior
- ...EPAM Systems, Inc. is seeking a skilled Senior Data Engineer in the United States to lead the design and optimization of data pipelines. You will ensure efficient data processing while enabling the aggregation of commerce data into a centralized platform. The ideal candidate...DatabricksSeniorRemote work
- ...Synoptek is seeking an experienced Data Engineer in the United States to design and manage scalable ETL/ELT pipelines leveraging Medallion Architecture. The role requires strong expertise in Databricks, Delta Lake, and extensive experience with PySpark and SQL to build...DatabricksSenior
- ...Taskus India is looking for a Senior Data Engineer to support their data strategy. The role involves building resilient pipelines, optimizing... .... Hands-on experience with modern data stacks like Databricks or Snowflake is essential. This role offers the opportunity to...DatabricksSenior
- ...A premier recruitment agency is seeking a Lead Data Engineer for a remote role focused on delivering complex data solutions for enterprise... ...years of experience in data engineering, strong expertise in Databricks and AWS, and a proficiency in Python and SQL. This...DatabricksSeniorRemote work
- ...Required Skills and Experience: Proven experience as a Data Engineer or in a similar role with a focus on Snowflake, Python, Pyspark... ...Preferred Qualifications: Good Knowledge in Azure and Databricks in highly preferred. Knowledge of Apache Kafka or other...DatabricksSenior
- ...FullStack is looking for a Senior Data Engineer to connect with U.S. clients for flexible, project-based development work. The ideal candidate... ...5 years of Data Engineering experience, strong skills in Databricks and SQL Server, and the ability to work on complex datasets...DatabricksSeniorRemote workFlexible hours
- ...Kinsley Power Systems is looking for a skilled Data Engineer to support enterprise data management and develop ETL pipelines. The ideal candidate should have at least 4 years of experience in data analysis and data engineering, and proficiency in SQL, Python, and data...DatabricksSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr.Databricks/Data Engineering. Be the first to apply!
Related searches
- bi data engineer New York, NY
- staff data engineer New York, NY
- data visualization developer New York, NY
- data science developer New York, NY
- senior data center engineer New York, NY
- sr information security engineer New York, NY
- IT data engineer New York, NY
- junior big data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer contract New York, NY

