Databricks Engineer
Diverse Lynx
Job Title: Sr. Databricks Developer (4)
Location: Columbus, OH - 5 Days onsite role
FTC/ FTE role Summary: We are looking for a Databricks Developer with strong experience in Python and Apache Spark to design, develop, and optimize scalable data pipelines and cloud-based data solutions. The ideal candidate will have hands-on expertise in Databricks, PySpark, SQL, and modern data engineering practices.
Key Responsibilities:-
Design, develop, and maintain ETL/ELT pipelines using Databricks and PySpark- Build scalable batch and real-time data processing solutions using Apache Spark- Develop data transformation workflows using Python, PySpark, and Spark SQL- Implement Delta Lake solutions and optimize data processing performance- Create and manage Databricks notebooks, jobs, and workflows- Ensure data quality, validation, logging, and exception handling- Optimize Spark performance using partitioning, caching, and tuning techniques- Collaborate with cross-functional teams to gather requirements and deliver solutions- Support CI/CD, deployment automation, and production releases- Troubleshoot and resolve issues in data pipelines and platform processes
Required Skills:-
Preferred Skills:-
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location: Columbus, OH - 5 Days onsite role
FTC/ FTE role Summary: We are looking for a Databricks Developer with strong experience in Python and Apache Spark to design, develop, and optimize scalable data pipelines and cloud-based data solutions. The ideal candidate will have hands-on expertise in Databricks, PySpark, SQL, and modern data engineering practices.
Key Responsibilities:-
Design, develop, and maintain ETL/ELT pipelines using Databricks and PySpark- Build scalable batch and real-time data processing solutions using Apache Spark- Develop data transformation workflows using Python, PySpark, and Spark SQL- Implement Delta Lake solutions and optimize data processing performance- Create and manage Databricks notebooks, jobs, and workflows- Ensure data quality, validation, logging, and exception handling- Optimize Spark performance using partitioning, caching, and tuning techniques- Collaborate with cross-functional teams to gather requirements and deliver solutions- Support CI/CD, deployment automation, and production releases- Troubleshoot and resolve issues in data pipelines and platform processes
Required Skills:-
- Strong hands-on experience with Databricks
- Strong Python programming skills
- Expertise in Apache Spark, PySpark, and Spark SQL- Strong SQL and data transformation skills
- Experience with Delta Lake and lakehouse concepts- Knowledge of ETL/ELT and data pipeline design
- Experience with AWS, Azure, or GCP- Familiarity with Git, CI/CD, and Agile practices
- Good problem-solving and communication skills
Preferred Skills:-
- Experience with Airflow, Azure Data Factory, or Databricks Workflows
- Knowledge of Kafka or streaming frameworks
- Experience with MLflow or analytics platforms
- Understanding of data governance and security best practices
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Databricks Engineer in Columbus, OH vacancy
- ...Overview: Role: AWS Databricks Engineer Location: Chicago, IL Job Description: • 12+ years of overall experience in data engineering, cloud architecture, or analytics platforms. • Strong expertise in AWS big-data stack and Databricks Lakehouse. •...Databricks
Purple Drive
Columbus, OH2 days ago - ...hybrid workplace globally. Technology partners include Snowflake, Databricks, AWS, Azure, Google Cloud, and Starburst. Immuta was... ...Park, Maryland. About the Role We’re hiring a Go-To-Market (GTM) Engineer to join the Business Development organization, where you’ll focus...DatabricksFull timeLocal areaWorldwide
Immuta
Columbus, OH2 days ago - ...International, based in Columbus, Ohio, is seeking a Lead Data Engineer to architect and lead modern data solutions. This hands-on... ...experience in data engineering, particularly with Azure Data Factory, Databricks, and proven leadership skills. Join a prestigious company...Databricks
- Humana Inc is seeking a skilled Data Engineering Lead to oversee the architecture and operationalization of a centralized Finance reporting data platform. The role involves working with Databricks, SQL, and Power BI to drive data quality and reporting solutions. Ideal candidates...DatabricksRemote job
$99k - $232k
Specialty/Competency: Managed Services Industry/Sector: Not Applicable Time Type: Full time Travel Requirements: Up to 60% At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise...DatabricksFull timeH1bPwC
Columbus, OH2 days ago$124k - $280k
...Requirements: Up to 80% At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to... ..., Azure Data Engineer Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus Proficient in Python...DatabricksFull timeH1bPwC
Columbus, OH3 days ago$250.6k - $384.6k
...achieving that vision. As Sr Manager, AV Behavior Safety Engineering, you will lead the strategy and support execution for how GM... ...Platforms: (Preferred Microsoft Azure (Data Lake, Machine Learning, Databricks)), Nice to Have (AWS (S3, SageMaker, Bedrock) or Google...DatabricksOdd jobPermanent employmentLocal areaRemote workWork from homeFlexible hoursGeneral Motors
Columbus, OH2 days ago$95.5k - $177.5k
...Operations Technology Solutions) is looking for a Specialist Quality Engineer to lead Quality assurance and control activities in developing... ...-art modern data platform with cutting edge technologies like Databricks, Snowflake, Python, DataOps, AtScale and Streamsets, etc. You...DatabricksFull timeTemporary workPart timeCasual workWork at office2 days per weekNationwide
Columbus, OH3 days ago$150k - $200k
...every day. To learn more, please see . The AI Automation Engineer - Finance & Accounting applies AI to finance operations at Cengage... ...Anywhere, Power Automate Data: Snowflake, PostgreSQL, Databricks Key Competencies Financial Fluency - speaks the language...DatabricksLive inLocal areaWorldwideCengage Group
Columbus, OH3 days ago$124k - $280k
...Requirements: Up to 80% At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to... ...with data warehouse technology including Snowflake or Databricks Experience working with Anthropic - Claude and Claude code...DatabricksFull timeH1bPwC
Columbus, OH5 days ago- ...latency, and reliability benchmarks that outperform what is possible on Snowflake Cortex or Databricks Genie. Who you will work with You will join a focused team of AI engineers within Teradata's AI Apps, Analytics, and UX Engineering organization, working on the most technically...DatabricksPermanent employmentFlexible hours
- ...Vice President, Cloud Data Engineering About the Company Top-tier organization in the consumer services industry Industry Consumer Services... ..., distributed systems. Strong technical experience in Databricks, Snowflake, and FHIR, as well as a proven track record of leading...Databricks
Confidential
Worthington, OH1 day ago - ...Overview: Role: Senior Engineer Total Exp: 6 - 8 Years Skills: Python, Databricks Must have databricks, Python, PySpark, CICD experience 3-5 years' experience with data management, best practices and software development. Experience in Data Warehousing...Databricks
Purple Drive
Columbus, OH4 days ago - ...will have over 7 years of experience, strong expertise in cloud security especially within Azure, and hands-on experience with tools like Databricks. Preferred candidates are located in Columbus, OH but full-remote candidates will be considered. #J-18808-Ljbffr McKessonDatabricksRemote work
- A leading technology firm seeks a dynamic Sales Engineer to join their team. This remote role focuses on supporting sales through technical expertise in cloud computing and cybersecurity. Candidates should have a background in developing technical proposals and conducting...Remote job
- ...Teradata Corporation (SE) is seeking a Competitive Intelligence Analyst focused on driving actionable insights through research on Databricks and Google BigQuery. This role requires a strong analytical mindset and excellent communication skills. The ideal candidate has a...Databricks
Teradata
Columbus, OH2 days ago - ...role involves designing scalable cloud data architectures, focusing on SaaS data transformation and modern cloud platforms like Databricks and Snowflake. Ideal candidates will have extensive experience in data architecture and data migration, contributing to enterprise...DatabricksRemote job
- ...working within a hybrid big data architecture using modern data engineering technologies. The Senior Data Engineer will play a... ...tasks. Build and maintain new cloud data pipelines using Databricks and PySpark. Required Qualifications ~6 to 8+ years of...Databricks
3B Staffing LLC
Columbus, OH2 days ago - ...workplace globally. • Technology partners include Snowflake, Databricks, AWS, Azure, Google Cloud, and Starburst. • Immuta has been... ...Maryland. ABOUT OUR TEAM At Immuta, the Site Reliability Engineering team defines what reliability means at scale. We are...DatabricksFull timeWork at officeLocal areaWorldwide3 days per week
- ...Required Skills: 10 & Above Year Experience Experience in Data Warehousing, AWS Cloud Business, Intelligence, Informatica and Databricks (data flow design, development, enhancement and maintenance). Real time data ingestion using Stream sets Experience UDM...Databricks
Syntricate Technologies
Columbus, OH3 days ago - ...solutions. Ideal candidates will have strong backgrounds in big data, programming, and cloud technologies. You will be crucial in establishing relationships and aligning technical strategies to ensure customer success across a wide array of use cases. J-18808-Ljbffr DatabricksDatabricks
- We are seeking a highly skilled Data & AI Engineer with strong hands‑on engineering expertise to design, develop, and deploy next-generation... ...MLOps practices and AI model deployment. Experience with Databricks, Snowflake, or similar modern data platforms. Experience with...Databricks
- ...Position Overview We are seeking a dynamic and innovative Sales Engineer to join our team. The ideal candidate will have a strong cloud computing and cybersecurity background, with a proven history of supporting sales teams in complex technical environments. As a Sales...Remote work
Varonis
Columbus, OH4 days ago $136.6k - $184.8k
...supply chain — and we’re looking for talented people who want to help. You’ll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You’ll collaborate with people across AWS...Flexible hoursAmazon
Columbus, OH5 days ago- ...in Data Science, Statistics, Mathematics, Computer Science, Engineering, or equivalent experience. 4+ years of experience applying advanced... ..., and applied mathematics. 4+ years' experience using Databricks, Snowflake, or similar cloud‑based data platforms. Ability to...DatabricksWork at officeRemote work
McKesson’s Corporate
Columbus, OH1 day ago $150k
...Databricks Data Engineer Columbus, Ohio, United States About the Job Title: Databricks Data Engineer (Senior Manager / AVP) Location: Columbus, OH (1st choice), Remote (2nd choice) Experience Required: 7-12 years Base Salary: Up to $150k Job...DatabricksRemote workInizio Partners
Columbus, OH4 days ago- ...tracked actions to closure, and review-ready evidence package. 4. Lead Stakeholder Reviews and Approvals o Plan and facilitate reviews for the ISO 21434 assessment and TARA with key stakeholders (PCRA, BU Cybersecurity, Product Cybersecurity, and engineering leads)....
Dorleco
Columbus, OH2 days ago - ...IT Resources in Columbus, Ohio, is looking for a Senior Data Engineer to work with clinical and healthcare data. The role involves building... .... The ideal candidate has 5+ years of experience, strong Databricks skills, and a deep understanding of OMOP. This position also...Databricks
- ...Overview: Role Overview We are seeking a Data Engineer with strong expertise in Databricks, Python, and PySpark , coupled with experience in CI/CD pipelines. The ideal candidate will have a solid background in data management, data warehousing, and data...Databricks
Purple Drive
Columbus, OH4 days ago - ...looking to apply your relevant experience to a new industry, join our team as we help shape a brighter way forward. Operating Engineer JLL What this job involves: The Operating Engineer focuses on operating, maintaining, troubleshooting, and repairing all...Daily paidFull timeWork experience placementFlexible hours
*US AMR-Jones Lang LaSalle Americas, Inc.
Columbus, OH12 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Engineer. Be the first to apply!
