Databricks Developer - Python & Scala

dhanutek

Position Title: Databricks Developer – Python & Scala Location: Dallas, TX – onsite Duration: 12+ Months with possible extension Experience: 7+ years Job Description We are looking for an experienced Databricks Developer with strong expertise in Python, Scala, Apache Spark, and cloud-based data engineering. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and data processing solutions using the Databricks platform. Required Skills:

7+ years of experience in Data Engineering / Big Data development.
Strong hands-on experience with Databricks.
Strong programming experience in Python and Scala.
Excellent knowledge of Apache Spark / PySpark.
Strong experience with SQL and relational databases.
Hands-on experience with Delta Lake / Delta tables.
Experience developing and managing Databricks notebooks and workflows/jobs.
Strong understanding of ETL/ELT concepts and data pipeline architecture.
Experience with cloud platforms such as Azure or AWS.
Experience with Git and CI/CD.
Strong problem-solving and communication skills.

Preferred Skills:

Experience with Azure Data Factory (ADF).
Experience with Azure Data Lake Storage (ADLS).
Experience with AWS S3, Glue, EMR, or similar services.
Knowledge of Kafka or other streaming technologies.
Experience with Databricks Unity Catalog and data governance.
Knowledge of Terraform and Infrastructure as Code.
Experience with Jenkins/Azure DevOps.
Experience working in large enterprise environments, preferably telecommunications.

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Databricks Developer - Python & Scala in Dallas, TX vacancy

Databricks, Scala/Java, Azure
...Dallas, TXEmployment Type: C2CIndustry: Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Databricks, Scala/Java, AzureLocation: Dallas, TX (Day 1 Onsite)Kindly submit only locals who can come for in-person interview Job Description:The...
Databricks
Local area
SRI Tech
Dallas, TX
2 days ago
Senior Data Engineer
...space who specializes in Microsoft Azure and Databricks. This person will be a part of multiple... ...SQL (ETL, SSIS packages), and PySpark or Scala automation. Architecture experience in... ...Data Pipeline Architecture and CI/CD methodology-SQL-Automation (Python (PySpark), Scala)
Databricks
Addison Group
Dallas, TX
1 day ago
Python Developer with Perl
Job ID: 18695937Reference Number: 23-00126Title: Python Developer with PerlPosted Date: 2023-01-16Contact: Shyam MaramContact Email: shyam... ...using PySpark and Python for financial reporting using Databricks and AzureExperience on working in Cloud environment preferably...
Databricks
HAN Staffing
Dallas, TX
3 days ago
Data Engineer - MarTech
...and operate scalable batch and real-time data pipelines in Databricks and related tooling to support audience, personalization, and... ...proficiency in a programming language for data engineering (e.g., Python or Scala).Hands-on experience with Databricks/Spark, data lake/...
Databricks
Hourly pay
Work experience placement
7 eleven
Irving, TX
23 hours ago
Senior Software Engineer (Python)
...processing, and scalable backend services.In this role, you will develop scalable APIs, high-performance search capabilities, event-... ...with technologies including Azure, Elasticsearch, Kafka, Databricks, Python, and distributed systems to build highly available, low-...
Databricks
Full time
Allata
Dallas, TX
23 hours ago
Sr. Data Engineer
...in data engineering and analytics in • In-depth knowledge of Apache Spark, Pyspark and Databricks architecture. • Strong programming skills in languages such as Python or Scala. • Experience with data engineering concepts, ETL processes, and data modeling. •...
Databricks
Xforia Inc
Dallas, TX
23 hours ago
Cloud Data Engineer
...Engineer with expertise in Azure Databricks, Azure Synapse Analytics, SQL, and... ...candidate will have experience designing, developing, and optimizing scalable data... .... Strong technical skills in Python, PySpark, SQL, T-SQL, and Scala are required, along with experience...
Databricks
Full time
Work experience placement
Flexible hours
AmTrust
Dallas, TX
19 hours ago
Data Engineer II - QuantumBlack, AI by McKinsey
...adjacent technical rolesProficiency in Python, Scala, or Java for production-grade pipelines... ...and Delta LakePractical experience with Databricks, AWS Glue, and transformation... ...you might contribute in a given year: Develop a streaming data platform to integrate...
Databricks
Apprenticeship
Easy work
McKinsey & Company
Dallas, TX
2 days ago
Sr. Data Engineer
...project managers, IT architects, technical leads, and other developers, along with internal customers and cross functional teams... ..., and reporting).Top required experience: Apache Spark, Scala, Azure Databricks Nice to have skills: SQL; CICD Should have at least 5 years...
Databricks
Hourly pay
Work experience placement
Work at office
Local area
SRI Tech
Dallas, TX
2 days ago
Lead Data Scientist
$160.9k - $270.4k
...in at least one data science language (Python, R, Scala, etc.), as well as expertise with modern... ...to minimize model decay. Ability to develop custom Machine Learning (ML). Highly proficient... ...Environments (IDEs) such as Databricks Workspaces or Visual Studio Code. Proficiency...
Databricks
Temporary work
Local area
AT&T
Dallas, TX
2 days ago
AWS Cloud Engineer
...Functions, Kinesis, etc.) Programming skills in Python, Scala, or Pyspark for data processing and automation... ...). Data Pipeline Development: Design, develop, and optimize ETL/ELT pipelines using AWS & Databricks services such as Unity Catalog, Pyspark, AWS Glue...
Databricks
3B Staffing LLC
Dallas, TX
23 hours ago
Lead Data Engineer
...incidents. • 8+ years in Data Engineering, with strong hands-on Spark (PySpark/Scala), SQL, and Python. • Experience building and operating ETL/ELT pipelines on cloud platforms (AWS EMR/S3, Databricks, or equivalent); workflow orchestration (Airflow or similar). •...
Databricks
United IT
Dallas, TX
1 day ago
Data Engineer
...and operate scalable batch and real-time data pipelines in Databricks and related tooling to support audience, personalization, and... ...proficiency in a programming language for data engineering (e.g., Python or Scala). Hands-on experience with Databricks/Spark, data lake/...
Databricks
Compunnel
Irving, TX
2 days ago
Senior Data Engineer
$157.41k - $207.8k
...analysts to elevate our data ecosystem. Develop and maintain scalable data pipelines for... ...technologies (Hive, Spark, PySpark, Airflow and Databricks); Visualization tools (Power BI, Looker); and Programming languages (Python, Go, Scala, and Java). Local telecommuting permitted...
Databricks
Local area
Remote work
Avaya
Irving, TX
2 days ago
Entry Level Python/R Developer
$100k
...looking for entry-level software programmers, Java full stack developers, Python/Java developers, data analysts/data scientists, machine... ...skills. Preferred skills: NLP, text mining, Tableau, PowerBI, Databricks, Tensorflow.For Java/full stack/software positions required...
Databricks
Full time
H1b
SynergisticIT
Dallas, TX
2 days ago
Data Engineer
$100.79k - $160.26k
...., Azure Data Factory, Azure Databricks, Azure Event Hubs, SSIS) to ingest... ...SkillsProficiency in SQL and Python.Data pipeline tooling and... ...languages such as Java, Scala, or Go; experience integrating... ...we represent our clients and develop our people.Physical DemandsSedentary...
Databricks
Full time
Work at office
Remote work
Relocation
Visa sponsorship
Relocation package
DLA Piper
Dallas, TX
2 days ago
Technical Architect
...AZURE DATA LAKE, Azure Synapse Analytics, Databricks Job description... ...Factory and onpremise systems Spark expert Scala added advantage Fabric expert covering all... ...scalability 9Stay updated with the latest developments in Databricks and associated...
Databricks
Contract work
VBeyond
Dallas, TX
1 day ago
Data Engineer - West Region
...Azure, Google Cloud Platform (GCP), Databricks, and Snowflake, along with the technologies... ...and actionable development tasks.* Developing solutions across AWS, Azure, GCP,... ...in programming languages such as SQL, Python, Java and or Scala.* Experience with several modern data...
Databricks
Temporary work
Work at office
Local area
Slalom
Dallas, TX
1 day ago
Azure Databricks Engineer
...Key Responsibilities : Azure Databricks Architecture & Design :... ...understand business requirements and develop data solutions. Manage... ...in Spark, PySpark, Scala, or SQL for large-scale data... ...Strong programming skills in Python, Scala, or Java. Experience...
Databricks
Cedent Consulting
Dallas, TX
2 days ago
Data & ML Engineer
...where applicable. Expertise in programming languages such as Python or Scala, experience with data processing frameworks like Spark, and... ...Engineering, or related discipline Experience with Azure Databricks, Spark, Synapse, and MLFlow Experience with Docker, AKS,...
Databricks
Minimum wage
Full time
Local area
EssilorLuxottica Group
Dallas, TX
more than 2 months ago
GenAI Python Systems Engineer - Senior Associate
$77k - $202k
...Description & SummaryThe OpportunityAs a GenAI Python Systems Engineer - Senior Associate, you... ...Engineering practice, you will focus on developing and implementing advanced AI and ML... ...AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake, or related data and AI credentials...
Databricks
Full time
H1b
PwC
Dallas, TX
2 days ago
Backend Python Developer
...Backend Python Developer We're growing rapidly and are looking for a Senior Backend Developer with Python Application Developer experience... ...applications. Develop integrations with Snowflake, Databricks, and cloud based data platforms. Design and optimize data access...
Databricks
Work at office
Local area
CGI
Dallas, TX
3 days ago
Senior Architect, Data Engineering
$215.2k - $244.7k
...excellent opportunity to work with clients developing Big Data strategy and roadmaps, while... ...guidance and platform selection advice for Databricks, Snowflake, and/or Microsoft... ...using modern toolsets such as Spark on Scala, Storm, Flume, SqoopDesign data structures...
Databricks
Local area
Immediate start
Flexible hours
West Monroe Partners
Dallas, TX
4 days ago
Lead AI Engineer- Remote
$112.7k - $193.2k
...embeddings pipelines, and ETL/ELT jobs on Spark/Databricks; design analytics models and rules enginesDefine and develop APIs for integrations across the enterprise;... ...with solid AI/ML delivery (Azure preferred) with Scala, Python, PySpark4+ years hands on with Databricks4+...
Databricks
Minimum wage
Full time
Contract work
Work experience placement
Work at office
Local area
Remote work
UnitedHealth Group
Richardson, TX
23 hours ago
GenAI Python Systems Engineer - Experienced Associate
$63k - $140k
...Description & SummaryThe OpportunityAs a GenAI Python Systems Engineer - Experienced Associate... ...and techniques to design and develop robust data solutions for clients, transforming... ...AWS, Google Cloud, Microsoft Azure, Databricks, Snowflake, or related data and AI credentials...
Databricks
Full time
H1b
PwC
Dallas, TX
2 days ago
Informatica Python ETL Data Engineer & Tester
...to uphold the software quality standards Develop user training programs, documentation,... ...and Experience• Informatica development, Python, AWS, SQL, Oracle, and GitLab.• ETL Testing... ...or Mortgage domain experience.• Azure, Databricks, Snowflake, Redshift, PostgreSQL,...
Databricks
Full time
Temporary work
Relocation
Infosys Technologies
Richardson, TX
2 days ago
Senior Data Engineer on-site)
...experienced Senior Data Engineer with deep expertise in Azure Databricks to contribute to the design, development, and... ...ADF, Key Vault, Synapse. Strong programming skills in Python, SQL, and familiarity with Scala. Solid understanding of data modeling (OLTP/OLAP), star...
Databricks
Ziosk
Dallas, TX
3 days ago
Senior Staff Backline Engineer - Data & AI
$170.4 per hour
P-1381At Databricks, we are passionate about enabling Data & AI teams to solve the world... ...and the health of our products. By developing smart solutions and streamlining... ...Solid hands-on programming skills in Python, SQL, or Scala.Product Supportability Track: Deep understanding...
Databricks
Local area
Worldwide
DataBricks
Dallas, TX
2 days ago
Data Engineer II
...ll be connecting, ingesting, and exporting data between two Databricks instances, making pipelines available for internal and external... ...in a programming language for data engineering (e.g., Python or Scala). Hands-on experience with Databricks/Spark, data lake/warehouse...
Databricks
Full time
Contract work
Motion Recruitment
Irving, TX
2 days ago
Senior Unified Data Semantic Engineer
...Miramar, FL 33027 Duties Design and develop a scalable modular semantic layer framework... ...engineering, computer programming (Python, Scala, or Java), and AI/ML algorithms. Experience... ...developing semantic layer solutions (Databricks, Snowflake, or similar) and cloud-based...
Databricks
Work at office
Local area
Remote work
Southern Glazer's Wine and Spirits
Dallas, TX
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Databricks Developer - Python & Scala. Be the first to apply!