DataBrick Data Engineer
American IT Systems
Job Title: DataBrick Data Engineer
Location: Across USA any Location- Remote
6+ Months
Job Summary
The Databricks Data Engineer owns the end-to-end migration strategy, target architecture design, and technical execution of moving legacy ETL workloads to the Databricks Lakehouse. He will establish migration standards, optimize PySpark pipelines, orchestrate complex data workflows, and deploy proprietary automation tools to ensure a seamless, high-performing transition from legacy systems.
Key Responsibilities
Architectural Strategy & Governance
- Design the target Databricks Lakehouse architecture utilizing Delta Lake , Photon , and Unity Catalog .
- Establish global code refactoring standards, optimization benchmarks, and PySpark best practices.
- Resolve highly complex dependency mappings and architect seamless, zero-downtime dual-run strategies.
- Lead the technical deployment and integration of specialized migration accelerators
Hands-on Engineering & Optimization
- Review automated output from migration tools and manually refactor complex legacy logic into high-performing PySpark notebooks.
- Eliminate legacy anti-patterns such as massive row-by-row processing and inefficient lookups.
- Optimize PySpark code performance using advanced Spark features including Z-Ordering , partitioning , and caching .
- Build robust Databricks Workflows and orchestrate complex DAGs based on comprehensive source lineage.
Technical Skills & Competencies
- Core Platforms : Databricks, Delta Lake, Unity Catalog, Photon, DataStage.
- Languages & Frameworks : PySpark, Python, SQL, Shell Scripting.
- Cloud & DevOps : AWS alongside CI/CD deployment pipelines.
- Orchestration : Apache Airflow, Databricks Workflows.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the DataBrick Data Engineer in Remote vacancy
$100k - $125k
...including discounts on our products! We are currently hiring for a Data Engineer! This is a full-time position working out of our Champaign,... ...Azure Data Factory pipelines Build and maintain Databrick scripts and Python scripts to load and transform data Develop...SuggestedFull timeTemporary workWork experience placementCurrently hiringWork at officeLocal areaRemote workMonday to Friday$120k - $135k
Full Time, Fully Remote Sr. Azure Data Engineer opportunity with rapidly growing financial corporation Employee testimonials: Great company... ...Science or related field required. License/Certification Databrick Data Engineer Associate required. License/Certification Databrick...SuggestedFull timeRemote work$121.7k - $162.2k
...? At MGM Resorts, we seek individuals like YOU to create unique and show-stopping experiences for our guests.THE JOB:The Senior Data Engineer provides technical leadership in the architecture, development, and operational management of enterprise data platforms and integration...SuggestedFull timeHome office$160.06k - $183.33k
...USAJob Family GroupEngineering / Product DevelopmentJob ProfileLead Data EngineerManagement LevelManager - Non People LeaderFlexible Work... ...Services, LLCLead Data EngineerJob Description: Lead Data Engineer positions offered by Cox Automotive Corporate Services, LLC (Atlanta...SuggestedFull timeWork at officeRemote workFlexible hours- ...customers and colleagues. Those stories are part of what makes this such a special place to work.Job Overview The Lead Enterprise Data Engineer designs and maintains scalable data architecture to support Macy’s analytics initiatives. This role ensures high-quality, secure...Suggested
$128.04k - $173.23k
...Possess: None Clearance Level Must Be Able to Obtain: None Public Trust/Other Required: None Job Family: Data Science and Data Engineering Job Qualifications: Skills: Data Lake, Data Migration Design, Data Warehousing (DW), ETL Design Certifications...Full timeTemporary workWork at officeImmediate startRemote workWorldwideFlexible hours$128.04k - $173.23k
...Possess: None Clearance Level Must Be Able to Obtain: None Public Trust/Other Required: None Job Family: Data Science and Data Engineering Job Qualifications: Skills: Data Analysis, Data Analytics, Data Lake, Data Warehousing (DW) Certifications:...Full timeTemporary workWork at officeImmediate startRemote workWorldwideFlexible hours$151k - $168k
...Miami, London, Munich, Geneva, Stockholm, Shanghai, and Beijing, among other locations globally. Job SummaryCAA is seeking a Lead Data Engineer with deep expertise in data engineering, data architecture, database development, and data modeling to provide technical...Permanent employmentFull timeWork at officeLocal areaRemote work2 days per week- Req ID:373986NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be... ...thinking organization, apply now.We are currently seeking a Lead Data Engineer to join our team in Pla, Texas (US-TX), United States (US)....Work at officeRemote workFlexible hours
- ...leader, take a look at the exciting employment opportunities that are currently available and apply online.Job SummaryAs a Lead Data Engineer, you will be responsible for leading the design and implementation of complex data solutions and managing the organization's data...Full timeLocal area
$174k - $230k
...our way to creating a category defining business assisting needy Americans. The Job We are looking for our first in-house Data Engineer to own and evolve our core data infrastructure. This is an early and high-impact role. As the data engineering function grows under...Full timeFor contractorsRemote work$120.9k - $187k
...careers by learning from the world and each other.POSITION TITLELead Data EngineerPOSITION LOCATIONThis position is available to Virginia... ...end-to-end‑to‑end data architecture, data governance, and data engineering from source systems to data consumers—is seeking a Lead Data...Full timeWork at officeLocal areaRemote workWork visa- ...place for you. About the Role:At PitchBook, we believe that the Data Operations team plays a vital role in setting us apart from our... ...overhead Act as a technical mentor and coach a team of data engineers with diverse experience levels Uplevel the team’s capabilities...Work at officeRemote workVisa sponsorship
- ...we invest in our employees and our community. Join us in using data, bold thinking, and a commitment to innovation to help clear the... ...accounting, investor reporting, and collections. As a Lead Data Engineer, you'll lead the Financial Data Operations team, owning the pipelines...Full timeWork at officeLocal areaRemote workRelocationFlexible hours
$90k - $200k
..., and government agencies, a list that spans across the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine learning...Work at officeRemote workVisa sponsorshipWork visaFlexible hours$130k - $155k
Position: Data Engineer Location: Boston, MAJob Id: 467 # of Openings: 1 Geode Capital Management, LLC is seeking a highly motivated Data Engineer to join our Data team. The engineer will report to the Director...Work at officeRemote workMonday to Friday$100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workRelocationVisa sponsorshipRelocation package- ...be authorized to work in the United States without the need for current or future sponsorship.Predictive Analytics is seeking a Data Engineer to join our Business Data and Analytics department. In this role, you’ll collaborate with claim and underwriting professionals,...Full timePart timeSeasonal workWork at officeRemote work
$107.5k - $204.5k
...the strength of more than 100 years of experience and renowned engineering expertise to meet the needs of today’s mission and stay ahead of... ...and defense.Raytheon is seeking a highly skilled and motivated Data Engineer to join our Digital Technology, Data, Analytics & AI (...Temporary workWork experience placementWork at officeLocal areaRemote workWork from homeFlexible hours$77.6k - $176k
Data EngineerThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more... ...unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it...Full timeContract workPart timeWork at officeLocal areaRemote work$101.69k - $112.99k
..., E-3, etc.). Applicants requiring visa sponsorship to start employment with Eversource will not be considered.Highly motivated Data Engineer will conduct advanced analytics to increase the efficiency and effectiveness of Eversource Protection and Controls (P&C) activities...Full timeH1bWork at officeWork from home2 days per week$145k - $160k
Job DescriptionEverforth ECS is seeking a Data Engineer to work in a hybrid remote/onsite capacity, with minimum of 3 business days onsite at our Fairfax, VA corporate office and/or our Ashburn, VAcustomer site.Please Note: This position is contingent upon contract award...Contract workWork at officeRemote work$248.3k - $315k
...Technical Center three times per week, at minimum [or other frequency dictated by the business if more than 3 days].The RoleThe Agentic Data Engineer is a pre‑eminent technical expert who designs, builds, and scales industrial-grade data and AI platforms that power vehicle...Full timeH1bLocal areaWork from homeRelocation packageFlexible hours$140k - $175k
...next-generation solutions that patients and healthcare partners need today and into the future. Job Description The Data Engineer will be responsible for building and maintaining the platform that services timely and accurate data for operational teams and business...Full timeTemporary workWork experience placementRemote workFlexible hours$81.12k - $129.79k
...Employment Status: Full time Shift: Day (United States of America) Facility: Remote - VA Requisition Number: R161952 Data Engineer-Nordic OMOP (Open) How You’ll Help Transform Healthcare: Candidates residing in the following states may be considered for...Full timeWork experience placementRemote workMonday to FridayShift work$150.1k - $225.1k
...create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. Data Engineer II Aliso Viejo, CA The Data Engineering Team fuels real-time, intelligent data insights for PlayStation’s Cloud...Full timeRemote work- ...Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview:We are seeking a highly skilled Sr. Data Engineer to join our team in McLean, VA. The ideal...Local areaRemote work
$99k - $225k
Data Visualization EngineerThe Opportunity: As a data scientist, you’re excited at the prospect of unlocking the secrets held by a... ...basic design principles5+ years of experience with Data pipeline engineering, such as executing data transformation stages4+ years of...Full timeContract workPart timeWork at officeLocal areaRemote work$90.7k
ResponsibilitiesNoblis is seeking Data Engineers at multiple levels to join our team in support of national security missions. As the ETL Developer, you analyze our clients’ challenges and provide solutions by identifying and applying new tools and technologies to help...Full timeContract workPart timeLocal areaRemote work$90k - $130k
...with bragging rights to the only network that offers voice and data connectivity anywhere in the world. For over 20 years, Iridium’... ...the world.What We’re Looking For:If you are experienced in data engineering, cloud-based data platforms, and enterprise data modernization,...Full timeWork at officeRemote work3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to DataBrick Data Engineer. Be the first to apply!
Related searches
- data center engineer Remote
- senior cloud data engineer Remote
- data infrastructure engineer Remote
- sr information security engineer Remote
- hadoop big data developer Remote
- data visualization developer Remote
- remote data engineer Remote
- etl data engineer Remote
- data engineer analytics Remote
- sr data engineer Remote