Databricks Data Engineer
Prophecy Technologies
Role Overview: This role is for a Databricks Data Engineer with experience in designing, developing, and deploying robust, scalable batch and streaming data pipelines using PySpark, Spark SQL, and Delta Live Tables. Key Responsibilities:
- Data Pipeline Development: Design, develop, and deploy data pipelines using PySpark, Spark SQL, and Delta Live Tables.
- Data Modeling & Transformation: Implement complex data transformations and business logic using the Medallion Architecture.
- Data Quality & Reliability: Design and implement data quality frameworks and cleansing routines.
- Performance & Cost Optimization: Proactively monitor, debug, and tune Databricks jobs and Spark clusters.
- Infrastructure as Code & CI/CD: Partner with DevOps teams to manage Databricks environments, clusters, and job deployments.
- Data Governance & Security: Implement governance capabilities using Databricks Unity Catalog.
- Collaboration: Work closely with Functional Consultants, Data Scientists, and Analytics Engineers.
- Databricks & Spark Expertise: Deep hands-on experience with the Databricks Lakehouse Platform.
- Programming & Data Engineering: Expert-level proficiency in Python and PySpark.
- Data Warehousing Concepts: Strong knowledge of data modeling principles.
- Cloud & Software Engineering: Proven experience with a major cloud platform.
- Databricks Certified Data Engineer - Professional certification.
- Experience with Terraform or other IaC tools.
- Experience delivering data solutions in retail or e-commerce environments.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Databricks Data Engineer in Marlborough, NH vacancy
$70 - $75 per hour
...Hi, I hope you're doing well. We have an immediate contract opportunity for a Databricks Data Engineer . Please find the details below: Role: Data Engineer (Databricks / Spark) Location: Marlborough, NH (Onsite) Duration: Long...DatabricksLong term contractContract workImmediate startDiverse Lynx
Marlborough, NH4 days ago$100k
...Java Full stack developers, Python/Java developers, data analysts/data scientists, machine learning engineers for full time positions with clients. Who should... ...skills include NLP, text mining, Tableau, PowerBI, Databricks, Tensorflow. For Java/full stack/software...DatabricksFull timeH1bRemote workSynergisticIT
Keene, NH2 days ago$50k - $60k
...and technology. If a customer is looking for a better way to manage their warehouse inventory, equip their workforce, or secure their data, we make it happen. All it takes is finding the right combination of tech hardware, software, cloud solutions, and support services....SuggestedHourly payWork at officeWork visaMonday to FridayPC Connection Inc
Keene, NH4 days ago$131k - $220k
...objectives. Lead the digital product development in partnership with engineering, architecture, and other teams to develop and refine the... ...Experience with Salesforce Financial Services Cloud, Data Cloud and Experience Cloud is preferred Experience presenting...SuggestedFull timeWork at officeLocal areaRelocation packageAmerican Family Insurance
Keene, NH4 days ago- ...We are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/ Data Scientists, Machine Learning engineers. Who Should Apply Recent Computer science/Engineering /Mathematics/Statistics or Science Graduates looking...SuggestedH1b
SynergisticIT
Keene, NH1 day ago - Position Overview Keep our communities fed. Our focus is simple but meaningful, from our distribution centers to our offices - every employee of C&S and their family of companies works to help feed local families, neighbors, and communities. Our focus is simple but...Weekly payFull timeWork at officeLocal areaShift workNight shiftDay shift
C&S Wholesale Grocers Inc
Keene, NH5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Data Engineer. Be the first to apply!
