Databricks Engineer

About Apexon:

Apexon is a digital first technology services firm specializing in accelerating business transformation and delivering human centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.

Apexon brings together distinct core competencies in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering, and UX, along with deep expertise in BFSI, healthcare, and life sciences, helping businesses capitalize on the unlimited opportunities digital offers.

Our reputation is built on a comprehensive suite of engineering services, a dedication to solving clients' toughest technology problems, and a commitment to continuous improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon has a global presence across four continents.


We enable #HumanFirstDIGITAL


We are hiring for a Databricks Engineer opportunity.


Role: Databricks Engineer
Location: Remote
Position: 1
Employment Type: W2 Only


Role Overview:

We are seeking an experienced Databricks Engineer with strong expertise in Databricks Lakehouse, PySpark, SQL, Medallion Architecture, and Unity Catalog. The ideal candidate will be responsible for designing, developing, optimizing, and securing scalable data pipelines while implementing best practices for data governance, performance tuning, and CI/CD within the Databricks platform.


Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Databricks, PySpark, and SQL.

• Implement and optimize Medallion Architecture for efficient data processing.

• Perform performance tuning and optimization of Databricks workloads and Lakehouse environments.

• Configure and manage Unity Catalog, including row level and column level security.

• Manage data lineage, governance, and secure data sharing across enterprise environments.

• Implement and maintain CI/CD pipelines and automated testing processes within Databricks.

• Collaborate with cross functional teams to deliver reliable and scalable data solutions.

• Ensure data quality, security, and compliance across data engineering processes.

• Troubleshoot and resolve data pipeline and platform performance issues.

• Support ongoing enhancements and operational activities within the Databricks ecosystem.


Required Skills:

• Strong proficiency in PySpark.

• Advanced SQL experience.

• Hands on experience with Databricks Lakehouse Platform.

• Experience implementing Medallion Architecture.

• Performance tuning and optimization within Databricks.

• Experience configuring Unity Catalog.

• Knowledge of row level and column level security.

• Experience managing data lineage and secure data sharing.

• Hands on experience with CI/CD implementation and testing processes in Databricks.

• Strong analytical and problem solving skills.

• Excellent verbal and written communication skills.


Preferred Skills:

• SAS

• SQL

• Unix

• Linux


Expected Deliverables:

• Scalable Databricks Data Pipelines.

• Optimized Lakehouse Performance.

• Medallion Architecture Implementation.

• Unity Catalog Security Configuration.

• Data Lineage and Governance Solutions.

• CI/CD Pipeline Implementation.

• Technical Documentation and Operational Support.


Education Requirement:

• Bachelor's degree required.


Our Commitment to Diversity & Inclusion:

Did you know that Apexon has been Certified™ by Great Place To Work® in multiple global regions? Apexon is committed to being an equal opportunity employer and promoting diversity in the workplace. We take affirmative action to ensure equal employment opportunity for all qualified individuals. Apexon strictly prohibits discrimination and harassment of any kind and provides equal employment opportunities to employees and applicants without regard to gender, race, color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other characteristic protected by law.


Our Commitment to Environment:

Actively contribute to Apexon's commitment to environmental responsibility by following sustainable practices and supporting ESG initiatives.


Our Perks and Benefits:

Our benefits and rewards program has been thoughtfully designed to recognize your skills and contributions, elevate your learning experience, and provide care and support for you and your loved ones.


We also offer:

• Health Insurance with Dental & Vision

• 401K Plan

• Life Insurance, STD & LTD

• Paid Vacations & Holidays

• Continuous Skill Based Development and Career Advancement Opportunities