Data Engineer

The client is seeking a Senior Data Engineer to join an aggressive, fast-paced data modernization initiative where the ability to hit the ground running is essential. This role centers on building and managing data ingestion pipelines within a Databricks environment, as well as developing APIs to expose data for front-end portal consumption. The ideal candidate brings strong hands‑on experience with Databricks, Spark, and Python, and possesses excellent verbal and written communication skills to collaborate effectively with a cross‑functional team of engineers and stakeholders. If you believe you are the right fit for the role, we welcome you to apply! Key Responsibilities Design, develop, and maintain data ingestion pipelines using Databricks to move data into the organization's database environment Build and expose APIs to make ingested data available for consumption by front‑end portals and downstream applications Implement CI/CD workflows using Databricks Asset Bundles to promote code across environments (dev, QA, production) Perform QA and validation of pipeline outputs to ensure data accuracy, completeness, and reliability Collaborate with technical leads and fellow engineers to understand requirements and deliver solutions with minimal ramp‑up time Write clean, efficient, and maintainable Python and Spark code following team standards and best practices Proactively communicate progress, blockers, and delivery timelines to project leadership without waiting to be prompted Contribute to a delivery‑focused team culture where accountability and ownership of assigned work are paramount We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. Skills and Requirements 7+ years of hands‑on experience with Databricks, including pipeline development and platform configuration 7+ years of experience with Apache Spark for large‑scale data processing 7+ years of experience writing production‑grade Python code in a data engineering context Demonstrated experience with CI/CD pipelines using Databricks Asset Bundles (or equivalent Databricks‑native deployment tooling) for code promotion and environment management Experience building and deploying data ingestion pipelines from source systems into a cloud data lakehouse or warehouse environment Experience developing or integrating APIs to expose data assets for application or front‑end consumption Strong accountability mindset — ability to self‑manage, deliver on commitments, and proactively surface blockers without waiting for direction Experience in Healthcare technology is a huge plus! ArcGIS Python API Experience #J-18808-Ljbffr Insight Global