Data Engineer - Databricks
Insight Global
Job Description About the Role We’re seeking a Data Engineer with strong Databricks experience to join a high-impact Data Platform team building a modern, analytics-ready lakehouse environment. You’ll play a key role in developing scalable pipelines and delivering trusted datasets that power both internal analytics and customer-facing solutions. This is a hands-on role across the full data lifecycle, from ingestion through transformation and consumption-ready data models. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to View email address on click.appcast.io learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: Skills and Requirements What You’ll Do
- Build and maintain data pipelines in Databricks across batch and streaming patterns
- Develop and optimize Delta Lake / lakehouse transformations (silver/gold layers, facts & dimensions)
- Implement incremental processing, SCD Type 1 & 2 logic, and data quality controls
- Translate business requirements into reusable, production-ready data pipelines
- Contribute to CI/CD and infrastructure-as-code for the data platform
- Monitor and optimize pipeline performance, cost, and reliability
- Collaborate with stakeholders to support data SLAs, contracts, and reporting needs
- Support onboarding of new data sources as the platform scales
- 3+ years of hands-on data engineering experience
- Strong experience with Databricks (required)
- Advanced SQL (window functions, MERGE/upsert patterns, incremental pipelines)
- Proficiency in Python for data ingestion and orchestration
- Experience with Apache Spark and Delta Lake
- Strong understanding of dimensional data modeling (facts, dimensions, SCDs)
- Experience building and supporting production data pipelines
- Databricks Certified Data Engineer Associate (or similar certification)
- Experience with Delta Live Tables, Unity Catalog, or Databricks workflows
- Exposure to streaming/event-driven architectures (Kafka, etc.)
- Familiarity with Terraform / Infrastructure-as-Code
- Experience supporting BI/reporting tools (Power BI or similar)
- Work on a modern Databricks lakehouse platform with real business impact
- Collaborate with a high-performing, cross-functional team
- Opportunity to deepen expertise in cutting-edge data architecture
- Clear path toward greater technical ownership and growth Insight Global
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Databricks in Portland, ME vacancy
- ...IT enthusiasts, Python/Java developers, Data analysts/ Data Scientists. We welcome candidates... ...Should Apply : Recent Computer science/Engineering /Mathematics/Statistics or Science... ...skills Preferred skills: Powerbi, Databricks, Snowflake, NLP, Text mining, Tableau, Time...Databricks
- ...IT enthusiasts, Python/Java developers, Data analysts/Data Scientists. We welcome candidates... ...to apply. Recent Computer science/Engineering/Mathematics/Statistics or Science... ...communication skillsPreferred skills: Powerbi, Databricks, Snowflake, NLP, Text mining, Tableau,...Databricks
$45 - $60 per hour
...Maine Type: Contract Job #20891 Ready to take the next step as a Data Engineer in Westbrook, Maine? Do you enjoy building scalable data... ...SQL, data engineering, ETL/ELT development, data warehousing, Databricks, Snowflake, AWS, and dbt who enjoy building and enhancing data...DatabricksContract workWork at officeLocal areaImmediate start- ...Datacenter Engineer The engineer in this position should have a wealth of experience engineering/installing datacenter equipment. The... ...cohesive package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead...SuggestedFor contractorsWork at officeLocal area
ADEX
Portland, ME5 days ago - ...role, you will be responsible for building out key components of data ingestion and transformation, using a combination of strong... ...Education & Experience: Bachelor’s degree in Computer Science, Engineering, or similar disciplines and 5 or more years of professional experience...SuggestedWork experience placement
$85k - $225k
Join to apply for the AI Data Engineer role at Veeva Systems Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed...Full timeWork at officeLocal areaRemote workWork from homeFlexible hours$115k
Machine Learning Engineer IDEXX's Data & AI Center of Excellence is seeking a Machine Learning Engineer to join our AI Enablement Team. This... ...production environments. Familiarity with ML tech stacks such as Databricks, Delta Tables, AWS (EC2, S3, SageMaker), and...DatabricksWork at officeLocal areaWorldwide2 days per week$200.6k - $250.4k
Principal Software Engineer, Semantic Data ServicesAbout the RoleWEX is reimagining its enterprise data platform with an ambitious goal: make... ...such as Spark, Flink, Kafka, Iceberg, Snowflake, Databricks, cloud-native data services, graph databases, or equivalent...DatabricksFull timeFlexible hours$90k - $110k
...communication.We are seeking a highly motivated and experienced Data Engineer to join our IT Data Engineering team and support the... ...to our customers in near-real-time. This is not a SQL/ELT or Databricks-notebook-driven role; candidates must have experience building...DatabricksWork at officeLocal areaWorldwide$120k - $240k
...Collaborate with our technology partner ecosystem, including but not limited to Snowflake, AWS, Databricks, and Siemens. Work collaboratively with your Pod (Sales Engineer and Business Development Rep) to question and develop an understanding of the prospect's challenges...DatabricksFull timeRemote work- We are looking for a Data Engineer to help build and maintain reliable data solutions for a client. This position focuses on moving, transforming, and validating data from multiple sources to support reporting, analytics, and operational needs. The ideal candidate will...
$62 per hour
*Description* Builds robust, fault-tolerant data pipelines that collect, assemble and potentially transform and aggregate unorganized data distributed into databases or data sources such as operational data stores, data integration hubs and data lakes or estuaries. Compiles...Contract workTemporary work- ...you’ll help share the client's marketing data strategy. This includes driving data... ...with cross-functional teams such as IT and engineering to integrate data from various sources into... ...working within data platforms like Databricks/Snowflake, and analytics modeling platforms...DatabricksFull time
FocusKPI
Portland, ME2 days ago - ...advanced methods to analyze operational data and derive meaningful, actionable insights... ...ETL/ELT pipelines using SQL Server and Databricks leveraging Apache Spark/PySpark for... ...workflows. -Understanding of data engineering concepts, including ETL/ELT, data modeling...DatabricksMinimum wageContract workTemporary workWork experience placementWork at officeRemote work
MAXIMUS
Portland, ME4 days ago $91k - $104k
...and risk management to explain valuation movements and resolve data questions Process Optimization & AI Automation Audit existing... ...Utilize Python and modern data platforms (such as Power BI, Databricks, or Microsoft Fabric) to transition manual reports into...DatabricksFull timeWork at officeFlexible hours3Degrees
Portland, ME24 days ago$120k - $150k
Manager Of Data Engineering IT accelerates the success of IDEXX employees and customers by providing scalable and innovative solutions and leadership. We are a global organization that supports all technology needed to deliver products and solutions to customers enabling...Local areaWorldwideFlexible hours$96.1k - $115.5k
...Then this role is for you! In today's software development and data landscape, collaboration, end-to-end (E2E) accountability, problem... ...business outcomes.We believe in the power of integrated engineering, where development, data quality, architecture, and agility skills...Full timeFlexible hours$109.1k - $224k
...obtain buy-in and drive decision making. Integrate large volume of data from different sources (including DB2, SQL Server, Web API and... ...scraping, or object-oriented software is preferred. Experience engineering solutions using cloud platforms and exposure to scaling...Temporary workWork experience placementWorldwideFlexible hours$87.79k - $124k
...person at Northeastern's Roux Institute in Portland, Maine. The Data Scientist at the AI Solutions Hub (AISH), the delivery arm of... ...who will work under the guidance of senior data scientists, AI engineers, and faculty leads. The Data Scientist will contribute to data...Full timeWork experience placementInternship- ...Description We are looking for a Senior DevOps/MLOps Engineer to join our AI Enablement team within the Data and AI COE on a contract basis. In this role, you... ...effectively build and operate on our enterprise Databricks environment on AWS. You will contribute to...DatabricksContract workWork experience placement
- ...Unum is seeking a data science professional to partner with business units, turning data into actionable insights and growth opportunities. The role involves integrating large data sources and applying advanced modeling to forecast and assess risk. You will lead analytics...
$105.79k - $141.05k
...the trusted network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network and... ...the U.S. The Role At Lumen, the Lead Information Security Engineer owns the development, maintenance, and defensibility of the security...Full timeTemporary workRemote workLumen
Portland, ME4 days ago$40 per hour
...As a Machine Learning Engineering Intern, you will be part of a collaborative team supporting the development, deployment, and monitoring... ...learning models. Your primary role is to contribute to Workiva's data scientists' efforts within the Data Management and Analytics...Remote jobFull timeSummer workInternshipSummer internshipWork at officeWorkiva
South Portland, ME2 days ago$104.9k - $199.07k
...Our company purpose is to empower easy, data-driven decision-making on important healthcare... ...Product Manager with a platform engineering focus to join our team of engineers, designers... ...technologies (e.g., experience with Databricks, SQL, R, Python etc.)Understanding of cloud...DatabricksFull timeWork experience placementRemote workFlexible hours$78.8k - $145.13k
...Our company purpose is to empower easy, data-driven decision-making on important healthcare... ...Managers work closely with our client engineering teams (located in both the US and India)... ...and as part of a teamExperience with Databricks and cloud platforms, particularly...DatabricksFull timeWork experience placementRemote workFlexible hours$107.66k - $161.7k
...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture... ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale...Remote jobFull timeWork experience placementInternshipQuora
Portland, ME2 days ago$195k - $260k
...About the Role WEX is transforming into a data-driven enterprise through its modern Data-as-a-Service (DaaS) platform. At the core... ...this strategy is a need for world-class technical leadership—engineers who can see across domains, design foundational systems, and set...Flexible hours- ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with... ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
Instacart
South Portland, ME2 days ago $163k - $245k
...Total Visits, March 2025) Day to Day As a Staff Machine Learning Engineer, you will be a team lead on the Employer Agents Team. Your team... ...product and technical goals. On a daily basis, you will explore data, formulate problem statements, build new agentic experiences,...Work experience placementLocal area$73.3k - $150.5k
...others, and join Team Unum today! General Summary:We are seeking a Data Scientist II to join the CX Analytics team within our Customer... ...complex work, partnering closely with BI Analysts and Data Engineers to ensure analyses are grounded in reliable data and effectively...Full timeTemporary workWork experience placementRemote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Databricks. Be the first to apply!
Related searches
- data engineer machine learning Portland, ME
- data science developer Portland, ME
- finance data engineer Portland, ME
- data engineer analytics Portland, ME
- data center engineer Portland, ME
- data engineer Portland, ME
- senior data center engineer Portland, ME
- data developer Portland, ME
- data engineering intern summer Portland, ME
- data capturer Portland, ME