Senior Data Engineer (Databricks or equivalent)

Senior Data Engineer (Databricks or equivalent)

Print (

Apply



Senior Data Engineer (Databricks or equivalent)

Salary

See Position Description

Location

390 Robert St. N St. Paul, MN

Job Type

Full-Time

Remote Employment

Flexible/Hybrid

Job Number

2026-00201

Division

Regional Administration

Department

IS-Admin

Opening Date

05/29/2026

Closing Date

6/14/2026 11:59 PM Central

• Description

• Benefits

• Questions

WHO WE ARE

This position is eligible for a hybrid telework arrangement (both remote and onsite). Candidate's permanent residence must be in Minnesota or Wisconsin.

We are the Metropolitan Council, the regional government for the seven-county Twin Cities metropolitan area. We plan 30 years ahead for the metropolitan area and provide regional transportation, wastewater, and housing services. More information about us is on our website ( .

We are committed to supporting a diverse workforce that reflects the communities we serve.

Information Services is the central IT department supporting all divisions of the Metropolitan Council. Our 140 team members provide technology, practices, and innovative solutions that enable the Council's core services.

How your work would contribute to our organization and the Twin Cities region:

The Senior Data Engineer designs, develops, and maintains data solutions. This includes databases, data platforms, data lakes, data warehouses, and data marts, as well as data movement (data pipelines/ETL/ELT – extracting, transforming, and loading data). They collaborate with technology and business units to create solutions that make data available to systems and/or data consumers, such as developers, data scientists, business analysts, or line-of-business users. They may also integrate data, including analytics and data science outputs, into existing business processes or systems.

The Senior Data Engineer ensures the security, performance, and availability of these data solutions. They administer data tools and identify and resolve data quality issues.

The ideal candidate for the position has a high degree of expertise in data platforms and database technologies, data modeling, structured and unstructured data, and strong programming skills. They have strong communication skills and experience working on small to large, highly complex initiatives. The ideal candidate has a proven track record of developing successful data strategies and is a strong teammate who can listen, lead, and mentor others effectively.

Benefits: Great work/life balance, insurance starting on day one, MN State Retirement Program pension, in-house clinic, salary continuance for injury or illness, 13 paid holidays per year plus generous annual leave, employee development, free Metro Transit rides, and much more!

Full Salary Range: $44.72 - $72.53 hourly/$95,804.80 - $155,396.80 Annually

What you would do in this job

• Collaborate with technology and business stakeholders to determine data needs.

• Develop data solutions using various software development methodologies, including waterfall and agile.

• Write and understand complex SQL queries and define best practices.

• Develop and support ELT/ETL solutions utilizing Python, Scala, or other object-oriented programming languages

• Design, develop, and maintain data integrations between source and target systems.

• Understand and implement data security and data classifications.

• Innovate and leverage emerging technologies and participate in strategic planning.

• Set up monitoring and alerting for data solutions.

• Script, automate, configure, and monitor data processes.

• Troubleshoot database, data integration, or application issues related to data.

• Build and maintain modern cloud data platforms for reporting and analytics.

• Partner with business intelligence and analytics developers on metric development, reporting, and visualizations.

• Work with a variety of internal and external data sources, including APIs, Web Services, and integration platform-as-a-service.

• Work with data streaming and messaging services to move data between systems.

• Provide technical leadership on projects and initiatives

• Mentor peers and partners across the organization

What education and experience are required for this job (minimum qualifications)

Any of the following combinations of education (in Computer Science/Engineering, Information Technology, or related) and directly related experience:

• Master's degree and three (3) years of experience.

• Bachelor's degree and five (5) years of experience.

• Associate's degree and seven (7) years of experience.

• High school diploma/GED and nine (9) years of experience.

Knowledge, Skills, and Abilities Required:

• Experience developing data solutions for the cloud

• Modern cloud data platform experience in tools such as Databricks, Snowflake, or an equivalent.

• Proficiency in Python, Scala, or other equivalent object-oriented programming languages

• Gathering, understanding, and analyzing stakeholder requirements, needs, and objectives.

• Data development methodologies, best practices, standards, and procedures.

• Experience writing and tuning complex SQL queries and defining SQL best practices.

• Installation and configuration of database software and drivers on servers and clients.

• Data modeling, database normalization, and denormalization techniques.

• Designing, developing, and maintaining data solutions for operations, reporting, and analytics (databases, data platforms, data lakes, data warehouses, and data marts).

• Designing, developing, and maintaining data integrations (data pipelines/ETL/ELT – extracting, transforming, and loading data) using various types of data sources and targets.

• ITIL, Incident, Service, and Change Management, including SLAs and metrics.

What additional skills and experience would be helpful in this job (desired qualifications):

• Experience with APIs, Web Services, and Integration Platform as a Service.

• Data streaming and messaging experience.

• Reporting and data visualization experience.

• Experience leading a technical team.

• Experience working and collaborating with individuals from diverse backgrounds.

What you can expect from us:

• We offer the opportunity to make a difference and positively influence the Twin Cities metropolitan area.

• We encourage our employees to develop their skills through on-site training and tuition reimbursement.

• We provide a competitive salary, excellent benefits, and a good work/life balance.

More about why you should join us! (

Additional information

Union/Grade: AFSCME/Pay Grade I

FLSA Status: Exempt

Safety Sensitive: No

Work Environment:

Work is performed in a standard office setting. Requires travel between primary work site to other sites.

The responsibilities listed are typical of the positions included in the job classification; however, not all duties are necessarily performed by each specific position. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential duties of the position. Regular attendance is an essential responsibility.

Security Policy:

This position involves direct access to Criminal Justice Information (CJI) as defined by the FBI CJIS (Criminal Justice Information Services) Security Policy. In accordance with section 5.12.1.1 of the FBI CJIS Security Policy, final candidates if applicable must be willing to submit to a state of residence and national fingerprint-based record check. If the result of the record check reveals criminal convictions, the nature and circumstances of those convictions will be reviewed by the Metropolitan Transit Police Department and/or the Minnesota Bureau of Criminal Apprehension to determine if access to Criminal Justice Information would be permissible. If it is determined that access to Criminal Justice Information would not be permissible, the candidate will no longer be eligible for this position.

If you are new to the Metropolitan Council , you must pass a background check, which verifies education, employment, and criminal history. If you have a criminal conviction, you do not automatically fail. The Metropolitan Council considers felony, gross misdemeanor, and misdemeanor convictions on a case-by-case basis, based on whether they are related to the job and whether the candidate has demonstrated adequate rehabilitation.

If you are already an employee of the Metropolitan Council , you must pass a criminal background check if the job you're applying for is safety sensitive, is a supervisory or management job, is in the Finance, Information Services,Audit, or Human Resources departments, or has access to financial records, files/databases, cash, vouchers, or transit fare cards.

IMPORTANT: If you make a false statement or withhold information, you may be barred from job consideration.

The Metropolitan Council is an Equal Opportunity, Affirmative Action, and veteran-friendly employer. The Council is committed to a workforce that reflects the region's diversity and strongly encourages persons of color, members of the LGBTQ community, individuals with disabilities, women, and veterans to apply.

If you have a disability that requires accommodation during the selection process, please email View email address on click.appcast.io.

We believe our employees are a key to our agency's success! In order to attract and retain high quality employees, the Council provides a highly competitive benefits package both in choice and coverage levels. Some highlights about our benefits are listed below:

• Guaranteed monthly retirement income through Minnesota State Retirement System pension fund

• Opportunity to save additional funds for retirement on a tax-deferred basis through a voluntary deferred compensation (457) plan

• Two or more medical plans from which to choose, with employer contribution towards premiums over 80%

• Dental insurance, life insurance and vision insurance

The following benefits are provided to all employees as part of working for the Council. You will have access to free:

• View email address on click.appcast.io clinic

• bus/rail pass valued at over $1200 per year

• parking at many job locations

• fitness centers at many job locations

• Employee Assistance Program

• extensive health and wellness programs and resources

01

Applicant Instructions: Ensure your application includes all relevant education and experience. The supplemental questions below help assess your qualifications and eligibility for this position. Answer each question fully; do not type "see resume," as incomplete applications will not be considered. Your responses should align with the Work History section of your application. If you attach a resume, it will be reviewed as part of the education and experience evaluation. I have read and understand the above instructions regarding my application and supplemental questions.

• Yes

• No

02

How did youfirsthear about this job opening?

• CareerForce Center

• Community Event/Organization

• Employee Referral

• Facebook

• Glassdoor

• Indeed

• Job Fair

• LinkedIn

• Metro Transit Bus Advertisement

• Twitter

• Website: governmentjobs.com

• Website: metrocouncil.org

• Website: metrotransit.org

• Website: minnesotajobnetwork.com

• Other

03

If you selected 'Other', please describe where you first heard about this job. if you selected 'Employee Referral' please enter the employee's first and last name, ID number (if known), and job title. Type N/A if not applicable.

04

The Metropolitan Council recognizes that Artificial Intelligence (AI) and generative tools are increasingly used in application processes. While the Council permits the use of AI to assist in the preparation of application materials, all applicants must certify the following statement:

• I affirm that all information provided in my application including any uploaded documentation is true and accurate. I further affirm that I have personally reviewed, verified, and approved all content, including any content generated with the assistance of AI. I will provide all interview responses directly and in real-time without unauthorized assistance. I will not use AI avatars, external assistance in answering including computer-generated suggestions, or any recording and transcription tools during the interview process unless I have received prior approval from Human Resources for a disability-related reasonable accommodation.

05

The salary range for this position is $44.72 - $72.53 hourly and $93,018 - $150,862 annually. Please list your minimum compensation expectation below. The starting salary will be based on the selected candidates' experience, skills, and education, as well as internal equity, and includes a generous benefits package. NOTE: If selected for the position, our salary offer will NOT exceed the top of the full salary range.

06

Please select the option that best describes your level of related education and years of progressively responsible experience in information technology or a related field.

• High school diploma/GED AND 9 or more years of related experience.

• Associate's degree AND 7 or more years of related experience.

• Bachelor's degree AND 5 or more years of related experience.

• Master's degree AND 3 or more years of related experience.

• None of the above.

07

If you have a degree, please indicate the type and field (e.g. "Bachelor's degree in Computer Science"). If this does not apply to you, type "N/A."

08

Please select the areas below with which you have experience (select all that apply).

• Experience developing data solutions for the cloud

• Modern cloud data platform experience in Databricks

• Gathering, understanding, and analyzing stakeholder requirements, needs, and objectives.

• Data development methodologies, best practices, standards, and procedures.

• Experience writing and tuning complex SQL queries and defining SQL best practices.

• Installation and configuration of database software and drivers on servers and clients.

• Data modeling, database normalization, and denormalization techniques.

• Designing, developing, and maintaining data solutions for operations, reporting, and analytics (databases, data platforms, data lakes, data warehouses, and data marts).

• Database administration and security, maintenance, monitoring, and support (SQL Server, Oracle, and Sybase ASE).

• Designing, developing, and maintaining data integrations (data pipelines/ETL/ELT – extracting, transforming, and loading data) using various types of data sources and targets.

• Programming language knowledge with at least one scripting language.

• ITIL, Incident, Service and Change Management, including SLAs and metrics.

• None of the above.

09

Please describe your experience in data engineering including the organization, responsibilities held, and duration of position(s). If this experience doesn't apply to you, please type "N/A".

10

Please describe the types of databases you have worked with and for how long. If this experience doesn't apply to you, please type "N/A".

11

Please describe the development methodologies and tools you have used to design and build data solutions. If this experience doesn't apply to you, please type "N/A".

12

Please describe any data pipeline, integration, or ETL/ELT tools you have experience using to move data from one system to another. If this experience doesn't apply to you, please type "N/A".

13

In detail, please describe your experience promoting an equitable, positive, and respectful work environment that values culture and diversity among all employees. If this experience doesn't apply to you, please type "N/A".

14

Please select the areas below in which you have knowledge, skills, and abilities (select all that apply).

• Experience with APIs, Web Services, and Integration Platform as a Service.

• Data streaming and messaging experience.

• Reporting and data visualization experience.

• Experience leading a technical team.

• None of the above.

15

For each area you selected in the question above, please describe your experience and specify where you gained it. If this question does not apply to you, write N/A.

16

Describe your experience working and collaborating with individuals from diverse backgrounds.

Required Question

Employer

Metropolitan Council

Address

390 Robert St. N.St. Paul, Minnesota, 55101

Website

Apply

Please verify your email addressVerify Email