Data Engineer/Python Developer

TechDigital Group

Job Responsibilities: Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL. Work with structured and unstructured data to build scalable data solutions. Write efficient and scalable PySpark scripts for data transformation and processing. Optimize SQL queries, stored procedures, and indexing strategies to enhance performance. Design and implement data models, schemas, and partitioning strategies for large-scale datasets. Collaborate with Data Scientists, Analysts, and other Engineers to integrate data workflows. Ensure data quality, validation, and consistency in data pipelines. Implement error handling, logging, and monitoring for data pipelines. Work with cloud platforms (AWS, Azure, or GCP) for data processing and storage. Optimize data pipelines for cost efficiency and performance. Technical Skills Required: Strong experience in Python for data engineering tasks. Proficiency in PySpark for large-scale data processing. Deep understanding of SQL (Joins, Window Functions, CTEs, Query Optimization). Experience in ETL/ELT development using Spark and SQL. Experience with cloud data services (AWS Glue, Databricks, Azure Synapse, GCP BigQuery). Familiarity with orchestration tools (Airflow, Apache Oozie). Experience with data warehousing (Snowflake, Redshift, BigQuery). Understanding of performance tuning in PySpark and SQL. Familiarity with version control (Git) and CI/CD pipelines. #J-18808-Ljbffr

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Data Engineer/Python Developer in Saint Paul, MN vacancy

Data Engineer I (TM1, Python, AWS)
$109.3k - $180.2k
...Target Openings 1 What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy... ...Hyperion, etc.). ~2+ years of hands-on experience working with Python , preferably with TM1py and Pandas. ~ Experience working...
Suggested
Work experience placement
H1b
Local area
Travelers Insurance
Saint Paul, MN
3 days ago
Senior Data Engineer (AWS, Databricks, Python)
$139.4k - $230k
...and where you do it. Job Category Data Analytics, Data Science, Technology Compensation... ...Is the Opportunity? Travelers Data Engineering team constructs pipelines that... ...desire to guide team members' growth and develop data solutions that translate complex data...
Suggested
Work experience placement
Local area
Travelers Insurance
Saint Paul, MN
2 days ago
Data Engineer I (AWS, Python, SQL)
$109.3k - $180.2k
...0.00 Target Openings 1 What Is the Opportunity? As a Data Engineer I at Travelers, you'll contribute to how Business Insurance CMP... ..., and embedding MLOps practices into how pricing models are developed and deployed. You'll build domain expertise CMP and Specialty...
Suggested
Work experience placement
Local area
Immediate start
Travelers Insurance
Saint Paul, MN
3 days ago
Data Engineer
...Overview Clinical Care Management (CCM) Data Engineer will be responsible for designing, developing, testing, deploying & maintaining technology solutions across... ...) ~ SQL (high level of proficiency) ~ Python ~ GCP - Cloud Computing ~ BigQuery (data warehouse...
Suggested
Local area
My3Tech Inc
Saint Paul, MN
2 days ago
Data Engineer
...AWS, Lambda, Power BI, Data Engineer - Job Title: Sr Data Engineer Location... ...and integrations using SQL and APIs. Develop and maintain dashboards and reports with... ...modeling. Generative AI and LLMs; Python; Snowflake. Alation or similar data...
Suggested
Temporary work
Saxon Global
Saint Paul, MN
2 days ago
Senior Data Engineer
$55 - $58 per hour
...IDR is seeking a Senior Data Engineer to join one of our top clients for a remote contract opportunity... ...the Senior Data Engineer: Develop and maintain end-to-end ETL/ELT... ...Proficiency in programming with SQL, Java, or Python for pipeline development. Hands-on...
Hourly pay
Contract work
Remote work
Flexible hours
IDR Healthcare
Saint Paul, MN
4 days ago
Senior Distinguished Data Engineer (Remote-Eligible)
$286.2k - $326.7k
...Senior Distinguished Data Engineer (Remote-Eligible) Distinguished Data Engineers are individual contributors who strive to be diverse in... ...standards for defining a domain 2+ years of experience using Python, SQL or Scala 1+ year of experience deploying machine learning...
Full time
Part time
Local area
Remote work
Capital One
Saint Paul, MN
5 days ago
Senior Data Engineer
$100k - $120k
...Overview Kimley-Horn is seeking a Senior Data Engineer to join our Innovations team in St. Paul... ..., and GIS/BIM-related sources-and develop repeatable onboarding patterns using incremental... ...also be considered. ~ Proficiency in Python and/or Spark, plus experience with...
Work at office
Work visa
Flexible hours
Kimley-Horn
Saint Paul, MN
7 days ago
Data Engineer - Healthcare
$97.9k - $133.5k
...Become a part of our caring community The Data Engineer 2 will develop scalable data processing architectures and solutions that facilitate the... ...data analysis or engineering. ~ Proficiency in SQL and Python. ~ Comprehensive knowledge of Microsoft Office Applications...
Full time
Temporary work
Apprenticeship
Work at office
Remote work
CenterWell
Saint Paul, MN
3 days ago
Sr. Data Engineer
$150k - $190k
...customers and partners. The Senior Data Engineer will be responsible for the analysis, design... ...environment with a focus on developer experience thatfacilitates maximum efficiency... ...Hands-on experience and knowledge of the Python programming language Experience...
Work experience placement
Worldwide
Flexible hours
Shift work
SHI GmbH
Saint Paul, MN
4 days ago
Senior Data Engineer - Cybersecurity
$99.6k - $192.9k
...We are looking for a skilled GCP Data Engineer to join our EPEO - Data and AI Ops team. In... ...will play a critical part in designing, developing, and maintaining our Security Data Lake... ...data pipelines (ETL/ELT) using Python, SQL, and GCP services (such as Cloud Functions...
Immediate start
Remote work
Flexible hours
Ford Motor Company
Saint Paul, MN
4 days ago
Databricks Data Engineer - Senior - Consulting - Location Open
$106.9k - $176.5k
...better working world. Technology – Data and Decision Science – Data Engineering – Senior We are seeking a... ...data platform designs. Design, develop, and implement data engineering solutions... ...skills in languages such as Python, Scala, or SQL. Experience with...
Summer holiday
Flexible hours
EY
Saint Paul, MN
2 days ago
Senior Data Engineer (Databricks or equivalent)
...Senior Data Engineer This position is eligible for a hybrid telework arrangement (both remote... ...: The Senior Data Engineer designs, develops, and maintains data solutions. This includes... ...and support ELT/ETL solutions utilizing Python, Scala, or other object-oriented...
Hourly pay
Permanent employment
Work at office
Remote work
Metropolitan Council of the Twin Cities
Saint Paul, MN
4 days ago
Senior, Data Engineer
$140k - $160k
...responsible for assisting in the efforts to design, develop, and maintain databases and data integration (ETL) systems to support business... ...in programming languages is commonly used in data engineering, such as Python or Java Our Company: Carrington Mortgage Holdings...
Work experience placement
Remote work
Work from home
Carrington
Saint Paul, MN
3 days ago
Data Migration Engineer II
$25.48 - $63.65 per hour
...Job Description The Data Migration Engineer II is responsible for designing, building, testing... ...Preferred Qualifications: Experience in Python, C# CCL. Experience in workflow... ...implementation and interface activities. Develop and manage data migration plans,...
Hourly pay
Contract work
Temporary work
Local area
Flexible hours
Oracle
Saint Paul, MN
2 days ago
Senior Data Engineer (Databricks or equivalent)
...Senior Data Engineer (Databricks or equivalent) Print ( Apply Senior Data Engineer... ...region: The Senior Data Engineer designs, develops, and maintains data solutions. This... ...and support ELT/ETL solutions utilizing Python, Scala, or other object-oriented programming...
Hourly pay
Permanent employment
Full time
Work at office
Remote work
Flexible hours
Metropolitan Council
Saint Paul, MN
4 days ago
Data Engineer
$102k - $130.63k
...Hypergiant, Forward Slope, Systems Innovation Engineering, SoarTech, and Highbury Defense Group... ...platforms, and sensor technologies. SIE develops resilient, integrated systems that... ...Job Description ~ Data Engineer ~ Full Time ~...
Full time
Contract work
Temporary work
For subcontractor
Internship
Remote work
Accelint
Saint Paul, MN
1 day ago
Senior Data Engineer, Healthcare Data Infra (Onsite Houston)
$155k - $190k
...Qualified Health PBC is looking for a Data Engineer to build data pipelines that power AI systems in healthcare. You will work directly with partners and contribute to the delivery of high-quality data that impacts patient care. This role requires onsite presence in Houston...
3 days per week
Qualified Health PBC
Saint Paul, MN
12 hours ago
Storage & Data Protection Engineer 1
$73.38k - $104.83k
...Storage & Data Protection Engineer 1 At HDR, our employee-owners are fully engaged in creating a welcoming environment where each of us is... ...action documentation for storage or backup-related events. Develop working knowledge of adjacent VCF components that interact...
Full time
Temporary work
Part time
Monday to Friday
Shift work
HDR
Saint Paul, MN
1 day ago
Senior Data Engineer
$102.7k
...development, and maintenance of the organization's data infrastructure, ensuring the efficient... ...with data professionals, analysts, and engineers to build and optimize data pipelines,... ...ESSENTIAL RESPONSIBILITIES Design, develop, and maintain robust data processes and solutions...
Temporary work
For contractors
Work at office
Local area
Remote work
Highmark Health
Saint Paul, MN
5 days ago
Senior Data Protection Engineer
$180.37k - $212.2k
...foster collaboration, connection, and alignment. Attendance is expected and fully supported. We are looking for a Senior Data Protection Engineer to lead and expand our data protection capabilities, ensuring the Coinbase ecosystem remains resilient against...
Local area
Coinbase
Saint Paul, MN
5 days ago
Data Engineer II
$99k - $149k
...Day to Day This role’s primary responsibility is to integrate data from a variety of sources into common data domain models,... ...learning new technologies Demonstrated experience in software engineering fundamentals and coding Salary Range Transparency Tier 1...
Work experience placement
Local area
Indeed Inc.
Saint Paul, MN
2 days ago
Storage & Data Protection Engineer 2
...Storage & Data Protection Engineer 2 Independently administer vSAN storage policies, storage tiers, and workload-aligned provisioning patterns... ...changes that affect storage resiliency and recoverability. Develop practical knowledge of adjacent VCF tools and dependencies...
Monday to Friday
Shift work
HDR
Saint Paul, MN
1 day ago
Senior Data Engineer/US Citizen/Minnesota- Hybrid
...At Enable Data Incorporated, we are excited to welcome a talented Senior Data Engineer to join our dynamic team! With our extensive knowledge in application, data, and... ...clients. Key Responsibilities Design, develop, and maintain scalable data pipelines using...
Relocation
Enable Data Incorporated
Saint Paul, MN
3 days ago
Data Engineer II (AWS, Databricks, SQL, GenAI)
$126.5k - $208.7k
...Imagine loving what you do and where you do it. Job Category Data Analytics, Data Science, Technology Compensation Overview... ...Openings 1 What Is the Opportunity? Travelers Data Engineering team constructs pipelines that contextualize and provide easy access...
Work experience placement
Local area
Immediate start
Travelers Insurance
Saint Paul, MN
4 days ago
Data Engineer- Full Stack
$138.8k - $232.7k
...customer-obsessed, entrepreneurial, and data-driven and is dedicated to delivering industry... ...mentoring junior talent and driving engineering best practices. By collaborating with... ...efficiency, and downstream AI consumption. Develop and operate robust orchestration...
Immediate start
Remote work
Flexible hours
Ford Motor Company
Saint Paul, MN
1 day ago
Data Infrastructure & Ingestion Engineer (Remote)
...Speechify is seeking a Software Engineer for its AI team to enhance data processes for model training. The role emphasizes gathering audio data, managing... ...in software development, proficiency in Bash and Python, and experience with Docker and GCP. The position offers...
Remote work
Clutch Canada
Saint Paul, MN
12 hours ago
Studio+ - Adobe Customer Journey Analytics (CJA) Developer -Senior - Location OPEN
$102.5k - $187.9k
...Location: Anywhere in Country Adobe CJA Developer – Experience Staff / Senior The Opportunity... ...will have a strong background in data analytics, experience with Adobe CJA, and... ...Familiarity with data analysis tools (e.g., SQL, Python, R) and data visualization software (e.g....
Summer holiday
Flexible hours
Ernst & Young Oman
Saint Paul, MN
13 hours ago
Sr. Data Engineer - Healthcare Data Infrastructure (Texas)
$155k - $190k
...with us. Qualified Health is seeking a Data Engineer to support partner integration. This isn... ...Director and directly with customer data teams Develop and optimize SQL queries against complex... ...re ready to master it. Proficiency with Python and PySpark for data transformation at...
Live in
Flexible hours
3 days per week
Qualified Health PBC
Saint Paul, MN
12 hours ago
Consultant, Data Engineering
...Little About Us EDB provides a data and AI platform that enables... ...for a high-performing Data Engineer or Analytics Consultant who thrives... .... Analytics & Insights: Develop advanced analytics models,... ...Engineering: Strong proficiency in Python or Scala, and advanced SQL...
Remote work
EDB
Saint Paul, MN
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer/Python Developer. Be the first to apply!