Python developer

job summary:
Key Responsibilities

Design, build, and maintain high-performance ETL/ELT data pipelines using Python and PySpark.

Apply expert-level coding skills to develop and manage data processing jobs leveraging PySpark for distributed computing across large-scale datasets.

Take full ownership of the data workflow, including getting data from multiple sources, scrubbing, and validating data to ensure the highest quality.

Write and optimize complex, performant SQL queries for data extraction, integrity checks, and performance tuning.

Contribute to platform modernization by exploring and increasing the adoption of AI/ML, including using tools like Copilot and Claude for acceleration, and building models to fill data gaps or improve systems.

Collaborate with data architects by proposing ideas and great questions, taking ownership as the expert on data, pipelines, and systems.

Implement DevOps practices for the automated deployment and orchestration of Python applications and data pipelines (e.g., using Docker, Jenkins, Terraform).

Hands on experience with SQL and complex performance tuning.

location: Charlotte, North Carolina
job type: Contract
salary: $51.78 - 56.78 per hour
work hours: 8am to 5pm
education: Bachelors


responsibilities:

Key Responsibilities

• Design, build, and maintain high-performance ETL/ELT data pipelines using Python and PySpark.
• Apply expert-level coding skills to develop and manage data processing jobs leveraging PySpark for distributed computing across large-scale datasets.
• Take full ownership of the data workflow, including getting data from multiple sources, scrubbing, and validating data to ensure the highest quality.
• Write and optimize complex, performant SQL queries for data extraction, integrity checks, and performance tuning.
• Contribute to platform modernization by exploring and increasing the adoption of AI/ML, including using tools like Copilot and Claude for acceleration, and building models to fill data gaps or improve systems.
• Collaborate with data architects by proposing ideas and great questions, taking ownership as the expert on data, pipelines, and systems.
• Implement DevOps practices for the automated deployment and orchestration of Python applications and data pipelines (e.g., using Docker, Jenkins, Terraform).
• Hands on experience with SQL and complex performance tuning.

qualifications:
Required Technical Skills

Programming: Expert-level proficiency in Python, including libraries like Pandas and NumPy.

Designing: Designing data pipelines for the data coming from multiple sources

Data Processing: Solid hands-on experience with PySpark for building scalable data workflows

Data Querying: Expert-level knowledge of writing complex SQL queries (Oracle or Snowflake), with proven ability to perform performance tuning on large datasets and complex database code.

Cloud Platform: Robust experience with AWS cloud services and associated data services, specifically:

AWS Glue (ETL)

S3

Lambda

Redshift

DynamoDB, Athena, ECS, EventBridge, OpenSearch, RDS

ETL & Data Management: Robust proficiency in ETL/ELT methodologies and tools, as well as Data Quality, Data Validation, and Anomaly Detection techniques.

Scripting: Working experience with scripting and automation using Unix and Python.

Desired Skills & Professional Attributes

Familiarity with AI/ML and Large Language Model (LLM) approaches to data analysis and validation.

Knowledge of data warehousing concepts and data modeling techniques.

Experience with DevOps, Continuous Integration, and Continuous Delivery (e.g., Jenkins, GitHub).

Experience with BI Reporting tools such as Power BI or Tableau.

Robust preference for candidates with prior experience in the investment data domain.

Ability to work independently through complex data challenges and robust analytical and problem-solving skills.

Job Responsibilities

Design, build, and maintain high-performance ETL/ELT data pipelines using Python and PySpark.

Apply expert-level coding skills to develop and manage data processing jobs leveraging PySpark for distributed computing across large-scale datasets.

Take full ownership of the data workflow, including getting data from multiple sources, scrubbing, and validating data to ensure the highest quality.

Write and optimize complex, performant SQL queries for data extraction, integrity checks, and performance tuning.

Contribute to platform modernization by exploring and increasing the adoption of AI/ML, including using tools like Copilot and Claude for acceleration, and building models to fill data gaps or improve systems.

Collaborate with data architects by proposing ideas and great questions, taking ownership as the expert on data, pipelines, and systems.

Implement DevOps practices for the automated deployment and orchestration of Python applications and data pipelines (e.g., using Docker, Jenkins, Terraform).

Hands on experience with SQL and complex performance tuning.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact View email address on click.appcast.io.


Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).


This posting is open for thirty (30) days.