Big Data Developer With Pyspark Experience

Big Data Developer With Pyspark Experience

Big Data Developer With Pyspark Experience

1 week ago Be among the first 25 applicants

Leading IT consulting firm in Baltimore MD seeking an experienced developer with hands-on experience in Big Data, Pyspark, Python, AWS, and SQL/NoSQL. This is a six-month consulting position with possibility of extension. Payrate $65/hour.

Note: Visa sponsorship or C2C employment not available for this position.

Position Responsibilities::

• Lead the design, development, and deployment of PySpark-based big data solutions.
• Architect and optimize ETL pipelines for structured and unstructured data.
• Collaborate with Client, data engineers, data scientists, and business teams to understand requirements and provide scalable solutions.
• Optimize Spark performance through partitioning, caching, and tuning.
• Work with cloud platforms like AWS.
• Ensure data security, governance, and compliance.
• Mentor junior developers and review code for best practices and efficiency.

MUST HAVE:

• 7+ years of experience in Amazon Web Service(AWS) Cloud Computing.
• 10+ years of experience in big data and distributed computing.
• Experience with PySpark, Apache Spark, and Python.
• Experience with SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.).
• Hands on experience with AWS cloud-based data platforms.
• Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes) is a plus.

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Information Services

Referrals increase your chances of interviewing at WRA by 2x

Get notified about new Big Data Developer jobs in Baltimore, MD .

Baltimore, MD $112,597.33-$152,810.66 1 month ago

Linthicum Heights, MD $57.87-$92.40 1 week ago

Columbia, MD $100,000.00-$160,000.00 2 days ago

Baltimore, MD $112,597.33-$152,810.66 1 month ago

Software Engineer - 2 (Python Developer)

Data Engineer - Multiple Levels (TS/SCI with Poly Required)

Dayton, MD $95,000.00-$155,000.00 1 year ago

Data Engineer (Mid-Senior Level) – Healthcare SaaS Platform

Annapolis, MD $110,000.00-$130,000.00 2 days ago

Baltimore, MD $144,768.00-$209,109.33 1 month ago

Baltimore, MD $144,768.00-$209,109.33 1 month ago

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics

Big Data Engineer (Remote, Top Secret Clearance Required) (Baltimore)

Agile Developer - 5 (Java/Spring Boot/Python)

Annapolis Junction, MD $228,000.00-$293,000.00 1 week ago

Software Engineer I (Merchant Data Platform)

Maryland, United States $90,000.00-$150,000.00 4 months ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.