Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer with Pyspark

Infowave Systems, Inc

Job Description

Job Description

Job Title: Senior Data Engineer (PySpark, ETL,Cloudera Data Hub)

Location: Rancho Cucamonga,CA(Hybrid)

Job Description:

We are looking for an experienced and motivated Data Engineer with expertise in PySpark to join our dynamic team. As a key member of our data engineering team , you will play a crucial role in designing, building, and maintaining scalable data pipelines that enable efficient data processing and analytics within the healthcare domain .

This role will combine both development and administrative activities , making it essential that the candidate has experience not only in building robust data pipelines but also in overseeing their operational aspects to ensure performance, reliability, and optimization.

Key Responsibilities:

  • Design, develop, and maintain scalable ETL pipelines using PySpark to process large datasets.
  • Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to understand data requirements and deliver high-quality solutions.
  • Work on administrative tasks , including monitoring, troubleshooting, and optimizing data pipelines and infrastructure.
  • Manage data integration across healthcare systems, ensuring compliance with relevant standards.
  • Leverage SSIS for ETL development and ensure smooth data movement across different environments.
  • Integrate and transform data from multiple sources, ensuring data quality and consistency.
  • Handle and resolve data processing issues, ensuring minimal disruption to operations.
  • Document best practices, processes, and workflows to maintain pipeline efficiency and scalability.
  • Work with both relational and non-relational databases, ensuring smooth data flow and optimized performance.

Required Skills & Qualifications:

  • Strong experience in Data Engineering, with expertise in designing, building, and maintaining ETL pipelines.
  • Strong proficiency in PySpark for large-scale data processing and transformation.
  • Experience with ETL tools , particularly SSIS (SQL Server Integration Services).
  • Solid understanding of data modeling , relational databases, and data warehousing principles.
  • Cloudera Data Hub experience will be Advantage. 
  • Experience working with cloud-based data storage and processing technologies (AWS, GCP, or Azure).
  • Familiarity with healthcare data standards , such as HL7 and FHIR , is highly desirable.
  • Proven ability in data pipeline monitoring, troubleshooting, and performance tuning .
  • Strong communication skills and the ability to work collaboratively with cross-functional teams.

Infowave Systems is an equal opportunity employer that is committed to diversity and inclusion in the workplace.

Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer with Pyspark in Rancho Cucamonga, CA vacancy
  •  ...00.00 -$274,100.00 Join the Clean Energy RevolutionBecome a Data Engineering, Senior Manager at Southern California Edison (SCE) and build a better...  ...data assets. Additionally, you will partner closely with operational leaders, technology teams, and executive stakeholders... 
    Senior
    Remote work

    Edison International

    Pomona, CA
    1 day ago
  • Join the Clean Energy RevolutionBecome a Data Engineering, Senior Advisor at Southern California Edison (SCE) and build a better tomorrow. In this...  ...perform data mining activities to derive insights, work with cloud OLAP systems (e.g., Snowflake), and keep abreast of new... 
    Senior
    Remote work
    Relocation

    Edison International

    Pomona, CA
    2 days ago
  •  ...0% ONSITE DAILY IN NORCO, CA Job Summary The Senior SQL Server Database Developer / Data Engineer serves as the technical lead for enterprise database...  ...and establishing database engineering standards. As with any position, additional expectations exist.  Some of... 
    Senior
    Contract work
    Temporary work
    Flexible hours

    VSolvit

    Norco, CA
    23 days ago
  • Hello, I'm moving to Rancho Cucamonga in December. I'm looking for two personal care attendants to cover seven morning shifts a week, to assist me with my morning care. Experience preferred. If interested and want more details, leave me a message on this platform.
    Senior
    Day shift

    Care.com

    Rancho Cucamonga, CA
    4 hours ago
  •  ...Overview If you are a highly motivated individual with an active, unrestricted credential (CPA/EA/Practicing Attorney) and excellent communication skills, we need you to help our customers complete their taxes using Intuit TurboTax products. You will be working toward... 
    Senior
    Remote work

    Intuit

    Rancho Cucamonga, CA
    2 days ago
  •  ...Overview If you are a highly motivated individual with an active, unrestricted credential (CPA/EA/Practicing Attorney) and excellent communication skills, we need you to help our customers complete their taxes using Intuit TurboTax products. You will be working toward... 
    Senior
    Remote work

    Intuit

    Rancho Cucamonga, CA
    2 days ago
  •  ...and project controls services that allow our clients to build with confidence. To achieve these objectives, we will strive...  .... About the Role: We are seeking an experienced  Senior Data Engineering & Analytics Lead to drive data strategy, build scalable data... 
    Senior
    Full time
    Work at office
    Remote work

    PM2CM

    Pomona, CA
    1 day ago
  • $28.74 - $36.72 per hour

     ...Overview If you are a highly motivated individual with an active, unrestricted credential (CPA/EA/Practicing Attorney) and excellent communication skills, we need you to help our customers complete their taxes using Intuit TurboTax products. You will be working toward... 
    Senior
    Remote work

    Intuit

    Rancho Cucamonga, CA
    15 hours ago
  • $56.16k - $106.08k

     ...Senior HVAC TechnicianLocation: Rancho Cucamonga, CA, 91729, United StatesBase Pay: $56,160.00 - $106,080.00 / YearOther Compensation: Now Offering - $2000 Sign-On Bonus!Job Category: HVAC and RefrigerationIndustry: eCommerce / RetailerRequired Degree: High schoolManage... 
    Senior
    Relocation package

    IntelliSource

    Rancho Cucamonga, CA
    3 days ago
  •  ...Data Science Developer - Senior All IT Solutions Canada · Ontario, Ontario Workplace Type — On-site...  ...development, cloud services, data engineering, artificial intelligence, application...  ...available to qualified applicants with disabilities during the application... 
    Senior
    Contract work
    Local area
    3 days per week

    All IT Solutions

    Ontario, CA
    2 hours ago
  • $38.46 - $43.56 per hour

     ...Job Description Job Description Data Center Operations Engineer — Los Angeles Join Our Award-Winning Team and Help Shape the Future of Cloud...  ...Accounts for medical and dependent care expenses ~401(k) with 100% company match ~ A supportive, fast-growing, and global... 
    Full time
    Temporary work
    Work at office
    Worldwide
    Relocation
    Monday to Friday
    Flexible hours

    www.leaseweb.com

    Pomona, CA
    21 hours ago
  • IEHP is seeking a Senior Talent Advisor to develop and execute recruiting strategies for management-level and senior roles. You will partner with leaders across departments to build an inspired workforce and drive hard-to-fill fills with modern sourcing techniques. Role... 
    Senior

    IEHP

    Rancho Cucamonga, CA
    4 days ago
  •  ...the United States. This role requires a minimum of 5 years of payroll experience, particularly in a multi-state environment, along with strong knowledge of payroll compliance and regulations. The ideal candidate will be proficient in UKG Ready and possess excellent analytical... 
    Senior

    Confidential

    Upland, CA
    1 day ago
  •  ...Job Description Job Description Senior Data Scientist Location: Hybrid/Remote (as applicable...  ...the organization. You will work closely with leaders and cross-functional partners to...  ...projects. Collaborate with data engineering and governance teams to improve data... 
    Senior
    Work at office
    Local area
    Remote work
    Flexible hours

    Aspire General Insurance Company

    Rancho Cucamonga, CA
    14 days ago
  • A leading nonprofit organization in Rancho Cucamonga seeks a Senior Talent & Recruitment Specialist to enhance their recruitment efforts...  ...experience in Talent Acquisition or HR operations, proficiency with Applicant Tracking Systems, and strong communication skills. Responsibilities... 
    Senior

    National Core

    Rancho Cucamonga, CA
    2 days ago
  • Inland Empire Health Plans (IEHP) is seeking a Senior Talent Advisor to lead leadership recruitment, employing modern sourcing and branding methods. The role partners with hiring leaders to build pipelines and ensure an exceptional candidate experience, especially for... 
    Senior
    Remote job

    Inland Empire Health Plan

    Rancho Cucamonga, CA
    2 days ago
  •  ...and lower-extremity care across Inland Empire clinics in California. This clinic-based role serves senior populations within a coordinated, team-oriented setting, with a focus on quality care and predictable scheduling. The position emphasizes treating routine podiatric... 
    Senior
    Full time

    Comprehensive Mobile Care

    Rancho Cucamonga, CA
    2 days ago
  •  ...instant noodles, snacks, and sauces sold in North America. You will monitor regulatory changes, manage labeling, and coordinate responses with cross‑functional teams. 0-10% travel may be required. Qualifications include a Bachelor's in Food Science or related field and 5-10... 
    Senior

    Nongshim America, Inc.

    Rancho Cucamonga, CA
    2 days ago
  •  ...Our Growth Isn't Measured In Numbers, It's An Investment In Aligning With The Best Talent. If you have a background and skillset for IT and a determined mindset to overcome any obstacle, you'll enjoy being part of TeamLogic IT. Our team exhibits a deep-seated need... 
    Senior
    Work at office
    Local area
    Flexible hours

    TeamLogic IT

    Rancho Cucamonga, CA
    4 days ago
  • $130k - $165k

     ...Senior Construction Superintendent A nonprofit affordable housing developer needs a Senior Construction Superintendent to take the...  ...responsibilities as any project superintendent, just applied to the jobs with the highest stakes. Reporting to the VP of Construction, you'... 
    Senior
    For subcontractor
    Night shift

    National CORE

    Rancho Cucamonga, CA
    20 hours ago
  • # Senior Talent & Recruitment SpecialistCorporate Rancho Cucamonga - Rancho Cucamonga, CA 91730Start Date 01/13/2026* Support recruiting...  ...preferred).* Strong attention to detail and ability to work with sensitive information.* Exceptional organizational skills and ability... 
    Senior
    Work at office

    National Core

    Rancho Cucamonga, CA
    2 days ago
  •  ...Summary: Provide Speech-Language Pathology Therapy and related services for patients while maintaining positive levels of interaction with facilities and clients in accordance with the principles and practices of Speech-Language Pathology therapy and within Reliant... 
    Senior
    Relief
    Work at office
    Shift work

    Reliant Rehabilitation

    Rancho Cucamonga, CA
    2 days ago
  •  ...comment on the topics they care most about. With 100,000+ active communities and...  ...systems and marketplace dynamics, our ML engineers tackle some of the most interesting and impactful...  ..., and monitoring Build scalable data and model pipelines with strong reliability... 
    Senior
    For contractors
    Flexible hours

    Reddit

    Ontario, CA
    3 days ago
  •  ...payroll processing within UKG Ready, while maintaining compliance with all applicable federal, state, and local regulations. This...  ...expert for payroll, partnering closely with HR and Finance to ensure data integrity, reporting accuracy, and continuous process improvement... 
    Senior
    Local area

    Confidential

    Upland, CA
    4 days ago
  • SUMMARYThe Senior Treasury Management (TM) Consultant is a client-facing, subject matter expert...  ....The Senior TM Consultant works closely with Clients, Sales, Product, Operations, Risk,...  ...business situations and interpret data, charts, and reports.REASONING ABILITYAbility... 
    Senior

    Citizens Business Bank

    Rancho Cucamonga, CA
    1 day ago
  • $90k - $110k

     ...organization and attention to detail. We are looking for an individual with a positive attitude who wants to grow their skill set at a...  ...responding to audit inquiries.Maintain accuracy and integrity of cost data used in financial statements.Cross-Functional CollaborationServe... 
    Senior

    Bradshaw Home

    Rancho Cucamonga, CA
    4 days ago
  •  ...Job Description Job Description Senior Sales Executive for our Patented Solar Streetlight...  ...989) expanding a patented line of custom-engineered solar streetlight systems. After...  ...are rebuilding and scaling this division with a focused, lean model. The foundation is... 
    Senior
    Temporary work
    For contractors

    Connector Electric / CE Solar

    Rancho Cucamonga, CA
    21 days ago
  •  ...Senior Living Sales Director (Community Relations Director)Are you passionate about working with seniors? Are you dedicated to supporting seniors on their wellness journey to ensure they are provided with an atmosphere that values individualism and dignity? If so, we... 
    Senior
    Full time
    Temporary work
    Part time
    Work at office
    Local area
    Immediate start
    Flexible hours
    Shift work

    Merrill Gardens

    Rancho Cucamonga, CA
    20 hours ago
  • $89.4k - $119.3k

     ...Cardinal Health Canada, with over 1,300 employees nationwide, is...  ...across the country.   The Data & Analytics Function manages the...  ...advantage. Data Engineering transforms raw data into trusted...  ...collaborate effectively with senior engineers, analysts, and business... 
    Full time
    Work at office
    Local area

    Cardinal Health

    Ontario, CA
    22 days ago
  •  ...Description Drive Product Strategy Through Data At Aspire General Insurance, we're...  ...Product team as either a Product Analyst or Senior Product Analyst, depending on experience....  ...and profitability. You'll work closely with Product Management, Underwriting,... 
    Senior
    Local area

    Aspire General Insurance Company

    Rancho Cucamonga, CA
    7 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer with Pyspark. Be the first to apply!