Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer, Specialist

Vanguard

Data Engineer The Data Engineer designs, builds, and supports scalable, secure, and reusable data solutions that enable analytics, reporting, operational workloads, and emerging AI/ML use cases. This role works across the full development lifecycle, translating business needs into production-ready data pipelines and applications using AWS, Python, Spark, and SQL. The engineer will improve data quality, reliability, performance, monitoring, and engineering standards while partnering closely with business and technology teams. Responsibilities: Design, develop, test, and maintain scalable ETL/ELT pipelines and data-processing solutions supporting analytics, reporting, operational, and AI/ML workloads. Build cloud-native data solutions using AWS services including S3, Glue, EMR, Lambda, Step Functions, IAM, CloudWatch, Secrets Manager, and CloudFormation. Develop high-performance data-processing applications using Python, PySpark, Apache Spark, and SQL. Integrate large-scale structured and unstructured data from multiple sources while maintaining data consistency, integrity, and accessibility. Translate business and technical requirements into maintainable solution designs, production code, queries, and reusable data components. Design and implement data-quality validation, reconciliation, monitoring, alerting, and operational controls to improve platform reliability. Troubleshoot data pipelines and applications, identify root causes, and resolve performance, reliability, and data-quality issues. Lead solutions through design, development, testing, deployment, and production support while applying established software and data engineering practices. Partner with business stakeholders, engineers, and technology teams to understand data needs, explain technical considerations, and provide guidance on data solutions. Contribute to engineering standards, documentation, code reviews, knowledge sharing, and adoption of new technologies and platform capabilities. Qualifications: 3+ years of experience in data engineering, software development, data management, database development, or related technical work. Experience designing and developing production-grade ETL/ELT pipelines and large-scale data-processing solutions. Hands-on experience developing applications and data pipelines using Python and SQL. Experience with distributed data-processing technologies such as Apache Spark or PySpark. Experience developing cloud-based data solutions using AWS services such as S3, Glue, EMR, Lambda, Step Functions, CloudWatch, IAM, or comparable services. Experience implementing data-quality, monitoring, testing, and operational controls for production data solutions. Undergraduate degree or equivalent combination of education, training, and relevant professional experience. Experience with infrastructure as code, including AWS CloudFormation or comparable technologies, preferred. Experience supporting data platforms used for AI/ML or advanced analytics workloads, preferred. Special Factors Sponsorship: Vanguard is not offering visa sponsorship for this position. Vanguard

Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Data Engineer, Specialist in Malvern, PA vacancy
  •  ...guiding complex solutions from design through production.Drive Data Science across the full AI lifecycle, from problem formulation,...  ...uncertainty, and translate findings into actionable product and engineering recommendations.Turn complex data into clear, cohesive stories... 
    Suggested
    Full time

    Vanguard

    Malvern, PA
    3 days ago
  •  ...designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of sources for business partners to generate insight and make decisions.... 
    Suggested

    Brains Technology Solutions, Inc.

    Malvern, PA
    1 day ago
  •  ...problems, hypotheses, measurement plans, and actionable recommendations. Lead complex analytical projects from problem definition through data acquisition, analysis, interpretation, and communication of results. Provide analytical direction and delegate work where... 
    Suggested
    Full time

    Vanguard

    Malvern, PA
    2 days ago
  •  ...Job Description Job Description Lead Data Engineer / Data Architect (Innovation & POC Lead) Location : Exton, PA Rate : DOE Job Description Serve as the onsite Data Engineering and Architecture lead, driving technology innovation, evaluation, and adoption... 
    Suggested

    Georgia IT Inc.

    Exton, PA
    4 days ago
  • Machine Learning Engineer We are seeking an experienced Machine Learning Engineer to join our AI/ML Engineering team. You will be responsible for developing and optimizing complex data pipelines, integrating model pipelines, and building scalable AI/ML solutions, including... 
    Suggested
    Work experience placement

    Samprasoft

    Malvern, PA
    2 days ago
  • Senior Data Engineer - 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services, API... 

    Samprasoft

    Malvern, PA
    2 days ago
  • Job Summary The Databricks AWS Data Engineer will develop and support a new data environment from the ground up, focusing primarily on data pipelines and cloud-based data engineering solutions. The role requires strong development experience with Python, PySpark, and SQL... 

    Compunnel

    Malvern, PA
    2 days ago
  • Job Title Responsibilities Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced Data Modeling principles Required Skills : Data Warehouse Basic... 

    Kaav Inc.

    Malvern, PA
    2 days ago
  • Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability... 

    Samprasoft

    Malvern, PA
    2 days ago
  • Responsibilities Pulling data from GitHub and Jira transforming it for input into our data warehouse. Qualifications Familiarity with AWS including lambda, event bridge, s3. Proficient in typescript Datalake / Data warehouse experience is a big plus. Required Skills :... 

    Brains Technology Solutions, Inc.

    Malvern, PA
    2 days ago
  • ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required to work in EST starting around 1... 
    Contract work
    Immediate start
    Remote work

    3B Staffing LLC

    Malvern, PA
    2 days ago
  • Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting together large, intricate... 

    3B Staffing LLC

    Malvern, PA
    2 days ago
  • Experience in the below technologies. ETL using EMR & Glue require working experience. SQL/PYSPARK/PYTHON/Jupyter Notebooks/GitHub functions/ CI/CD Knowledge on cloud Services: EMR/GLUE/S3/EC2/Service Catalog/PostgreSQL/Lambda/cloudFormation/SNS/EventBridge Knowledge ...
    Work experience placement

    Brains Technology Solutions, Inc.

    Malvern, PA
    2 days ago
  • Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment. Position Overview Vanguard is seeking... 

    3B Staffing LLC

    Malvern, PA
    2 days ago
  • Data Lake 2.0 Developer Data Lake 2.0 is a multi-year program aimed at modernizing legacy analytics platforms. As we move away from...  ...a modernized platform that will be in use by Analysts and Data Engineers. The deliverables will help data consumers and users manage “Data... 

    Samprasoft

    Malvern, PA
    2 days ago
  • Data Engineer Troubleshoots software and processes for data consistency and integrity. Integrates complex data from a variety of sources for business partners to generate insight and make decisions. Translates business specifications into design specifications and code.... 

    Samprasoft

    Malvern, PA
    2 days ago
  • Job Summary The AWS Data Engineer will design, develop, and implement scalable, high-performance data ingestion and transformation pipelines using AWS services and Apache Spark. The role involves integrating complex datasets from multiple sources, developing advanced SQL... 

    Compunnel

    Malvern, PA
    2 days ago
  • Job Title: Senior Data Engineer Location: Malvern, PA Onsite Duration:6 Months Experience Required: 10 & Above EXPERIENCE_RANGE_IN_REQUIRED_SKILLS_ Python, AWS- S3, AWS Lambdas, AWS Glue, SQL, DynamoDB , Kafka/ Kinesis , pySpark ROLE_DESCRIPTION - Overview: We are seeking... 
    Local area

    I-Flow

    Malvern, PA
    2 days ago
  • Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing. • Deep technical knowledge - including... 

    Trinity Technology Solutions

    Malvern, PA
    2 days ago
  •  ...Job Title Collaborate with product owners, UX designers, data analysts, scrum masters, and developers to develop a world-class user experience. Recommend and effectively explain improvements in functionality, and UX elements that enable users to achieve their goals... 

    Samprasoft

    Malvern, PA
    4 days ago
  • Data Management SpecialistJOB TITLE: Data Management SpecialistDEPARTMENT: Central Lab Services - ITFull-timeExton, PAPURPOSE: Manage...  ...and transferred to our clients. Work with LIS Application Specialist to make sure those data elements are setup correctly in the system... 
    Contract work
    Work experience placement
    Work at office

    Frontage Laboratories

    Lionville, PA
    4 days ago
  • Role : Data Engineer with Python Location: Malvern, PA (Onsite) Contract Job Summary We are seeking a Data Engineer with strong Python expertise to design, build, and maintain scalable data pipelines and data infrastructure. The ideal candidate will work with large datasets... 
    Contract work

    AceStack LLC

    Malvern, PA
    4 days ago
  • Purple Drive AWS Data Engineer - Python, AWS Glue, PySpark & Attunity We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS Glue, PySpark, Attunity (Qlik Replicate), and AWS Cloud to design, develop, and maintain scalable enterprise data integration... 

    Purple Drive

    Malvern, PA
    2 days ago
  • What You'll Do:Serve as the primary risk SME for data-related risks across Personal Wealth.Provide independent guidance and challenge regarding data governance, data quality, lineage, data management, and analytics controls.Partner with product and technology leaders to... 
    Full time

    Vanguard

    Malvern, PA
    2 days ago
  •  ...integrated software algorithms to structure, analyze, and leverage data in a production environment.Core ResponsibilitiesLeverages data...  ...Familiarity with Feature Store usage, LLMs, GenAI, RAG, Prompt Engineering, and Model Evaluation.Experience with API design and... 
    Full time
    Work experience placement

    Vanguard

    Malvern, PA
    4 days ago
  • Job Title: Data Engineering Lead Location: Malvern, PA Contract Job Description: Skills: Java| AWS | Python | PySpark | Event-Driven Pipelines | Data Architecture Summary We are seeking an experienced Tech lead- Data Engineer (15+ years) with a strong background in... 
    Contract work

    AceStack LLC

    Malvern, PA
    2 days ago
  •  ...Requisition #: 76678The Role at a GlanceLincoln Financial's AI, Data and Analytics (AIDA) organization is building the capabilities...  ...trust the result. We deliver with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams, with governance built... 
    For contractors
    Work experience placement
    3 days per week

    Lincoln Financial Group

    Radnor, PA
    1 day ago
  •  ...least 4 years of experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed... 
    Permanent employment
    Full time
    H1b

    Sonsoft

    King of Prussia, PA
    4 days ago
  • We are looking for a Snowflake Data Engineer to build modern data solutions that support analytics, AI, and enterprise decision-making. This role will focus on creating reliable pipelines, scalable data models, and secure data products within a Snowflake environment. The... 

    Robert Half

    Villanova, PA
    3 days ago
  • Role Purpose Serve as the onsite Data Engineering and Architecture lead, driving technology innovation, evaluation, and adoption across the enterprise data landscape. Key Responsibilities Act as the onsite SME for Data Engineering and Data Architecture. Lead Proof of... 

    VBeyond

    Exton, PA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer, Specialist. Be the first to apply!