Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AWS Data engineer w/Databrics

Compunnel

div:has([data-free-thinking-preview-answer=true])+:is(.text-message,.relative:has(>.text-message))]:-mt-2 grow"> Job Summary The AWS Data Engineer will build and support an extensive transaction stitching application designed to track the journey of money flowing through client accounts over the lifetime of funds. The role requires strong Python and SQL expertise along with hands-on experience with AWS data services and Databricks to develop scalable data processing and analytics solutions. Key Responsibilities

  • Build and maintain data engineering solutions supporting transaction stitching and tracking of funds throughout their lifecycle.
  • Develop data processing and transformation workflows using Python and SQL.
  • Design and implement data solutions using AWS services such as Glue, S3, Lambda, and Redshift.
  • Develop and maintain data processing solutions using Databricks.
  • Support data integration, transformation, and processing requirements for transaction-related data.
  • Collaborate with technical and business stakeholders to understand data requirements and deliver scalable solutions.
  • Troubleshoot data processing issues and optimize solutions for reliability and performance.
Required Qualifications
  • Strong proficiency in Python.
  • Strong SQL skills and experience working with data processing and analytical workloads.
  • Hands-on experience with AWS data services such as Glue, S3, Lambda, and Redshift.
  • Hands-on experience with Databricks.
  • Strong data engineering and data processing skills.
  • Strong analytical, problem-solving, and communication skills.
Preferred Qualifications • Experience in financial services or transaction-processing environments. Compunnel

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AWS Data engineer w/Databrics in Malvern, PA vacancy
  •  ...Job TitleData Engineers will be data mining, writing code, and creating tables/environments in S3QualificationsEngineer required - SQL, Python, Pyspark, S3, AWS, environment creationPreferable for both - retail business knowledge, technical documentationRequired Skills... 
    Amazon Web Service

    Kaav Inc.

    Malvern, PA
    13 hours ago
  •  ...Data Engineer - Assessment required Hybird Malvern, pa Job Description Duties: Build out an extensive transaction stitching...  ...over the lifetime of the funds. Skills: Advanced Python, SQL skills and AWS Services (e.g. Glue, S3, Lambda, Redshift... 
    Amazon Web Service

    Akaasa Technologies

    Malvern, PA
    2 days ago
  •  ...Hi , This is Praveen from Pronixinc Role: AWS Big Data Engineer with Databricks (Mid, Sr and SME level role)- W2 Only Location: Malvern, PA (Hybrid 3 days in office and 2 days remote) Duration: long term Contract 1+ year (likely to be extended multiple... 
    Amazon Web Service
    Long term contract
    Work at office
    Remote work

    Pronix - US

    Malvern, PA
    2 days ago
  •  ...Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical...  ...Advanced Python Advanced SQL Strong experience with AWS Services , including: AWS Glue Amazon S3 AWS... 
    Amazon Web Service

    3B Staffing LLC

    Malvern, PA
    2 days ago
  • Overview: We are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large-scale... 
    Amazon Web Service

    Programmers.io

    Malvern, PA
    2 days ago
  •  ...Advice and Wealth Management Technology ( AWMT ) is seeking a data engineer for the Data & Analytics engineering team, driving innovation in...  ...skills in data transformation using Python, PySpark, SQL, and AWS services, including experience with creating data products to be... 
    Amazon Web Service

    Akaasa Technologies

    Malvern, PA
    2 days ago
  •  ...Data Analytical Engineer SEEKING A SENIOR CANDIDATE hybrid - Malvern. PA Job Description Writes ETL (Extract / Transform...  ...generate insight and make decisions. Experience building AWS cloud architecture and supporting services and technologies... 
    Amazon Web Service

    RIT Solutions

    Malvern, PA
    5 days ago
  • Responsibilities Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced Data Modeling principles Required Skills : Data Warehouse Basic Qualification :... 
    Amazon Web Service

    Procyon TS

    Malvern, PA
    5 days ago
  •  ...Position : AWS Data Engineering Technical Lead Location: Malvern PA (onsite day 1 for hybrid model) Length: 1+ year (likely to be extended multiple years) Video interview is okay JOB DETAILS - Tech lead experience - Working with Unstructured... 
    Amazon Web Service

    Pronix - US

    Malvern, PA
    2 days ago
  • Role Description: We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting... 
    Amazon Web Service

    Syntricate Technologies

    Malvern, PA
    1 day ago
  •  ...impact, high-visibility role where you will pioneer world-class Data & AI engineering solutions, building the next generation of intelligent, agent...  ...agents into business workflows, focusing on Databricks and AWS environments. You will lead data engineering, AI agent... 
    Amazon Web Service

    Vanguard

    Malvern, PA
    2 days ago
  •  ...Data Solutions SpecialistProvides advanced data solutions by using software to process, store, and serve data to others. Tests data quality...  ...batch processing.Experience in cloud data platforms including AWS Redshift, Google Big Query, or Azure Synapse, with proficiency in... 
    Amazon Web Service
    Work experience placement

    Vanguard

    Malvern, PA
    3 days ago
  • Purple Drive AWS Data Engineer - Python, AWS Glue, PySpark & Attunity We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS Glue, PySpark, Attunity (Qlik Replicate), and AWS Cloud to design, develop, and maintain scalable enterprise data integration... 
    Amazon Web Service

    Purple Drive

    Malvern, PA
    1 day ago
  •  ...Data Engineer - Contract to Hire (Hybrid, No Sponsorship) Location: Wayne, PA | Plano, TX | Charlotte, NC | Scottsdale, AZ Job Type:...  ...decision-making. This hybrid role offers exposure to advanced AWS cloud technologies, opportunities to lead solution development,... 
    Amazon Web Service
    Permanent employment
    Contract work
    Local area
    3 days per week

    Indotronix International Corporation

    Wayne, PA
    5 days ago
  •  ...Role at a Glance Lincoln Financial's AI, Data and Analytics (AIDA) organization is...  ...deliver with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams,...  ...grounding, and citations. Design and build AWS source-to-product pipelines and agent-... 
    Amazon Web Service
    For contractors
    Work experience placement
    Work at office
    Relocation package
    3 days per week

    Lincoln Financial

    Radnor, PA
    3 days ago
  • Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing. • Deep technical knowledge - including... 
    Amazon Web Service

    Trinity Technology Solutions

    Malvern, PA
    1 day ago
  •  ...mandates, both passive and active, to conduct data-driven analyses and develop tools that shape trading strategies. As a Full Stack Engineer, you will design, implement, and maintain...  ...Test-Driven Development (TDD) practices. AWS Services: Extensive experience with key... 
    Amazon Web Service

    RIT Solutions, Inc.

    Wayne, PA
    1 day ago
  •  ...The Role at a Glance About AIDA Data Strategy and Governance Lincoln Financial...  ...deliver with AIDA's infrastructure, platform, engineering, MLOps, and AI-native platform teams,...  ...SQL, Python, orchestration, and approved AWS services. Embed quality, metadata, lineage... 
    Amazon Web Service
    For contractors
    Work experience placement
    Work at office
    Relocation package
    3 days per week

    Lincoln Financial

    Radnor, PA
    3 days ago
  • Data Engineer (TS/SCI with Full Scope Polygraph) {S} Job Category : ENG Requisition Number : DATAE003244 Apply now Posted : February 23,...  ...containers, (e.g. Docker, Docker Compose), cloud services (e.g. AWS), tools for distributed computing (e.g. Spark, Pyspark) Active... 
    Amazon Web Service
    Full time
    Temporary work
    Work experience placement
    Work at office
    Visa sponsorship
    Relocation package
    Flexible hours

    TSG

    King of Prussia, PA
    2 days ago
  •  ...development of Compliance solutions and capabilities primarily in an AWS cloud environment. The role will include the following duties and...  ...analysisDefinition of test scenariosCustom code development w/ automated unit testingBuild and deployment from non-prod to production... 
    Amazon Web Service

    Samprasoft

    Malvern, PA
    3 days ago
  • $138.5k - $173.1k

     ...enable sustainable growth. Guided by modern engineering practices and a commitment to domain...  ...enhance AI security controls, including data protection, model governance, source code...  ..., and assessment of AI platforms such as AWS Bedrock, Claude, Microsoft Copilot, GitHub... 
    Amazon Web Service

    Envestnet

    Berwyn, PA
    3 days ago
  • The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic...  ..., and AI workloads.Drive modernization initiatives through AWS-based platforms, automation, DataOps, MLOps, platform... 
    Amazon Web Service
    Full time
    For contractors
    Work at office

    Vanguard

    Malvern, PA
    1 day ago
  •  ...Data EngineerTroubleshoots software and processes for data consistency and integrity. Integrates complex data from a variety of sources...  ...guidance and serves as a technical consultant.Adhere to data engineering standards and contribute expertise to other data expert teams... 

    Samprasoft

    Malvern, PA
    13 hours ago
  •  ...Job TitleResponsibilitiesProvides expert level data solutions by using software to process, store, and serve data to others.Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure.QualificationsProvides expert... 

    Samprasoft

    Malvern, PA
    13 hours ago
  •  ...with prominent GenAI based solution patterns. Deep knowledge in data science principles, techniques, and development life cycle. Extensive...  ...with Python and AI/ML related libraries and SQL. Experience with AWS platform and services preferred. Required Skills: Python, SQL... 
    Amazon Web Service

    Samprasoft

    Malvern, PA
    3 days ago
  •  ...Job Title: AI ML Engineer Location: Malvern, PA Duration : Full Time Job Description...  ...AI and Machine Learning solutions on AWS using Bedrock, SageMaker, Python, MLOps,...  ...business problems. Develop scalable data pipelines and MLOps frameworks for model... 
    Amazon Web Service
    Full time

    SFE

    Malvern, PA
    2 days ago
  • NO VISA CANDIDATES / NO AGENCIES / NO THIRD PARTIES Position Summary We are seeking a highly skilled Data Engineer to design, build, and govern enterprise data platforms that support operational applications, business analytics, and AI initiatives. This role will develop... 

    7N

    Berwyn, PA
    4 days ago
  •  ...role partners closely with quantitative researchers, data scientists, and investment teams to engineer, deploy, and operate production-grade machine learning...  ...practices and operating machine learning solutions on AWS SageMaker. Expertise in Python, cloud-native architectures... 
    Amazon Web Service
    Work experience placement

    Vanguard

    Malvern, PA
    2 days ago
  •  ...division, we are seeking a Machine Learning/ AI Engineer to design, build, and scale enterprise AI/...  ...end-to-end AI/ML solutions, including data ingestion, feature engineering, model...  ...native AI/ML applications and services using AWS technologies such as SageMaker, ECS, Lambda... 
    Amazon Web Service
    Visa sponsorship
    Malvern, PA
    3 days ago
  •  ...REQUIREMENT_CITY - Malvern, PA Role Name - AI Engineer EXPERIENCE_RANGE_IN_REQUIRED_SKILLS_ Python~Digital : Amazon Web Service(AWS) Cloud Computing~Digital : Node.js~AI Agents, Langchain ROLE_DESCRIPTION - Python, AWS, Node JS , Agentic AI, Langchain Experience... 
    Amazon Web Service

    eTeam

    Malvern, PA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AWS Data engineer w/Databrics. Be the first to apply!