Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead AWS Data Engineer

Tata Consultancy Services

Data EngineerJob Description Must Have Technical/Functional Skills · 12+ years of solid hands-on experience in Python, AWS Data Services, DBT, Apache Airflow (on Astronomer platform), SQL and PySpark · Very good hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement. · Experience in creating data pipelines and orchestrating using DBT & Apache Airflow · Significant experience with data migrations and development of Operational Data Stores, Enterprise Data Warehouses, Data Lake and Data Marts. · Experience in fixing performance issues / parallelism, Data model exposure is a must. · Good to have: Experience with cloud ETL and ELT in one of the tools like Glue/EMR or any other ELT tool · Experience in using Snowflake, DB2, Postgres and other database technologies is plus. · Excellent communication skills to liaise with Business & IT stakeholders. · Expertise in planning execution of a project and efforts estimation. · Exposure to working in Agile ways of working Roles & Responsibilities · Lead the design of reliable, secure, and highly available data lakes, data marts and data meshes · Leads the design, development, and maintenance of data integration solutions using Python, AWS Data Services, DBT ensuring data pipeline & data quality · Collaborate with business stakeholders and architects to define the enterprise data strategy, data models, and migration Roadmap · Translate complex technical constraints into business insights and manage expectations across cross-functional teams · Develop, modify, configure & debug existing data pipeline as per the business requirement. · Troubleshoot and resolve technical issues. Debug, tune and optimize code for optimal performance · Manage the new requirements, Review the existing jobs, Perform gap analysis & Fixing performance issues, etc. · Guide, coach, and upskill junior and mid-level data engineers on best practices, coding standards, and modern data patterns · Document all data flow & mappings, sessions and workflows · Ticket handling and problem ticket analysis skills in Agile /POD approach

Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Lead AWS Data Engineer in Owings Mills, MD vacancy
  • JD: 10+ years of experience in big data and distributed computing. Very Strong hands-on...  ...schedulers like Airflow. Hands on experience with AWS cloud-based data platforms. Experience in...  ...) is a plus. Strong problem-solving skills and ability to lead a team. SARIAN Co
    Amazon Web Service

    SARIAN Co

    Owings Mills, MD
    2 days ago
  •  ...Data EngineerThis position will focus on developing various database and data loading/transformation efforts. Initiatives could include...  ...externally. Candidate is required to interact with databases using AWS Lambda, AWS Glue (for transformations) Python and Spark. Possible... 
    Amazon Web Service

    My3Tech Inc

    Owings Mills, MD
    5 days ago
  • Job Title Need to have analytical skill, SQL, Python/ Pyspark, Snowflake and AWS proficiency. In addition, candidate should be able to handle pressure, constantly prioritize, be able to learn new skills as needed and be a good team player. Candidate must be able to deliver... 
    Amazon Web Service

    Sparktek

    Owings Mills, MD
    2 days ago
  •  ...Reference26-01207Information Technology - Engineer, Software Sr PURPOSE: Performs complex analysis...  ...test cases. Compile, assess, and report data results from software testing and analysis...  ...Knowledge of cloud technologies (e.g. AWS, Azure), Proficient Knowledge of database... 
    Amazon Web Service
    Work experience placement

    Mindlance

    Owings Mills, MD
    4 days ago
  •  ...Proficient in database querying and designing for relational DBs (e.g. Oracle, SQL Server, PostgreSQL) Proficiency in cloud technologies (AWS preferred) Shows dedication to quality by implementing suitable software using unit/integration and acceptance testing at the time of... 
    Amazon Web Service

    Samprasoft

    Owings Mills, MD
    4 days ago
  •  ...Position Summary: The Data Engineer II will be responsible for designing, building, and maintaining the bank's data infrastructure and...  ...data storage solutions. Familiarity with cloud platforms like AWS, Azure, or Google Cloud, including relevant data services (e.g.... 
    Amazon Web Service
    Work at office

    Orrstown Financial

    Towson, MD
    2 hours ago
  •  ...Onsite! Minimum Qualifications: 5+ years of progressive software engineering experience. Expert knowledge of Python and related popular...  ...containerized applications and deploying to cloud infrastructure such as AWS, Azure, or similar providers. Proficient on Linux platforms... 
    Amazon Web Service
    Local area

    My3Tech Inc

    Owings Mills, MD
    5 days ago
  • Network Engineer W/ AWS ExpExperience with monitoring tools such as AWS CloudWatch, App Dynamics, New Relic, Grafana, and Splunk to troubleshoot issues end-to-end as well as set up health checks, alerts, and triggers.
    Amazon Web Service

    Samprasoft

    Owings Mills, MD
    2 hours ago
  •  ...teams and dig into application function is required to work day-to-day support tickets outside of the on-call cycle. A background in AWS cloud-based application development and monitoring is required. With a large amount of our application support in the AWS space, this... 
    Amazon Web Service

    My3Tech Inc

    Owings Mills, MD
    20 hours ago
  •  ...Data Architect This is a Sr. Data Architect role Enterprise Data Architecture Team....  ...options that are close to development and engineering delivery. My team manages data technology...  ...guiding the team right technologies We’re AWS Shop - need strong AWS background. –... 
    Amazon Web Service

    Samprasoft

    Owings Mills, MD
    4 days ago
  • Cloud Security Engineer Location: Dallas, Texas (Hybrid) Duration: Contract Responsibilities: Develop automated remediation workflows Neutralize cloud security threats Write custom AWS Config Rules Compliance automation Tier-3 security incident support Cloud vulnerability... 
    Amazon Web Service
    Contract work

    Sparktek

    Owings Mills, MD
    2 days ago
  •  ...language Experience with report creation (preferably Crystal reports) VB scripting Scheduling of jobs Additional Skills +: IIB development AWS experience SFTP Mutual Fund experience Required Skills : Basic Qualification : Additional Skills : Background Check :Yes Drug Screen... 
    Amazon Web Service
    For contractors
    Remote work

    Samprasoft

    Owings Mills, MD
    2 days ago
  •  ...developing on and interfacing with cloud computing platforms such as AWS• Hands-on experience with Spring based application development•...  ...large group presentations conducted at the project/business lead level.Ability to understand and capture business functional and technical... 
    Amazon Web Service

    Comtech

    Owings Mills, MD
    4 days ago
  •  ...needed Small team - 7 with 3 Ba's and a lead Application: middle office investment...  ...Core Entity framework LINQ Postgress SQL, AWS 3RD ROLE:.Net Core Entity framework w/ Angular...  ...Very STRONG SQL Server coding - rewriting data extract code (Must have) AWS / Cloud... 
    Amazon Web Service
    Work at office
    Local area
    2 days per week

    Georgia IT Inc

    Owings Mills, MD
    3 days ago
  •  ...technology innovation, ERP and CRM counselling, Product Engineering, Business Intelligence, Data Management, SOA, BPM, Data Warehousing, SharePoint Consulting...  ...- RESTful Web Service Development / Design experience - AWS deployment for web services, a plus- Unit Testing-... 
    Amazon Web Service
    Worldwide

    USM Systems

    Owings Mills, MD
    4 days ago
  •  ...Unix/ AIX patch & maintain systems able to address customer tickers scripting & automation Other Skills/ Knowledge Puppet & Ansible AWS Requirements • Typically requires 3+ years of relevant experience with UNIX/Linux systems administration - RedHat Linux experience... 
    Amazon Web Service
    Work experience placement

    r2 Technologies, Inc.

    Owings Mills, MD
    2 days ago
  •  ...+ Months Onsite Day 1: Hybrid Role: 2-3 Days Onsite Per Week! Must Have: Strong SQL - PostgreSQL, SQL server API experience AWS project experience Splunk error logging Required Skills: Basic Qualification: Additional Skills: Onsite Day 1: Hybrid Role: 2-3... 
    Amazon Web Service
    Local area
    2 days per week
    3 days per week

    My3Tech

    Owings Mills, MD
    4 days ago
  •  ...Seeking a Voice / IVR Product Owner to lead the product strategy and execution for Amazon...  ...backlog while partnering with business, engineering, operations, and architecture teams to...  ...regulated industry experience Experience with AWS, Amazon Lex, Contact Lens, or CRM... 
    Amazon Web Service
    Contract work
    Work at office
    Immediate start

    Mondo

    Owings Mills, MD
    27 days ago
  • $65 - $70 per hour

     ...DevOps Engineer Immediate need for a talented DevOps Engineer. This is a 06 months contract...  ...Experience: ~ Key skills; AWS, Docker, Terraform, Python, file storage....  ...three days a week Our client is a leading Investment Management Industry, and we are... 
    Amazon Web Service
    Contract work
    Local area
    Immediate start
    Remote work
    3 days per week

    Pyramid Corporation

    Owings Mills, MD
    1 day ago
  • $40 per hour

     ...As a Machine Learning Engineering Intern, you will be part of a collaborative team supporting...  ...primary role is to contribute to Workiva's data scientists' efforts within the Data...  ...Knowledge of cloud platforms such as AWS Proficiency with Python and/or Go Familiarity... 
    Amazon Web Service
    Remote job
    Full time
    Summer work
    Internship
    Summer internship
    Work at office

    Workiva

    Towson, MD
    20 hours ago
  • $115 per hour

     ...Principal Data Product Manager (PBM) Location: Remote (Candidates...  ...Data Product Manager to lead the strategy, roadmap, and delivery...  ...business leaders, architects, engineers, and analysts to deliver high-...  .... ~ Experience with AWS, APIs, Kafka, and Snowflake or... 
    Amazon Web Service
    Contract work
    Temporary work
    Remote work

    System One

    Owings Mills, MD
    20 days ago
  • $159k - $272k

     ...Principal of Cloud Infrastructure and Engineering, within the Global Technology...  ...organization, you will lead the team responsible for designing...  ...problems, and implement data-driven solutions.As a leader use...  ...practices and industry trends in AWS, Azure, and GCP.Stay abreast... 
    Amazon Web Service
    Full time
    Local area
    Remote work
    3 days per week

    T. Rowe Price

    Owings Mills, MD
    20 hours ago
  •  ...Angular Typescript (Angular 11)Common Skills:.NET/.NET Core (Must have)Very Very STRONG SQL Server coding - rewriting data extract code (Must have)AWS / Cloud Native Architectures knowledgeWeb Services / Microservices (Restful & SOAP)Preferred: Exp with mutual funds, stocks... 
    Amazon Web Service
    Work at office
    Local area
    2 days per week

    Staffing

    Owings Mills, MD
    2 days ago
  •  ...opportunity to solve complex business, logic, data and technical challenges. Overview: •...  ...solutions that raise the quality of UI engineering in the firm and ultimately improve the experience...  ...ideas to varied audiences Preferred: • AWS experience • Financial industry... 
    Amazon Web Service

    Apex Informatics

    Owings Mills, MD
    2 days ago
  • $121k - $206k

     ...related pipelines to support AWS and Salesforce metadata deployment...  ...timelines. You will also:Lead projects or work streamsBe accountable...  ...and improve Salesforce data quality, implementing rules and...  ...business stakeholdersMentor junior engineers on DevOps best... 
    Amazon Web Service
    Full time
    Local area
    Remote work
    3 days per week

    T. Rowe Price

    Owings Mills, MD
    4 days ago
  •  ...transfer protocol). Ability to write basic Splunk queries and investigate application issues through Splunk logs preferred. Cloud and AWS knowledge (such as Azure, S3 buckets, New Relic, Splunk, Cloud Watch) Production support experience 24/7 support, fast paced. Role... 
    Amazon Web Service

    Samprasoft

    Owings Mills, MD
    1 day ago
  •  ...including vendor integrated solutions and data feeds. This position is responsible for...  ...Participates in re-platforming and re-engineering efforts essential to ongoing system support...  ...Financial systems Applications utilizing AWS managed services Monitoring and restoration... 
    Amazon Web Service

    Samprasoft

    Owings Mills, MD
    1 day ago
  • $201k - $342k

     ...role within Global Technology Engineering and Operations with accountability...  ...year platform strategy, while leading teams responsible for day‑to‑...  ...to cloud, co‑location, and data center exit strategiesLeads network...  ...cloud platforms at scale; AWS preferred.Proven ability to... 
    Amazon Web Service
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    Work from home
    1 day per week

    T. Rowe Price

    Owings Mills, MD
    20 hours ago
  • $121k - $206k

     ...long-term solutions leveraging AWS and Salesforce technologies...  ...software solutions. You will also:Lead projects or work streams...  ...actionable insights.Champion engineering excellence by applying best practices...  ...engineering, and real-time, data-driven automation.Manage technical... 
    Amazon Web Service
    Full time
    Temporary work
    Local area
    Remote work
    3 days per week

    T. Rowe Price

    Owings Mills, MD
    1 day ago
  •  ...Description Job Description Apply now: DevOps Engineer, location is Owings Mills, MD. The start...  ...Analytics Platforms team within the Chief Data Office. This team is responsible for...  ...ideal candidate will have deep Kubernetes and AWS infrastructure experience, a strong... 
    Amazon Web Service
    Contract work
    Work at office
    Immediate start
    2 days per week

    Mondo

    Owings Mills, MD
    27 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead AWS Data Engineer. Be the first to apply!