Lead AWS Data Engineer
$110k - $125kTata Consultancy Services
Must Have Technical/Functional Skills
- 12+ years of solid hands-on experience in Python, AWS Data Services, DBT, Apache Airflow (on Astronomer platform), SQL and PySpark
- Very Good hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement.
- Experience in creating data pipelines and orchestrating using DBT & Apache Airflow
- Significant experience with data migrations and development of Operational Data Stores, Enterprise Data Warehouses, Data Lake and Data Marts.
- Experiencing in fixing performance issues / parallelism, Data model exposure is a must.
- Good to have: Experience with cloud ETL and ELT in one of the tools like Glue/EMR or any other ELT tool
- Experience in using Snowflake, DB2, Postgres and other database technologies is plus.
- Excellent communication skills to liaise with Business & IT stakeholders.
- Expertise in planning execution of a project and efforts estimation.
- Exposure to working in Agile ways of working
- Lead the design of reliable, secure, and highly available data lakes, data marts and data meshes
- leads the design, development, and maintenance of data integration solutions using Python, AWS Data Services, DBT ensuring data pipeline & data quality
- Collaborate with business stakeholders and architects to define the enterprise data strategy, data models, and migration Roadmap
- Translate complex technical constraints into business insights and manage expectations across cross-functional teams
- Develop, modify, configure & debug existing data pipeline as per the business requirement.
- Troubleshoot and resolve technical issues. Debug, tune and optimize code for optimal performance
- Manage the new requirements, Review the existing jobs, Perform gap analysis & Fixing performance issues, etc.
- Guide, coach, and upskill junior and mid-level data engineers on best practices, coding standards, and modern data patterns
- Document all data flow & mappings, sessions and workflows
- Ticket handling and problem ticket analysis skills in Agile /POD approach
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead AWS Data Engineer in Owings Mills, MD vacancy
- JD: 10+ years of experience in big data and distributed computing. Very Strong hands-on... ...schedulers like Airflow. Hands on experience with AWS cloud-based data platforms. Experience in... ...) is a plus. Strong problem-solving skills and ability to lead a team. SARIAN CoAmazon Web Service
- ...Big Data Developer / Data EngineerThis position will focus on developing various database and data loading/transformation efforts. Initiatives... .... Candidate is required to interact with databases using AWS Lambda, AWS Glue (for transformations) Python and Spark. Possible...Amazon Web Service
Samprasoft
Owings Mills, MD2 days ago - Job Title Need to have analytical skill, SQL, Python/ Pyspark, Snowflake and AWS proficiency. In addition, candidate should be able to handle pressure, constantly prioritize, be able to learn new skills as needed and be a good team player. Candidate must be able to deliver...Amazon Web Service
- ...Proficient in database querying and designing for relational DBs (e.g. Oracle, SQL Server, PostgreSQL) Proficiency in cloud technologies (AWS preferred) Shows dedication to quality by implementing suitable software using unit/integration and acceptance testing at the time of...Amazon Web Service
- ...Onsite! Minimum Qualifications: 5+ years of progressive software engineering experience. Expert knowledge of Python and related popular... ...containerized applications and deploying to cloud infrastructure such as AWS, Azure, or similar providers. Proficient on Linux platforms...Amazon Web ServiceLocal area
- ...1st Week6 MonthsOnsite from Nov 1st Week!Must be vaccinated!RequirementsAngular, RXJS, Spring Boot, GIT & Docker, Rest Web Services, AWS, JavaRequired Skills: Basic Qualification: Additional Skills: Background Check: Yes Drug Screen: Yes Candidate must be your W2 Employee...Amazon Web Service
Samprasoft
Owings Mills, MD2 days ago - ...experienceSplunk error loggingRequired Skills: Basic Qualification: Additional Skills: Onsite Day 1: Hybrid Role: 2-3 Days Onsite Per Week! Must Have: Strong SQL - PostgreSQL, SQL server API experience AWS project experience Splunk error logging Background Check: Yes...Amazon Web ServiceLocal area2 days per week3 days per week
My3Tech Inc
Owings Mills, MD2 days ago - ...Job Description Job Description Position Summary: The Data Engineer II will be responsible for designing, building, and maintaining... ...data storage solutions. Familiarity with cloud platforms like AWS, Azure, or Google Cloud, including relevant data services (e.g....Amazon Web ServiceWork at office
Orrstown Bank
Towson, MD3 days ago - ...ensure high availability, scalability, and reliability of systems. Deploy, manage, and maintain applications and systems deployed to AWS and apply security as code principles in a SDLC. Skills Required: AWS, DevOps, Terraform, GitHub, Jenkins, Docker, Ansible, LDAP, Kubernetes...Amazon Web Service
Sparktek
Owings Mills, MD2 days ago - ...Data Architect This is a Sr. Data Architect role Enterprise Data Architecture Team.... ...options that are close to development and engineering delivery. My team manages data technology... ...guiding the team right technologies We’re AWS Shop - need strong AWS background. –...Amazon Web Service
Samprasoft
Owings Mills, MD1 day ago - ...must be able to work independently. Project: Client Reporting is modernizing our platform to transition from on-premise to an AWS platform. Our application tech stack is transitioning to Java micro services and Angular UI. Proven experience in AWS deployments is...Amazon Web Service
Samprasoft
Owings Mills, MD1 day ago - ...teams and dig into application function is required to work day-to-day support tickets outside of the on-call cycle. A background in AWS cloud-based application development and monitoring is required. With a large amount of our application support in the AWS space, this...Amazon Web Service
My3Tech Inc
Owings Mills, MD2 days ago - ...development with React JS ~ Java Development ~ AWS -- ~ EC2, Fargate, Lambda ~ Agile... ...field such as computer science, computer engineering or related field required ~5-7 years’... ...science, with strong competencies in data structures, algorithms, and software design...Amazon Web Service
My3Tech Inc
Owings Mills, MD1 day ago - ...applications using Java/Spring boot or Python or NodeJS, knowledge of automated testing of data a plus. Requires skills: Latest Java- Streams API, Java Lambdas, Java Generics AWS (Amazon Web Services) certified (Developer or Architect (Associate/Professional))...Amazon Web Service
My3Tech Inc
Owings Mills, MD2 days ago - Cloud Security Engineer Location: Dallas, Texas (Hybrid) Duration: Contract Responsibilities: Develop automated remediation workflows Neutralize cloud security threats Write custom AWS Config Rules Compliance automation Tier-3 security incident support Cloud vulnerability...Amazon Web ServiceContract work
- ...T Rowe has a need coming up for a Data Architect. I won't have a conversation with manager... ...at the moment. This is a hands on data engineering role but also includes steering strategic... ..., Adobe Experience Platform (AEP), ETL, AWS, Spark or Snowflake, and Python or Pyspark...Amazon Web Service2 days per week
Apex Informatics
Owings Mills, MD4 days ago - ...language Experience with report creation (preferably Crystal reports) VB scripting Scheduling of jobs Additional Skills +: IIB development AWS experience SFTP Mutual Fund experience Required Skills : Basic Qualification : Additional Skills : Background Check :Yes Drug Screen...Amazon Web ServiceFor contractorsRemote work
- ...Seeking a Voice / IVR Product Owner to lead the product strategy and execution for Amazon... ...backlog while partnering with business, engineering, operations, and architecture teams to... ...regulated industry experience Experience with AWS, Amazon Lex, Contact Lens, or CRM...Amazon Web ServiceContract workWork at officeImmediate start
Mondo
Owings Mills, MD24 days ago - ...connect via citrix. Responsibilities: Design and develop REST services using Java/J2EE, Spring and Amazon Web Services. Design and develop AWS lambdas using NodeJS and/or Python. Participate in requirements discussions with analysts and business partners and strategic...Amazon Web ServiceRemote work
- ...Unix/ AIX patch & maintain systems able to address customer tickers scripting & automation Other Skills/ Knowledge Puppet & Ansible AWS Requirements • Typically requires 3+ years of relevant experience with UNIX/Linux systems administration - RedHat Linux experience...Amazon Web ServiceWork experience placement
- ...test standards. Solid database querying and data validation skills. Experience building... ...private clouds, such as Amazon Web Services (AWS), Microsoft Azure, or similar providers... ...functional testing and works with the engineering team to resolve issues. Participate effectively...Amazon Web Service
Real Soft
Owings Mills, MD2 days ago $115 per hour
...Principal Data Product Manager (PBM) Location: Remote (Candidates... ...Data Product Manager to lead the strategy, roadmap, and delivery... ...business leaders, architects, engineers, and analysts to deliver high-... .... ~ Experience with AWS, APIs, Kafka, and Snowflake or...Amazon Web ServiceContract workTemporary workRemote workSystem One
Owings Mills, MD17 days ago- ...Reference26-01207Information Technology - Engineer, Software Sr PURPOSE: Performs complex analysis... ...test cases. Compile, assess, and report data results from software testing and analysis... ...Knowledge of cloud technologies (e.g. AWS, Azure), Proficient Knowledge of database...Amazon Web ServiceWork experience placement
- ...Description Job Description Apply now: DevOps Engineer, location is Owings Mills, MD. The start... ...Analytics Platforms team within the Chief Data Office. This team is responsible for... ...ideal candidate will have deep Kubernetes and AWS infrastructure experience, a strong...Amazon Web ServiceContract workWork at officeImmediate start2 days per week
Mondo
Owings Mills, MD24 days ago - ...Network Security Engineer Location: Owings Mills MD – Hybrid Job Type: 6 Month Contract... ...cloud exposure. Will need to man the two data centers in MD: OM and Columbia. Needs to... ...understanding and oversight of multi-cloud(Azure/AWS) connectivity with primary and secondary...Amazon Web ServiceContract workWork experience placementLocal areaRemote work
Samprasoft
Owings Mills, MD1 day ago - ...opportunity to solve complex business, logic, data and technical challenges. Overview: •... ...solutions that raise the quality of UI engineering in the firm and ultimately improve the experience... ...ideas to varied audiences Preferred: • AWS experience • Financial industry...Amazon Web Service
- ...coding needed Small team - 7 with 3 Ba's and a lead Application: middle office investment... ...Core Entity framework LINQ Postgress SQL, AWS 3RD ROLE:.Net Core Entity framework w/ Angular... ...Very STRONG SQL Server coding - rewriting data extract code (Must have) AWS / Cloud...Amazon Web ServiceWork at officeLocal area2 days per week
- ...transfer protocol). Ability to write basic Splunk queries and investigate application issues through Splunk logs preferred. Cloud and AWS knowledge (such as Azure, S3 buckets, New Relic, Splunk, Cloud Watch) Production support experience 24/7 support, fast paced. Role...Amazon Web Service
$40 per hour
...As a Machine Learning Engineering Intern, you will be part of a collaborative team supporting... ...primary role is to contribute to Workiva's data scientists' efforts within the Data... ...Knowledge of cloud platforms such as AWS Proficiency with Python and/or Go Familiarity...Amazon Web ServiceRemote jobFull timeSummer workInternshipSummer internshipWork at officeWorkiva
Towson, MD2 days ago$77k - $131k
...diverse technology landscape that includes AWS-based solutions, vendor platforms, hybrid... ...in areas such as databases, APIs, data querying, and data validation. Responsibilities... ...Playwright , frameworks, and quality engineering practices. Familiarity with data governance...Amazon Web ServiceRemote work3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AWS Data Engineer. Be the first to apply!
Related searches
- aws Owings Mills, MD
- devops aws developer (remote) Owings Mills, MD
- aws developer Owings Mills, MD
- aws devops Owings Mills, MD
- software development engineer aws Owings Mills, MD
- aws cloud Owings Mills, MD
- senior aws cloud engineer Owings Mills, MD
- data loss prevention analyst Owings Mills, MD
- data recovery Owings Mills, MD
- clinical data coordinator remote Owings Mills, MD