Lead AWS Data Engineer
Tata Consultancy Services
Data Engineer
Job Description Must Have Technical/Functional Skills · 12+ years of solid hands-on experience in Python, AWS Data Services, DBT, Apache Airflow (on Astronomer platform), SQL and PySpark · Very good hands-on knowledge on SQL and Data Warehousing life cycle is an absolute requirement. · Experience in creating data pipelines and orchestrating using DBT & Apache Airflow · Significant experience with data migrations and development of Operational Data Stores, Enterprise Data Warehouses, Data Lake and Data Marts. · Experience in fixing performance issues / parallelism, Data model exposure is a must. · Good to have: Experience with cloud ETL and ELT in one of the tools like Glue/EMR or any other ELT tool · Experience in using Snowflake, DB2, Postgres and other database technologies is plus. · Excellent communication skills to liaise with Business & IT stakeholders. · Expertise in planning execution of a project and efforts estimation. · Exposure to working in Agile ways of working Roles & Responsibilities · Lead the design of reliable, secure, and highly available data lakes, data marts and data meshes · Leads the design, development, and maintenance of data integration solutions using Python, AWS Data Services, DBT ensuring data pipeline & data quality · Collaborate with business stakeholders and architects to define the enterprise data strategy, data models, and migration Roadmap · Translate complex technical constraints into business insights and manage expectations across cross-functional teams · Develop, modify, configure & debug existing data pipeline as per the business requirement. · Troubleshoot and resolve technical issues. Debug, tune and optimize code for optimal performance · Manage the new requirements, Review the existing jobs, Perform gap analysis & Fixing performance issues, etc. · Guide, coach, and upskill junior and mid-level data engineers on best practices, coding standards, and modern data patterns · Document all data flow & mappings, sessions and workflows · Ticket handling and problem ticket analysis skills in Agile /POD approach
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Lead AWS Data Engineer in Owings Mills, MD vacancy
- ...JD: ~10+ years of experience in big data and distributed computing. ~ Very Strong... ...Airflow. ~ Hands on experience with AWS cloud-based data platforms. ~ Experience... ...) is a plus. ~ Strong problem-solving skills and ability to lead a team....Amazon Web Service
SARIAN Co
Owings Mills, MD9 hours ago - ...Job Title Need to have analytical skill, SQL, Python/ Pyspark, Snowflake and AWS proficiency. In addition, candidate should be able to handle pressure, constantly prioritize, be able to learn new skills as needed and be a good team player. Candidate must be able to...Amazon Web Service
Sparktek
Owings Mills, MD2 days ago - ...Big Data Developer / Data EngineerThis position will focus on developing various database and data loading/transformation efforts. Initiatives... .... Candidate is required to interact with databases using AWS Lambda, AWS Glue (for transformations) Python and Spark. Possible...Amazon Web Service
Samprasoft
Owings Mills, MD5 days ago - ...Reference26-01207Information Technology - Engineer, Software Sr PURPOSE: Performs complex analysis... ...test cases. Compile, assess, and report data results from software testing and analysis... ...Knowledge of cloud technologies (e.g. AWS, Azure), Proficient Knowledge of database...Amazon Web ServiceWork experience placement
- ...Proficient in database querying and designing for relational DBs (e.g. Oracle, SQL Server, PostgreSQL) Proficiency in cloud technologies (AWS preferred) Shows dedication to quality by implementing suitable software using unit/integration and acceptance testing at the time of...Amazon Web Service
Samprasoft
Owings Mills, MD4 days ago - ...Position Summary: The Data Engineer II will be responsible for designing, building, and maintaining the bank's data infrastructure and... ...data storage solutions. Familiarity with cloud platforms like AWS, Azure, or Google Cloud, including relevant data services (e.g....Amazon Web ServiceWork at office
Orrstown Financial
Towson, MD5 days ago $121.6k - $163.8k
...opportunities. Position Overview Index Analytics is seeking a Data Engineer to support Government clients to design, build, and optimize scalable... ...and maintain scalable, reliable ETL/ELT data pipelinesusing AWS, Snowflake and Snowflake tools Develop and optimize data models...Amazon Web ServiceLocal areaIndex Analytics LLC
Windsor Mill, MD5 days ago- ...1st Week6 MonthsOnsite from Nov 1st Week!Must be vaccinated!RequirementsAngular, RXJS, Spring Boot, GIT & Docker, Rest Web Services, AWS, JavaRequired Skills: Basic Qualification: Additional Skills: Background Check: Yes Drug Screen: Yes Candidate must be your W2 Employee...Amazon Web Service
Samprasoft
Owings Mills, MD5 days ago - ...Cloud Security Engineer Location: Dallas, Texas (Hybrid) Duration: Contract Responsibilities: Develop automated remediation workflows Neutralize cloud security threats Write custom AWS Config Rules Compliance automation Tier-3 security incident...Amazon Web ServiceContract work
Sparktek
Owings Mills, MD2 days ago - ...with report creation (preferably Crystal reports) VB scripting Scheduling of jobs Additional Skills +: IIB development AWS experience SFTP Mutual Fund experience Required Skills : Basic Qualification : Additional Skills : Background Check :Yes Drug Screen...Amazon Web ServiceFor contractorsRemote work
Samprasoft
Owings Mills, MD4 days ago - ...ensure high availability, scalability, and reliability of systems. Deploy, manage, and maintain applications and systems deployed to AWS and apply security as code principles in a SDLC. Skills Required: AWS, DevOps, Terraform, GitHub, Jenkins, Docker, Ansible, LDAP, Kubernetes...Amazon Web Service
Sparktek
Owings Mills, MD5 days ago $150k - $160k
...Data ScientistThank you for considering IT Concepts dba Kentro,... ...opportunity and collaboration leads to success. Our dynamic community... ...solve complex challenges.Data Engineering & Pipeline Development:Design... ...computing environments such as AWS, Azure, or GCP.Data Science...Amazon Web ServiceWork at officeLocal areaNavstar
Gwynn Oak, MD5 days ago- ...citrix. Responsibilities: Design and develop REST services using Java/J2EE, Spring and Amazon Web Services. Design and develop AWS lambdas using NodeJS and/or Python. Participate in requirements discussions with analysts and business partners and strategic recommendations...Amazon Web ServiceRemote work
Samprasoft
Owings Mills, MD4 days ago - ...Data Architect This is a Sr. Data Architect role Enterprise Data Architecture Team.... ...options that are close to development and engineering delivery. My team manages data technology... ...guiding the team right technologies We’re AWS Shop - need strong AWS background. –...Amazon Web Service
Samprasoft
Owings Mills, MD4 days ago - ...systems able to address customer tickers scripting & automation Other Skills/ Knowledge Puppet & Ansible AWS Requirements • Typically requires 3+ years of relevant experience with UNIX/Linux systems administration - RedHat...Amazon Web ServiceWork experience placement
r2 Technologies, Inc.
Owings Mills, MD5 days ago - ...Spring boot or Python or NodeJS, knowledge of automated testing of data a plus. Requires skills:Latest Java- Streams API, Java Lambdas,... ...of Python and/or JavaScript/Typescript (specially for developing AWS Lambdas)Working knowledge of version control system gitKnowledge...Amazon Web Service
Samprasoft
Owings Mills, MD5 days ago - ...Net AWS Developer Lead for a group of Software Engineers to bring cloud first technologies to the group and be able to lead the team in developing these skillsets... ...will be new (mostly) or transforming .NET/Azure data based solutions into AWS cloud architecture. Current...Amazon Web ServiceRemote work2 days per week
Samprasoft
Owings Mills, MD4 days ago - ...developing on and interfacing with cloud computing platforms such as AWS• Hands-on experience with Spring based application development•... ...large group presentations conducted at the project/business lead level.Ability to understand and capture business functional and technical...Amazon Web Service
- ...Job Title: MLOps Engineer Location: Woodlawn, MD (supporting a federal client) local... ...Build and maintain automated ML pipelines (data ingestion, preprocessing, training,... ...Manage cloud infrastructure for ML workloads (AWS, Docker, Kubernetes) Implement monitoring...Amazon Web ServiceLocal area
3B Staffing LLC
Marriottsville, MD2 days ago - ...technology innovation, ERP and CRM counselling, Product Engineering, Business Intelligence, Data Management, SOA, BPM, Data Warehousing, SharePoint Consulting... ...- RESTful Web Service Development / Design experience - AWS deployment for web services, a plus- Unit Testing-...Amazon Web ServiceWorldwide
- ...needed Small team - 7 with 3 Ba's and a lead Application: middle office investment... ...Core Entity framework LINQ Postgress SQL, AWS 3RD ROLE:.Net Core Entity framework w/ Angular... ...Very STRONG SQL Server coding - rewriting data extract code (Must have) AWS / Cloud...Amazon Web ServiceWork at officeLocal area2 days per week
Georgia IT Inc
Owings Mills, MD3 days ago - ...Seeking a Voice / IVR Product Owner to lead the product strategy and execution for Amazon... ...backlog while partnering with business, engineering, operations, and architecture teams to... ...regulated industry experience Experience with AWS, Amazon Lex, Contact Lens, or CRM...Amazon Web ServiceContract workWork at officeImmediate start
Mondo
Owings Mills, MD22 days ago $65 - $70 per hour
...DevOps Engineer Immediate need for a talented DevOps Engineer. This is a 06 months contract... ...Experience: ~ Key skills; AWS, Docker, Terraform, Python, file storage.... ...three days a week Our client is a leading Investment Management Industry, and we are...Amazon Web ServiceContract workLocal areaImmediate startRemote work3 days per weekPyramid Corporation
Owings Mills, MD23 hours ago$115 per hour
...Principal Data Product Manager (PBM) Location: Remote (Candidates... ...Data Product Manager to lead the strategy, roadmap, and delivery... ...business leaders, architects, engineers, and analysts to deliver high-... .... ~ Experience with AWS, APIs, Kafka, and Snowflake or...Amazon Web ServiceContract workTemporary workRemote workSystem One
Owings Mills, MD15 days ago- ...Network Engineer with Observability/Monitoring platform Position is onsite in Owings... ...maintain a stable and efficient converged data, voice, and video network environment. •... ...' for VMware (NSX), and 'Cloud' (AWS, Route53, Azure, etc.) • Knowledge of the...Amazon Web ServiceWork at officeLocal area
3B Staffing LLC
Owings Mills, MD3 days ago $159k - $272k
...Principal of Cloud Infrastructure and Engineering, within the Global Technology... ...organization, you will lead the team responsible for designing... ...problems, and implement data-driven solutions.As a leader use... ...practices and industry trends in AWS, Azure, and GCP.Stay abreast...Amazon Web ServiceFull timeLocal areaRemote work3 days per week- ...transfer protocol). Ability to write basic Splunk queries and investigate application issues through Splunk logs preferred. Cloud and AWS knowledge (such as Azure, S3 buckets, New Relic, Splunk, Cloud Watch) Production support experience 24/7 support, fast paced. Role...Amazon Web Service
- ...DevOps Engineer Owings Mills, MD 21117 6 Months Onsite Role: Hybrid Model: 2 -3 Days Onsite! Please note that this position is... ...their own device to connect via citrix. Top Requirements: AWS Infrastructure Automated deployment (Gitlab) Python is ideal...Amazon Web Service
Samprasoft
Owings Mills, MD4 days ago $40 per hour
...As a Machine Learning Engineering Intern, you will be part of a collaborative team supporting... ...primary role is to contribute to Workiva's data scientists' efforts within the Data... ...Knowledge of cloud platforms such as AWS Proficiency with Python and/or Go Familiarity...Amazon Web ServiceRemote jobFull timeSummer workInternshipSummer internshipWork at officeWorkiva
Towson, MD5 days ago$121k - $206k
...related pipelines to support AWS and Salesforce metadata deployment... ...timelines. You will also:Lead projects or work streamsBe accountable... ...and improve Salesforce data quality, implementing rules and... ...business stakeholdersMentor junior engineers on DevOps best...Amazon Web ServiceFull timeLocal areaRemote work3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AWS Data Engineer. Be the first to apply!
Related searches
- aws Owings Mills, MD
- devops aws developer (remote) Owings Mills, MD
- aws developer Owings Mills, MD
- aws devops Owings Mills, MD
- software development engineer aws Owings Mills, MD
- aws cloud Owings Mills, MD
- amazon aws Owings Mills, MD
- senior aws cloud engineer Owings Mills, MD
- data loss prevention analyst Owings Mills, MD
- clinical data coordinator remote Owings Mills, MD