AWS Data Engineer

Spectraforce Technologies

Newark, NJ

Title: AWS Data Engineer
Location: Newark, NJ (Hybrid)
Duration: 12 Months

Job Description:

Responsibilities:

Designing, building, and maintaining efficient, reusable, and reliable code
Ensure the best possible performance and quality of high scale data applications and services
Participate in system design discussions
Independently perform hands on development and unit testing of the applications
Collaborate with the development team and build individual components into enterprise data platform
Work in a team environment with product, QE/QA, and cross functional teams to deliver a project throughout the whole software development cycle.
Responsible to identify and resolve any performance issues
Keep up to date with new technology development and implementation
Participate in code review to make sure standards and best practices are met
Project management: Agile developers take responsibility for estimating, planning, and managing all tasks and report on progress
Software quality: The Agile developer is also responsible for the quality of the software he/she produces. The team takes responsibility for the quality of the work they produce instead of turning over some code to a separate and independent group for testing
Teamwork: This includes collaboration with all other team members with the aim to take shared responsibility for the overall efforts
Understanding user needs: This is about interacting with users as necessary to clarify requirements

Primary & Must-Have Skills

AWS Core Ecosystem: Glue, Lambda, S3, IAM Roles, Redshift, RDS.
Infrastructure as Code (IaC): Writing CloudFormation templates.
DevOps / CI-CD: GitHub repository version control, Jenkins, SonarQube, and X-Ray.
Programming & Data Languages: Expert-level proficiency in Python (for Lambda) and SQL queries.

Nice-to-Have Ecosystem Tools

Candidates will build integrations between these ecosystem tools using the AWS tech stack. Prior familiarity with any of the following is a major plus:
Informatica: Specifically Data Catalog, Data Lineage, and Data Marketplace.
Denodo: For data virtualization and data semantics.
Ataccama: For Master Data Management (MDM), Reference Data Management (RDM), and data quality observability.

Background & Experience Profile

Years of Experience: Around 8+ years of experience (Senior level).
AWS Certifications: While strong experience is evaluated, certifications are highly preferred because they ensure a 360-degree visibility of AWS services for architectural design optimizations.

Qualifications:

Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience
8+ years of experience as Data Engineer on AWS Stack with experience on DevOps tool
AWS Solutions Architect or AWS Developer Certification required
Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, Glue DataBrew, EMR/Spark, RDS, Redshift, DataSync, DMS, DynamoDB, Lambda, Step Functions, IAM, KMS, SM, EventBridge, EC2, SQS, SNS, LakeFormation, CloudWatch, Cloud Trail
Implement high velocity streaming solutions and orchestration using Amazon Kinesis, AWS Managed Airflow and AWS Managed Kafka (preferred)
Solid experience building solutions on AWS data lake/data warehouse
Analyze, design, development, and implementation of data ingestion pipeline in AWS
Knowledge implementing ETL/ELT for data solutions
End-to-end data solutions (ingest, storage, integration, processing, access) on AWS
Knowledge implementing RBAC strategy/solutions using AWS IAM and Redshift RBAC model
Build & implement CI/CD pipelines for EDP Platform using CloudFormation and Jenkins
Programming experience with Python, Shell scripting and SQL
Knowledge of analyzing data using SQL Stored procedures
Build automated data pipelines to ingest data from relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift
Build Automated data pipelines to ingest data from Rest APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.
Good Experience of DevOps practice
Experience with modern source code management and software repository systems (Bitbucket)
Experience with programming languages (Python)
Experience with scripting languages (Shell, Groovy)
Experience with API deployment for tooling integration
Experience using Jenkins, CloudBees (Pipeline as Code, Shared Libraries)
The ability to document exceptions/issues/action plans/meeting minutes/lessons learned accurately and in a timely fashion
Experience with administering DevOps tools in SaaS
Experience using DevOps Tools (SonarQube, Artifactory etc.)
Experience using build tools (Maven, MS Build and Gradle)
Experience using containers (Docker)
Experience using Atlassian suite (Jira, Confluence)
Experience of Infrastructure as Code using CloudFormation
Creating Jenkins CI pipelines to integrate Sonar/Security scans and test automation scripts
Part of DevOps QA and AWS team focusing on building CI/CD pipeline
Responsible for writing and maintaining Jenkins Pipelines

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the AWS Data Engineer in Newark, NJ vacancy

AWS Data Engineer
Data Engineer - AWS Location: Newark, NJ. Work Arrangement: 3 days/week hybrid. Final in-person interview required. Employment Type: W2 candidates are highly preferred. We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical...
Amazon Web Service
3 days per week
PamTen
Newark, NJ
2 days ago
Data Engineer
$65k - $80k
...a global consulting firm specializing in Data Science and Business Intelligence, with offices... ...This is a full-time, hybrid, Data Engineer role located in Newark, NJ. The Data Engineer... ...standard tools. Experience required with: AWS Services: AWS Glue, Data Pipeline, Redshift...
Amazon Web Service
Full time
NeenOpal Inc.
Newark, NJ
3 days ago
Data Engineer
$90 - $110 per hour
...more exclusive features. A large asset manager is looking for a Data Engineer with Azure experience in Newark, NJ. Pay: $90-110/hr (corp or W... .... Design storage solutions for large data sets; plan for AWS cloud migration. Assess scalability impacts and ensure sustainable...
Amazon Web Service
Full time
Local area
Relocation
Open Systems Technologies
Newark, NJ
1 day ago
Data Engineer - AWS
...Contract positions for a major investment firm. Hybrid work environment in Newark, NJ. Data Engineers (AWS) Job Summary: We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team. The ideal candidate will be responsible...
Amazon Web Service
Hourly pay
Contract work
JSR Tech Consulting
Newark, NJ
2 days ago
AWS Lead Data Engineer
...AWS Lead Data Engineer Hybrid - 3 days from Newark, NJ office Note: Please submit local candidates who are available for an in-person client interview from Newark (Washington Street) office after the 1st round of client interview is complete. Before presenting...
Amazon Web Service
Second job
Work at office
Local area
Shift work
Ruri Software Technologies LLC
Newark, NJ
5 days ago
AWS Lead Data Engineer
$85 per hour
...NJ (Hybrid – 3 days onsite) Engagement: Contract Pay Rate: Up to $85/hr (C2C) or $80/hr (W2) We are seeking an experienced AWS Lead Data Engineer to join a high-performing Data Engineering team. This role requires a strong technical leader who can architect, build, and...
Amazon Web Service
Contract work
JSR Tech Consulting
Newark, NJ
3 days ago
Senior Data Engineer
$85k - $95k
# Senior Data EngineerNew YorkApply for this job* Permanent* Experienced Professionals*... ...Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of... ...data warehouses and data applications on AWS for large enterprises Programming experience...
Amazon Web Service
Permanent employment
Full time
Local area
Capgemini
Newark, NJ
1 day ago
AWS Data Engineer
Job Title: AWS Data Engineer Duration: 7 months Location: Hybrid (Newark, NJ) Qualifications Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience Experience implementing, supporting data lakes, data warehouses...
Amazon Web Service
Spectraforce Technologies
Newark, NJ
4 days ago
AWS Data Engineer
...Based on Experience) Employment Type: W2 or Corp-to-Corp Candidates: Local Candidates Preferred We are seeking an experienced AWS Data Engineer to join a growing Data Engineering team supporting enterprise-scale cloud initiatives within a leading financial services...
Amazon Web Service
Contract work
Local area
3 days per week
JSR Tech Consulting
Newark, NJ
4 days ago
Data Engineer
$70 - $75 per hour
...Remote Duration: 6 Months (Contract To Hire) Overview As a Cloud Engineer within the AWS AI/ML platform team, you will have the opportunity to work... ..., KMS Keys, VPC NACLs, and SCPs. Familiar with ETL and big data tool-chains such as those provided by Hadoop/EMR, Glue,...
Amazon Web Service
Full time
Contract work
Remote work
SPECTRAFORCE
Newark, NJ
2 days ago
Data Engineer: Cloud ETL & Data Warehousing (Hybrid)
$65k - $80k
...A global consulting firm is seeking a full-time Data Engineer in Newark, NJ. You'll design and manage data engineering solutions, build and... ...experience, is proficient in Python and SQL, and is familiar with AWS and Azure services. This role offers a salary range of $65,000–...
Amazon Web Service
Full time
NeenOpal Inc.
Newark, NJ
4 days ago
Lead AWS Data Engineer
...Pay Rate: Open Employment Type: W2 or Corp-to-Corp Candidates: Local Candidates Preferred We are seeking an experienced Lead AWS Data Engineer to join a growing Data Engineering team within a leading investment management organization. This is a hands‑on technical...
Amazon Web Service
Long term contract
Contract work
Local area
3 days per week
JSR Tech Consulting
Newark, NJ
3 days ago
Data Engineer III - (Pyspark/databricks/Mongo/Sql/Python)
...skills will contribute to a winning culture and team. As a Data Engineer III at JPMorganChase within the External Reporting and Finance... ...and skills Hands on experience in Pyspark and Databricks and AWS Services such as ECS, Lambdas and EKS services. Exposure to...
Amazon Web Service
J.P. Morgan
Jersey City, NJ
2 days ago
AI Data Engineer
...company that specializes in cybersecurity, Big Data/databases, software development, systems... ...HUBZone company. About the job AI Data Engineer Job Overview: The AI Data Engineer is responsible... ...(s) in area of expertise a plus AWS Machine Learning Specialty, Azure AI Engineer...
Amazon Web Service
Remote work
Flexible hours
SCALIS
Newark, NJ
5 days ago
AI Data Engineer
Proven experience as a software engineer with strongproficiencyin Python and/or Java, writing... ...APIs, third-party services, and enterprise data sources. Strong understanding of security... ...IP networking knowledge. Experience with AWS/Azure cloud services or equivalent. Experience...
Amazon Web Service
Temporary work
GuruSchools LLC
Newark, NJ
3 days ago
Lead Data Engineer [Multiple Positions Available]
$200k
...DESCRIPTION: Duties: Build and deploy AWS components using industry leading automation... ...: Bachelor's degree in Electronic Engineering, Computer Science, Computer Engineering,... ...experience in the job offered or as Lead Data Engineer, Data Engineer, Software Engineer...
Amazon Web Service
Full time
J.P. Morgan
Jersey City, NJ
9 days ago
Senior Data Engineer
...Senior Data Engineer- Jersey city, NJ Must have: Spark, Scala, Java, AWS (EMR) Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plus Data set size is 500m-1b rows per batch His resume review focuses...
Amazon Web Service
Apex Informatics
Jersey City, NJ
5 days ago
Senior Data engineer
...backend development), Spark (performance tuning, expertise), and AWS. Prefer 6+ years of experience. Roles and Responsibilities... ...Min 6 years of hands-on experience • AWS, Python, Spark • Data/Backend Software Developer Nice to have: •...
Amazon Web Service
Apex Informatics
Jersey City, NJ
5 days ago
"Data Engineer"
...your updated resume to ****@*****.*** Job Title: Data Engineer Location: Remote Duration: 6 to 12 Months Contract... ...programming skills in Python & SQL. Python, Pyspark, AWS, EMR, Reshift, EMR. 3 to 6 years of experience working...
Amazon Web Service
Contract work
Remote work
Navtech
Jersey City, NJ
1 day ago
Data Engineer
...transform large datasets from various sources. Build and optimize data architectures and data models to support analytics and... ...Proficiency in ETL tools (e.g., Apache Airflow, Talend, Informatica, AWS Glue). Strong experience with cloud platforms - AWS (S3,...
Amazon Web Service
Purple Drive
Jersey City, NJ
2 days ago
Big Data Engineer
...experience with MySQL, PostgreSQL, MongoDB, Cassandra. Role: Big Data Engineer Job Overview: We're seeking a highly skilled Data Engineer, Big... ...: Build scalable ETL pipelines using Apache Spark, Talend, AWS Glue, Google Dataflow, Apache NiFi. Ingest data from APIs, file...
Amazon Web Service
TechDigital Group
Jersey City, NJ
4 days ago
Sr. Data Engineer
...Sr. Data Engineer Location: New jersey Client: Client / APEX 10+ Overall industry experience 5+ years' experience with building large... ...building Data Lake, data applications and micro-services using Azure, AWS and Hands-on experience in cloud Data stack (preference is...
Amazon Web Service
Keylent Inc
Passaic, NJ
1 day ago
Senior Data Engineer
.... Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the... ...world. We are seeking an experienced Data Engineer to join our data team. In this role, you... ...integration processes, and data infrastructure on AWS cloud. You will collaborate closely with...
Amazon Web Service
Local area
Tiger Analytics
Jersey City, NJ
1 day ago
Senior Data Engineer
...Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on... ...industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied... ...platforms such as NVIDIA, Google Cloud, AWS, and Snowflake, we build and deliver...
Amazon Web Service
Full time
Quantiphi
Jersey City, NJ
3 days ago
Sr. Data Engineer
...Our client is expanding their Data Engineering toolset and need an experienced AWS, Kafka streams, Python and SQL Data Engineer. This role will be required to design and implement our new data pipelines using AWS and Kafka streams, and train other team members. As a Sr...
Amazon Web Service
Flexible hours
Inizio Partners Corp
Jersey City, NJ
4 days ago
Data Engineer
...Job Summary: Strong Snowflake Data warehousing knowledge Basic-Medium level Python Development... ...in Matillion) Basic understanding of AWS Cloud platform Basic understanding of BI ToolWe are looking for a skilled Data Engineer to join our team. The ideal candidate will...
Amazon Web Service
Omni Inclusive
Secaucus, NJ
2 days ago
Data Engineer
...Data Engineer page is loaded## Data Engineerlocations: East Rutherfordtime type: Full timeposted on: Posted Yesterdayjob requisition id: R\... ...Experience with Python and R* Knowledge of Snowflake* Experience with AWS* Experience working with large data sets* Knowledge of data...
Amazon Web Service
Work experience placement
Summer work
Local area
Michael Kors
East Rutherford, NJ
4 days ago
Data Engineer
$142.32k - $213.48k
...join us. We’ll enable growth and progress together. The Sr Data Engineer, AVP is an intermediate level position responsible for participation... ...knowledge and experience required Hands on experience with AWS Glue, AWS Athena, AIRFLOW, SNOWFLAKE Database expertise on...
Amazon Web Service
Full time
Citigroup Inc
Jersey City, NJ
2 days ago
AWS Data Engineer
...develop ETL/ELT pipelines using Databricks and PySpark . Ingest data from multiple sources and transform it for analytics. Collaborate... ...in SQL and Python. Knowledge of cloud platforms ( Azure/AWS/GCP ). Experience with production support . Familiarity with Git...
Amazon Web Service
Cyber Space Technologies LLC
Jersey City, NJ
2 days ago
Senior Data Engineer
$135k - $170k
...values, our people, and our drive to win. About the Role The Senior Data Engineer will own the path from raw transactional and event data to... ...BetMGM's analytics, ML, and operational systems. Builds on an AWS + Snowflake stack - Prefect on ECS Fargate for orchestration, dbt...
Amazon Web Service
Contract work
For contractors
H1b
Visa sponsorship
Flexible hours
BetMGM
Jersey City, NJ
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AWS Data Engineer. Be the first to apply!