Big Data Engineer
Apex Systems
Big Data Engineer
We are seeking a mid-level Big Data AWS Engineer for a contract role. This position involves the analysis, coding, implementation, and testing of Big Data applications, both API and Batch, on the AWS Cloud. The role requires a strong background in developing and maintaining robust data solutions.
Key Responsibilities
- Develop, implement, and test Big Data applications (API & Batch) on the AWS Cloud.
- Utilize Java, Scala, Kotlin, Cassandra, Python, Hadoop, HDFS, Spark, and MapReduce frameworks.
- Apply coding experience in Scala, PySpark, and Java for REST API and SOAP webservices.
- Leverage AWS experience with Batch and API microservices using EMR, EC2, ECS, S3, Airflow, Step Functions, and AWS API Gateway.
- Conduct performance tuning for Batch Applications, including Spark, Hadoop, EMR, Java, and Python.
- Utilize Linux experience for shell scripting and Python tasks.
- Create automation pipelines for data ingestion and transformation using Spark with Snowflake.
Required Qualifications
- 7+ years of experience in analysis, coding, implementation, and testing of Big Data Applications on the AWS Cloud.
- Experience with Java, Scala, Kotlin, Cassandra, Python, Hadoop, HDFS, Spark, and the MapReduce framework.
- Coding experience with Scala, PySpark, and Java for REST API and SOAP webservices.
- Experience with AWS services including EMR, EC2, ECS, S3, Airflow, Step Functions, and AWS API Gateway.
- Experience with Batch Application performance tuning (Spark/Hadoop/EMR, Java, Python).
- Must have Linux experience, including shell scripting and Python.
- Experience with Snowflake in creating automation pipelines for data ingestion and transformation using Spark.
Preferred Qualifications
- DevOps experience with tools such as GIT, GitHub, Bitbucket, GitLab, IntelliJ IDEA, and PyCharm.
- Experience creating CI/CD pipelines using Maven, Gradle, Jenkins, Artifactory, and AWS CodeCommit CloudFormation.
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in United States vacancy
- ...apply if you do not currently possess this level of clearance. Telework: None Basic Requirements 14 years of experience as a software engineer Bachelor’s degree in a technical discipline 4 additional years of experience as a software engineer may be substituted for a...Big dataFull timeImmediate startRemote work
Shield Consulting Solutions
Annapolis, MD3 days ago - ...Big Data Developer This role requires a seasoned developer having 8+ years of experience in Big Data, Java. The ideal candidate will be having sound knowledge of big data ecosystem especially Spark and handling massive data sets. The role also requires optimizing existing...Big data
Omni Inclusive
Phoenix, AZ2 days ago - ...Big Data Engineer Location: Mountain View, CA (3 days onsite) Skill Set: ~ Minimum of 5+ years working with Apache Flink or Spark Structured Streaming (preferably Flink) ~5+ years experience with Java or Scala ~ Strong experience working with microservices...Big data
Kasmo Global
Mountain View, CA5 days ago - ...Big Data Engineer 5+ years experience in the following skillset: Design, development & implementations of data processing solutions using HDFS, Hive and Spark Ensure solutions are highly usable, scalable, and maintainable Understand the impacts...Big data
3B Staffing LLC
Charlotte, NC5 days ago - ...Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...Big data
VortalSoft
New York, NY2 days ago - ...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are... ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open...Big data
STEM Xpert
Phoenix, AZ2 days ago - ...Seeking a mid-level Big Data Engineer for a remote contract position, the candidate will develop, implement, and test Big Data applications on the AWS Cloud, utilizing frameworks such as Spark and Hadoop while leveraging their experience in Java, Scala, and Python. Key...Big dataContract workRemote work
Virtual Vocations Inc
United States3 days ago - ...Spark core AND Spark SQL 5 years of hands‑on programming experience in either core Java OR Spark 3 years of hands‑on experience in Data Warehousing AND Data Marts AND Data/Dimensional Modeling AND ETL 1 year of hands‑on experience in HBase OR Cassandra OR any other NoSQL...Big dataContract workImmediate start
InfraMatix Inc
Chevy Chase, MD4 days ago - ...Job Title Required Qualifications ~5+ years of experience in Big Data engineering within large enterprise environments. ~ Strong hands-on expertise with PySpark, Scala, Spark, and SQL. ~ Proven experience with data sourcing, ingestion, and conformance on distributed...Big data
Saxon Global
Charlotte, NC2 days ago - ...Description Design, develop, and maintain data pipelines and processing systems for... ...Computer Science/ Information Technology /IS/Engineering (Any) or closely related field with Twelve... ...of working with Data Engineering or Big Data Tools or Technologies is required. #J...Big dataFull timeRelocation
Daticsinc
Plainfield, IL2 days ago - ...~ Expert in Spark, Python scripting and strong in SQL ~5+ years processing large datasets on big data platform such as SPARK; Python EMR; Hadoop on AWS ~5+ years of experience architecting and building scalable Reporting and Advance Analytics solutions using...Big data
3B Staffing LLC
Beaverton, OR3 days ago $48 - $50 per hour
...Immediate need for a talented Big Data Engineer . This is a 06+ Months Contract opportunity with long-term potential and is located in Atlanta GA (Hybrid) . Please review the job description below and contact me ASAP if you are interested. Job ID:26-16871 Pay...Big dataContract workLocal areaImmediate startRemote workPyramid Consulting
United States2 days ago- You will be able to apply advanced Data Engineering and Machine learning skills to solve real world challenges in building applications that help the company build better models and do advanced reporting. • Cleanse, manipulate and analyze large datasets (Structured and...Big data
Exaways Corporation
McLean, VA1 day ago - ...Our client, a premier investment bank, is looking for a Big Data Engineer to join their growing team in Chicago, IL. Currently our client spends a lot of time trying to answer client's questions by logging in to several disparate data sources. It is estimated each support...Big dataFor contractors
Liniumit
Chicago, IL2 days ago - ...Software Engineer (Big Data) Duration: 3-6 Months CTH Location: Houston/Plano, TX This is a W2 position that requires candidates to be onsite for 2-3 days in a week (Hybrid role). Required Skills: Hadoop Java Spark SQL Nice to Have:...Big data2 days per week3 days per week
TriOptus LLC
Plano, TX5 days ago - ...Big Data Engineer San Jose, CA (Remote) Experian Need 8 years of experience and hands on programming experience in any one or more programming languages like Java, Scala or Python Good experience with distributed systems like Hadoop, HDFs and No SQL databases...Big dataRemote work
Omega Solutions
United States2 days ago - ...Big Data Engineer Job Type: Full Time Employment Location: Phoenix, AZ or New York Experience Required: 6+ Years Responsibilities: Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms...Big dataFull time
Syntricate Technologies
New York, NY5 days ago - ...Responsibilities Data Architecture: Design and implement scalable, robust, and efficient data architectures, including data lakes,... ...functional teams, including data scientists, analysts, software engineers, and business stakeholders, to understand data requirements and...Big data
Doran Jones Inc
Tampa, FL1 day ago - ...Big Data Engineer We are looking for a big data engineer with Java/AWS experience. This is a hybrid role in Plano, TX, and is a W2 contract only. The ideal candidate will have a combination of Java and Python skills, with more emphasis on the Java side. Experience...Big dataContract work
Syntricate Technologies
Plano, TX5 days ago $50 - $60 per hour
...Bigdata Engineer Location: Phoenix, AZ Duration: 12+ Months Client: Client / Impetus Pay Rate: $50 to $60 Max depends on experience... ...year Bachelors Year and university Total Exp US Exp. Big Data Exp. Current Location Open for Travel Open for...Big dataRelocationOmega Solutions
Santa Clara, CA3 days ago- ...Big Data Engineer Location: Adolfo Alsina, Argentina Job Duration: Fulltime Work Mode: Remote We are seeking a forward-thinking Big Data Engineer based in Adolfo Alsina, Argentina to architect and optimize secure, high-performance data ecosystems. In this role...Big dataFull timeRemote work
E-Solutions
United States1 day ago - ...Big Data Engineer with Bachelor Degree in Computer Science, Computer Information Systems, Information Technology, or a combination of education and experience equating to the U.S. equivalent of a Bachelor’s degree in one of the aforementioned subjects. Job Duties and Responsibilities...Big dataWork experience placement
Rite Pros, Inc
Portland, ME3 days ago $100k - $110k
...Immediate need for a talented Big Data Engineer . This is a Fulltime opportunity with long-term potential and is located in Detroit, MI (Hybrid) . Please review the job description below and contact me ASAP if you are interested. Job ID:26-13596 Pay Range: $100000 - $1...Big dataFull timeLocal areaImmediate startPyramid Consulting
Detroit, MI2 days ago- ...We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross‑functional teams to architect data pipelines, implement data integration solutions, and...Big dataWork experience placement
Tential Solutions
Vernon, CT3 days ago - ...Carolina Duration: Long Term Required: • Degree in a technology related field (e.g. Engineering, Computer Science, etc.). • 8+ years of experience in implementing data engineering solutions in data analytics space • 3+ years of experience in developing data...Big data
Samprasoft
Durham, NC1 day ago - ...Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and...Big dataWork experience placement
Purple Drive
New York, NY2 days ago - ...Big Data Engineer Experian 12+ month contract Remote - HQ in Costa Mesa, CA • BS degree in computer science, computer engineering or equivalent • 5 – 6 years of experience delivering enterprise software solutions • Proficient in Spark, Scala, Python, AWS...Big dataContract workRemote work
Software Technology Inc
United States5 days ago - ...Big Data Engineer Costa Mesa , CA or PHX or Bay Area Contract Job Responsibilities 10+ years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop...Big dataContract work
Lorven Technologies
Costa Mesa, CA4 days ago - ...clients insights, strategy, design, software engineering and systems integration. Our tightly... ...Specialties Enterprise Solutions Web Development Data Warehousing Systems Integration IT... ...Job Description Position details: Title: Big Data Engineer Location: Houston, TX- locals...Big dataLocal areaFlexible hoursShift work
STEM Xpert
Houston, TX2 days ago - ...JOb Title : Data Engineer Location: Miami, Florida, USA Experience : 7-10 years Job Description: • Build a Centralized data platform - unified data platform for customer across organization • Data engineer should knowledge of data model, AWS serverless...Big data
Yantran LLC
Miami Beach, FL5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- remote data engineer United States
- data engineer intern United States
- entry level big data engineer United States
- big data devops engineer United States
- vp data engineering United States
- entry level data engineer United States
- data engineer United States
- data processing engineer United States
- data engineer contract United States
- software data engineer United States