Big Data Engineer

Software Technology Inc

United States

Big Data Engineer

Experian

12+ month contract

Remote - HQ in Costa Mesa, CA

• BS degree in computer science, computer engineering or equivalent

• 5 – 6 years of experience delivering enterprise software solutions

• Proficient in Spark, Scala, Python, AWS Cloud technologies

• 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala

• Flair for data, schema, data model, how to bring efficiency in big data related life cycle

• Must be able to quickly understand technical and business requirements and can translate them into technical implementations

• Experience with Agile Development methodologies

• Experience with data ingestion and transformation

• Solid understanding of secure application development methodologies

• Experienced in developing microservices using spring framework is a plus

• Experience in with Airflow and Python will be preferred

• Understanding of automated QA needs related to Big data

• Strong object-oriented design and analysis skills

• Excellent written and verbal communication skills

Responsibilities

• Utilize your software engineering skills including Java, Spark, Python, Scala to analyze disparate, complex systems and collaboratively design new products and services

• Integrate new data sources and tools

• Implement scalable and reliable distributed data replication strategies

• Ability to mentor and provide direction in architecture and design to onsite/offshore developers

• Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases

• Perform analysis of large data sets using components from the Hadoop ecosystem

• Own product features from the development, testing through to production deployment

• Evaluate big data technologies and prototype solutions to improve our data processing architecture

• Automate everything

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the Big Data Engineer in United States vacancy

Big Data Engineer
...apply if you do not currently possess this level of clearance. Telework: None Basic Requirements 14 years of experience as a software engineer Bachelor’s degree in a technical discipline 4 additional years of experience as a software engineer may be substituted for a...
Big data
Full time
Immediate start
Remote work
Shield Consulting Solutions
Annapolis, MD
3 days ago
Big Data Engineer
...Big Data Developer This role requires a seasoned developer having 8+ years of experience in Big Data, Java. The ideal candidate will be having sound knowledge of big data ecosystem especially Spark and handling massive data sets. The role also requires optimizing existing...
Big data
Omni Inclusive
Phoenix, AZ
2 days ago
Big Data Engineer
...Big Data Engineer Location: Mountain View, CA (3 days onsite) Skill Set: ~ Minimum of 5+ years working with Apache Flink or Spark Structured Streaming (preferably Flink) ~5+ years experience with Java or Scala ~ Strong experience working with microservices...
Big data
Kasmo Global
Mountain View, CA
5 days ago
Big Data Engineer
...Big Data Engineer 5+ years experience in the following skillset: Design, development & implementations of data processing solutions using HDFS, Hive and Spark Ensure solutions are highly usable, scalable, and maintainable Understand the impacts...
Big data
3B Staffing LLC
Charlotte, NC
5 days ago
Big Data Engineer
...Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...
Big data
VortalSoft
New York, NY
2 days ago
Big Data Engineer
...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are... ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open...
Big data
STEM Xpert
Phoenix, AZ
2 days ago
Big Data Engineer
...Seeking a mid-level Big Data Engineer for a remote contract position, the candidate will develop, implement, and test Big Data applications on the AWS Cloud, utilizing frameworks such as Spark and Hadoop while leveraging their experience in Java, Scala, and Python. Key...
Big data
Contract work
Remote work
Virtual Vocations Inc
United States
3 days ago
Big Data Engineer
...Spark core AND Spark SQL 5 years of hands‑on programming experience in either core Java OR Spark 3 years of hands‑on experience in Data Warehousing AND Data Marts AND Data/Dimensional Modeling AND ETL 1 year of hands‑on experience in HBase OR Cassandra OR any other NoSQL...
Big data
Contract work
Immediate start
InfraMatix Inc
Chevy Chase, MD
4 days ago
Big Data Engineer
...Job Title Required Qualifications ~5+ years of experience in Big Data engineering within large enterprise environments. ~ Strong hands-on expertise with PySpark, Scala, Spark, and SQL. ~ Proven experience with data sourcing, ingestion, and conformance on distributed...
Big data
Saxon Global
Charlotte, NC
2 days ago
BIG DATA ENGINEER
...Description Design, develop, and maintain data pipelines and processing systems for... ...Computer Science/ Information Technology /IS/Engineering (Any) or closely related field with Twelve... ...of working with Data Engineering or Big Data Tools or Technologies is required. #J...
Big data
Full time
Relocation
Daticsinc
Plainfield, IL
2 days ago
Big Data Engineer
...~ Expert in Spark, Python scripting and strong in SQL ~5+ years processing large datasets on big data platform such as SPARK; Python EMR; Hadoop on AWS ~5+ years of experience architecting and building scalable Reporting and Advance Analytics solutions using...
Big data
3B Staffing LLC
Beaverton, OR
3 days ago
Big Data Engineer
$48 - $50 per hour
...Immediate need for a talented Big Data Engineer . This is a 06+ Months Contract opportunity with long-term potential and is located in Atlanta GA (Hybrid) . Please review the job description below and contact me ASAP if you are interested. Job ID:26-16871 Pay...
Big data
Contract work
Local area
Immediate start
Remote work
Pyramid Consulting
United States
2 days ago
Big Data Engineer
You will be able to apply advanced Data Engineering and Machine learning skills to solve real world challenges in building applications that help the company build better models and do advanced reporting. • Cleanse, manipulate and analyze large datasets (Structured and...
Big data
Exaways Corporation
McLean, VA
1 day ago
Big Data Engineer
...Our client, a premier investment bank, is looking for a Big Data Engineer to join their growing team in Chicago, IL. Currently our client spends a lot of time trying to answer client's questions by logging in to several disparate data sources. It is estimated each support...
Big data
For contractors
Liniumit
Chicago, IL
2 days ago
Big Data Engineer
...Software Engineer (Big Data) Duration: 3-6 Months CTH Location: Houston/Plano, TX This is a W2 position that requires candidates to be onsite for 2-3 days in a week (Hybrid role). Required Skills: Hadoop Java Spark SQL Nice to Have:...
Big data
2 days per week
3 days per week
TriOptus LLC
Plano, TX
5 days ago
Big Data Engineer
...Big Data Engineer San Jose, CA (Remote) Experian Need 8 years of experience and hands on programming experience in any one or more programming languages like Java, Scala or Python Good experience with distributed systems like Hadoop, HDFs and No SQL databases...
Big data
Remote work
Omega Solutions
United States
2 days ago
Big Data Engineer
...Big Data Engineer Job Type: Full Time Employment Location: Phoenix, AZ or New York Experience Required: 6+ Years Responsibilities: Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms...
Big data
Full time
Syntricate Technologies
New York, NY
5 days ago
Big Data Engineer
...Responsibilities Data Architecture: Design and implement scalable, robust, and efficient data architectures, including data lakes,... ...functional teams, including data scientists, analysts, software engineers, and business stakeholders, to understand data requirements and...
Big data
Doran Jones Inc
Tampa, FL
1 day ago
Big Data Engineer
...Big Data Engineer We are looking for a big data engineer with Java/AWS experience. This is a hybrid role in Plano, TX, and is a W2 contract only. The ideal candidate will have a combination of Java and Python skills, with more emphasis on the Java side. Experience...
Big data
Contract work
Syntricate Technologies
Plano, TX
5 days ago
Big Data Engineer
$50 - $60 per hour
...Bigdata Engineer Location: Phoenix, AZ Duration: 12+ Months Client: Client / Impetus Pay Rate: $50 to $60 Max depends on experience... ...year Bachelors Year and university Total Exp US Exp. Big Data Exp. Current Location Open for Travel Open for...
Big data
Relocation
Omega Solutions
Santa Clara, CA
3 days ago
Big Data Engineer
...Big Data Engineer Location: Adolfo Alsina, Argentina Job Duration: Fulltime Work Mode: Remote We are seeking a forward-thinking Big Data Engineer based in Adolfo Alsina, Argentina to architect and optimize secure, high-performance data ecosystems. In this role...
Big data
Full time
Remote work
E-Solutions
United States
1 day ago
Big Data Engineer
...Big Data Engineer with Bachelor Degree in Computer Science, Computer Information Systems, Information Technology, or a combination of education and experience equating to the U.S. equivalent of a Bachelor’s degree in one of the aforementioned subjects. Job Duties and Responsibilities...
Big data
Work experience placement
Rite Pros, Inc
Portland, ME
3 days ago
Big Data Engineer
$100k - $110k
...Immediate need for a talented Big Data Engineer . This is a Fulltime opportunity with long-term potential and is located in Detroit, MI (Hybrid) . Please review the job description below and contact me ASAP if you are interested. Job ID:26-13596 Pay Range: $100000 - $1...
Big data
Full time
Local area
Immediate start
Pyramid Consulting
Detroit, MI
2 days ago
Big Data Engineer
...We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross‑functional teams to architect data pipelines, implement data integration solutions, and...
Big data
Work experience placement
Tential Solutions
Vernon, CT
3 days ago
Big Data Engineer
...Carolina Duration: Long Term Required: • Degree in a technology related field (e.g. Engineering, Computer Science, etc.). • 8+ years of experience in implementing data engineering solutions in data analytics space • 3+ years of experience in developing data...
Big data
Samprasoft
Durham, NC
1 day ago
Big Data Engineer
...Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and...
Big data
Work experience placement
Purple Drive
New York, NY
2 days ago
Big Data Engineer
...Big Data Engineer We are seeking a mid-level Big Data AWS Engineer for a contract role. This position involves the analysis, coding, implementation, and testing of Big Data applications, both API and Batch, on the AWS Cloud. The role requires a strong background in...
Big data
Contract work
Remote work
Apex Systems
United States
14 hours ago
Big Data Engineer
...Big Data Engineer Costa Mesa , CA or PHX or Bay Area Contract Job Responsibilities 10+ years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop...
Big data
Contract work
Lorven Technologies
Costa Mesa, CA
4 days ago
Big data engineer
...clients insights, strategy, design, software engineering and systems integration. Our tightly... ...Specialties Enterprise Solutions Web Development Data Warehousing Systems Integration IT... ...Job Description Position details: Title: Big Data Engineer Location: Houston, TX- locals...
Big data
Local area
Flexible hours
Shift work
STEM Xpert
Houston, TX
2 days ago
Big Data Engineer
...JOb Title : Data Engineer Location: Miami, Florida, USA Experience : 7-10 years Job Description: • Build a Centralized data platform - unified data platform for customer across organization • Data engineer should knowledge of data model, AWS serverless...
Big data
Yantran LLC
Miami Beach, FL
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!