Big Data Engineer
Software Technology Inc
Big Data Engineer
Experian
12+ month contract
Remote - HQ in Costa Mesa, CA
• BS degree in computer science, computer engineering or equivalent
• 5 – 6 years of experience delivering enterprise software solutions
• Proficient in Spark, Scala, Python, AWS Cloud technologies
• 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala
• Flair for data, schema, data model, how to bring efficiency in big data related life cycle
• Must be able to quickly understand technical and business requirements and can translate them into technical implementations
• Experience with Agile Development methodologies
• Experience with data ingestion and transformation
• Solid understanding of secure application development methodologies
• Experienced in developing microservices using spring framework is a plus
• Experience in with Airflow and Python will be preferred
• Understanding of automated QA needs related to Big data
• Strong object-oriented design and analysis skills
• Excellent written and verbal communication skills
Responsibilities
• Utilize your software engineering skills including Java, Spark, Python, Scala to analyze disparate, complex systems and collaboratively design new products and services
• Integrate new data sources and tools
• Implement scalable and reliable distributed data replication strategies
• Ability to mentor and provide direction in architecture and design to onsite/offshore developers
• Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases
• Perform analysis of large data sets using components from the Hadoop ecosystem
• Own product features from the development, testing through to production deployment
• Evaluate big data technologies and prototype solutions to improve our data processing architecture
• Automate everything
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in United States vacancy
- ...Best Startup Employers 2022 List. Front’s Data team builds the analytics infrastructure... ...performance. We’re looking for a Staff Data Engineer to own critical parts of that platform end... ...Working knowledge of at least one big data technology (HDFS, EMR, Redshift, Spark...Big dataFull timeWork at officeImmediate startRemote workWork from homeMonday to FridayFlexible hours
$120k - $160k
Role Description Clear Fracture is building AI-driven data integration systems that enable organizations to connect, transform, and reason... ...tenant, production-scale use cases. We are looking for a Data Engineer who operates as a software engineer first, with strong...Big dataFull timeClear Fracture LLC
Remote1 day ago- ...business services such as Application Development, Mobile App Development, Cloud and Branding Services. Job Overview Job Role: Big Data Engineer No. of positions: Multiple Experience: 2-4 Years Location: ST. LOUIS, MO. Relocation may be required. Job...Big dataRelocationFlexible hours
PROTOCOL INFOTECH INC
Saint Louis, MO1 day ago $110k - $140k
...cybersecurity, network architecture, reverse engineering, software and hardware development... ...next evolution of national defense - the data evolution - by accelerating a breadth of... ...Our capabilities range from C5ISR, AI and Big Data, cyber operations and synthetic training...Big dataFull timeWork experience placementLocal areaRemote workWork from homeWorldwide- ...experience in software design, development and release. Well versed with agile development methodologies. Experience in Data Ingestion, Streaming and Big Data technologies. Excellent communication and stakeholder management Ability to work with distributed teams. Exposure...Big dataPermanent employmentFull timeH1b
SonSoft
King of Prussia, PA2 days ago $107k - $126k
...About The Role We are seeking a highly skilled hands-on Snowflake Data Engineer to help scale our modern Data platform. You will bridge the gap... ...Talend, dbt, Informatica, DataStage, AWS Glue) Expertise in big data technologies (e.g., Hadoop, Spark, Kafka, Databricks) and...Big dataFull timeWork at officeLocal areaImmediate startRemote workRelocation$144.5k - $195.5k
...Able to Obtain: Secret Public Trust/Other Required: None Job Family: Data Science and Data Engineering Job Qualifications: Skills: Amazon Web Services (AWS), Big Data, Data Analytics, Data Architecture Development, Technical Solutions Certifications...Big dataFull timeContract workImmediate startRemote workWorldwideFlexible hours- ...with exciting career opportunities that align with their overall experience and objectives. Job Description We are seeking a Big Data Engineer to help customers turn Big Data into useful information. Qualifications Master’s degree in Computer Science + 5 years of professional...Big dataFlexible hours
The Altip Group
Herndon, VA4 days ago - ...current systems. Communicate status and risk to stakeholders and escalates issues as appropriate. Qualifications Knowledge of big‑data tools such as Spark and HiveQL is desirable. Ability to use complex analytical, interpretive, and problem‑solving techniques....Big dataApprenticeshipLocal areaFlexible hours
Virtusa
Tampa, FL2 days ago - Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...Big data
VortalSoft
New York, NY2 days ago - ...JOb Title : Data Engineer Location: Miami, Florida, USA Experience : 7-10 years Job Description: • Build a Centralized data platform - unified data platform for customer across organization • Data engineer should knowledge of data model, AWS serverless...Big data
Yantran LLC
Miami Beach, FL1 day ago $104.6k - $156.8k
Role Description AdvanSix is seeking a Big Data Engineer to build and operate our enterprise Unified Data Layer (UDL) - spanning IT and OT - to deliver trustworthy, performant data products that power Finance, Operations, Supply Chain & Logistics, HSE, Commercial, and corporate...Big dataFull timeTemporary workFlexible hoursAdvanSix
Remote1 day ago- Implementation of various solutions arising out of the large data processing (GB’s/ PB’s) over various NoSQL, Hadoop, and MPP-based products... ...participation in the various Architecture and design calls with Big Data customers Working with Sr. Architects and providing...Big data
- ...request applicants to apply who are authorized to work without sponsorship* Employment TYPE: Contract W2 - NO C2C Job Title: Big Data Engineer About BCforward BCforward is a leading global IT consulting and workforce solutions firm providing services and support to...Big dataContract work
BCforward
Wilmington, DE2 days ago $160.81k
...What will you be doing? Barclays Services Corp. seeks Big Data Engineer, AVP in Whippany, NJ (multiple positions available): Analyze system requirements to automate and improve functionality and test, maintain, monitor, and enhance radial and BDH environment engineering...Big dataHourly payLocal areaRemote workBarclays
Hanover, PA5 days ago- Responsibilities Data Architecture: Design and implement scalable, robust, and efficient data architectures, including data lakes,... ...functional teams, including data scientists, analysts, software engineers, and business stakeholders, to understand data requirements and...Big data
Doran Jones Inc
Tampa, FL2 days ago - Job Description Position: Big Data Engineer – Wealth Management About the Company Since our founding in 1935, we have been committed to serving local and global communities by leading in Investment Banking, Securities, Investment Management and Wealth Management services...Big dataWork experience placementCasual workWork at officeLocal area
ALLTECH CONSULTING SVC INC
Alpharetta, GA2 days ago - ...Big Data Engineer Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes Big Data Engineer Chicago IL - Long Term Big Data Spark, Scala, python - ALL are must. Senior candidates...Big dataRemote workRelocation
Keylent Inc
United States17 hours ago - ...Linux servers troubleshooting and support tasks Oversee governance and mitigate risk Qualifications Masters or Bachelor in CIS / Engineering / Science / Mathematics / Statistics / Design… etc. Should be Mexican Citizen eligible for TN visa sponsorship Should have...Big dataFull timeRelocationVisa sponsorship
- Job Title: Hadoop / HPE MapR Engineer (Data Platform) We are seeking a highly skilled Hadoop / HPE MapR Engineer to design, build, operate,... ...improvements. Required Qualifications 7+ years of experience in Big Data / Data Platform Engineering. Strong hands‑on experience...Big data
- ...escalables, tanto en ambientes OnPremise como en ecosistemas Big Data y Cloud. Este rol aportará activamente a la mejora continua, optimizaci... ...en programación en pares, onboarding y mentoría de otros Data Engineers. Qualifications ~Más de 3-5 años de experiencia en...Big dataFull time
Keppri
Remote22 days ago $97k - $165k
...to you. Role Summary T. Rowe Price is seeking an innovative Data AI Engineer to guide the development and deployment of scalable AI and... ...preferably within a regulated industry. Hands-on expertise with big data technologies (Spark, Kafka) and modern data platforms (Snowflake...Big dataFull timeLocal areaRemote work3 days per week$225k - $275k
...Role Schonfeld Strategic Advisors is seeking an experienced AI Data Engineer to join our Data Engineering team. In this role, you will be... ...using tools like Apache Airflow, Prefect, Dagster, or similar * Big Data Technologies: Hands-on experience with distributed...Big dataFull time- ...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are... ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open...Big data
- The Big Data Engineer/Consulting-Level serves as a primary development resource for design, writing code, test, implementation, document functionality, and maintain of NextGen solutions for the GCP Cloud enterprise data initiatives. The role requires working closely with...Big dataContract work
- ...Consultants are certified AWS Solution Architects and have experience migrating enterprise applications and data for Fortune 500 companies. Job Description As a big data engineer you will develop innovative software using state of the art big data streaming architectures....Big data
- Role Description Turn 10 Studios is looking for a Data Engineer to join the Data Pipeline team. As a member of the team, you will get to live... ...and quality tools. ~3+ years’ experience with modern Big Data Analytics using Data Lake, Spark, and formats like Parquet...Big dataFull time
Brillio
Remote5 hours ago - At Riot, Data Engineers play a critical role in transforming data into actionable insights that drive decisions across the company. Our engineers... ...field. 5+ years managing a team. Hands-on expertise in big-data technologies, particularly the Apache stack (Airflow, Spark...Big dataFull timeLocal areaWorldwideFlexible hours
- ...Amazon Glue, Google Dataflow, Talend MDM, Hadoop, Presto, Strong experience with MySQL, PostgreSQL, MongoDB, Cassandra. Role: Big Data Engineer Job Overview: We're seeking a highly skilled Data Engineer, Big Data Engineer to build scalable data pipelines, develop ML models...Big data
- ...This is a full-time opportunity for a data/ML Engineer from LATAM. In‑person verification will be conducted. IDT is an American telecommunications... ...for managed LLM deployments. ~ Hands‑on experience with big data technologies including Apache Spark, Hadoop, and Kafka...Big dataFull time
Medium
New Jersey2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer United States
- big data engineer United States
- big data developer United States
- remote data engineer United States
- bi data engineer United States
- big data devops engineer United States
- finance data engineer United States
- sr information security engineer United States
- junior big data engineer United States
- entry level big data engineer United States