Big Data Engineer
United IT
Big Data Engineer
Location: Remote
Role Summary
- Excellent Scala, PySpark, Java coding experience for REST API and SOAP webservices
- Excellent AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS API Gateway
- Excellent Batch Application performance tuning (Spark/Hadoop/EMR, Java, python)
- Must have Linux experience (Shell scripting/Python)
- Excellent to have DevOps experience (GIT, GitHub, Bit Bucket, GitLab, IntelliJ IDEA, PyCharm)
- Excellent to have experience creating CI/CD pipelines – Maven, Gradle, Jenkins, Artifactory, AWS Code Commit, CloudFormation
Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in United States vacancy
- ...have) - The resource should have good experience in Java - The resource should have knowledge and hands on Hadoop Big Data Pig Hive Spark & Scala. - The resource should have experience in SQL/DB2. - Excellent interpersonal verbal and written...Big data
3B Staffing LLC
Austin, TX15 hours ago - ...creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience... ...Skills : Data Warehouse Basic Qualification : Additional Skills : Big Data Background Check : No Drug Screen : No...Big data
Kaav Inc.
Malvern, PA4 days ago - Big Data Engineer Big data engineer with Kubernetes and containers. Strong database experience such as with Hadoop and coding with Java or Python. Strong database focus, 60 percent and 40 percent on coding with Java/Python. With a DevOps background.Big data
Cardinal Integrated
Raritan, NJ5 days ago $50k
Data Analyst Location: Wichita, KS Rate: $50k Experience in Excel, VBA, data processing Expert in Excel and PowerPoint to perform data analysis Coordinate with multiple groups to collect data Knowledge in TableauBig dataKeylent Inc
Wichita, KS3 days ago- ...Job Title Interview Process: 3 Rounds of Zoom Video Interview Required: ~8 years experience in BIG data development such as Hadoop/spark/hive ~6+ years of hands on experience on AWS cloud ~6+ years of experience in SNOWFLAKE ~8+ years of experience in...Big data
Omega Solutions Inc
Austin, TX2 days ago - ...Skills: 5-10 years of experience Python, Airflow, PySpark, Spark SQL, Spark Streaming, Scala, Relational/No SQL databases, Apache Kafka, writing complex sql queries, GCP (Bigquery, Dataproc), working with RESTful APIs in data pipelines, CI/CD (gitlab CI)...Big data
Saxon Global
Atlanta, GA2 days ago - ...Job Title Required Skills: Applicant should be familiar with the following technologies/skillsets: Big Data knowhow is mandatory Big Data pipelines Optimization of big data Scalability of big data across different data stores (Aurora, RedShift, S3)...Big data
Syntricate Technologies
Charlotte, NC2 days ago - ...MANTECH seeks a motivated, career and customer-oriented Senior Data Engineer to join our team in Chantilly, VA. The Senior Data... ...Designing and implementing large-scale ingest systems within complex Big Data environments. Optimizing all stages of the data...Big dataFull timeWork at office
MANTECH
Chantilly, Loudoun County, VA8 hours ago - ...Big Data Engineer Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes ID: 9495 Positions: Big Data Engineer Location: Mooresville, NC Data engineers 4+ years Hadoop...Big data
Keylent Inc
Mooresville, NC5 days ago - ...the Firm from bad actors and # Evaluate fraud risk for card transactions for the benefit of the Firm's clients. The data engineers would build the Data Lake that enables the ML team to develop models and serve the data for production flow. Specifically, the...Big data
Seven Seven Software
Tampa, FL2 days ago - ...Title : Python - Big Data Location : Austin TX Performance Expectations: Technical Hiring Criteria (Must Haves) • Top 3 Required skills: Python Development Strong experience in Python, Django, REST APIs, VueJs -- (Must-Have) Hands-on experience with Docker...Big data
eTeam
Austin, TX5 days ago $56.33 - $61.33 per hour
...ETL Developer Responsibilities Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for Analytics Location: Malvern, Pennsylvania Job Type: Contract Salary: $56.33 - 61.33 per hour Work Hours: 8am to 5pm Education:...Big dataHourly payContract workRandstad
Malvern, PA4 days ago- ...Seeking a mid-level Big Data Engineer for a remote contract position, the candidate will develop, implement, and test Big Data applications on the AWS Cloud, utilizing frameworks such as Spark and Hadoop while leveraging their experience in Java, Scala, and Python. Key...Big dataContract workRemote work
Virtual Vocations Inc
United States3 days ago - ...Job Description: Core Java, spring boot, Oracle, microservices, Kafka, app-engine (Containers), REST/Web services, Angular, CI/CD, Junit Must Have : Core Java , Spark experience (with Java) and Hive, Spring framework, Kafka (if not Kafka them relatively...Big data
Texas State Library and Archives Commision
Jersey City, NJ2 days ago - ...apply if you do not currently possess this level of clearance. Basic Requirements: ~14 years of experience as a software engineer ~ Bachelor's degree in a technical discipline ~4 additional years of experience as a software engineer may be substituted for...Big dataImmediate start
Shield Consulting Solutions
Annapolis Junction, MD5 days ago - ...Big Data Engineer Location: Costa Mesa, CA or Allen, TX Duration: Fulltime Job Description: Big Data Engineer Must Have Technical/Functional Skills Big Data, PySpark, AWS (EMR, SageMaker, DunamoDB) Roles & Responsibilities: Strong hands-on experience with...Big dataFull timeImmediate start
JConnect Infotech
Costa Mesa, CA5 days ago - ...Principal Big Data Engineer As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design and development. Having the dynamic ability to adapt to conventional big-data frameworks...Big data
Omni Inclusive
Santa Clara, CA14 hours ago - ...Big Data Engineer Participate as a member of a small team to release the full potential of Big Data in AT&T through a combination of platform technology, collective human intelligence and the vast data resources available to our company. Will provide rich insight into...Big data
Cardinal Integrated
New York, NY5 days ago - ...MANTECH seeks a motivated, career and customer-oriented Data Engineer to join our team in Chantilly, VA. The Data Engineer will... ...replication/distribution, and large-scale ingest systems in a Big Data environment. Optimizing all stages of the data lifecycle...Big dataFull timeWork at office
MANTECH
Chantilly, Loudoun County, VA8 hours ago - ...Big Data Engineer Location: Adolfo Alsina, Argentina Job Duration: Fulltime Work Mode: Remote We are seeking a forward-thinking Big Data Engineer based in Adolfo Alsina, Argentina to architect and optimize secure, high-performance data ecosystems. In this role...Big dataFull timeRemote work
E-Solutions
United States1 day ago - ...tenants. Establish and enforce policies for resource quota management, data lifecycle and storage optimization. Implement housekeeping... ...ecosystem. Stay abreast of the Industry trends and advancements in big data technologies, continuously seeking opportunities for...Big data
Diverse Lynx
Irving, TX5 days ago - ...Artifactory • Web Services Framework: Django, Flask • API Framework: Gunicorn 5+ years of relevant experience focused on Support Engineering, TechOps, DevOps, systems administration, application development, build, release and deployment • Experience deploying...Big data
3B Staffing LLC
Happy Valley, OR15 hours ago - ...Position: Software Engineer (Big Data) Duration: 3-6 Months CTH Location: Houston/Plano , TX This is a W2 position that requires candidates to be onsite for 2-3 days in a week (Hybrid role). Required Skills: Hadoop. Java...Big data2 days per week3 days per week
TriOptus LLC
Houston, TX5 days ago $50 - $60 per hour
...Bigdata Engineer Location: Phoenix, AZ Duration: 12+ Months Client: Client / Impetus Pay Rate: $50 to $60 Max depends on experience... ...year Bachelors Year and university Total Exp US Exp. Big Data Exp. Current Location Open for Travel Open for...Big dataRelocationOmega Solutions
Phoenix, AZ3 days ago- ...Big Data Engineer: Must Have: • Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential • Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the...Big data
Texas State Library and Archives Commision
Sunnyvale, CA2 days ago - ...Big Data Engineer | Wilmington, DE Client: Photon / Banking Only USC GC GC-EAD Rate: $55/hr on C2C Job Description: · BS/BA degree or with 8+ years of experience · Advanced knowledge of application, data and infrastructure architecture disciplines · Understanding...Big data
Omega Solutions Inc
Wilmington, DE5 days ago - People Tech Group, based in Seattle, is seeking a professional with hands-on experience in Big Data technologies such as Spark, Phoenix, Kafka, and HBase. The ideal candidate will have at least 3 years of experience in large-scale projects and a strong familiarity with...Big data
- ...Big Data Engineer Hybrid - Malvern, PA Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency...Big data
RIT Solutions
Malvern, PA5 days ago - ...Job Title Required Skills: Big Data Engineer with mapreduce, spark, hive, sql skillset Expert in SQL and Data warehousing concepts. Hands-on experience with public cloud data warehouse (GCP, Azure, AWS). GCP certification will be very good to have....Big data
Syntricate Technologies
Phoenix, AZ5 days ago - ...Data Engineer San Jose, CA/PST Zone Duration: 1 year # of Positions: 2 Responsibilities Designing, developing & tuning data products... ...of strong hands-on experience in enterprise data warehousing / big data implementations & complex data solutions and frameworks...Big data
Central Business Solutions
San Jose, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- vp data engineering United States
- senior cloud data engineer United States
- principal data engineer United States
- finance data engineer United States
- master data engineer United States
- aws data engineer United States
- data engineer United States
- sr data engineer United States
- software data engineer United States
- junior data engineer remote United States