Big Data Engineer
$90k - $110kBright Vision Technologies
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential. Job Title: Big Data Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $90,000–$110,000 Annually
Experience Required: 6+ years Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position. Job Summary
We are seeking an experienced Big Data Engineer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments Required Qualifications
- Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
- Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
- Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
- Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
- Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
- Strong SQL skills and experience working with both relational and NoSQL data stores.
- Experience with workflow orchestration tools such as Airflow or Oozie.
- Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.
- Strong scripting skills in Python or Shell.
- Excellent troubleshooting, debugging, and documentation skills.
- Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks.
- Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi).
- Exposure to data governance tooling such as Apache Atlas or Collibra.
- Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino).
- Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows.
Would you like to know more about this opportunity? For immediate consideration, please send your resume to View email address on us.fitly.work
Bright Vision Technologies is an Equal Opportunity Employer.
Equal Employment Opportunity (EEO) Statement
Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.
BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
- Company DescriptionMaganti IT Resources LLCJob DescriptionTitle: Data Science EngineerLocation: San Mateo, CAType: permanentJobdescriptiion:Client is a leader in applying Big Data technology to extract and analyze unstructured and coded clinical data to derive outcome-...Big dataPermanent employment
- ...Job Title: AWS Data Engineer Location: Foster City, CA/Raleigh, NC || Onsite Job Type: Contract Job Description:... ...~ Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies ~...Big dataContract workWork experience placement
$146.2k - $233.7k
...the world. Progress starts with you.Job DescriptionAs a Staff Data Engineer, you'll join our Value Added Services - Digital Marketing & Engagement... ...into scalable data solutionsArchitect solutions using big data technologies such as Hadoop, Spark, and distributed data processing...Big dataFull timeWork experience placementWork at officeLocal areaImmediate start$169.1k - $270.8k
...Progress starts with you.Job DescriptionAs a Senior Consultant Data Engineer, you'll join our Value Added Services - Digital Marketing & Engagement... ...-scale, enterprise-class applications. • Solid experience in big data engineering, with working knowledge of Hadoop, Apache...Big dataFull timeWork experience placementWork at officeLocal areaImmediate start- ...software development or related3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBaseHands on experience with Unix, Teradata and other relational databases....Big data
- We have following urgent role with our DIRECT client Title: Sr. Data Engineer ( Big Data) Location: San Bruno, CA Duration: 6+ Months Rate: Market Technical Requirements Development experience with Java, Scala, Flume, Python Development background with Spark or MapReduce...Big data
$148k - $222k
SummaryJoin Guidewire’s Data Platform and Analytics team, a group dedicated to building and... ...excellence, leveraging the latest in Big Data and cloud technologies to deliver scalable... ...for our customers. As a Senior Software Engineer (EMR Spark) on the Cloud Data Platform, you...Big dataFull timePart timeFlexible hours$132k - $228k
SummaryJoin Guidewire’s Data Platform and Analytics team, a group dedicated to building and... .... Our team leverages the latest in big data and cloud technologies to deliver scalable... ...measurable value for our customers.As a Software Engineer - Data Platform, you will play a pivotal...Big dataFull timePart timeFlexible hours$180k - $276k
Foster City, CAInformation Technology and Applications - ITA PMO /Full-time /HybridZoox is seeking a highly motivated, hands-on Data Engineer to build the next generation of autonomous, self-healing data pipelines. You will be the primary responsible for building the framework...Full timeTemporary workRelocation package$243.29k - $295.25k
...interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.The Data Engineering team at Roblox plays a fundamental role in enabling the company's success by developing and maintaining highly leveraged Core...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday$221.38k - $263.67k
...civil shared experiences for everyone.WHY DATA SCIENCE & ANALYTICS?The Data Science &... ...data spectrum including analytical data engineering, product analytics, experimentation, causal... ...using scripting languages (Python, R), and big data query/processing languages and tools...Big dataFull timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to Friday- ...On-Site role Job Description: Data Engineer - PSQA Onsite in Foster City, CA | 5 days in office Responsibilities: Design, build, and maintain dashboards and scorecards for PSQA release and quality metrics. Query, aggregate, and transform release/version data using SQL...Work at office
$38 per hour
...Data Engineer - PSQAOur client, a leading organization in the technology industry, is seeking a Data Engineer - PSQA to join their team. As a Data Engineer - PSQA, you will be part of the Quality Assurance department supporting the Product and Software Quality teams. The...Flexible hours- ...Pattern AI is seeking a Data Engineer in Hayward Park, California, to join our team. The role focuses on expanding and optimizing data pipelines crucial for our automated machine learning platform. Candidates should have a minimum of 4 years of experience and proficiency...
- ...Data Engineer – PSQAOnsite in Foster City, CA | 5 days in officeResponsibilities:Design, build, and maintain dashboards and scorecards for PSQA release and quality metricsQuery, aggregate, and transform release/version data using SQL and PythonDevelop ETL pipelines to...
- ...Lead Data EngineerMinimum 10 years experience in data engineering and lead experience at least 3-4 years. Experience with Hadoop ecosystem (HDFS, Hive, Yarn, file formats like Avro/Parquet), Kafka, Spark Streaming, PySpark, Airflow. Experience with programming in languages...
- Job TitleFor roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location...Full timeWork experience placement
- ...OpportunityChartmetric, Inc. is a 10-year-old startup specializing in music data analytics. We are trusted by Universal MusicGroup, Sony, Warner... ...stakeholdersBachelor's degree in Computer Science, Data Engineering, or equivalent practical experienceThrives in dynamic startup...Work at office
- ...The Data team leverages data from our autonomous vehicles and operations to determine autonomy and service readiness. We provide the... ...is consumed to generate valuable insights by data scientists, engineers, and business users Establish robust data integrity monitoring...Temporary workRelocation package
- ...PatternAI is an automated machine learning platform that reveals critical patterns in data for narrow business problems. Job Description We are looking for a savvy Data Engineer to join our growing team of data experts. The hire will be responsible for expanding and optimizing...
- ...Job TitleRequired Qualifications:5+ years of experience in data engineering or data science, with a focus on financial data.Strong expertise in SQL, with the ability to write simple queries efficiently.Proficiency in Snowflake, with intermediate to expert-level experience...
$165.2k - $223.6k
Want to change the world with Big Data and Analytics? Come join us on the Amazon Web services (AWS) Elastic MapReduce (EMR) team!EMR... ...intuitive ways of interacting with data, and we’re looking for top engineers to build them from the ground up.This is a hands-on position...Big dataInternshipLocal area$160k - $221k
Foster City, CASafety Strategy and Operations - Safety Strategy and Operations /Full-time /HybridThe AV Safety Software Data Engineer will play a critical role in supporting Zoox’s safety data reporting and compliance efforts. In this position, you will work with large-...Full timeTemporary workRelocation package$165.2k - $223.6k
...analytics platform that executes Apace Spark, Python and other runtime engines. We are scaling the backend infrastructure to enable super-low... ...unique experience. Top reasons to join our team: - Be part of big data revolution in cloud- Be catalyst to deliver a truly disruptive...Big dataInternshipLocal areaFlexible hours- ...Lead Data EngineerStellic is growing! We're looking for a Lead Data Engineer to own the next phase of our data platform that will power everything from internal decision-making to customer-facing insights — and we need a technical leader who can evolve it to support increasing...WorldwideFlexible hours
- ...Job Description Job Description Technical Service Data Engineer Schedule: Monday to Friday, 8 am to 5 pm We are looking for a Technical Service Data Engineer who would translate complex engineering specifications and 3D CAD data into high-precision repair...Monday to FridayShift work
- ...Job Description Job Description AV Safety Data Engineer (Contract) The Safety Strategy Operations team is responsible for developing and implementing safety processes from comprehensive safety planning and risk management to operational safety in the field, data analysis...Contract work
- ...Peninsula) | Secondary: NYC The Opportunity We\'re doing an AI-first engineering rebuild for a company that already has an audience of 100M+... ...one build with no legacy constraints, so you get to design the data platform from scratch instead of untangling years of pipelines....Work at officeRelocation packageFlexible hours2 days per week
- ...next-generation semantic platform that links fragmented enterprise data and extracts meaning with knowledge-distilled models. We’re... ...layer for enterprise AI. What You’ll Do zaimler's query engine powers graph-native queries across a two-layer system: an internal...H1bVisa sponsorshipFlexible hours
- ...CADuration: Full Time Job Description : Mandatory Skills: Core Java - JDBC connection methodsSpring Frameworks (mainly Spring Batch and XD)Big Data:- MUST Experiences (min 1 yr) on Hadoop tools/technologies like Map Reduce, Hive, Pig, HDFC etc.- Well understanding and...Big dataFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- data engineer analytics San Mateo, CA
- senior cloud data engineer San Mateo, CA
- data center engineer San Mateo, CA
- sr data engineer San Mateo, CA
- data engineer San Mateo, CA
- sr information security engineer San Mateo, CA
- data developer San Mateo, CA
- senior data center engineer San Mateo, CA
- data engineer machine learning San Mateo, CA
- senior data engineer San Mateo, CA


