Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

$90k - $110k
Full-time

Bright Vision Technologies

Big Data Engineer – Remote

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title:  Big Data Engineer
Location: 100% Remote (U.S.)
Position Type:  Full-time, Direct W2
Salary Range: $90,000–$110,000 Annually
Experience Required: 6+ years

Sponsorship:  U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary
We are seeking an experienced Big Data Engineer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments

Required Qualifications
  • Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
  • Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
  • Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
  • Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
  • Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
  • Strong SQL skills and experience working with both relational and NoSQL data stores.
  • Experience with workflow orchestration tools such as Airflow or Oozie.
  • Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.
  • Strong scripting skills in Python or Shell.
  • Excellent troubleshooting, debugging, and documentation skills.
Preferred Qualifications
  • Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks.
  • Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi).
  • Exposure to data governance tooling such as Apache Atlas or Collibra.
  • Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino).
  • Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to View email address on us.fitly.work
Bright Vision Technologies is an Equal Opportunity Employer.

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in San Mateo, CA vacancy
  • Company DescriptionMaganti IT Resources LLCJob DescriptionTitle: Data Science EngineerLocation: San Mateo, CAType: permanentJobdescriptiion:Client is a leader in applying Big Data technology to extract and analyze unstructured and coded clinical data to derive outcome-... 
    Big data
    Permanent employment

    Maganti IT Resources

    San Mateo, CA
    3 days ago
  •  ...Job Title: AWS Data Engineer Location: Foster City, CA/Raleigh, NC || Onsite Job Type: Contract Job Description:...  ...~ Expertise in ETL optimization, designing, coding, and tuning big data processes using Apache Spark or similar technologies ~... 
    Big data
    Contract work
    Work experience placement

    Trinity Technology Solutions

    San Mateo, CA
    1 day ago
  • $146.2k - $233.7k

     ...the world. Progress starts with you.Job DescriptionAs a Staff Data Engineer, you'll join our Value Added Services - Digital Marketing & Engagement...  ...into scalable data solutionsArchitect solutions using big data technologies such as Hadoop, Spark, and distributed data processing... 
    Big data
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start

    Visa

    Foster, CA
    2 days ago
  • $169.1k - $270.8k

     ...Progress starts with you.Job DescriptionAs a Senior Consultant Data Engineer, you'll join our Value Added Services - Digital Marketing & Engagement...  ...-scale, enterprise-class applications. • Solid experience in big data engineering, with working knowledge of Hadoop, Apache... 
    Big data
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start

    Visa

    Foster, CA
    2 days ago
  •  ...software development or related3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBaseHands on experience with Unix, Teradata and other relational databases.... 
    Big data

    Redolent

    San Bruno, CA
    2 days ago
  • We have following urgent role with our DIRECT client Title: Sr. Data Engineer ( Big Data) Location: San Bruno, CA Duration: 6+ Months Rate: Market Technical Requirements Development experience with Java, Scala, Flume, Python Development background with Spark or MapReduce... 
    Big data

    Redolent Infotech Pvt. Ltd.

    San Bruno, CA
    3 days ago
  • $148k - $222k

    SummaryJoin Guidewire’s Data Platform and Analytics team, a group dedicated to building and...  ...excellence, leveraging the latest in Big Data and cloud technologies to deliver scalable...  ...for our customers. As a Senior Software Engineer (EMR Spark) on the Cloud Data Platform, you... 
    Big data
    Full time
    Part time
    Flexible hours

    Guidewire Software, Inc.

    San Mateo, CA
    5 days ago
  • $132k - $228k

    SummaryJoin Guidewire’s Data Platform and Analytics team, a group dedicated to building and...  .... Our team leverages the latest in big data and cloud technologies to deliver scalable...  ...measurable value for our customers.As a Software Engineer - Data Platform, you will play a pivotal... 
    Big data
    Full time
    Part time
    Flexible hours

    Guidewire Software, Inc.

    San Mateo, CA
    5 days ago
  • $180k - $276k

    Foster City, CAInformation Technology and Applications - ITA PMO /Full-time /HybridZoox is seeking a highly motivated, hands-on Data Engineer to build the next generation of autonomous, self-healing data pipelines. You will be the primary responsible for building the framework... 
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    2 days ago
  • $243.29k - $295.25k

     ...interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.The Data Engineering team at Roblox plays a fundamental role in enabling the company's success by developing and maintaining highly leveraged Core... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    5 days ago
  • $221.38k - $263.67k

     ...civil shared experiences for everyone.WHY DATA SCIENCE & ANALYTICS?The Data Science &...  ...data spectrum including analytical data engineering, product analytics, experimentation, causal...  ...using scripting languages (Python, R), and big data query/processing languages and tools... 
    Big data
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    3 days ago
  •  ...On-Site role Job Description: Data Engineer - PSQA Onsite in Foster City, CA | 5 days in office Responsibilities: Design, build, and maintain dashboards and scorecards for PSQA release and quality metrics. Query, aggregate, and transform release/version data using SQL... 
    Work at office

    Denken Solutions

    Foster, CA
    1 day ago
  • $38 per hour

     ...Data Engineer - PSQAOur client, a leading organization in the technology industry, is seeking a Data Engineer - PSQA to join their team. As a Data Engineer - PSQA, you will be part of the Quality Assurance department supporting the Product and Software Quality teams. The... 
    Flexible hours

    Manpower

    San Mateo, CA
    2 days ago
  •  ...Pattern AI is seeking a Data Engineer in Hayward Park, California, to join our team. The role focuses on expanding and optimizing data pipelines crucial for our automated machine learning platform. Candidates should have a minimum of 4 years of experience and proficiency... 

    Pattern AI

    San Mateo, CA
    3 days ago
  •  ...Data Engineer – PSQAOnsite in Foster City, CA | 5 days in officeResponsibilities:Design, build, and maintain dashboards and scorecards for PSQA release and quality metricsQuery, aggregate, and transform release/version data using SQL and PythonDevelop ETL pipelines to... 

    Artech

    San Mateo, CA
    2 days ago
  •  ...Lead Data EngineerMinimum 10 years experience in data engineering and lead experience at least 3-4 years. Experience with Hadoop ecosystem (HDFS, Hive, Yarn, file formats like Avro/Parquet), Kafka, Spark Streaming, PySpark, Airflow. Experience with programming in languages... 

    InterSources

    San Mateo, CA
    1 day ago
  • Job TitleFor roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location...
    Full time
    Work experience placement

    Roblox

    San Mateo, CA
    2 days ago
  •  ...OpportunityChartmetric, Inc. is a 10-year-old startup specializing in music data analytics. We are trusted by Universal MusicGroup, Sony, Warner...  ...stakeholdersBachelor's degree in Computer Science, Data Engineering, or equivalent practical experienceThrives in dynamic startup... 
    Work at office

    Chartmetric

    San Mateo, CA
    1 day ago
  •  ...The Data team leverages data from our autonomous vehicles and operations to determine autonomy and service readiness. We provide the...  ...is consumed to generate valuable insights by data scientists, engineers, and business users Establish robust data integrity monitoring... 
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    3 days ago
  •  ...PatternAI is an automated machine learning platform that reveals critical patterns in data for narrow business problems. Job Description We are looking for a savvy Data Engineer to join our growing team of data experts. The hire will be responsible for expanding and optimizing... 

    Pattern AI

    San Mateo, CA
    3 days ago
  •  ...Job TitleRequired Qualifications:5+ years of experience in data engineering or data science, with a focus on financial data.Strong expertise in SQL, with the ability to write simple queries efficiently.Proficiency in Snowflake, with intermediate to expert-level experience... 

    RIT Solutions

    San Mateo, CA
    1 day ago
  • $165.2k - $223.6k

    Want to change the world with Big Data and Analytics? Come join us on the Amazon Web services (AWS) Elastic MapReduce (EMR) team!EMR...  ...intuitive ways of interacting with data, and we’re looking for top engineers to build them from the ground up.This is a hands-on position... 
    Big data
    Internship
    Local area

    Amazon

    East Palo Alto, CA
    2 days ago
  • $160k - $221k

    Foster City, CASafety Strategy and Operations - Safety Strategy and Operations /Full-time /HybridThe AV Safety Software Data Engineer will play a critical role in supporting Zoox’s safety data reporting and compliance efforts. In this position, you will work with large-... 
    Full time
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    2 days ago
  • $165.2k - $223.6k

     ...analytics platform that executes Apace Spark, Python and other runtime engines. We are scaling the backend infrastructure to enable super-low...  ...unique experience. Top reasons to join our team: - Be part of big data revolution in cloud- Be catalyst to deliver a truly disruptive... 
    Big data
    Internship
    Local area
    Flexible hours

    Amazon

    East Palo Alto, CA
    5 days ago
  •  ...Lead Data EngineerStellic is growing! We're looking for a Lead Data Engineer to own the next phase of our data platform that will power everything from internal decision-making to customer-facing insights — and we need a technical leader who can evolve it to support increasing... 
    Worldwide
    Flexible hours

    Stellic

    San Mateo, CA
    4 days ago
  •  ...Job Description Job Description Technical Service Data Engineer Schedule: Monday to Friday, 8 am to 5 pm We are looking for a Technical Service Data Engineer who would translate complex engineering specifications and 3D CAD data into high-precision repair... 
    Monday to Friday
    Shift work

    Vertex Sigma Software

    Foster, CA
    9 days ago
  •  ...Job Description Job Description AV Safety Data Engineer (Contract) The Safety Strategy Operations team is responsible for developing and implementing safety processes from comprehensive safety planning and risk management to operational safety in the field, data analysis... 
    Contract work

    Vertex Sigma Software

    Foster, CA
    9 days ago
  •  ...Peninsula) | Secondary: NYC The Opportunity We\'re doing an AI-first engineering rebuild for a company that already has an audience of 100M+...  ...one build with no legacy constraints, so you get to design the data platform from scratch instead of untangling years of pipelines.... 
    Work at office
    Relocation package
    Flexible hours
    2 days per week

    MrBeast

    San Mateo, CA
    1 day ago
  •  ...next-generation semantic platform that links fragmented enterprise data and extracts meaning with knowledge-distilled models. We’re...  ...layer for enterprise AI. What You’ll Do   zaimler's query engine powers graph-native queries across a two-layer system: an internal... 
    H1b
    Visa sponsorship
    Flexible hours

    zaimler

    San Mateo, CA
    9 days ago
  •  ...CADuration: Full Time Job Description : Mandatory Skills: Core Java - JDBC connection methodsSpring Frameworks (mainly Spring Batch and XD)Big Data:- MUST Experiences (min 1 yr) on Hadoop tools/technologies like Map Reduce, Hive, Pig, HDFC etc.- Well understanding and... 
    Big data
    Full time

    Ventures Unlimited

    Foster, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!