Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

$90k - $110k

Bright Vision Technologies

Big Data Engineer - Remote

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: Big Data Engineer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $90,000-$110,000 Annually
Experience Required: 6+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary
We are seeking an experienced Big Data Engineer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments

Required Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related technical discipline.
  • Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
  • Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
  • Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
  • Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
  • Strong SQL skills and experience working with both relational and NoSQL data stores.
  • Experience with workflow orchestration tools such as Airflow or Oozie.
  • Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.
  • Strong scripting skills in Python or Shell.
  • Excellent troubleshooting, debugging, and documentation skills.
Preferred Qualifications
  • Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks.
  • Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi).
  • Exposure to data governance tooling such as Apache Atlas or Collibra.
  • Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino).
  • Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to [email protected]
Bright Vision Technologies is an Equal Opportunity Employer.
Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Milpitas, CA vacancy
  •  ...Principal Big Data Engineer As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design and development. Having the dynamic ability to adapt to conventional big-data frameworks... 
    Big data

    Omni Inclusive

    Santa Clara, CA
    5 days ago
  •  ...Cloud Data Engineer This role has been designed as 'Onsite' with an expectation that you will primarily work from an HPE office. Job...  ...~1+ years of programming experience in Java ~ Expertise in big data technologies such as Apache Spark or Kafka with at least 1... 
    Big data
    Work experience placement
    Work at office

    Hewlett Packard Enterprise

    Alviso, CA
    5 days ago
  • $50 - $60 per hour

     ...Bigdata Engineer Location: Phoenix, AZ Duration: 12+ Months Client: Client / Impetus Pay Rate: $50 to $60 Max depends on experience...  ...year Bachelors Year and university Total Exp US Exp. Big Data Exp. Current Location Open for Travel Open for... 
    Big data
    Relocation

    Omega Solutions

    Santa Clara, CA
    2 days ago
  •  ...Big Data Engineer: Must Have: • Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential • Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the... 
    Big data

    Texas State Library and Archives Commision

    Sunnyvale, CA
    1 day ago
  •  ...Big Data Engineer San Jose, CA (Remote) Experian Need 8 years of experience and hands on programming experience in any one or more programming languages like Java, Scala or Python Good experience with distributed systems like Hadoop, HDFs and No SQL databases... 
    Big data
    Remote work

    Omega Solutions Inc

    San Jose, CA
    2 days ago
  •  ...Responsibilities Designing, developing & tuning data products, applications and integrations...  ...and reusable components for various data engineering functions/areas. Collaborate with key...  ...in enterprise data warehousing / big data implementations & complex data solutions... 
    Big data

    Central Business Solutions

    San Jose, CA
    4 days ago
  •  ...approach for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and...  ...calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured... 
    Big data

    Comtech

    San Jose, CA
    2 days ago
  •  ...Big Data Engineer CA – Los Angeles, CA - Los Alamitos, CA - Norwalk, CA - El Segundo, CA - Sacramento, CA - San Diego, CA - San Francisco, CA - San Jose, WA - Seattle, OR - Portland What Will I Do in This Position? As part of our Advanced Technology & Architecture... 
    Big data
    Work experience placement

    ClifyX

    San Jose, CA
    2 days ago
  •  ...Key Responsibilities Design, develop, and maintain big data pipelines leveraging Hadoop, Spark, and Kafka . Develop...  ...functional teams including data scientists, analysts, and DevOps engineers to deliver end-to-end data solutions. Ensure data quality... 
    Big data

    Purple Drive

    Sunnyvale, CA
    1 day ago
  •  ...Big Data Engineer Headquartered in New Jersey (U.S), Cygnus Professionals Inc. is a next generation global information technology Solution and Consulting company powered by strong management and leadership team with over 30 person years of experience. Today, Cygnus... 
    Big data
    Contract work
    Immediate start

    Cygnus Professionals

    Palo Alto, CA
    4 days ago
  • $175k - $221k

     ...content intelligence.If you’re inspired to dream big, innovate fast, and make a difference, we’d love...  ...A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming pipelines... 
    Big data
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    4 days ago
  • $174.72k - $295.68k

     ...learning, and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset...  ...in programming languages like Python or SQL.Experience with Big Data tools and cloud platforms (e.g., AWS, GCP, BigQuery).... 
    Big data
    Full time

    XPENG Motors

    Santa Clara, CA
    2 days ago
  • $135k - $180k

    Santa Clara, CAData Engineering - Backend Engineering /Full-time /HybridPlusAI is a Physical AI...  ...: Create and maintain optimal data processing pipeline architectureBuild the...  ...transformation, and loading of data using SQL and big data technologies.Identify, design, and implement... 
    Big data
    Full time

    Plus.ai

    Santa Clara, CA
    2 days ago
  • $60 - $69.01 per hour

     ...Data Engineer Pay Rate Range: $60 - $69.01/hr. Duties: Design, build, optimize, and maintain scalable data pipelines that support...  ..., and data quality across distributed systems. Work with Big Data technologies and best practices to process high-volume datasets... 
    Big data

    Varite

    San Jose, CA
    2 days ago
  • $117k - $234k

     ...OfficePosition Summary...What you'll do...Role summary: As a Senior Data Engineer, you will design, develop, and maintain scalable data pipelines...  ...optimize data accessibility and reliability within cloud and big data environments. This role demands a strategic mindset to... 
    Big data
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    4 days ago
  • $202.5k - $274k

     ...the QuickBooks Capital and Lending Platform as a Staff Software Engineer in Data. You will join an innovative and passionate team of engineers...  ...technologies like Python, PySpark, Spark, SQL, Data Bricks, Big Data fundamentals, AWS, Elastic Search, Kafka, to build enterprise... 
    Big data
    Worldwide

    Intuit

    Mountain View, CA
    3 days ago
  • $148.75k - $361k

     ...world while gaining meaningful experience across a variety of disciplines.About the teamThe mission of Roku's Data Engineering team is to develop a world-class big data platform that enables internal and external customers to leverage data to grow their businesses. Data... 
    Big data
    Work at office
    Local area
    Remote work
    Worldwide
    Monday to Thursday
    Flexible hours

    Roku

    San Jose, CA
    6 hours ago
  •  ...impacting millions of customers worldwide drive value from data at Walmart Scale Interact with Walmart engineering teams across geographies to leverage expertise and...  .... Your Qualifications Min 6-10 years of Big data development experience Demonstrates up-to-... 
    Big data
    Worldwide

    Software Technology Inc

    Sunnyvale, CA
    4 days ago
  • $202.5k - $274k

     ...impact of their ideas? Are you motivated by data-driven decisions? If 'yes', then the...  ...partner closely with a world-class org of Engineering, ML, Search, Data Science, Data Engineering...  ...a must-have.Demonstrated experience with big data tools and frameworks such as Apache... 
    Big data
    Worldwide

    Intuit

    Mountain View, CA
    5 days ago
  •  ...professional IT Consulting services in the US. We are actively seeking Data Engineer for one of our client, Please share your resume with current...  ...building and optimizing data pipelines and integrating with big data platforms like Apache Spark and Hadoop. Develop efficient,... 
    Big data

    Rootshell Enterprise Technologies

    Santa Clara, CA
    3 days ago
  •  ...software development or related 2. 3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBase 3. Hands on experience with Unix, Teradata and other relational... 
    Big data
    Full time

    Redolent

    Sunnyvale, CA
    2 days ago
  • $117k - $234k

     ...drive critical business initiatives with Data. You love writing and owning codes and enjoy...  ...and act on this data. Partner with engineering, AI/ML, and product teams to ensure data...  ...you'll bring:4-6 years of experience in Big Data development with a focus on scalable... 
    Big data
    Full time
    Temporary work
    Part time

    Sam's Club

    Sunnyvale, CA
    3 days ago
  •  ...About the job Lead Data Engineer Role: Lead Data Engineer Location: Fremont, CA(3 days onsite, 2 days work from home) Duration...  ...Spark with major emphasis on S3 and Glue ~ Experience with Big Data Tools and technologies Key Skills: Strong technical... 
    Big data
    Full time
    Work from home

    Inizio Partners

    Fremont, CA
    3 days ago
  •  ...for your reference. Recent update from client for this data engineer role / Request-ID: 13145-1 _ Bentonville, AR position is no...  ...As a Senior Data Engineer, you will • Design and develop big data applications using the latest open source technologies.... 
    Big data

    Texas State Library and Archives Commision

    Sunnyvale, CA
    1 day ago
  •  ...Senior Data Engineer Location: Sunnyvale CA (Onsite) Duration: Long Term Job Description: GCP Experience • 4+ years of recent GCP...  ...: As a Senior Data Engineer, you will • Design and develop big data applications using the latest open source technologies. •... 
    Big data

    JConnect Infotech

    Sunnyvale, CA
    4 days ago
  •  ...Job Summary We are seeking an experienced Data Engineer to design, implement, and optimize cloud-based data solutions on Azure. This role...  ...Data Lake, and cloud-native data services. Experience with big data technologies, including Hadoop and Spark. Strong scripting... 
    Big data

    Compunnel

    San Jose, CA
    1 day ago
  •  ...Data Strategy Understands, articulates, and applies principles of the defined strategy to routine business problems that involve a...  ...mathematical solutions. Identifies what methods (for example, analytics, big data analytics, automation) would provide a solution for the... 
    Big data

    Diverse Lynx

    Sunnyvale, CA
    4 days ago
  •  ...accomplish. We are seeking an exceptional engineer with a background in large scale software...  ...using cutting-edge technologies to build data intensive systems, designing and optimizing...  ...Java or Scala ~5+ years experience with big data platforms ~ Familiarity with ML/AI... 
    Big data

    Apple

    Sunnyvale, CA
    4 days ago
  • $80 - $95 per hour

    This range is provided by OSI Engineering. Your actual pay will be based on your skills and experience...  ...Mountain View, CA is seeking a talented Data Engineer to help build secure, scalable...  ...engineers with strong expertise in Big Data infrastructure and data warehousing... 
    Big data
    Full time
    Contract work

    OSI Engineering

    Mountain View, CA
    5 days ago
  •  ...implementation of large-scale distributed data platforms. • Build and optimize high-...  ...observability. • Mentor a team of data engineers and provide technical leadership across...  ...years of experience in Data Engineering and Big Data ecosystems. • Expert knowledge of... 
    Big data

    Veridic Solutions

    Sunnyvale, CA
    21 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!