Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

Bright Vision Technologies

Big Data Engineer – RemoteBright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.Job TitleBig Data EngineerLocation100% Remote (U.S.)Position TypeFull-time, Direct W2Salary Range$90,000–$110,000 AnnuallyExperience Required6+ yearsSponsorshipU.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.Job SummaryWe are seeking an experienced Big Data Engineer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments.Required QualificationsBachelor's degree in Computer Science, Engineering, or a related technical discipline.Five or more years of professional experience designing and operating big-data pipelines on Hadoop.Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.Strong SQL skills and experience working with both relational and NoSQL data stores.Experience with workflow orchestration tools such as Airflow or Oozie.Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.Strong scripting skills in Python or Shell.Excellent troubleshooting, debugging, and documentation skills.Preferred QualificationsExperience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks.Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi).Exposure to data governance tooling such as Apache Atlas or Collibra.Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino).Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows.How to ApplyWould you like to know more about this opportunity? For immediate consideration, please send your resume to View email address on click.appcast.io Bright Vision Technologies is an Equal Opportunity Employer.Equal Employment Opportunity (EEO) StatementBright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Milpitas, CA vacancy
  • Bright Vision Technologies is seeking a seasoned Big Data Engineer to design, build, and operate large-scale data pipelines on Hadoop and related ecosystems. You will ingest, transform, and analyze massive structured and unstructured data to support analytics, ML, and reporting... 
    Big data
    Remote job

    Bright Vision Technologies

    Milpitas, CA
    2 days ago
  •  ...Big Data EngineerLocation: Mountain view CA (3 days onsite)Skill Set:Minimum of 5+ years working with Apache Flink or Spark Structured Streaming (preferably Flink)5+ years experience with Java or ScalaStrong experience working with micro services and KubernetesStrong... 
    Big data

    Kasmo Global

    Mountain View, CA
    3 days ago
  •  ...Principal Big Data EngineerAs a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design and development. Having the dynamic ability to adapt to conventional big-data frameworks... 
    Big data

    Omni Inclusive

    Santa Clara, CA
    3 days ago
  •  ...Big Data EngineerSan Jose, CA (Remote)ExperianNeed 8 years of experience and hands on programming experience in any one or more programming languages like Java, Scala or PythonGood experience with distributed systems like Hadoop, HDFs and No SQL databasesExperience in... 
    Big data
    Remote work

    Omega Solutions Inc

    San Jose, CA
    3 days ago
  •  ...Big Data EngineerCA – Los Angeles, CA - Los Alamitos, CA - Norwalk, CA - El Segundo, CA - Sacramento, CA - San Diego, CA - San Francisco, CA - San Jose, WA - Seattle, OR - PortlandWhat Will I Do in This Position?As part of our Advanced Technology & Architecture (AT&A)... 
    Big data
    Work experience placement

    ClifyX

    San Jose, CA
    3 days ago
  •  ...approach for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and...  ...calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured... 
    Big data

    Comtech

    San Jose, CA
    4 days ago
  •  ...Big Data EngineerHeadquartered in New Jersey (U.S), Cygnus Professionals Inc. is a next generation global information technology Solution...  ...along with your contact details and rate part.Role: Big Data Engineer w/SparkLocation: Palo Alto, CADuration: Potential Contract to HireMode... 
    Big data
    Contract work
    Immediate start

    Cygnus Professionals

    Palo Alto, CA
    46 minutes ago
  • $175k - $221k

     ...content intelligence.If you’re inspired to dream big, innovate fast, and make a difference, we’d love...  ...A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming pipelines... 
    Big data
    Full time
    Local area
    Work from home

    News Break

    Mountain View, CA
    1 day ago
  • $60 - $69.01 per hour

     ...Data EngineerPay Rate Range: $60 - $69.01/hr.Duties:Design, build, optimize, and maintain...  ...across distributed systems.Work with Big Data technologies and best practices to process...  ...Data Science, Product, Marketing, and Engineering teams to deliver actionable insights and... 
    Big data

    Varite

    San Jose, CA
    3 days ago
  • $174.72k - $295.68k

     ...learning, and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset...  ...in programming languages like Python or SQL.Experience with Big Data tools and cloud platforms (e.g., AWS, GCP, BigQuery).... 
    Big data
    Full time

    XPENG Motors

    Santa Clara, CA
    4 days ago
  • $135k - $180k

    Santa Clara, CAData Engineering - Backend Engineering /Full-time /HybridPlusAI is a Physical AI...  ...: Create and maintain optimal data processing pipeline architectureBuild the...  ...transformation, and loading of data using SQL and big data technologies.Identify, design, and implement... 
    Big data
    Full time

    Plus.ai

    Santa Clara, CA
    4 days ago
  • $202.5k - $274k

     ...the QuickBooks Capital and Lending Platform as a Staff Software Engineer in Data. You will join an innovative and passionate team of engineers...  ...technologies like Python, PySpark, Spark, SQL, Data Bricks, Big Data fundamentals, AWS, Elastic Search, Kafka, to build enterprise... 
    Big data
    Worldwide

    Intuit

    Mountain View, CA
    5 hours ago
  •  ...software development or related3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBaseHands on experience with Unix, Teradata and other relational databases.... 
    Big data

    Redolent

    Sunnyvale, CA
    3 days ago
  • Job-ID17032030Reference21-063692 Data Engineer / Architect Client doesn't have much bandwidth for any handholding. They will grant required...  ...Data warehousing & Data modeling concepts • Experience working on Big Data, BI or Analytics related projects • Advanced knowledge of... 
    Big data

    Intelliswift

    Cupertino, CA
    1 day ago
  •  ...Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka...  ...Strong proficiency in Python, SQL, and potentially Scala/Java. Big Data: Expertise in Apache Spark (Spark SQL, DataFrames, Streaming... 
    Big data

    Compunnel

    Sunnyvale, CA
    4 days ago
  •  ...Title: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal...  ...in a fast-paced environment. Strong background in transforming big data into business insights Technical Requirements Knowledge/... 
    Big data
    Contract work

    TWO95 International

    Sunnyvale, CA
    11 hours ago
  • $148.75k - $361k

     ...world while gaining meaningful experience across a variety of disciplines.About the teamThe mission of Roku's Data Engineering team is to develop a world-class big data platform that enables internal and external customers to leverage data to grow their businesses. Data... 
    Big data
    Work at office
    Local area
    Remote work
    Worldwide
    Monday to Thursday
    Flexible hours

    Roku

    San Jose, CA
    2 days ago
  •  ...Data EngineerRootshell Enterprise Technologies Inc. is a recognized provider of professional...  ...in the US. We are actively seeking a Data Engineer for one of our clients.Location: Santa...  ...optimizing data pipelines and integrating with big data platforms like Apache Spark and... 
    Big data

    Rootshell Inc

    Santa Clara, CA
    3 days ago
  • $80 - $95 per hour

     ...This range is provided by OSI Engineering. Your actual pay will be based on your skills and experience...  ...Mountain View, CA is seeking a talented Data Engineer to help build secure, scalable...  ...engineers with strong expertise in Big Data infrastructure and data... 
    Big data
    Full time
    Contract work

    OSI Engineering

    Mountain View, CA
    10 hours ago
  •  ...Senior Data EngineerLocation: Sunnyvale CA (Onsite)Duration: Long TermJob Description:GCP Experience • 4+ years of...  ...Jenkins, or TFSRoles and Responsibilities:As a Senior Data Engineer, you will • Design and develop big data applications using the latest open source... 
    Big data

    JConnect Infotech

    Sunnyvale, CA
    3 days ago
  •  ...Job Title: Big Data Engineer Location: San Jose, CA Duration: Long Term Contract Job Description Client is looking for Big Data engineers with expert level experience in developing enterprise software applications on Spark/Hadoop, NoSql, InMemory Databases.... 
    Big data
    Long term contract
    Immediate start

    Rapinno Tech

    San Jose, CA
    18 hours ago
  •  ...Sr. Data EngineerMountain View, CA / Denver, CO / RemoteFull-TimePosition Summary:We are looking for a Sr. Data Engineer to join our growing Data Platform and Engineering teams. The ideal candidate...  ...data from many sourcesExperience in big data, data mining and statistical... 
    Big data

    1872 Consulting

    Mountain View, CA
    3 days ago
  •  ...Data EngineerData Engineers are focused on enabling a data-driven approach to optimization by sourcing, maintaining and ensuring the availability...  ...research, and quality assurance testingApply a variety of big data technologies to ingest, transform, index, aggregate, correlate... 
    Big data

    Kaav Inc.

    San Jose, CA
    3 days ago
  • $323k - $428k

     ...Roku in San Jose is seeking a skilled Senior Software Engineer to work on big data technologies including Apache Spark and Airflow. You will design, build, and maintain scalable systems while collaborating with cross-functional teams to deliver high-quality data products... 
    Big data

    Roku

    San Jose, CA
    10 hours ago
  • $150.4k - $277.6k

     ...accomplish. We are seeking an exceptional engineer with a background in large scale software...  ...using cutting‑edge technologies to build data intensive systems, designing and optimizing...  ...languages: Java or Scala 5+ years experience with big data platforms Familiarity with ML/AI... 
    Big data

    Apple

    Sunnyvale, CA
    3 days ago
  •  ...Data Engineering LeadLead the architecture, design, and implementation of large-scale distributed data platforms.Build and optimize high-performance...  ...Skills10+ years of experience in Data Engineering and Big Data ecosystems.Expert knowledge of PySpark and Spark SQL.Strong... 
    Big data

    Veridic Solutions

    Sunnyvale, CA
    3 days ago
  •  ...Data EngineerWe are seeking a highly skilled Data Engineer to join our team, focusing on building, maintaining, and optimizing our data infrastructure. As a Data...  ...reporting. This role requires expertise in ETL processes, big data technologies, and cloud data platforms.Key... 
    Big data

    Omni Inclusive

    Santa Clara, CA
    3 days ago
  •  ...Lead Data EngineerRadiumOne is seeking a Lead Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data...  ...experienceKnowledge and expertise of No SQL and Big Data technologiesStrong knowledge of LinuxDemonstrated... 
    Big data

    Stepping Up Solutions

    Sunnyvale, CA
    4 days ago
  •  ...Data EngineerMinimum 10 years of experienceResponsibilities:Data Pipeline Development:...  ...with Data Scientists and Machine Learning Engineers to understand data requirements for model...  ...PyTorch.Understanding of distributed systems, big data technologies, and real-time data... 
    Big data

    Yochana

    San Jose, CA
    3 days ago
  • A pioneering AI technology firm is seeking an experienced Data Engineer to enhance its scalable data systems. The position requires expertise...  ..., particularly AWS, and solid experience in developing big data systems. With responsibilities that include designing high... 
    Big data

    BREVIAN

    Sunnyvale, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!