Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Hadoop Big Data Developer

$100k - $150k
Full-time

Bright Vision Technologies

Hadoop Big Data Developer - Remote

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Job Title: Hadoop Big Data Developer
Location: 100% Remote (U.S.)
Position Type: Full-time, Direct W2
Salary Range: $100,000–$150,000 Annually
Experience Required: 6+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary:
We are seeking an experienced Hadoop Big Data Developer to design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related big-data ecosystems. In this role you will be responsible for ingesting, transforming, and analyzing massive volumes of structured and unstructured data to support enterprise analytics, machine learning, and reporting workloads. The ideal candidate will combine deep technical expertise across the Hadoop ecosystem with strong software engineering fundamentals and a clear understanding of how to deliver reliable, performant, and cost-effective data platforms in production environments.

Required Qualifications
  • Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
  • Five or more years of professional experience designing and operating big-data pipelines on Hadoop.
  • Strong hands-on expertise with Apache Spark (Scala, Python, or Java) in production environments.
  • Solid experience with Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
  • Hands-on experience with streaming data platforms such as Kafka, Spark Streaming, or Flink.
  • Strong SQL skills and experience working with both relational and NoSQL data stores.
  • Experience with workflow orchestration tools such as Airflow or Oozie.
  • Solid understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.
  • Strong scripting skills in Python or Shell.
  • Excellent troubleshooting, debugging, and documentation skills.
Preferred Qualifications
  • Experience operating Hadoop on cloud platforms such as AWS EMR, Azure HDInsight, or Databricks.
  • Familiarity with modern lakehouse formats (Delta, Iceberg, Hudi).
  • Exposure to data governance tooling such as Apache Atlas or Collibra.
  • Experience with Kubernetes-based data platforms (Spark-on-K8s, Trino).
  • Hands-on experience with CI/CD and infrastructure-as-code in data engineering workflows.
How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to  View email address on brightvisiontechnologies.applytojob.com or contact us at Show phone number . Learn more about Bright Vision Technologies at .
Bright Vision Technologies is an Equal Opportunity Employer.

 

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Hadoop Big Data Developer in Lexington, MA vacancy
  •  ...Business SystemsJob DescriptionRole: Core Java Developer/ Software EngineerLocation: Boston,...  ...Skills & Expr : Core Java, AWS, Big Data/HadoopDescription:Come join an elite engineering...  ...AWS services.You have worked within the Hadoop / Big Data ecosystem.Additional... 
    Big data

    USM Systems

    Boston, MA
    1 day ago
  •  ...with us.Department Summary:MITRE’s Data Science and Engineering department...  ...based and self-hosted environments.Develop batch and streaming data-processing...  ...EngineeringDistributed Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage and Data... 
    Big data
    Internship
    Local area

    Mitre

    Bedford, MA
    2 hours ago
  • $163.8k - $257.4k

     ...experienced Principal Software Engineer (Data) to join our fast-paced, collaborative data...  ...to solve challenging problems and make a big impact as we invest in making technographics...  ...expertise in big data frameworks (Hadoop, Spark) and the JVM stack (Java, Scala)Strong... 
    Big data
    Worldwide

    ZoomInfo

    Waltham, MA
    2 days ago
  • Job DutiesDesign and Develop big data solutions using Hadoop and Spark platform Cover end-to-end BI and Data strategy inclusive of partnership with internal and external stakeholders. Lead critical aspects of the data management and application management. Design and deliver... 
    Big data

    NTT DATA

    Brighton, MA
    2 days ago
  • $120k - $160k

     ...is looking for an experienced Senior AWS Data Engineer to be a part of, the Enterprise...  ...the team guidance on best practices while developing code in Python for AWS cloud services. In...  ...of data sources using SQL and cloud-based big data technologies.Build analytics tools... 
    Big data
    Flexible hours

    Hitachi

    Waltham, MA
    6 days ago
  •  ...then choose MITRE - and make a difference with us.MITRE’s Data Science and Engineering department is looking for...  ...prediction)Data EngineeringDistributed Data Processing and Big Data Architectures (e.g., Spark, Hadoop, Ray, Dask, Kafka)Data Pipeline/ETL Development and... 
    Big data
    Internship
    Local area

    Mitre

    Bedford, MA
    1 hour ago
  •  ...Overview: The data engineering group, led by Ravi, is focused on building data integrations and data pipelines as part of the broader...  ...technologies like Kafka is a plus. # Proficiency in Python, PySpark, and big data development. # Strong knowledge of Azure stack and Kafka.... 
    Big data
    Local area

    My3Tech Inc

    Waltham, MA
    2 days ago
  • $90k - $157.5k

    DescriptionEnterprise Data Governance organization is recruiting a Data Governance Senior Developer to help drive Collibra Data Intelligence platform implementation. As a Senior...  ...multiple data sources.Hands on experience in big-data processing, troubleshooting and resolving... 
    Big data
    Full time
    Temporary work
    Flexible hours

    State Street Bank

    Boston, MA
    4 days ago
  •  ...are seeking an experienced AWS Data Engineer to design, build, and...  ...platform. This role involves developing ETL/ELT processes, integrating...  ...and developing enterprise-wide big data solutions. Strong...  ...Big Data technologies such as Hadoop and Spark. Familiarity with shell... 
    Big data

    Compunnel

    Boston, MA
    2 days ago
  •  ...Capital One, you'll be part of a big group of makers, breakers,...  ...needs. We are seeking Senior Data Engineers who are passionate about...  ...cutting edge technologies to develop modern data pipelines...  ...data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi... 
    Big data
    Full time
    Part time
    Internship
    Local area

    Capital One Financial Corp

    Cambridge, MA
    1 day ago
  •  ...Google Cloud Data Engineer Are you ready to step up to the New and take your technology...  ...Work with data team to efficiently use Hadoop/Cloud infrastructure to analyze data, build...  ...ingestion to consumption within a hybrid big data architecture, using Java, Python, Scala... 
    Big data
    Work experience placement

    ClifyX

    Boston, MA
    3 days ago
  • $90k - $157.5k

    Seeking a highly skilled data engineer, to design, build, and optimize our data infrastructure...  ...frameworks as Apache Spark, Scala, Hadoop, Hive. This hands-on role will partner...  ...managers, architects and business leadership to develop and execute the technology product... 
    Full time
    Temporary work
    Flexible hours

    State Street Bank

    Boston, MA
    5 days ago
  • As a Senior Data Engineer, CASM Platform, you will: Data Integration, API Development: Integrate...  ...Engineering Optimization: Design, develop, and optimize large-scale ETL/ELT pipelines...  ..., hands-on experience with Databricks and big data frameworks. Expertise in integrating... 
    Big data
    Contract work

    Cedent Consulting

    Boston, MA
    4 days ago
  •  ...thrives on having a large toolbox to support data- and model-driven decision making. We...  ...background with the ability to formulate problems, develop and evaluate solutions, and communicate...  ....Applied experience with spatiotemporal big data technologies, e.g., GeoMesa,... 
    Big data
    Internship
    Local area
    Remote work

    Mitre

    Bedford, MA
    3 days ago
  •  ...WithAt Slalom, we co-create custom software, data, and cloud products with clients who are...  ...solutions that inspire people to dream big and move faster.What You’ll DoAs a Data...  ...employer and is committed to attracting, developing and retaining highly qualified talent who... 
    Big data
    Temporary work
    Local area

    Slalom

    Boston, MA
    5 days ago
  • $78.7k - $138.2k

     ...Financial is looking to add a Senior Data Scientist to the team! The...  ...strategy, technical risks, and scope. Develop, document, and communicate business...  ...Engineering, etc.)Experience with big data technologies which may include Hadoop, Cloud Computing Environments (including... 
    Big data
    Full time
    H1b
    Work at office
    Work from home
    Visa sponsorship
    1 day per week

    Ameriprise Financial

    Boston, MA
    4 days ago
  •  ...Data Engineer Location: Boston, MA (Onsite role from Day 1) Duration: C2C In-person Interview Job Description: 10+ years of...  ...experience in Java, J2EE and Python Solid tech skillset/experience in Big Data/Data Model, PySpark Strong knowledge on Spark technology... 
    Big data

    Kasmo Global

    Boston, MA
    3 days ago
  •  ...Data Engineer Location: Boston, MA (Onsite- 4 days/week) Duration: 6+ months contract...  ...stakeholders to understand requirements, develop predictive models, and generate actionable...  ...distributed computing frameworks like Spark for big data processing. Knowledge of machine... 
    Big data
    Contract work

    ShiftCode Analytics

    Boston, MA
    3 days ago
  •  ...Senior Data Engineer Location: Boston, MA (Day one Onsite) Job Description: A robust background in AWS services such as Lambda...  ..., prompt engineering, and MCP. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch... 
    Big data

    InterSources

    Boston, MA
    3 days ago
  •  ...Learning Engineer to join our team and help develop cutting-edge AI solutions. In this role,...  ...learning and AI Create and implement big data processing pipelines and architectures...  ...Experience with big data technologies (e.g., Hadoop, Spark, Kafka) ~ Proven ability to... 
    Big data
    Remote job
    Full time

    Givzey

    Newton, MA
    1 day ago
  • $166k - $220k

     ...operating system that turns thousands of data streams into a realtime, 3D command and control...  ...diverse HR data sources, to designing, developing, and optimizing data models and pipelines...  ...Qualifications: Experience with big data processing frameworks (e.g., Apache... 
    Big data
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Boston, MA
    3 days ago
  •  ...technology and leadership in cloud, AI and data with unmatched industry experience,...  ...agentic AI knowledge to design, develop and reinvent processes with AI to...  ...Google Cloud).You have knowledge of big data technologies (e.g., Hadoop, Spark).Knowledge of agent-based modeling... 
    Big data
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    4 days ago
  • $75 - $100 per hour

    • Designs, develops, and implements methods, processes, and systems to consolidate and analyze diverse data sets including structured and unstructured. • Develop software programs...  ...: • Databases and Data Engineering for Big Data • Elasticsearch • Statistical... 
    Big data
    Remote work

    Athari DDS

    Lexington, MA
    22 hours ago
  •  ...Senior Data Engineer AgileEngine is an Inc. 5000 company that creates award-winning software...  ..., orchestrate workflows with Airflow, develop ingestion workflows from third-party APIs,...  ...or DuckDB; ~2+ years of experience with Big Data technologies (Spark, Snowflake); ~... 
    Big data
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    AgileEngine

    Boston, MA
    1 day ago
  •  ...Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence...  ...complex data sets and models. Experience with developing data pipelines from many sources from...  ...Python, R, SQL, SAS). Strong knowledge of big data analysis and storage tools and technologies... 
    Big data
    Full time
    Flexible hours

    Dormont Manufacturing Company

    Boston, MA
    5 days ago
  • $160k - $190k

     ...traffic analysis, and large-scale behavioral data collection, TVision measures what...  ...power TVision’s measurement platform. You’ll develop scalable backend services, cloud-native data...  ...optimization best practices.Experience with modern big data processing frameworks such as Spark,... 
    Big data
    Work experience placement
    Local area

    Viant Technology

    Boston, MA
    3 days ago
  •  ...Position Summary The Data Engineer will play a crucial role in developing and fine-tuning data specifically for our LLMs and machine learning models. This individual...  ...in data engineering principles, experience with big data technologies, and a keen understanding of the... 
    Big data
    H1b
    Remote work
    Flexible hours

    C the Signs

    Boston, MA
    23 hours ago
  •  ...professional but personal life, interests you- you would enjoy your career with Quantiphi!Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our... 
    Big data

    Quantiphi, Inc.

    Boston, MA
    5 days ago
  •  ...Responsible AI team within the Global Data & AI Practice. AI is becoming more...  ...’s data and AI activities. We’re developing and deploying differentiated IP...  ...TensorFlow, PyTorch). Experience on big data technologies and tools (e.g., Hadoop, Spark).Database management and... 
    Big data
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    1 day ago
  • $90k - $157.5k

    As a Cloud Data Engineer, AVP, you will design, develop and deliver scalable cloud data solutions using Databricks and AWS. You will collaborate with technology...  ..., machine learning, advanced analytics, and big data.Strong knowledge of Apache Airflow for workflow orchestration... 
    Big data
    Full time
    Temporary work
    Flexible hours

    State Street Bank

    Boston, MA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hadoop Big Data Developer. Be the first to apply!