Big Data Software Engineer

Full-time

Gigatec Engineering

In this key role as a Software Engineer, you'll get to transform a Streamlit-built UI prototype into a polished, production-ready interface, with a roadmap to extend its reach and build it into an interface with future plans to make the interface available external to the corporate enterprise.

Requirements

What You’ll Be Doing (We don’t love the bullet points, but we love the work!)

Required Skills and Experience (SW Swiss Army knife with a keyboard)
• Using the Linux CLI and Linux tools
• Developing Bash scripts to automate manual processes
• Recent software development experience using Python and Java
• Familiar with Streamlit, a Python framework for building interactive web applications
• Experience developing front-end applications using TypeScript, HTML, and CSS
• Experience with JavaScript frameworks such as React, Angular, and Vue
• Familiar with Distributed Big Data processing engines including Apache Spark
• Experience using Jupyter Notebook
• Experience with data wrangling and preprocessing using tools such as pandas, NumPy
• Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML
• Familiarity with data quality concepts, data validation, and anomaly detection
• Experience with Git Source Control System

Position Desired Skills
• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows
• Experience with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets
• Familiar with HPC Job Scheduling tools including Slurm
• Experience using the Atlassian Tool Suite (JIRA, Confluence)
• Appreciates a sense of humor and the occasional well-timed joke.

Apply

Vacancy posted 14 hours ago

Similar jobs that could be interesting for youBased on the Big Data Software Engineer in Annapolis Junction, MD vacancy

Senior Software Engineer - Data Ingest (TS/SCI w/Poly)
$146k - $234k
...of web-based applications that automate data management for IC data custodians. The products... ...flexible hours.The team is seeking a Software Engineer to:Devise strategies to extract meaning... ...libraries against dataSkilled with big data processing frameworks such as Pig,...
Big data
Contract work
Flexible hours
Shift work
Peraton Corporation
Annapolis Junction, MD
14 hours ago
Senior Data & AI Visualization Engineer
...Ready to turn raw data into stories that empower decision-makers? In this role, you’ll... ...analytics and unstructured data extraction. Big Data Frameworks: Experience with... ...-scale enterprise data. Collaborative Engineering: Familiarity with Agile development practices...
Big data
Annapolis Junction, MD
a month ago
Full Stack Software Engineer Data Analytics Team- Fully Cleared
$203k - $260k
...hands of mission operators. As a Full Stack Software Engineer supporting the team, you will build tools that turn complex data into actionable insight for real-world operations... ...Experience working in large-scale or big data environments Experience administering...
Big data
Full time
Immediate start
Shift work
Intelliforce-it Solutions Group
Annapolis Junction, MD
2 days ago
Senior Data Platform Engineer
$205k - $215k
...Requirements: ~5 years of experience as a software engineer ~ Bachelor’s degree in a technical... ...responsible for creating and maintaining data workflows and automation pipelines using... ...Experience using Distributed Big Data processing engines including Apache...
Big data
16 hours
Full time
Immediate start
Remote work
Shield Consulting Solutions
Annapolis Junction, MD
27 days ago
Principal Analytic Software Engineer
$200k - $280k
...this level of clearance.*** Are you a Principal Analytic Software Engineer who is ready for a new challenge that will launch your career... ...Enterprise capabilities include Full-Stack Application Development, Big Data, Cloud Technologies, Analytics, Machine Learning, AI, and...
Big data
Full time
Contract work
Remote work
Work from home
Relocation package
GliaCell Technologies
Laurel, MD
a month ago
Software Engineer - Hybrid
$160k - $185k
Position Description:The Software Engineer shall be responsible for creating and maintaining data workflows and automation pipelines using Apache Airflow. This role focuses... ...complex workflowsExperience using Distributed Big Data processing engines including Apache Spark...
Big data
Red Arch Solutions
Annapolis Junction, MD
4 days ago
Data Engineer IV
...Acquisition Email ****@*****.*** Tharros is seeking a Lead Data Engineer to support a Department of Defense customer in designing,... ...integrate large and diverse data sets, and leverage SQL and AWS big data technologies to improve the availability, reliability, and...
Big data
Full time
Jimmy Jazz
Laurel, MD
3 days ago
Data Analytics Engineer
...points, but we love the work!) In this key Data Engineering role, you'll get to build the workflow... ...to automate manual processes Recent software development experience using Python... ...workflows Experience using Distributed Big Data processing engines including Apache...
Big data
Visa sponsorship
Work visa
GIGATEC Engineering
Annapolis Junction, MD
2 days ago
Senior Software Engineer — Mission Analytics & ML
Leidos is seeking a Senior Software Engineer in the Intel Sector to develop custom analytics, prototype data-driven tools, and deliver scalable analytics solutions. The role... ...products. Ideal candidates bring experience with big data, ML, AI, LLMs, and a track record of...
Big data
Leidos
Savage, MD
1 day ago
Big Data Engineer
...training Basic Requirements: ~14 years of experience as a software engineer ~ Bachelor’s degree in a technical discipline ~4... ...Accumulo ingest (streaming and bulk imports) Familiarity with the Data Warehouse and their processing pipelines. ---------- Excellent...
Big data
16 hours
Full time
Immediate start
Remote work
Shield Consulting Solutions
Annapolis Junction, MD
23 days ago
Senior Data Engineer
$230k - $240k
...Requirements: ~7 years of experience as a software engineer ~ Bachelor’s degree in a technical... ...extensive expertise in dataflow design, data transport mechanisms, and Apache Spark based... ...Experience with Distributed Big Data processing engines including Apache...
Big data
Full time
Immediate start
Remote work
Shield Consulting Solutions
Annapolis Junction, MD
more than 2 months ago
Data Software Engineer
...is a growing company bringing complete engineering services and true full lifecycle System... ...expertise in high performance computing, large data analytics and cutting edge information... ...(8) years of demonstrated experience in Software Engineering with a Bachelor's degree in...
Sagecor Solutions
Laurel, MD
23 hours ago
Software Engineer w/ Poly SWE1
$91.2k - $169.4k
...fosters collaboration with other senior engineers for the development of advanced data analytics solutions and agile... ...This Program is seeking a full stack software engineer to develop, maintain and... ...Hadoop, Hive, Pig etc.), Distributed Big Data Store (NoSQL), JSON, and...
Big data
Full time
Temporary work
Work experience placement
Casual work
Flexible hours
Lockheed Martin
Annapolis Junction, MD
1 day ago
Experienced Software Engineer (Prime)
$176k - $226k
...Mission Analytics Software Engineer Make an impact where it matters most. Join a team building... ...mission users connect the dots across SIGINT data, activities, and knowledge. This work... ...experience with distributed, scalable big data stores such as HBase, CloudBase or...
Big data
Long term contract
Immediate start
Visa sponsorship
Intelliforce-IT Solutions Group, LLC.
Annapolis Junction, MD
4 days ago
Software Engineer 2
$152.15k - $205.85k
...Software Engineer Senior Location: USA MD Annapolis Junction Full Part/Time: Full time Job Req... ...responsible for creating and maintaining data workflows and automation pipelines using... ...workflows Experience using Distributed Big Data processing engines including Apache...
Big data
Full time
Part time
Remote work
General Dynamics
Annapolis Junction, MD
4 days ago
Senior Big Data Engineer
$186k - $220k
...SECURITY CLEARANCE AT THE TS/SCI POLYGRAPH LEVEL IS REQUIRED We are seeking a hands-on, heavy-hitting Software Engineer specializing in distributed big data infrastructure and processing to join our team in Annapolis Junction, MD. In this role, you will design,...
Big data
Hourly pay
Contract work
Work experience placement
Immediate start
Flexible hours
Nyla Technology Solutions
Annapolis Junction, MD
8 days ago
Software Engineer / UI / Data / StreamLit
...production interface while bridging front-end engineering, data workflows, and future enterprise reach.... ...to automate manual processes Recent software development experience using Python... ..., and Vue Familiar with Distributed Big Data processing engines including...
Big data
Part time
Visa sponsorship
Work visa
Gigatec Engineering
Annapolis Junction, MD
14 hours ago
Software Engineer (Prime)
$139k - $170k
...Software Engineer, Workflow Awareness Make an impact where it matters most. Join a team building... ...and awareness, helping users see where data has been, what state it is in now, what... ...cloud experience with distributed, scalable big data stores such as HBase, CloudBase or...
Big data
Long term contract
Immediate start
Visa sponsorship
Intelliforce-IT Solutions Group, LLC.
Annapolis Junction, MD
4 days ago
Software Engineer
$139k - $179k
...Software Engineer — Java / Big Data / Cloud Make an Impact Where It Matters Most At Intelliforce, we build mission-ready engineering solutions that directly support national security operations. In this role, you will help develop large-scale data processing capabilities...
Big data
Immediate start
Visa sponsorship
Intelliforce-IT Solutions Group, LLC.
Annapolis Junction, MD
14 hours ago
Junior Software Engineer
$10k
...Junior Software Engineer When you love the work you do, any mission is possible. Position:... ...Software Developer to support geolocation and data integration initiatives within a data... ...Java and Python Experience with big data and distributed processing frameworks...
Big data
Extra income
Tiber Technologies Inc
Annapolis Junction, MD
22 hours ago
Senior Python Software Engineer
$170k - $230k
...do not possess this level of clearance. Are you a Senior Software Engineer who is ready for a new challenge that will launch your career... ...capabilities include Full-Stack Application Development, Big Data, Cloud Technologies, Analytics, Machine Learning, AI, and DevOps...
Big data
Full time
Contract work
Remote work
Work from home
Relocation package
GliaCell Technologies LLC
Laurel, MD
4 days ago
Software Engineer
...Software Engineer One of our partners is seeking a Software Engineer to join their team. The company... ...business value to customers through their data, whether that be in the cloud or on-prem, derived through traditional big data approaches or AI/ML techniques. Our core...
Big data
Remote work
ClearanceJobs
Annapolis Junction, MD
4 days ago
Senior Data Engineer
$186k - $220k
...ACTIVE SECURITY CLEARANCE AT THE TS/SCI POLYGRAPH LEVEL IS REQUIRED We are seeking a versatile, heavy-hitting Software Engineer with deep big data and cloud expertise to join our team in Annapolis Junction, MD. In this role, you will architect, maintain, and scale...
Big data
Hourly pay
Contract work
Work experience placement
Immediate start
Flexible hours
Nyla Technology Solutions
Annapolis Junction, MD
8 days ago
Software Engineer (SWE) Skill Level 2
...Kaizen Approach is currently seeking a Software Engineer (SWE) to develop, maintain, and enhance... ...analytics, algorithm development, large data manipulation, real-time systems, and business... ...environments, including distributed Big Data stores (e.g., HBase, CloudBase/Accumulo...
Big data
Contract work
Work experience placement
Kaizen Approach
Annapolis Junction, MD
14 hours ago
Sustainment Software Engineer 1
$140k - $160k
...Sustainment Software Engineer 1 Annapolis Junction, Maryland Are you ready to make a significant... ...system engineers; analyze systems flow, data usage and work processes; and... ...Infrastructure Services, Cyber Security, and Big Data Engineering. T-Rex is constantly...
Big data
Work experience placement
Immediate start
T-Rex Solutions, LLC
Annapolis Junction, MD
14 hours ago
Full Stack Software Engineer
$203k - $260k
...Full Stack Software Engineer — Data Analytics Team Make an Impact Where It Matters Most At Intelliforce, we put powerful technology directly... ...with React Experience working in large-scale or big data environments Experience administering or developing...
Big data
Immediate start
Visa sponsorship
Intelliforce-IT Solutions Group, LLC.
Annapolis Junction, MD
14 hours ago
Data Flow Engineer
...Pointer Technologies is seeking a talented Data Flow and ETL Engineer to design, implement, and maintain... ...with data scientists, analysts, and software engineers to understand data needs and... ...concepts. Nice To Have Experience with big data technologies (e.g., Hadoop, Spark...
Big data
Temporary work
Immediate start
Flexible hours
Pointer Technologies
Annapolis Junction, MD
6 days ago
Senior Data Analytics Engineer
$186k - $220k
...CLEARANCE AT THE TS/SCI POLYGRAPH LEVEL IS REQUIRED As a Software Engineer on Team Nyla, you will bring your technical creativity and... ...Familiarity with cloud-native architectures, microservices, or big data processing framework tools. Active involvement in...
Big data
Hourly pay
Contract work
Work experience placement
Immediate start
Flexible hours
Nyla Technology Solutions
Annapolis Junction, MD
8 days ago
Senior Full Stack Software Engineer (Partial Telework)
$170k - $230k
...do not possess this level of clearance. Are you a Senior Software Engineer who is ready for a new challenge that will launch your career... ...capabilities include Full-Stack Application Development, Big Data, Cloud Technologies, Analytics, Machine Learning, AI, and DevOps...
Big data
16 hours
Full time
Contract work
Remote work
Work from home
Relocation package
GliaCell Technologies LLC
Annapolis Junction, MD
1 day ago
Software Engineer 2 (IDN - 143)
...growing company bringing complete engineering services and true full... ...performance computing, large data analytics and cutting edge information... ...manual processes - Recent software development experience using... ...- Familiar with Distributed Big Data processing engines including...
Big data
Full time
Sagecor Solutions
Maryland, MD
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Software Engineer. Be the first to apply!