Senior Big Data Engineer
Software Technology Inc
Sr. Big Data Engineer
This role will be responsible for transforming extensive and complex data into consumable business capabilities. Create system architecture, design, and specification using in-depth engineering skills and knowledge to solve complex development problems and achieve engineering goals. Determine and source appropriate data for a given analysis. Work with data modelers/analysts to understand the business problems they are trying to solve, then create or augment data assets to feed their analysis. Acts as a resource and mentor for colleagues with less experience.
Core responsibilities include:
- Leading a team of data engineers to develop data products and tools, explore new technologies, and continually improve tools and processes
- Hands-on experience working with Data Analysis and Architecture, Spark, PySpark, Python, Sqoop, Pig, Hive, No SQL Data Stores, Object Store, Design and Development of APIs, Kafka
- Creating business value by leading the design, writing code, and deploying big data and machine learning capabilities
- Possessing expert knowledge in performance, large-scale data distributed system scalability, system architecture, and data engineering best practices
- Prioritizing operational excellence, evaluating system performance, security, designing system metrics, and driving quality improvements
- Providing leadership, working collaboratively, and being a mentor in a fantastic team
- Ability to produce both detailed technical work and high-level architectural designs
Requirements include:
- 7+ years of recent hands-on in an object-oriented language (Java, Scala, Python)
- 5+ years of experience designing and building data pipelines and data-intensive applications
- Experience using Big Data frameworks (e.g., Hadoop, Spark), databases for complex data assembly and transformation
- Experience working with Healthcare data is a plus
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer in United States vacancy
- ...MANTECH seeks a motivated, career and customer-oriented Senior Data Engineer to join our team in Chantilly, VA. In this role, you will leverage... ..., loading, and large-scale ingestion systems within a Big Data environment. Develop ad-hoc ETL pipelines and build data...SeniorBig dataWork at office
MANTECH
Chantilly, Loudoun County, VA11 hours ago - We are seeking a skilled Data Engineer with strong handson expertise in Hadoop ecosystem technologies particularly in onpremise environments... ...using SqoopStrong knowledge of distributed data processing and big data conceptsAbility to design develop and maintain scalable data...SeniorBig data
- Job Title: Sr. DATA Engineer Work LocationTampa FLJob Description:Mandatory Karat InterviewRole Overview We are seeking a highly skilled and... ...AWS ecosystem The ideal candidate will have strong expertise in big data processing using PySpark and a deep understanding of data...SeniorBig data
- ...Senior Data Engineer Experience: 13 to 16 yrs. Top 2 Must Haves: 1. Graph DB hands on experience 2. AWS services Job Summary: - Analyzing... ...Certification - 15+ years of hands-on experience in big data tools, infrastructure and related tech Roles & Responsibilities...SeniorBig data
Keylent Inc
Columbus, OH1 day ago - About the RoleAs Senior Software Engineer, you will collaborate closely with design, product and engineering... ...critical thinking, experimentation, data, and industry best practices to... ...departmentAdditional tasks may be assignedAddendumSENIOR BIG DATA SOFTWARE ENGINEERDevelop, automate...SeniorBig dataRemote work
$250k - $300k
...deep fundamental research and applying data science and engineering techniques to alternative data sets.... ...structured and unstructured data sets. As a senior member of our Data Engineering team,... ...role, you will:Develop and support big data processing pipelines including but...SeniorBig dataWork experience placement$116.1k - $170.28k
...About the Role: We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map...SeniorBig dataRemote jobFull timeRackspace
Remote11 hours ago- ...Data Solutions Architect We are seeking a skilled professional with strong expertise in SQL, Python, Spark, and leading AI/ML frameworks... .... The ideal candidate will have hands-on experience with big data platforms and distributed data processing. Key Responsibilities...SeniorBig data
Omni Inclusive
Denver, CO1 day ago - ...Description Skill Agile, Civil, Database, Data Mining, Developer, Development, Java,... ...or more years of experience in a Software Engineer, Software Developer, and/or Programmer role... ...Java with a focus on backend/database, and Big Data solutions * Demonstrated skill across...SeniorBig dataFull time
Jobsbridge
Remote11 hours ago - Position Description: We are looking for a Senior Data Engineer that will play a critical role in shaping our data innovations. They will help create cutting-edge Big Data solutions by leveraging their prior industrial experience. This role requires close collaboration...SeniorBig dataFull time
Partech
Remote11 days ago - ...Senior Data Lake Engineer/Developer-Tech Lead Duration: 6 months CTH Location: New York Hands-on Tech lead responsible for designing a large... ...solving skills, and algorithms. Must Haves: Strong experience in Big Data Technologies such as Hadoop Data Management Tools for...SeniorBig data
Cardinal Integrated
New York, NY1 day ago - Our team plays a crucial role in the data ecosystem of the TikTok Recommendation System... ...degree or above in computer science, software engineering, or related fields, with experience in... ...:- Experience in using other big-data systems/frameworks (such as Hive, HBase...SeniorBig dataFlexible hours
- ...candidate is an inquisitive learner with a passion for security, data and analytics.The candidate must effectively collaborate with stakeholders... ...) as well as advanced designer experience in encapsulation of big data displayed via visualization toolkits aimed to drive action...SeniorBig data
- ...Must haves: Very Strong Java or Python coding. Looking for true software engineering skill set. Experience working with large data sets, ETL, or applications that do high-volume data collection. Spark or other large scale data processing AWS - should have...SeniorBig data
Apex Informatics
Murphy, TX4 days ago $175k - $221k
...content intelligence.If you’re inspired to dream big, innovate fast, and make a difference, we’d love... ...A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming pipelines...SeniorBig dataFull timeLocal areaWork from home- ...petrochemicals; and 14 billion cubic feet of natural gas storage capacity.We are currently seeking an experienced Python Software Engineer to join the Big Data and Advanced Analytics department. The Python Software Engineer will work closely with Data Engineers and Data...SeniorBig data
$50 - $60 per hour
...Title: Senior Big Data Engineer Location: Mississauga, ON Employment Type: Contract Compensation: Pay Range:$50.00-$60.00 Per HR Description Join our dynamic team as a Senior Big Data Engineer in a hybrid role based in Canada. This contract...SeniorBig dataContract workWork experience placementMitchell Martin
Tampa, FL3 days ago- Req ID:374073NTT DATA strives to hire exceptional, innovative and passionate individuals... ..., apply now.We are currently seeking a Senior AWS Data Engineer to join our team in Atlanta, Georgia (... .../Professional or AWS Certified Big Data Specialty.Experience with real-time...SeniorBig dataContract workWork at officeRemote workFlexible hours
- ...we are investing heavily in technology, data, and innovation to deliver exceptional subscriber... ...and drive long-term business growth.The Senior Data Engineer will play a key role in the design,... ...large-scale distributed systems and big data technologies, including Spark, and...SeniorBig dataFull timeWork at office
- ...Data Engineering Remote / Texas, USA Full-time Design and build data pipelines, ETL systems, and analytics platforms. Expertise in big data technologies and cloud platforms required. Responsibilities Design and build scalable data pipelines and ETL systems Implement data...SeniorBig dataFull timeRemote work
QuadSoft Inc
Wausau, WI4 days ago - ...Senior Data Engineer Work Location: Charlotte, NC 28203 (hybrid – 2 days onsite per week)(Locals) Contract duration: 12 months Target Start... ...25 Visa: USC and GC only Must Have Skills: Spark, Python, Big Data, AWS We are currently seeking a Senior Data Engineer...SeniorBig dataContract workLocal area2 days per week
Argyle Infotech
Charlotte, NC1 day ago - ...environment and you take the time to celebrate both the small & big wins. INCLUSION is a core tenant of your personal beliefs. A... ...you navigate our interview process.Lantern is looking for a Senior Data Engineer to join our Data Engineering team. The ideal candidate will...SeniorBig data
$98k - $169.05k
84.51 Overview:84.51 is a retail data science, insights and media company. We help The... ...___________________________________As a Senior Data Engineer, you will have the opportunity to build... ...ingest, transform, store, and distribute our big data to be consumed by data scientists...SeniorBig dataWork at office- ...Sr. Data Engineer Sr. Data Engineer ideally with GCP experience, mainly Dataflow and Apache Beam (Java). If not GCP, AWS or Azure. Additionally... ...background and hands on knowledge. ~ Past experience with big data technologies including HDFS, Spark, Impala, Hive ~...SeniorBig dataWork experience placementRemote work
Software Technology Inc
United States22 hours ago $150k - $200k
...and software systems are continually re-engineered, optimized, and maintained to stay on top... ...Trading is looking for a proven Senior Data Engineer to work directly with our trading... ...NeedExperience designing and developing big data warehouses and ETL pipelines.Proven...SeniorBig dataFull time$174.72k - $295.68k
...learning, and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset... ...in programming languages like Python or SQL.Experience with Big Data tools and cloud platforms (e.g., AWS, GCP, BigQuery)....SeniorBig dataFull time$125k - $165k
...technology landscape, an organization’s data has never been a more important aspect in... ...are looking for seasoned Senior Data Engineer to work with our team and our clients to... ...Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational...SeniorBig data- As a Senior Data Engineer, CASM Platform, you will: Data Integration, API Development: Integrate diverse cybersecurity data sources using variety... ...SQL, and extensive, hands-on experience with Databricks and big data frameworks. Expertise in integrating data science...SeniorBig dataContract work
- ...We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands-on experience building scalable data pipelines, migrating data from Hadoop...SeniorBig dataTemporary work
PB consulting
New York, NY4 days ago - ...HQL (Hive Query Language) Python Spark Pyspark Big data processing Software resource technical skill, such as; Pyspark... ...Good knowledge of Spark SQL. Strong in Software Programming/Engineering with a good understanding of DevOps, GitHub etc. Must know the...SeniorBig dataFlexible hours
Damco
United States3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Engineer. Be the first to apply!
Related searches
- data platform engineer United States
- aws data engineer United States
- azure data engineer United States
- data engineer freelance United States
- data engineer graduate United States
- big data devops engineer United States
- data pipeline engineer United States
- big data developer United States
- software data engineer United States
- data center engineer United States