Sr. Big Data Engineer
Samprasoft
Software Engineer IV - Big Data Engineer
Location: Durham, NC (Day 1 onsite)
Duration: Long Term
Responsibilities:
- Ability to assemble large, complex sets of data that meet non-functional and functional business requirements
- Ability to identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
- Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using Azure and SQL technologies
- Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
- Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
- Strong programming and analytical skills, problem determination and debugging, attention to detail, teamwork, and excellent communication skills.
- Knowledge of software development concepts/methodology/life cycle, especially Agile methodology
- Proficiency with code versioning tools like Git
- Proficiency with Windows- and Linux-based operating systems, including software installation, light administration and simple scripting.
Required Skills:
- Bachelor’s Degree in Computer Science or related field
- Strong analytical and Java programming skills
- Deep technical skills in software development technologies and tools such as socket communication, Python, DI, CI, Spring Boot, XML/JSON, Java, JavaScript, Docker, Dagger2, maven
- Experience in Cloud and Big Data technologies such as PowerShell, SQL, ADLS/Blob, Spark/SparkSQL, Databricks.
- 8+ years professional experience in software development
- 3+ years of cloud based or client/server development experience.
- 1+ years of Big Data development experience.
Preferred Skills:
- Experience implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML, etc.
- Experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL and data warehouse solutions
- Experience in Big data partitioning strategies, Azure ADF, Azure Databricks.
- Knowledge of cloud computing technologies
- Knowledge of non-relational databases
- Experience working on Azure SQL Server.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Sr. Big Data Engineer in Durham, NC vacancy
- ...Senior Technical Recruiter @ Seven Step | MBA, Global Talent Acquisition. Job Summary We are seeking an experienced Senior Big Data & Cloud Engineer to design, build, and deliver advanced API and data solutions that support financial goal planning, investment insights,...SeniorBig dataContract work
- Req ID: 32803At NTT DATA Services, we know that with the right people on board, anything is possible. The quality, integrity, and... ...who work here.NTT DATA Services currently seeks a Principal Big Data Engineer to join our team in Durham, North Carolina (US-NC), United...Big dataFor contractorsWork experience placement
- ...sponsorship for this position.Position Description:Builds data and reporting platforms in Cloud using Big Data technologies -- Hadoop, HBase, MongoDB, and... ...strategies.Develops and implements advanced data engineering frameworks.Recommends development testing tools and...Big dataFull time
- ...Sr Data Engineer Location: Philadelphia, PA/ Durham, NC Core engineering data skills. Strong in Python ideally using official SDKs to call REST APIs. Experience building ETL/ingestion pipelines: incremental syncs, idempotent upserts, backfills, error handling, retries...Senior
Yantran LLC
Durham, NC1 day ago - ...Data Engineer - AWS, Python, SQL Location: Hybrid Model (5 days in month), Durham NC, Westlake TX, Boston MA, New Jersey NJ Duration: Long term The Expertise and Skills You Bring: ~ Has Bachelor’s or Primary’s Degree in a technology related field (e.g. Engineering...Senior
Samprasoft
Durham, NC1 day ago - ...Senior Data Engineer We are the first publicly-traded biotech or pharmaceutical company to take the form of a public benefit corporation. Our public benefit purpose is to provide a brighter future for patients through the development of novel pharmaceutical therapies...SeniorWork at office3 days per week
IVIVA Medical
Durham, NC4 days ago - ...secure environment with clean data and deliver insights as part of... ...strategy for customers. The Sr Data Scientist will work on data... ...unstructured, diverse "big data" sources to generate actionable... ...Experience with advanced data engineering tools and frameworks (preferred...SeniorBig data
- Req ID:101764NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want... ...scenarios to test automation coverage across multiple toolsets (DW, E, Big Data).Experience in UAT testing, DB Testing, Regression Testing,...SeniorBig data
- NC FAST Senior Data Engineer Location: Research Triangle Park, Durham NC 27709 Client: State of NC DHHS-ITD requires the services of Specialists in the roles of Senior Data Engineer to lead data extraction, conversion, archival, de-identification, and migration efforts...SeniorContract work
- Join to apply for the Data Engineer role at BuildOps At BuildOps, we’re transforming the commercial contracting industry with our all-in-one... ...doing the best work of our careers. If you’re ready to tackle big challenges, work with a passionate team, and build something extraordinary...SeniorFull timeWork at officeWork from homeFlexible hours
$143.62k - $229.79k
Job DescriptionThe Principal Data Scientist will serve as the principal lead to provide... ...multiple large and/or complex data science and engineering projects.What You'll DoLead in the... ...issuesApply advanced conceptual understanding of Big Data systems to data set engineering and...Big dataFull timeLocal areaRemote workFlexible hours- ...Senior Cloud Data EngineerLocation: Durham North Carolina, Remote till CovidDuration: 12+ monthsThe Expertise and Skills You BringBachelor... ...required8+ years of total experience with 4+ years on data engineering in cloud native tools and technologiesStrong SQL knowledge and...SeniorWork experience placementRemote work
Samprasoft
Durham, NC3 days ago $110k - $140k
...Sunergi Inc. Machine Learning Engineer Full-time We are expanding rapidly and are... ...contributor on ML projects with a focus on data ingestion, transformation and presentation... ...robustness, efficiency and performance of big data platform and applications. Experience...Big dataFull timeRemote workSunergi
Durham, NCmore than 2 months ago- ...Role:- Data Engineer Location:- Durham, NC Primary Skills Informatica,Python,SQL The Expertise and Skills You Bring ~ Bachelor's Degree or equivalent in a technology related field (e.g. Computer Science, Engineering, etc.) required ~10+ years...Work experience placement
InterSources
Durham, NC5 days ago - ...Senior Data Engineer Fidelity Investments Workplace Solutions (WS) organization is looking for senior Data Engineers. This person will be playing a key role in designing and crafting a modern data and information delivery and analytics platform in the cloud to support...Work experience placement
Software Technology Inc
Durham, NC12 hours ago $65 per hour
...Data Engineer Rate:$65.00 Location: Durham, NC client:Fidelity Investments - Raleigh Durham The client, Fidelity, is initiating a migration project to enhance and update their current reporting infrastructure, aiming to move away from the existing ecosystem of Oracle...Argyle Infotech
Durham, NC2 days ago- ...Data Analytics Engineer Skanska is searching for a dynamic Data Analytics Engineer. This is a great opportunity to start a career with a company... ...you physically, financially, and emotionally through the big milestones and in your everyday life. Please visit the compensation...Full timeVisa sponsorship
Skanska constructions
Durham, NC4 days ago $300k
.... Position OverviewWe are seeking a Senior Information Security Engineer to lead the design, implementation and operation of security controls... ...to protect complex AI-driven environments and sensitive biotech data. The ideal candidate will translate technical risk into...SeniorWork at officeRelocation package- ...being kind and doing right by our customers, aiming to set a higher standard for the apparel industry. The Lead / Principal Data Engineer is the technical owner of Peter Millar’s modern data platform, responsible for the architecture, engineering standards, and production...Full timeSeasonal workLocal areaShift work
Peter Millar LLC
Durham, NCmore than 2 months ago - Join to apply for the Data Engineer role at Digital Turbine At Digital Turbine, we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide...Full timeLocal area
- ...Target RWE) combines deep health system partnerships, longitudinal data curation at scale, and modern study design to build continuous,... ...at pedestalhealth.com. The Role We are seeking a talented Data Engineer to join our Technology team. In this role, you will develop,...Work at office3 days per week
- Design and implement scalable data and AI platform solutions to advance Generative AI and Machine Learning capabilities. Bridge the... ...new data sources. Requirements Requires 5+ years of software engineering experience with strong SDLC discipline and proficiency in Python...Temporary work
- Hybrid two weeks onsite a month in either Merrimack, NH or Durham, NC We are seeking a Senior Data Engineer to build scalable data solutions within a highly collaborative technology team. The role focuses on Oracle PL/SQL, SQL scripting, ETL with Informatica, and data...
$50 - $53 per hour
Akkodis is seeking a Data Engineer for a Contract with a client in Durham, NC (Remote). The ideal candidate will be responsible for designing and developing end-to-end Power BI reporting solutions, operational dashboards, and scalable data architectures that support enterprise...Hourly payContract workTemporary workLocal areaRemote work- ...with a variety of challenges all while you enable life-changing, life-saving therapeutics to the patients who need them. The Data Engineer is a hands-on technical lead responsible for designing, building, and supporting BioAgilytix's Enterprise Data Platform. This role...Full timeTemporary workWork at officeLocal areaFlexible hoursAfternoon shift
BioAgilytix
Durham, NC3 days ago - ...Job Description Job Description Job Title: Data Engineer – Oracle Fusion & Data Platform Integration Location: Durham, NC (Hybrid) About the Role We are seeking a Data Engineer to join our growing data team to help design, build, and extend our data platform...
PiTech Solutions Inc
Durham, NC28 days ago - Job Summary:The Data Solutions Engineer designs, builds, and operates reliable, scalable data pipelines on PowerSecure’s Azure data platform to enable trusted analytics and selfservice BI. This role partners with BI Developers, the Data Architect, and business stakeholders...Full timeWork at officeVisa sponsorshipWork visaFlexible hours
- ...performance, availability and reliability Collaborating with team engineers to design and implement servers, storage, containers, network... ...across all areas of technologyThis person will work within the Data Cetner Operations team, its Partner engineers to provide key...Full timeWork experience placementLocal areaRemote work
- ...new era of industrial creativity, sustainability, precision, and resilience. Position Summary The Senior ML / AI Engineer sits within the Data Team’s AI, ML, and Data Science pod, supporting R&D, product development, and the build-out of Sennos’ advanced machine...SeniorFull timeWork at officeRemote workWork visa
Sennos Sennos
Durham, NCa month ago - ...Designs and implements batch and real-time data collection solutions using technologies (... ...similar frameworks). Collaborates with engineering team to define the overall system architecture... ...and building highly scalable Cloud-based Big Data applications according to business...Big dataFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Big Data Engineer. Be the first to apply!
Related searches
- finance data engineer Durham, NC
- data engineer machine learning Durham, NC
- senior data quality engineer Durham, NC
- aws data engineer Durham, NC
- data center engineer Durham, NC
- data engineer analytics Durham, NC
- senior data integration developer Durham, NC
- data developer Durham, NC
- etl data engineer Durham, NC
- senior data center engineer Durham, NC