Senior Data Engineer
Cedent Life Talent
Senior Data Engineer, CASM Platform
As a Senior Data Engineer, CASM Platform, you will:
- Data Integration, API Development: Integrate diverse cybersecurity data sources using variety of API mechanisms and to standardize and streamline data across the data and user planes.
- Build and maintain data APIs for seamless access to data pipelines, enabling real-time insights for applications, machine learning models, and analytical layers.
- Data Pipeline Engineering Optimization: Design, develop, and optimize large-scale ETL/ELT pipelines on Databricks to efficiently process and transform cybersecurity data. Utilize Python, PySpark, and Databricks to automate and standardize data workflows across stages (raw, cleaned, curated), ensuring scalability and high performance.
- Data Quality & Governance: Implement automated data quality checks, leveraging Databricks DQM tools and CI/CD pipelines to uphold data integrity and governance standards. Ensure data lineage, metadata management, and compliance with cybersecurity and privacy regulations, applying rigorous quality standards across data ingestion and processing workflows.
- Data Analytics & Visualization: Design centralized data models and perform in-depth data analysis to support cybersecurity and risk management objectives. Develop visualizations and dashboards using tools like Databricks, encapsulate data to spin up to React.js application layer to provide stakeholders with actionable insights into threat landscapes, vulnerability trends, and performance metrics across the platform.
- Scalable & Secure Data Architecture: Architect and manage secure, high-performance data environments on Databricks, utilizing AWS services such as S3, ELB, and Lambda. Ensure data availability, consistency, and security, aligning with AWS best practices and data encryption standards to safeguard sensitive cybersecurity data.
- Agile Product; Engineering Continuous Delivery: Collaborate with advanced Agile Product; Engineering cross-functional teams to deliver data-driven insights through analytics tools and custom visualizations that inform strategy and decision-making. Empower stakeholders with timely, actionable intelligence from complex data analyses, enhancing their ability to respond to evolving cybersecurity risks.
- Data Science & ML Integration: Deploy machine learning models, including predictive analytics, anomaly detection, and risk scoring algorithms, into the CASM platform. Leverage Python and PySpark to enable real-time and batch processing of model outputs, enhancing CASM Platform's proactive threat detection and response capabilities.
- Mentorship; Best Practices Promotion: Mentor junior engineers, establishing best practices in data engineering, DevOps, data science, and analytics. Encourage high standards in model deployment, data security, performance optimization, and visualization practices, fostering a culture of innovation and excellence.
Education Qualifications:
Minimum Qualifications • Education: B.S., M.S., or Ph.D. in Computer Science, Data Science, Information Systems, or a related field, or equivalent professional experience. • Technical Expertise: 8+ years in data engineering with strong skills in Python, PySpark, SQL, and extensive, hands-on experience with Databricks and big data frameworks. Expertise in integrating data science workflows and deploying ML models for real-time and batch processing within a cybersecurity context. • Cloud Proficiency: Advanced proficiency in AWS, including EC2, S3, Lambda, ELB, and container orchestration (Docker, Kubernetes). Experience in managing large-scale data environments on AWS, optimizing for performance, security, and compliance. • Security Integration: Proven experience implementing SCAS, SAST, DAST/WAS, and secure DevOps practices within an SDLC framework to ensure data security and compliance in a high- stakes cybersecurity environment. • Data Architecture: Demonstrated ability to design and implement complex data architectures, including data lakes, data warehouses, and lake house solutions. Emphasis on secure, scalable, and highly available data structures that support ML-driven insights and real-time analytics. • Data Quality ; Governance: Hands-on experience with automated data quality checks, data lineage, and governance standards. Proficiency in Databricks DQM or similar tools to enforce data integrity and compliance across pipelines. • Data Analytics; Visualization: Proficiency with analytics and visualization tools such as Databricks, Power BI, and Tableau to generate actionable insights for cybersecurity risks, threat patterns, and vulnerability trends. Skilled in translating complex data into accessible visuals and reports for cross-functional teams. • CI/CD and Automation: Experience building CI/CD pipelines that automate testing, security scans, and deployment processes. Proficiency in deploying ML models and data processing workflows using CI/CD, ensuring consistent quality and streamlined delivery. • Agile Experience: Deep experience in Agile/Scrum environments, with a thorough understanding of Agile core values and principles, effectively delivering complex projects with agility and cross-functional collaboration.
Preferred Experience:
• Advanced Data Modeling; Governance: Expertise in designing data models for cybersecurity data analytics, emphasizing data lineage, federation, governance, and compliance. Experience ensuring security and privacy within data architectures. • Machine Learning; Predictive Analytics: Experience deploying ML algorithms, predictive models, and anomaly detection frameworks to bolster CASM platform's cybersecurity capabilities. • High-Performance Engineering Culture: Background in mentoring engineers in data engineering best practices, promoting data science, ML, and analytics integration, and fostering a culture of collaboration and continuous improvement.
- ...Our client is currently seeking a Senior Data Engineer Position Summary We're seeking a Senior Data Engineer with a strong backend foundation to build and operate data pipelines and ML-enabled services on Azure. Requirements •4+ years of...Senior
- ...Senior Data Engineer Location - Pittsburgh, Boston, Toronto or Montreal (Remote north East US considered) Why Confluence? At Confluence, we've always been driven by a commitment to innovation, precision, and partnership in the investment data space. Our global...SeniorPermanent employmentRemote workFlexible hours
- ...Embrark Data Strategy Role This is an exciting phase in our growth that has created a unique opportunity to be involved in the... ...data strategy. You will be working on the Business Intelligence Engineering team and partnering with the Product, Marketing, and Finance teams...Senior
- Senior to Principal Data Engineer (SQLserver, Financial Services), Boston, MA. Hybrid, min 3 days week in office, 135k to 175k base on experienceCompensation Commensurate with experience, EOE, diverse highly educated culture Candidates must be a U.S. citizen or national...SeniorPermanent employmentContract workWork at officeLocal area3 days per week
$125.24k - $187.86k
...the U.S. Visa sponsorship/sponsorship assumption and other immigration support are not available for this position. As a Senior Data Engineer on the Data Platform team, you will build the data foundation that Lyric's products run on. Data Platform team owns the canonical...SeniorPermanent employmentFull timeRemote workVisa sponsorship$115k - $150k
About the jobSenior Associate, Data Products | Finance | Boston, MAOverviewJoin a high-performing investment-focused organization as... ...platforms.Required Experience6+ years of experience in Data Engineering, Data Platform Engineering, or Software Engineering.Deep expertise...SeniorWork at office3 days per week$300k
Senior Data EngineerOur client is one of the world's largest privately held investment management firms, overseeing hundreds of billions... ...best practices across the organizationPartner closely with engineering, data, business, and investment stakeholders to translate complex...Senior- Description At Liberty Mutual Investments Technology, we are seeking a skilled Senior Data Engineer who is ready to take on exciting challenges, contribute to our cloud-native data platform, and make a real impact across our investment insights. You will build modern...SeniorWork at officeLocal area
$140k - $200k
Boston, MAHybridFull Time$140k - $200k Job Description A rapidly growing scientific data and AI technology company is seeking a Senior Scientific Data Engineer to join its fully remote team. This role offers the opportunity to work at the intersection of data engineering...SeniorFull timeTemporary workImmediate startRemote work$175.5k - $180k
...technical owner, designing and leading the implementation of scalable data architectures for cutting-edge AI and agentic systems. You will... .... You will also spearhead the design of complex feature engineering workstreams, ensuring our data assets are not only robust but also...SeniorApprenticeshipEasy work- Senior Data Engineer - Boston, United StatesWe are partnering with our client, a leading institutional asset manager based in Boston's financial district, to appoint a Senior Data Engineer to join our client's team. In this permanent role, you will be instrumental in building...SeniorPermanent employmentWork at officeRemote workMonday to Friday
$195.3k - $199.2k
.... In this role you will design, develop, and maintain scalable data pipelines and systems using Databricks on Azure (among other environments... ...sharing capabilities. You will be leading and executing data engineering projects from inception to completion, ensuring timely delivery...SeniorApprenticeshipEasy work- Senior Investment Data Engineer, Boston, MA, Hybrid, 2 days in, 150k to 190kCompensation Commensurate with experience, bonus, benefits, EOE, diverse highly educated cultureCandidates must be a U.S. citizen or national, refugee, asylum, or lawful permanent resident. Principals...SeniorPermanent employmentWork experience placementCasual workWork at office
- ...Vice President, Senior Data Engineer About the Company Mission-driven provider of tax credit syndication services Industry Real Estate Type Privately Held Founded 2001 Employees 51-200 Specialties lihtc tax credit syndication low income...Senior
$140k - $160k
...that enables organizations to share and analyze sensitive data at speed without compromising security or control. VIA’s decentralized... .... An impressive mission requires an equally impressive Senior Data Analytics Engineer. As a Senior Data Analytics Engineer at VIA, you'll...SeniorSummer workRemote workWork from homeFlexible hours$176k - $179.5k
...patients. You will design and manage scalable data pipelines and secure analytics platforms,... ...data scientists, machine learning engineers, and industry experts to develop impactful... ...McKinsey. There is flexibility to hire at the Senior Data Engineer I/II or Principal Data...SeniorApprenticeshipEasy workShift work$140k - $200k
DescriptionAbout TetraScienceTetraScience is the Scientific Data and AI Company building Tetra OS, the operating system for... ...DoYou will join TetraScience's forward deployed teams as a senior, hands-on engineer. In this role, you will work directly with biotech, pharmaceutical...SeniorFull timeImmediate startFlexible hours$90k - $180k
...perspectives with those of our clients.About the RoleSenior Data EngineerPOSITIONTracing our roots to 1928, we are one of the... ...part of continued growth, a new opportunity has arisen for a Senior Data Engineer. As a member of the Science Research Technology team, this individual...SeniorFull timeRemote workFlexible hours1 day per week$125k - $180k
...time.We are building the Patient Evaluation Engine: a high-scale, multi-modal healthcare... ...autonomous AI agents reason over clinical data to drive real-time clinical evaluation across... ...of hospitals. We are looking for a Senior Data Engineer to build and own the data platform...SeniorFull timeRemote work$135k - $141.75k
...recognized as one of the industry's best firms to work for. For more information, visitlek.com.About the Role:We are seeking a Senior Data Engineer with deep expertise in data engineering and a strong working command of AI and LLM tech stacks. This role sits within our...SeniorPermanent employmentH1bLocal areaWorldwideHome office$120k - $202.5k
Who we are looking for We are looking for a Senior SIEM Data Engineer reporting directly to the Cyber Data Engineering Manager. You will lead the design, onboarding, transformation, validation, and operational support of cybersecurity telemetry and enterprise log data used...SeniorFull timeTemporary workWork experience placementWork at officeLocal areaFlexible hours- ...passionate about getting physicians and healthcare providers away from the keyboard and back to clinical care. Overview The Senior Data Engineer is a member of the Data Platform team, reporting to the Director of Machine Learning Engineering and Data. The Data Platform...SeniorFull timeTemporary workWork at office
$135k - $170k
...Data Engineer At EF World Journeys, we believe that the best way to learn about the world is to experience it, and we strive to help as... ...at local venues and businesses. Compensation range for the Senior Analytics Engineer role is $135,000-$170,000, based on experience...SeniorLocal areaFlexible hours$68 - $73.33 per hour
...Job Title: Senior Analytics Engineer Location: Boston, MA Type: Contract Compensation: $68-$73.33/hr Work Model: Remote Hours: 8... ...Engineer leads the design and development of the analytics data architecture, semantic models, and data pipelines that power...SeniorFull timeContract workLocal areaRemote work$165k - $209k
...solvers that share our passion for impact to join us! Position Summary: We are seeking a highly skilled, hands-on Senior / Principal Data Infrastructure Engineer to design, build, and own the data systems that make our proteomics data discoverable, trustworthy, and usable...Senior- Description The USRM Data Office turns data into a competitive advantage. As a Principal... ...prototypes, and partnering with data engineers to deliver scalable data products on Snowflake... ...business partners, technical teams, and senior leaders.Explore emerging technologies and...SeniorWork experience placementWork at officeLocal area
$77k - $214k
...ApplicableSpecialismSoftware EngineeringManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs a Forward Deployed Data Engineering - Senior Associate, you will be at the forefront of developing innovative software solutions that drive digital transformation and...SeniorFull timeH1b$183k - $243k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...for our data platformPartner with operations, product, and engineering to advocate best practices and build supporting systems and infrastructure...SeniorFull timeWork experience placementImmediate startShift work$80 - $100 per hour
Boston, MAHybridContract$80/hr - $100/hrWe are seeking a Senior Analytics Engineer for a contract-to-hire opportunity with a well-established organization... .... This role will focus on leading the design of analytics data architecture, semantic models, and data pipelines using SQL...SeniorFull timeContract workTemporary workFlexible hours- ...Job Description Job Description Senior Analytics Engineer – Data Architecture, dbt, SQL & AI Job Title: Senior Analytics Engineer Job ID: 1006 Location: Boston, MA Duration: 12 Months Contract Work Arrangement: Remote/Hybrid – Preference for candidates...SeniorContract workLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
- junior data engineer remote Boston, MA
- data platform engineer Boston, MA
- principal data engineer Boston, MA
- data engineer analytics Boston, MA
- data science developer Boston, MA
- data engineer manager Boston, MA
- big data developer Boston, MA
- big data devops engineer Boston, MA
- data center engineer Boston, MA
- big data cloud engineer Boston, MA




