Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

Cedent Consulting

As a Senior Data Engineer, CASM Platform, you will: Data Integration, API Development: Integrate diverse cybersecurity data sources using variety of API mechanisms and to standardize and streamline data across the data and user planes. Build and maintain data APIs for seamless access to data pipelines, enabling real-time insights for applications, machine learning models, and analytical layers. Data Pipeline Engineering Optimization: Design, develop, and optimize large-scale ETL/ELT pipelines on Databricks to efficiently process and transform cybersecurity data. Utilize Python, PySpark, and Databricks to automate and standardize data workflows across stages (raw, cleaned, curated), ensuring scalability and high performance. Data Quality & Governance: Implement automated data quality checks, leveraging Databricks DQM tools and CI/CD pipelines to uphold data integrity and governance standards. Ensure data lineage, metadata management, and compliance with cybersecurity and privacy regulations, applying rigorous quality standards across data ingestion and processing workflows. Data Analytics & Visualization: Design centralized data models and perform in-depth data analysis to support cybersecurity and risk management objectives. Develop visualizations and dashboards using tools like Databricks, encapsulate data to spin up to React.js application layer to provide stakeholders with actionable insights into threat landscapes, vulnerability trends, and performance metrics across the platform. Scalable & Secure Data Architecture: Architect and manage secure, high-performance data environments on Databricks, utilizing AWS services such as S3, ELB, and Lambda. Ensure data availability, consistency, and security, aligning with AWS best practices and data encryption standards to safeguard sensitive cybersecurity data. Agile Product; Engineering Continuous Delivery: Collaborate with advanced Agile Product; Engineering cross-functional teams to deliver data-driven insights through analytics tools and custom visualizations that inform strategy and decision-making. Empower stakeholders with timely, actionable intelligence from complex data analyses, enhancing their ability to respond to evolving cybersecurity risks. Data Science & ML Integration: deploy machine learning models, including predictive analytics, anomaly detection, and risk scoring algorithms, into the CASM platform. Leverage Python and PySpark to enable real-time and batch processing of model outputs, enhancing CASM Platform’s proactive threat detection and response capabilities. Mentorship; Best Practices Promotion: Mentor junior engineers, establishing best practices in data engineering, DevOps, data science, and analytics. Encourage high standards in model deployment, data security, performance optimization, and visualization practices, fostering a culture of innovation and excellence. Education Qualifications: Minimum Qualifications • Education: B.S., M.S., or Ph.D. in Computer Science, Data Science, Information Systems, or a related field, or equivalent professional experience. • Technical Expertise: 8+ years in data engineering with strong skills in Python, PySpark, SQL, and extensive, hands-on experience with Databricks and big data frameworks. Expertise in integrating data science workflows and deploying ML models for real-time and batch processing within a cybersecurity context. • Cloud Proficiency: Advanced proficiency in AWS, including EC2, S3, Lambda, ELB, and container orchestration (Docker, Kubernetes). Experience in managing large-scale data environments on AWS, optimizing for performance, security, and compliance. • Security Integration: Proven experience implementing SCAS, SAST, DAST/WAS, and secure DevOps practices within an SDLC framework to ensure data security and compliance in a high- stakes cybersecurity environment. • Data Architecture: Demonstrated ability to design and implement complex data architectures, including data lakes, data warehouses, and lake house solutions. Emphasis on secure, scalable, and highly available data structures that support ML-driven insights and real-time analytics. • Data Quality ; Governance: Hands-on experience with automated data quality checks, data lineage, and governance standards. Proficiency in Databricks DQM or similar tools to enforce data integrity and compliance across pipelines. • Data Analytics; Visualization: Proficiency with analytics and visualization tools such as Databricks, Power BI, and Tableau to generate actionable insights for cybersecurity risks, threat patterns, and vulnerability trends. Skilled in translating complex data into accessible visuals and reports for cross-functional teams. • CI/CD and Automation: Experience building CI/CD pipelines that automate testing, security scans, and deployment processes. Proficiency in deploying ML models and data processing workflows using CI/CD, ensuring consistent quality and streamlined delivery. • Agile Experience: Deep experience in Agile/Scrum environments, with a thorough understanding of Agile core values and principles, effectively delivering complex projects with agility and cross-functional collaboration. Preferred Experience: • Advanced Data Modeling; Governance: Expertise in designing data models for cybersecurity data analytics, emphasizing data lineage, federation, governance, and compliance. Experience ensuring security and privacy within data architectures. • Machine Learning; Predictive Analytics: Experience deploying ML algorithms, predictive models, and anomaly detection frameworks to bolster CASM platform’s cybersecurity capabilities. • High-Performance Engineering Culture: Background in mentoring engineers in data engineering best practices, promoting data science, ML, and analytics integration, and fostering a culture of collaboration and continuous improvement. Department: Preferred Vendors This is a contract position

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Boston, MA vacancy
  • $63 - $67 per hour

     ...Location: Boston, MA Salary: $63.00 USD Hourly - $67.00 USD Hourly Description: Our client is currently seeking a Senior Data Engineer Position Summary We're seeking a Senior Data Engineer with a strong backend foundation to build and operate data pipelines... 
    Senior
    Hourly pay

    Judge Group, Inc.

    Boston, MA
    2 days ago
  •  ...Embrark Data Strategy Role This is an exciting phase in our growth that has created a unique opportunity to be involved in the...  ...data strategy. You will be working on the Business Intelligence Engineering team and partnering with the Product, Marketing, and Finance teams... 
    Senior

    Software Technology Inc

    Boston, MA
    4 days ago
  •  ...Job Description Job Description Senior Analytics Engineer – Data Architecture, dbt, SQL & AI Job Title: Senior Analytics Engineer Job ID: 1006 Location: Boston, MA Duration: 12 Months Contract Work Arrangement: Remote/Hybrid – Preference for candidates... 
    Senior
    Contract work
    Local area
    Remote work

    Sigma Inc

    Boston, MA
    21 days ago
  •  ...passionate about getting physicians and healthcare providers away from the keyboard and back to clinical care. Overview The Senior Data Engineer is a member of the Data Platform team, reporting to the Director of Machine Learning Engineering and Data. The Data Platform... 
    Senior
    Full time
    Temporary work
    Work at office

    CODAMETRIX

    Boston, MA
    1 day ago
  •  ...additive manufacturing. About the Platform Engineering Team At ABCorp, we know that our...  ...Platform Engineering Team at ABCorp builds the data infrastructure layer that powers our...  ...scale. The Role ABCorp is seeking a Senior Data Engineer to own the data... 
    Senior
    Contract work
    Worldwide
    Visa sponsorship

    ABCorp

    Boston, MA
    2 days ago
  • $150k - $170k

     ...achieve exceptional outcomes. For more information visit: Bain Capital ABOUT THE ROLE We are seeking a highly motivated Senior Data Engineer to join our Private Markets Data Team. This role will be responsible for the design, implementation, and maintenance of data... 
    Senior

    Bain Capital

    Boston, MA
    3 days ago
  • $125k - $180k

     .... We are building the Patient Evaluation Engine: a high-scale, multi-modal healthcare platform...  ...AI agents reason over clinical data to drive real-time clinical evaluation across...  ...networks of hospitals. We are looking for a Senior Data Engineer to build and own the data... 
    Senior
    Full time
    Remote work

    Tempus

    Boston, MA
    1 hour ago
  • $125.24k - $187.86k

     ...the U.S. Visa sponsorship/sponsorship assumption and other immigration support are not available for this position. As a Senior Data Engineer on the Data Platform team, you will build the data foundation that Lyric's products run on. Data Platform team owns the canonical... 
    Senior
    Permanent employment
    Full time
    Remote work
    Visa sponsorship

    Lyric

    Boston, MA
    3 days ago
  • $140k - $175k

     ...deliver next-generation solutions that patients and healthcare partners need today and into the future. Job Description The Senior Data Engineer will be responsible for building and maintaining the platform that services timely and accurate data for operational teams... 
    Senior
    Full time
    Temporary work
    Work experience placement
    Remote work
    Work visa
    Flexible hours

    Fuze Health

    Milton, MA
    3 days ago
  • $90k - $180k

     ...believe our ownership structure fosters a long-term view that aligns our perspectives with those of our clients. About the Role Senior Data Engineer POSITION Tracing our roots to 1928, we are one of the world’s largest independent investment management firms. With over US$... 
    Senior
    Full time
    Remote work
    Flexible hours
    1 day per week

    Wellington Management

    Boston, MA
    2 days ago
  • $140k - $160k

     ...that enables organizations to share and analyze sensitive data at speed without compromising security or control. VIA’s decentralized...  .... An impressive mission requires an equally impressive Senior Data Analytics Engineer. As a Senior Data Analytics Engineer at VIA, you'll... 
    Senior
    Summer work
    Remote work
    Work from home
    Flexible hours

    Via Science

    Somerville, MA
    6 hours ago
  • $135k - $141.75k

     ...recognized as one of the industry's best firms to work for. For more information, visit lek.com . About the Role: We are seeking a Senior Data Engineer with deep expertise in data engineering and a strong working command of AI and LLM tech stacks. This role sits within our... 
    Senior
    Permanent employment
    H1b
    Local area
    Worldwide
    Home office

    L.E.K. Consulting

    Boston, MA
    3 days ago
  •  ...Vice President, Senior Data Engineer About the Company Mission-driven provider of tax credit syndication services Industry Real Estate Type Privately Held Founded 2001 Employees 51-200 Specialties lihtc tax credit syndication low income... 
    Senior

    Confidential

    Boston, MA
    3 days ago
  • $135k - $170k

     ...Data Engineer Position at EF World Journeys At EF World Journeys, we believe that the best way to learn about the world is to experience...  ...at local venues and businesses. Compensation range for the Senior Analytics Engineer role is $135,000-$170,000, based on... 
    Senior
    Local area
    Flexible hours

    EF World Journeys

    Boston, MA
    3 days ago
  • $68 - $73.33 per hour

     ...Job Title: Senior Analytics Engineer Location: Boston, MA Type: Contract Compensation: $68-$73.33/hr Work Model: Remote Hours: 8...  ...Engineer leads the design and development of the analytics data architecture, semantic models, and data pipelines that power... 
    Senior
    Full time
    Contract work
    Local area
    Remote work

    System One

    Boston, MA
    49 minutes ago
  • $250k

     ...Senior AI Data Engineer A high-growth organization is seeking a Senior AI Data Engineer to help build and scale the AI infrastructure that powers next-generation intelligent applications. This is a senior individual contributor role focused on developing production-grade... 
    Senior

    Huxley Associates

    Boston, MA
    2 days ago
  •  ...Job Description: Sr. Data Engineer – Data Ingestion Framework Python, DBT, and orchestration technologies such as Dagster or Control-M. The solution will utilize AWS S3 as the data Lakehouse storage layer and Snowflake as the target data platform.   Experience:... 
    Senior
    Contract work
    Local area
    Remote work

    Long Finch Technologies

    Boston, MA
    22 hours ago
  • $100k - $150k

     ...Job Description As a Senior Data Scientist / Product Engineer at Kearney Activate, you will play a key role in delivering secure, cloud-hosted data and analytics solutions for clients within Kearney’s Mobility, Defense and Advanced Industrials practice. This role is designed... 
    Senior
    Full time
    H1b
    Immediate start
    Home office
    Visa sponsorship
    Flexible hours

    Kearney

    Boston, MA
    12 days ago
  • Senior to Principal Data Engineer (SQLserver, Financial Services), Boston, MA. Hybrid, min 3 days week in office, 135k to 175k base on experienceCompensation Commensurate with experience, EOE, diverse highly educated culture Candidates must be a U.S. citizen or national... 
    Senior
    Permanent employment
    Contract work
    Work at office
    Local area
    3 days per week

    BlueSkyClarity

    Boston, MA
    12 hours ago
  • $115k - $150k

    About the jobSenior Associate, Data Products | Finance | Boston, MAOverviewJoin a high-performing investment-focused organization as...  ...platforms.Required Experience6+ years of experience in Data Engineering, Data Platform Engineering, or Software Engineering.Deep expertise... 
    Senior
    Work at office
    3 days per week

    Huxley Associates

    Boston, MA
    3 days ago
  • $300k

    Senior Data EngineerOur client is one of the world's largest privately held investment management firms, overseeing hundreds of billions...  ...best practices across the organizationPartner closely with engineering, data, business, and investment stakeholders to translate complex... 
    Senior

    Huxley Associates

    Boston, MA
    12 hours ago
  • Description At Liberty Mutual Investments Technology, we are seeking a skilled Senior Data Engineer who is ready to take on exciting challenges, contribute to our cloud-native data platform, and make a real impact across our investment insights. You will build modern... 
    Senior
    Work at office
    Local area

    Liberty Mutual

    Boston, MA
    2 days ago
  • $195.3k - $199.2k

     .... In this role you will design, develop, and maintain scalable data pipelines and systems using Databricks on Azure (among other environments...  ...sharing capabilities. You will be leading and executing data engineering projects from inception to completion, ensuring timely delivery... 
    Senior
    Apprenticeship
    Easy work

    McKinsey & Company

    Boston, MA
    3 days ago
  •  ...responsible for building and evolving the firm's next-generation data platform. The team is focused on designing and implementing...  ...Iceberg, AWS, and Snowflake technologies. This is a hands-on engineering role working on large-scale data ingestion, streaming architectures... 
    Senior
    Contract work
    Work at office
    Local area
    3 days per week

    DeWinter Group

    Boston, MA
    3 days ago
  • $140k - $200k

    Boston, MAHybridFull Time$140k - $200k Job Description A rapidly growing scientific data and AI technology company is seeking a Senior Scientific Data Engineer to join its fully remote team. This role offers the opportunity to work at the intersection of data engineering... 
    Senior
    Full time
    Temporary work
    Immediate start
    Remote work

    Motion Recruitment

    Boston, MA
    12 hours ago
  • Senior Data Engineer - Boston, United StatesWe are partnering with our client, a leading institutional asset manager based in Boston's financial district, to appoint a Senior Data Engineer to join our client's team. In this permanent role, you will be instrumental in building... 
    Senior
    Permanent employment
    Work at office
    Remote work
    Monday to Friday

    Huxley Associates

    Boston, MA
    12 hours ago
  • $175.5k - $180k

     ...technical owner, designing and leading the implementation of scalable data architectures for cutting-edge AI and agentic systems. You will...  .... You will also spearhead the design of complex feature engineering workstreams, ensuring our data assets are not only robust but also... 
    Senior
    Apprenticeship
    Easy work

    McKinsey & Company

    Boston, MA
    12 hours ago
  • Senior Investment Data Engineer, Boston, MA, Hybrid, 2 days in, 150k to 190kCompensation Commensurate with experience, bonus, benefits, EOE, diverse highly educated cultureCandidates must be a U.S. citizen or national, refugee, asylum, or lawful permanent resident. Principals... 
    Senior
    Permanent employment
    Work experience placement
    Casual work
    Work at office

    BlueSkyClarity

    Boston, MA
    12 hours ago
  • $176k - $179.5k

     ...patients. You will design and manage scalable data pipelines and secure analytics platforms,...  ...data scientists, machine learning engineers, and industry experts to develop impactful...  ...McKinsey. There is flexibility to hire at the Senior Data Engineer I/II or Principal Data... 
    Senior
    Apprenticeship
    Easy work
    Shift work

    McKinsey & Company

    Boston, MA
    3 days ago
  • $140k - $200k

    DescriptionAbout TetraScienceTetraScience is the Scientific Data and AI Company building Tetra OS, the operating system for...  ...DoYou will join TetraScience's forward deployed teams as a senior, hands-on engineer. In this role, you will work directly with biotech, pharmaceutical... 
    Senior
    Full time
    Immediate start
    Flexible hours

    TetraScience

    Boston, MA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!