Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Python Engineer - Big Data & Risk Analytics

TSR Consulting Services

Job Description

Job Title: Lead Python Engineer – Big Data & Risk Analytics

Location: Jersey City, NJ

Duration: Contract - 6 months (C2H potential)

Job Description

We are seeking a Lead Engineer, Big Data Risk Aggregation to join our dynamic team. The ideal candidate will have strong experience in large-scale data engineering, Apache Spark, and risk aggregation within Capital Markets and a proven ability to design and operate high-performance, auditable aggregation platforms that deliver reportable risk metrics .

Responsibilities:

  • Architect and build a high-performance, metadata-driven aggregation platform using Apache Spark.
  • Design and implement algorithms to reduce computational complexity for high-dimensional risk aggregations.
  • Create and maintain a semantic layer and business-friendly data model to power BI and AI-driven queries.
  • Optimize Spark internals including partitioning, shuffle strategies, and memory for extreme performance.
  • Build a self-service framework that enables quants and risk managers to define new aggregations without new code.
  • Deliver high-performance APIs and curated datasets for UIs and Python Notebooks to support analysis and replication.
  • Load aggregated metrics into OLAP stores such as Apache Pinot or Apache Druid to support analytics and UI layers.

Required Skills & Qualifications:

  • 10+ years of hands-on large-scale data engineering experience, preferably in Capital Markets or Risk technology.
  • Expert-level Apache Spark knowledge including architecture, performance tuning, shuffle optimization, and partitioning.
  • Deep understanding of risk aggregation for VaR, CCAR, Stress Testing, and FRTB.
  • Strong programming skills in Java and/or Python with expert-level SQL.
  • Experience building semantic layers and data models enabling BI and AI applications.
  • Proven delivery with high-performance OLAP databases such as Apache Pinot or Apache Druid.
  • Degree in Computer Science, Financial Mathematics, Financial Engineering, or a related quantitative field.

Preferred Skills:

  • Experience leading data engineering teams and establishing best practices for big data processing.
  • Demonstrated strength in performance diagnostics across CPU, memory, and network I/O.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Python Engineer - Big Data & Risk Analytics in Jersey City, NJ vacancy
  • $176.72k - $265.08k

     ...technically proficient Senior Python Lead with 10+ years of...  ...and market risk domains.Key Technical...  ...tasks effectively.Strong analytical, logical, systems thinking...  ...Exposure (e.g., Java).Big Data Technologies (Apache Spark...  ...Methodology: Prompt Engineering, Workflow Design, GenAI... 
    Risk
    Big data
    Full time
    Local area

    Citigroup

    Rutherford, NJ
    12 hours ago
  •  ...Verisk’s Catastrophe & Risk Solutions (CRS). Responsibilities...  ...rules, statistical data) for all lines of...  ...catastrophe and predictive analytics modeling preferred....  ...years, Verisk has been the leading data analytics and...  ...you to help us translate big data into big ideas.... 
    Risk
    Big data
    Work at office

    Verisk Analytics

    Jersey City, NJ
    2 days ago
  • $131.2k - $240.5k

     ...strategies. You will work with leading-class teams and solutions,...  ...enterprise resource planning and data warehouse environmentsProvide...  ...generate actionable insights and analytics, streamline decision making...  ...driven profitable growth. Manages risk and opportunities associated... 
    Risk
    Local area

    Deloitte

    Jersey City, NJ
    4 days ago
  • $176.72k - $265.08k

     ...Java & Big Data Engineering Lead – Markets Technology, SVP Lead the engineering strategy behind mission-critical trading, risk, and analytics platforms as a Java & Big Data Engineering Lead within...  ...engineering roadmap for Java, Python, cloud-native, and Big Data platforms... 
    Risk
    Big data
    Full time
    Work at office
    Remote work
    2 days per week

    Citi

    Rutherford, NJ
    6 days ago
  •  ...actuarial expertise, analytical skills, and...  ...critical pricing and risk decisions. You'll gain...  ...Verisk's extensive data into actionable insights...  ...process. Help lead the evolution of...  ...Experience with SQL, Python, and/or R....  ...help us translate big data into big ideas... 
    Risk
    Big data
    Work at office

    Verisk Analytics

    Jersey City, NJ
    4 days ago
  •  ...through insurance data and innovate...  ...work with our analytic products and actuarial...  ..., Economics, Engineering, or Physical...  ...of SQL, R, Python, or other general...  ...Verisk has been the leading data analytics...  ...decisions on risk, faster....  ...help us translate big data into big ideas... 
    Risk
    Big data
    Full time
    Temporary work
    Work at office

    Verisk Analytics

    Jersey City, NJ
    1 day ago
  • $142.32k - $213.48k

     ...skilled and experienced senior engineer and Python expert to lead the design and development...  ...units.Engage with data science, technical, and business...  ....Collaborate with Citi's Risk and Control teams to...  ...written and verbal.Strong analytical, problem-solving skills, and... 
    Risk
    Full time

    Citigroup

    Jersey City, NJ
    12 hours ago
  • $115k - $125k

     ...deliver industry-leading digital solutions...  ...Cloud & DevOps, Data, and Software Engineering, servicing an array...  ...skilled Senior Python Developer with extensive...  ...systems, and analytics platforms. You...  ...core trading and risk management...  ...Experience with big data tools like Spark... 
    Risk
    Big data
    Temporary work
    Flexible hours

    Synechron

    Jersey City, NJ
    5 days ago
  • $135k

     ...Account Executive to be the lead in identifying, managing...  ...in insurance software, data, geospatial and/or...  ...has been the leading data analytics and technology partner to...  ...make better decisions on risk, faster. At Verisk, you'...  ...to help us translate big data into big ideas. Join... 
    Risk
    Big data
    Contract work
    Temporary work
    Remote work
    Work from home
    Home office
    Flexible hours

    Verisk Analytics

    Jersey City, NJ
    3 days ago
  •  ...Legal, Compliance, Audit, Risk and Sustainability (...  ...program management, and a data‑driven approach to departmental...  ...& Program Management: Lead cross‑functional...  ...confidential information. Strong analytical and problem‑solving...  ...to help us translate big data into big ideas. Join... 
    Risk
    Big data
    Internship
    Immediate start

    Verisk Analytics

    Jersey City, NJ
    3 days ago
  •  ...Workforce AI Solutions Engineer. This role partners...  ...as the technical lead and primary owner...  ...unstructured enterprise data sources.Working...  ...the request.Strong analytical, consulting,...  ...urgency with technical risk, and drive work to...  ...help us translate big data into big ideas... 
    Risk
    Big data
    Work at office

    Verisk Analytics

    Jersey City, NJ
    2 days ago
  • $135k

     ...Account Executive to be the lead in identifying, managing...  ...in insurance software, data, geospatial and/or...  ...has been the leading data analytics and technology partner to...  ...make better decisions on risk, faster. At Verisk,...  ...you to help us translate big data into big ideas. Join... 
    Risk
    Big data
    Contract work
    Temporary work
    Remote work
    Work from home
    Home office
    Flexible hours

    Verisk

    Jersey City, NJ
    1 day ago
  •  ...experienceThe DevOps Engineer III is responsible...  ...incidents, and lead deployments and migrations...  ...Chef, Powershell, Python, XML, Web concepts...  ...been the leading data analytics and technology...  ...decisions on risk, faster.At Verisk,...  ...help us translate big data into big ideas... 
    Risk
    Big data
    Work at office

    Verisk Analytics

    Jersey City, NJ
    2 days ago
  •  ...requiring deep software engineering and Sitecore...  ...scalable solutions, and lead products from...  ...architecture, including: Data models, templates,...  ...and analytics capabilities SQL Server...  ...offs, project status, risks, dependencies, and...  ...help us translate big data into big ideas... 
    Risk
    Big data
    Work at office

    Verisk Analytics

    Jersey City, NJ
    3 days ago
  • $100k - $130k

    Job-ID: 22366Category: Data AnalyticsLocation:...  ...6-11-10Job Role: Data Engineering-Big Data EngineeringExperience...  ...Systems, Data Analytics, Computer Science, Business...  ...and resource capacity Lead roadmap reviews and drive...  ...Proactively identify risks, blockers and competing... 
    Risk
    Big data
    Temporary work
    Remote work

    EXL Service

    Jersey City, NJ
    3 days ago
  • $140k - $145k

     ...java, Apache Spark, Python, DB SQL, Linux,...  ..., and integrating analytical systems. Experience...  ...computing and data processing concepts...  ...data warehousing and big data technologies...  ...Technology, Engineering, or related field....  ...Capital Markets Risk Analytics Regulatory... 
    Risk
    Big data
    Full time

    Judge Group, Inc.

    Bayonne, NJ
    3 days ago
  •  ...Services.Job DescriptionJob Description:-Our Big Data capability team needs hands-on...  ...beautiful & functional code to solve complex analytics problems. If you are an exceptional developer...  ...in at-least one of Java, C++ or Python (preferred). Scala knowledge a strong advantage... 
    Big data
    Permanent employment
    Full time
    H1b

    Sonsoft

    Jersey City, NJ
    4 days ago
  •  ...Functional Business Analyst (ETL/data integration, Capital markets, Python, MicroStrategy) for their...  ....) ~ Excellent analytical and problem solving skills...  ...Markets with focus on Credit Risk, Market Risk or Capital calculations...  ...: ~ Knowledge of Big Data Architectures and... 
    Risk
    Big data

    ICONMA, LLC

    Jersey City, NJ
    20 days ago
  •  ...competitive advantage through Data Management. We partner with...  ...data platforms. EXL is a leading data analytics and digital operations and solutions...  .... Role Name: Data Engineering Lead – Data & Marketing...  ...delivery plans. Manage project risks, dependencies, decisions,... 
    Risk
    Full time
    Work at office

    EXL

    Jersey City, NJ
    a month ago
  •  ...Job DescriptionJob Description Mandatory skills: Eligible to workP, Big Query, Dataflow, Looker, and Python Key Responsibilities: We are seeking a skilled Data Analytics Engineer with strong experience in Google Cloud Platform (Eligible to workP) and expertise across... 
    Big data

    Diverse Lynx

    Secaucus, NJ
    2 days ago
  •  ...our capabilities in SAP data modernization and multi...  ...SAP Data Integration Engineer to design, build, and support...  ...unlock SAP data for analytics, BI, AI/ML, reporting,...  ...decision-making, risk identification, and delivery...  ...technologies. ~ Knowledge of Python for data transformation... 
    Risk
    Local area

    oXya - USA

    Jersey City, NJ
    9 days ago
  • $125.4k - $182.6k

     ...Sr. Data ScientistThe North America Data Analytics team at Chubb is seeking a Sr. Data Scientist...  ...reviewing production code in Python/PySpark.Knowledge of ML...  ...with Prompt Engineering, Chunking, LLM evaluation...  ...functionsHands-on experience with big data technologies and cloud... 
    Big data
    Temporary work
    Local area

    Chubb

    Jersey City, NJ
    2 days ago
  •  ...Quantitative Analytics Senior Associate...  ...ll join the Card Data & Analytics team...  ...product, finance, and risk to turn complex...  ..., Mathematics, Engineering, Econometrics,...  ...languages such as Python or SAS, with experience in Big Data...  ...Us Chase is a leading financial services... 
    Risk
    Big data

    Chase

    Brooklyn, NY
    5 days ago
  • Senior Python Risk DeveloperJob#: 3057386Job Description:Senior Python...  ...for risk calculations and analytics. The selected candidate will...  ...degree in Computer Science, Engineering, or a related discipline, or...  ...products.Familiarity with Quartz, big-data platforms, key/value stores,... 
    Risk
    Big data
    Work at office

    Apex Systems

    Jersey City, NJ
    3 days ago
  •  ...experienceThe Senior Software Engineer operates as a senior/lead team member of a team...  ...AttributesStrong analytical skills to breakdown...  ...has been the leading data analytics and...  ...better decisions on risk, faster.At Verisk, you...  ...to help us translate big data into big ideas.... 
    Risk
    Big data
    Flexible hours

    Verisk Analytics

    Jersey City, NJ
    12 hours ago
  •  ...Microsoft Fabric Data EngineerNewark, New...  ...JobMicrosoft Fabric Data Engineer - 6 month Hybrid...  ...data and analytics platform. The ideal...  ...ELT processes, and big data technologies....  ...Platform Migration: Lead and contribute to the...  ...programming experience with Python and PySpark for... 
    Big data
    Full time
    Local area

    Fortis Hayes

    Newark, NJ
    12 hours ago
  • $116k - $145k

     ...consists of a portfolio of leading brands across mobile...  ...We are looking for a Data Scientist for our Risk Data Science team to tackle...  ...Experience in data science, analytics or engineering preferred Bachelor's Degree...  ...with high proficiency in Python or R, and SQL... 
    Risk
    Temporary work
    Local area
    Worldwide

    FanDuel

    Jersey City, NJ
    3 days ago
  • $110.7k - $218.3k

     ...strategies, advanced analytics, Generative AI,...  ...team of strategists, data scientists, operators...  ..., designers, engineers, and architects. Our...  ...relationshipsAbility to lead projects or...  ...using JavaScript or Python to create survey logic...  ...subject to Federal Risk and Authorization Management... 
    Risk
    Local area

    Deloitte

    Jersey City, NJ
    4 days ago
  • $121.2k - $181.8k

     ...of the Role:Citi, the leading global bank, has approximately...  ...seeking a Senior Java Big Data Developer to design...  ...on developing a Risk and Finance dashboard...  ...that delivers sensitive analytical and business process data...  ...Java and J2EE backend engineering with JavaScript-based... 
    Risk
    Big data
    Full time

    Citigroup

    Jersey City, NJ
    12 hours ago
  • $55 - $62 per hour

     ...Description Job Description Senior Python Developer – Counterparty Credit Risk Technology Location: Jersey...  ...with GitHub Copilot. ~ Strong analytical and communication skills. Preferred...  .... Experience with Quartz, big data, distributed processing, or GenAI/... 
    Risk
    Big data
    Immediate start
    3 days per week

    Artech LLC

    Jersey City, NJ
    20 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Python Engineer - Big Data & Risk Analytics. Be the first to apply!