Principal Data Engineer

Principal Data Engineer OpportunityLocation: Chicago, IL or New York, NYBase Salary Range: $200,000 - $250,000 (Base salary is only one part of Group One Trading's total compensation, which includes an annual discretionary bonus.)The OpportunityOur Principal Data Engineer owns the architecture and technical direction of the data platform that powers trading analysis, reporting, and decision-making across Group One. They work closely with traders, risk, finance, and technology leadership to understand how data is produced and consumed across the firm, and translate those needs into a platform designed for reliability, scalability, and long-term evolution.Data usage is expanding rapidly across every part of our firm, and we are building a next-generation data platform to support it. Our existing Microsoft-based environment gives us a strong foundation and deep understanding of our data as we design what comes next. This role will define that future: evaluating technologies, selecting the architecture, establishing engineering standards, and defining a migration strategy that delivers value early while moving us deliberately toward the target platform.You will partner closely with our Senior Data Engineers who serve as the primary builders of the platform and provide technical leadership to the broader data team throughout the transition. We are looking for someone who has designed modern data platforms before, has lived with the consequences of their own architectural decisions, and knows how to make decisive technical choices while remaining open to being challenged by the engineers building alongside them.The SkillsetExtensive experience designing, building, and evolving production data platforms, including at least one significant modernization or migration from a legacy architectureDeep expertise in modern data architectures and the trade-offs among cloud data warehouses, lakehouses, batch and streaming systems, orchestration frameworks, transformation tooling, and event-driven architecturesExperience evaluating and working with technologies such as Snowflake, Databricks, BigQuery, Redshift, Airflow, Dagster, Prefect, dbt, Kafka, or comparable platformsStrong command of data architecture principles, including data modeling, storage and compute architecture, governance, lineage, security, reliability, and cost managementExpert-level SQL and strong proficiency in Python or a comparable language, with the ability and inclination to remain hands-onWorking familiarity with the Microsoft data stack-including MSSQL, SSIS, SSAS, SSRS, and Power BI-sufficient to understand existing workloads and design a pragmatic migration pathExperience establishing engineering standards around infrastructure-as-code, CI/CD, testing, observability, and data qualityDemonstrated technical leadership, including mentoring experienced engineers, driving architectural decisions, and building consensus across teams with competing requirementsSound judgment around architectural trade-offs, build-versus-buy decisions, vendor selection, and production change riskAbility to communicate complex architectural decisions clearly to both technical and non-technical stakeholdersWhat To Expect As A Principal Data EngineerWithin 1 month, you will understand our existing data environment, the systems that feed it, and the teams that depend on it. You will work directly with traders, risk, finance, operations, and technology leadership to understand our highest-value data use cases, current limitations, and long-term objectives.Within 3 months, you will have assessed our existing data landscape and established the target architecture for our next-generation platform, including technology selections, build-versus-buy decisions, migration strategy, and implementation sequencing. Working alongside our Senior Data Engineers, you will validate the architecture against real workloads, establish engineering standards, and begin putting the first components into production.Within 6 months, you will have production workloads operating on the new platform and a repeatable pattern for migrating additional datasets, pipelines, and reporting workloads. You will be leading the technical direction of the data engineering team, developing the engineers around you, and partnering with technology and business leadership on the longer-term roadmap for data at Group One.The BenefitsOur Principal Data Engineer earns a competitive salary, including a performance-based bonus. We provide fantastic benefits, including 401(k) and Roth 401(k) retirement plans with employer matching, medical, dental, vision, generous vacation time, paid holidays, parental leave, and flexible spending accounts (FSA) for health care, dependent daycare, and parking or mass transit expenses.If this sounds like the right opportunity for you, apply today! Please fill out our initial 3-minute, mobile-friendly application for the Principal Data Engineer role. We look forward to meeting you!