Data Engineer IV

We are looking for an experienced Data Engineer to support our infrastructure work. This role would be primarily responsible for building and modifying high-complexity pipelines and alerting systems for my team in legal. Due to the technical complexity of the role, we'd ideally like to find someone who has experience working on data warehousing and building (+ leading end-to-end projects to build) high-complexity monitoring and alerting systems. We're a very XFN-heavy team, so someone who is very communicative, collaborative, comfortable navigating ambiguity / tenacious in finding answers, and cognizant of privacy/security would do very well in this role.

Responsibilities:

• Building ETL pipelines:
  • Engineers are responsible for scheduling and querying massive tables, ensuring efficient data extraction and transformation.
• Collaborating with attorneys:
  • Work closely with attorneys and Data Scientists to understand what data is needed, where it is located, when it is required, and which tables are relevant.
• Cross-functional collaboration:
  • Collaborate with various XFN teams to launch new systems and products.
  • Responsibilities include preparing documentation, coordinating with multiple stakeholders, developing a plan for system building, identifying collaborators, and ensuring successful execution.
    
    
    
    

Minimum Requirements:

• Expert-level SQL (Presto, Postgres, MySQL, etc.- any form is fine).
• Expert-level Python.
• Expert-level proficiency using pipelining tools (e.g., Airflow, Dataswarm, etc).
• Experience leading DE efforts on large XFN projects with a wide variety of technical and non-technical stakeholders.
• Expert-level comms.

Preferred Requirements:

• Demonstrated experience using AI to expedite project delivery (or even better--building AI components to help automate workflows for non-technical stakeholders).
• Experience working on projects for highly regulated industries (e.g., legal, compliance, finance, security, privacy, etc).
• Experience mentoring junior team members.
• Experience working in startups / ambiguous environments with a broader scope of work.
• Big-tech experience not necessary; non-traditional backgrounds are welcome.

Benefits:

• 401(k).
• Dental Insurance.
• Health insurance.
• Vision insurance.
• We are an equal-opportunity employer and value diversity, equality, inclusion, and respect for people.
• The salary will be determined based on several factors, including, but not limited to, location, relevant education, qualifications, experience, technical skills, and business needs.

Additional Responsibilities:

• Participate in OP monthly team meetings and participate in team-building efforts.
• Contribute to OP technical discussions, peer reviews, etc.
• Contribute content and collaborate via the OP-Wiki/Knowledge Base.
• Provide status reports to OP Account Management as requested.

About us:
At OP, we help you harness the power of technology for maximum impact. A technology consulting and solutions company, we offer advisory and managed services, innovative platforms, and staffing solutions across a wide range of fields including AI, cyber security, enterprise architecture, and beyond. For nearly two decades, we've been challenging the status quo of the consulting industry, serving up fresh, ingenious thinking through a radically lean structure. Together, this strategy delivers unprecedented performance at an unparalleled pace for faster results that propel your business forward.