ML Engineer

Senior MLOps Engineer (Applied AI Focus)

As a Senior MLOps Engineer on our Product Innovations team, you will serve as the technical lead for Applied MLOps, bridging the gap between experimental data science and production-grade efficiency. You will focus heavily on ground truth generation, model evaluation, and pre/post processing decisions around a scaled vector embeddings ecosystem.

In this role, you'll get to:

• Architect Annotation & Measurement Pipelines: Own the design and implementation of human-in-the-loop and auto-annotation workflows. You will set up systems (e.g., Label Studio) to establish tight confidence metrics and rigorous Inter-Annotator Agreement (IAA).
• Drive Cost-Efficiency via Evaluation: Create the ground truth, golden sets, and by-model evaluation criteria that allows us to benchmark models and make informed data science decisions. Your work will directly impact margin by enabling us to deploy the right model for the right task.
• Enforce Applied MLOps Standards: Implement "model-as-a-judge" frameworks, deterministic PII scrubbing, and other best practices within our production pipelines to ensure our model-driven products are robust and compliant.
• Collaborate on Model Strategy: Work closely with our Data Science team to make applied generative decisions that result in stronger product outcomes and cost efficiencies.
• Build & Integrate: Collaborate with engineering to integrate measurement loops into our broader infrastructure (AWS/GCP), ensuring our model lifecycle is automated and observable.

Who you are and what you'll need for this position:

• Annotation & Evaluation Expert: You have deep experience setting up annotation workstreams (using tools like Label Studio, Scale AI, or custom solutions) and know how to calculate and improve ground truth quality.
• Applied MLOps Practitioner: You care about execution over policymaking. You have experience implementing model monitoring, versioning, and evaluation loops in a production environment.
• Python Proficiency: You possess strong proficiency in Python, capable of writing the glue code, scripts, and API integrations necessary to bind our models to our application stack.
• Model Optimization Mindset: You understand the trade-offs between model performance, latency, and cost. You are excited about the challenge of proving that a smaller model can do the job of a massive LLM.
• Cloud & Infrastructure Fluency: You are comfortable working within AWS (Sagemaker, S3) and GCP (Vertex AI) environments and can interface effectively with DevOps to deploy your solutions.
• Collaborative Leader: You can act as a force multiplier for our Data Science team, equipping them with the tools and data they need to move faster.

Confidence can sometimes hold us back from applying for a job. But we'll let you in on a secret: there's no such thing as a 'perfect' candidate. Have 50% of the criteria? Excited about this opportunity? Passionate about what we do at CreatorIQ? Please apply! CreatorIQ is a place where everyone can grow.

What you will get from us:

• People: work with talented, collaborative, and friendly people who love what they do.
• Guidance: utilize our learning platform to fully get the training and tools you'll need to become successful here from your first day with us.
• Surprise meal stipends: work from home can't stop the enjoyment of someone else making a meal for you!
• Work/life harmony: vacation, floating and set holidays, wellness allowance, and paid parental leave.
• Whole Health Package: medical, dental, vision, life, disability insurance, and more.
• Work from home stipend: to assist you in setting up a home office that works for you (or buy a new dog leash - your choice!).

Who we are:

CreatorIQ is the operating system for creator-led growth. Trusted by more than 1,300 global brands and agencies—including Burson, Delta Air Lines, Google, LVMH, Nestlé, and Sephora—CreatorIQ unifies creator marketing across paid, owned, earned, commerce, and community into one seamless, enterprise-grade ecosystem. With industry-leading intelligence infrastructure, rigorous compliance and security standards, and integrations with Meta, Snapchat, TikTok, YouTube, and more, CreatorIQ empowers brands and agencies to harness the creator economy as a strategic growth engine. CreatorIQ is a global company headquartered in Los Angeles with offices in Austin, New York, San Francisco, London, Manila, and Warsaw.

At CreatorIQ, we believe that diversity is the key to unlocking our full potential. We are committed to fostering an inclusive, equitable, and empowering work environment where everyone can thrive, regardless of race, ethnicity, gender, sexual orientation, age, religion, disability, or any other characteristic that makes us unique. By embracing our core values of being intentional, pursuing excellence every day, embracing the journey together, being a good human, and staying focused on what's important, we create an atmosphere that promotes collaboration and growth. Join us to celebrate differences, innovate together, and be a part of a business that is disrupting the marketing industry.

Compensation, benefits, and beyond:

We understand that a comprehensive benefits package plays a significant role in your overall compensation. To gain more insight into the various components of our total compensation, we invite you to review our benefits and perks.