Machine Learning Engineer

Role: ML Engineer

Location: Manhattan, NY

Work Model: Hybrid, 3 days per week at NY office location

Employment Type: Contract or Fulltime (Visa sponsorship is not available for this job)

Company Overview

Trianz is an applied AI solutions company that accelerates customer business transformation through AI powered "Transformation Services as a Software Model" . With 25+ years of transforming enterprises, we've evolved to a product-led, platform-driven organization serving global enterprises across Financial Services, Insurance, Healthcare, Hi-Tech, Manufacturing, and other industries.

With global presence across 4 continents, our platform portfolio under the unified Concierto brand delivers end-to-end transformations including solutions for Migrate, Manage, Maximize, Modernize, Insights & Agentic AI, and SecOps - delivered through strategic partnerships with leading hyperscalers.

We're building the premier innovation-led organization in the digital transformation space through AI-first methodologies and data-driven excellence - RevolutionAIzing Transformations.

Role Overview

The ML Engineer – LLM Platforms & Assistants will design, build, and operate production-grade large language model (LLM) pipelines primarily within AWS-based environments. This role focuses on integrating OpenAI models into modular Python services, implementing Retrieval-Augmented Generation (RAG) and semantic search, and deploying scalable, secure, and observable AI assistants.

Key Responsibilities

• Design and maintain LLM integrations using OpenAI APIs within AWS environments.
• Build Python-based LLM services deployed on AWS compute platforms (ECS, EKS, Lambda, or EC2).
• Implement RAG workflows and semantic search using AWS data and storage services.
• Develop LangChain or agentic workflows supporting reasoning and tool use.
• Integrate LLM pipelines with ETL/ELT workflows and enterprise data systems.
• Deploy and integrate MCP servers and emerging orchestration tools.
• Apply AWS security best practices using IAM, KMS, and Secrets Manager.
• Implement monitoring and observability using CloudWatch and related tools.
• Migrate custom GPT solutions into production-grade AWS-hosted assistants.

Ideal Candidate Profile

• 4–7+ years in software, ML, or applied AI engineering.
• Strong Python proficiency.
• Experience with RAG and semantic search.
• Hands-on OpenAI LLM integration experience.
• Experience deploying systems in AWS (S3, Lambda, ECS/EKS, IAM).

Preferred Qualifications

• Experience with Amazon Bedrock.
• AWS data services: Glue, Athena, OpenSearch, Aurora.
• ETL/ELT pipeline development.
• LLM orchestration and reasoning workflows.
• Benchmarking and LLM evaluation.
• Infrastructure as Code (CDK, CloudFormation, Terraform).

Education:

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience.

Why choose Trianz?

• Personal Growth: Startup agility with enterprise impact. Experience rapid innovation cycles while working on Fortune 500 transformations.
• AI-First Future: Where humans and AI revolutionize business. Lead the charge in implementing AI-driven transformation at scale.
• Global Impact: Shape transformation across continents. Work with diverse teams and clients spanning Americas, Europe, Asia, and beyond.
• Executive Access: Direct impact on Fortune 500 strategies. Work alongside C-suite leaders and influence major business decisions.
• Ownership & Entrepreneurial Spirit: Your ideas, our platform, global impact. Zero bureaucracy culture with decision-making autonomy and rapid execution.

Equal Employment Opportunity

Trianz is an Equal Opportunity Employer and does not discriminate based on race, color, creed, national or ethnic origin, gender, religion, disability, age, political affiliation or belief, special needs veteran, veteran of the Vietnam Era, or citizenship status (except in those special circumstances permitted or mandated by law). We comply with all state and federal laws and regulations protecting employees and applicants against illegal discrimination, retaliation, and harassment. Our policy is available upon request. We consider qualified applicants with criminal histories, consistent with applicable federal, state, and local law. Trianz participates in the E-Verify program in certain locations, as required by law. We are committed to providing reasonable accommodation for all qualified individuals with a disability or other reasons protected by applicable laws. If you require assistance or accommodation due to a disability or special needs to search for a job opening or apply, please email View email address on apply.j-vers.com with your request and contact information.

Trianz Privacy Notice

Trianz respects your privacy and wants to ensure we comply with applicable Data Privacy Regulations as per local regulator laws. Please review our privacy policy at for more..