Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Platm Engineer AI Agent Platm

Framework Ventures

OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa. Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me, Do the Right Thing, and Get Things Done. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more. About the role We are building the foundational data infrastructure that powers one of the world's leading crypto exchanges. As a Big Data Platform Engineer, you will design, build, and evolve the core platform services that enable hundreds of data engineers and analysts to move fast and ship reliable pipelines. You will be at the forefront of our AI agent initiative — embedding LLM-driven capabilities directly into the platform layer so that scheduling, cost optimization, and incident response increasingly run autonomously. Platform Core Design and operate large-scale distributed data systems Own the big data compute and storage infrastructure (MaxCompute/ODPS, Hologres, Spark) Build and maintain multi-site task orchestration that dynamically selects engines and enforces policy Drive reliability and performance improvements across batch and real-time pipelines AI Integration Build the AI-native platform layer Develop and expose MCP (Model Context Protocol) tool interfaces so AI agents can interact with platform APIs Build the scheduling and cost-optimization agents that auto-tune resource allocation and alert severity Instrument platform telemetry to feed AI-driven SLA monitoring and anomaly detection Design context retrieval pipelines (RAG / vector search) for SQL code and config knowledge bases Tooling & DX Evolve the developer experience Own the internal data development platform — IDE integrations, code review automation, deployment tooling Build APIs-first tools (backfill, ingestion automation) designed for future MCP integration Collaborate with data warehouse and service teams to define platform contracts Ops & Governance Drive operational excellence Establish SLA benchmarks, cost metrics, and latency dashboards as AI optimization targets Build automated incident response and root-cause analysis pipelines Define and enforce infrastructure policies across multi-cloud environments Requirements 5+ years of experience building large-scale data platforms (Hadoop/Spark/Flink or equivalent) Deep expertise in distributed storage and compute systems (MaxCompute, Hologres, ClickHouse, Hive) Strong software engineering skills in Java, Scala, or Python; experience with API-first design Hands-on experience with task scheduling systems (Airflow, DolphinScheduler, or in-house equivalents) Solid understanding of multi-cloud architectures and cost governance Familiarity with LLM integration patterns: tool calling, RAG pipelines, context management Experience with MCP or similar agent-tool frameworks is a strong plus Passion for building systems that make other engineers 10x more productive Preferred Qualifications IELTS score of 7 or above in all four components. 3+ years of work experience in English-speaking regions. Experience in cross border e-commerce, and familiarity with multi-country, multi-language architectural design is a plus. Perks & Benefits Competitive total compensation package L&D programs and Education subsidy for employees' growth and development Various team building programs and company events Wellness and meal allowances Comprehensive healthcare schemes for employees and dependants Information collected and processed as part of the recruitment process of any job application you choose to submit is subject to OKX's Candidate Privacy Notice. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Platm Engineer AI Agent Platm in New York, NY vacancy
  •  ...IDT Corporation is seeking a skilled Data/ML Engineer to join their BI team. This remote opportunity involves designing and maintaining data...  ...excellent communication skills, and proficiency in Python and big data technologies. The role offers competitive compensation, continuous... 
    Big data
    Remote work

    IDT

    New York, NY
    2 days ago
  •  ...leading football intelligence technology company is looking for a Data Engineer to design and maintain data pipelines that support deep...  ...experience with strong Python and SQL skills, alongside expertise in big-data frameworks like Databricks and orchestration tools such as... 
    Big data
    Remote work

    SumerSports LLC

    New York, NY
    2 days ago
  •  ...Cotiviti is seeking a Data Engineer to enhance operational functions through the creation and maintenance of Spark and SQL scripts. This role...  ...Science and at least 6 years of relevant experience in big data technologies and cloud platforms. The position offers a competitive... 
    Big data
    Remote work

    Cotiviti

    New York, NY
    2 days ago
  •  ...• 3-10 years of hands-on experience in data engineering with a focus on ETL workflows, data pipelines...  ...systems. • Familiarity with AI/ML tools and frameworks (e.g., TensorFlow...  ...into data pipelines. • Experience with big data technologies like Apache Spark, Kafka... 
    Big data

    Saxon Global

    Jersey City, NJ
    5 days ago
  •  ...Role: Sr. Data Engineer Location: New York,NY Longterm Client: Mphasis...  ...(JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or...  ...Bedrock APIs Knowledge of Generative AI concepts (such as RAG, Vector embeddings,... 
    Big data

    Concord IT Systems

    New York, NY
    4 days ago
  •  ...Title: Senior Data Science Engineer Location : Cary, NC - Onsite (5 days/week, local candidates...  ...Science Engineer to join a high-impact AI engineering team responsible for...  ...Google Cloud Platform (GCP) Utilize big data and orchestration tools such as BigQuery... 
    Big data
    Contract work
    Local area

    RIT Solutions, Inc.

    New York, NY
    4 days ago
  •  ...AI/ML – Data Engineer (Python, Gen AI, ML Modeling) Location: New York, NY (Hybrid – 3 Days Onsite) We are seeking an experienced AI/ML Data...  ...strong experience in Python, machine learning modeling, and big data technologies, along with the ability to collaborate with... 
    Big data

    Staffing the Universe

    New York, NY
    26 days ago
  •  ...AI/ML Data Engineer Location: New York, NY (Hybrid – 3 Days Onsite) Duration: Contract Rate: DOE Job Overview: We are seeking an...  ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable... 
    Big data
    Contract work

    Staffing the Universe

    New York, NY
    1 day ago
  •  ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC...  ...scalable, production-grade data platforms supporting Agentic AI and LLM-based systems. The role focuses on building event-driven... 
    Big data
    Contract work

    Argyle Infotech

    New York, NY
    1 day ago
  •  ...Sdna Global is looking for a skilled Data Engineer 1.0 to design and build AI-driven data pipelines. The role involves integrating machine learning models...  ...candidates should have over 6 years of experience with big data technologies like Azure, AWS, or GCP, along with proficiency... 
    Big data

    SDNA Global

    New York, NY
    18 hours ago
  •  ...Big Data Engineer Mandatory skills: Apache Spark/ Hive/ Kafka/ Amazon Glue/ Google Dataflow/ Talend MDM/ Hadoop/ Presto/ Strong experience...  ...optimizing data systems, building ETL pipelines, and deploying AI models in cloud environments. Key responsibilities: Data ingestion... 
    Big data

    Omni Inclusive

    Jersey City, NJ
    4 days ago
  •  ...Data Engineer (Lead) Data Engineer (Lead) Role NY 10036 (4 Days onsite) Long term rates upto...  ...15 years of exp - Min 4+ exp in hadoop, big data tech, map reduce, hive, spark etc overall...  ...external feeds, API, web scraping Knowledge of AI/Client implementation is aplus... 
    Big data

    Cardinal Integrated

    New York, NY
    1 day ago
  •  ...About the job Data Engineer - Palantir Job Description: Palantir Data Engineer We...  ...enterprise datasets and enabling analytics and AI/ML use cases on Palantir Foundry....  ...into data pipelines. Experience with big data technologies like Snowflake. Strong... 
    Big data
    Work experience placement

    Inizio Partners

    Jersey City, NJ
    5 days ago
  •  ...Role: - Sr. Big Data Engineer Location : - Jersey City, NJ (Onsite) Duration : - Long term Contract Position: - Full-time INTERVIEW...  ...Experiences • Nice to have development experience in Python based AI/ML workloads on Hadoop. • Experience of working on Nifi,... 
    Big data
    Long term contract
    Full time
    Work experience placement
    Flexible hours

    Maintec Technologies

    Jersey City, NJ
    1 day ago
  • $150k - $275k

     ...chaos of fragmented financial data, manual workflows, and opaque...  ...Joyful Health is building the AI-powered financial operating system...  ...to shape the future of our engineering team and are excited to lead by...  ...pipelines Familiarity with big data technologies and... 
    Big data
    Full time
    Private practice
    Work at office
    3 days per week

    Joyful Health

    New York, NY
    4 days ago
  •  ...of cloud technology, pioneering advanced, AI-driven solutions to revolutionize how...  ...Overview: We are seeking a skilled Data Engineer to join our dynamic team. This role involves...  ...optimizing data pipelines, implementing big data solutions, and contributing to our advanced... 
    Big data
    Contract work
    Remote work
    Flexible hours

    Cloudacio

    New York, NY
    4 days ago
  •  ...We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines...  ...engineering, cloud technologies, and big data processing. Qualifications Bachelor'...  ...Smart Cities. We are pioneers in geospatial AI technology, providing public leaders with... 
    Big data
    Full time
    Work at office
    Remote work

    Urban SDK

    New York, NY
    2 days ago
  •  ...A leading AI and Big Data company in the USA is seeking an experienced Senior Data Engineer to design and maintain scalable data pipelines. This role requires over 10 years of experience in data architecture, specifically with Google Cloud Platform and BigQuery. You will... 
    Big data
    Remote work

    Quantiphi

    New York, NY
    2 days ago
  •  ...Solvd is looking for a highly skilled Data Engineer to help design and build modern data platforms...  ...role requires strong technical depth in big data technologies, AWS services, and...  ...best practices Benefits Shape real‑world AI‑driven projects across key industries, working... 
    Big data

    Solvd

    New York, NY
    2 days ago
  •  ...Data Engineer - AWS New York, New York, United States About the Job Our client provides...  ...workloads like Data marts, Data warehouses, and AI/ML. The person will also be required to...  ...AWS Solutions Architect or AWS Big Data Certification preferred Ability to... 
    Big data
    Contract work
    Work experience placement
    Immediate start

    Inizio Partners

    New York, NY
    3 days ago
  • $200k - $220k

     ...Senior Data Engineer New York, New York, United States The Role...  ...research, systematic trading, AI and risk analytics. On top of...  ...APIs consumed by quants and AI agents Optimize workflows to meet...  ...and SQL ~ Deep expertise in big-data architecture: partitioning... 
    Big data

    Schonfeld

    New York, NY
    9 days ago
  •  ...Computing, Inc. (OCI) OCI is seeking experienced Data Engineers to design, develop, and manage data...  ...internal and client projects within our AI/ML & Data Insights team. About OCI We...  ...APIs and ensure system performance. Manage big data infrastructure and cloud deployments... 
    Big data

    Object Computing

    New York, NY
    2 days ago
  •  ...clubs. We are a collection of executives, engineers, data scientists, and visionaries from NFL...  ...What sets us apart is our unique blend of big tech talent, data scientists, and former...  ...experience. Our domain knowledge is augmented by AI and machine learning technologies to... 
    Big data
    Remote work
    Flexible hours

    SumerSports LLC

    New York, NY
    2 days ago
  •  ...As a Sr. Big Data Engineer in our Professional Services team, you will work with clients on short to medium-term customer engagements on their...  ...design, build and deployment of industry-leading big data and AI applications Consult on architecture and design; bootstrap or... 
    Big data
    Temporary work
    Worldwide

    Databricks

    New York, NY
    2 days ago
  •  ...Data Engineer You will be part of a growing Data Engineering team that handles CLIENT data for...  ...with the use of a variety of NoSQL and AI/Client frameworks and languages like R, Python...  ...LearningEvaluate readiness of new big/fast data capabilities to be used to support... 
    Big data
    Immediate start

    Cardinal Integrated

    Secaucus, NJ
    1 day ago
  • $105k - $145k

     ...Digital Group (BDG) is looking for a talented Data Engineer to join our growing data team. You will...  ...for scripting and automation. Cloud & Big Data Savvy: Hands-on experience with...  .... We may use artificial intelligence (AI) tools to support parts of the hiring... 
    Big data
    Work at office
    Remote work
    Flexible hours

    Bdg, Inc

    New York, NY
    3 days ago
  •  ...Data Engineer Do you want to be a part of the team that is reinventing drug research & development...  ...in the white-hot space of life science AI. At Tellic, we value culture as much...  ...plus) ~ Hands-on experience supporting Big Data technologies (e.g., Hadoop, Spark)... 
    Big data
    Visa sponsorship

    tellic

    New York, NY
    4 days ago
  •  ...Role Data Engineer + Gen AI Location NYC (Hybrid) Duration: 12+ Months Interview Mode In-Person Interview Company Description...  ...preferable ~ Experience with Google Cloud Platform services (Big Query, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer,... 
    Big data
    Worldwide

    Nucleusteq

    New York, NY
    2 days ago
  • $65 - $70 per hour

     ...Position: Data Engineer- AWS Location: Jersey City, New Jersey Duration: Contract Job...  ...Advanced proficiency in leveraging Gen AI models using APIs/SDKs. Expertise in cloud...  ...JSON, AVRO, or Protobuf. Knowledge of big-data storage formats such as Parquet or... 
    Big data
    Full time
    Contract work

    Pinnacle Group

    Jersey City, NJ
    5 days ago
  • $60 - $62 per hour

     ...Data Engineering New York, NY Contract Role Rate: $60 - $62/hr Onsite from Day 1 Data & AI Engineer - Lounge Services Required Skill: Bachelor's degree in...  ...experience with proven hands-on experience in Big Data technologies and Business... 
    Big data
    Contract work
    Work experience placement

    Diverse Lynx

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Platm Engineer AI Agent Platm. Be the first to apply!