Big Data Platm Engineer AI Agent Platm
Framework Ventures
OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa. Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me, Do the Right Thing, and Get Things Done. These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more. About the role We are building the foundational data infrastructure that powers one of the world's leading crypto exchanges. As a Big Data Platform Engineer, you will design, build, and evolve the core platform services that enable hundreds of data engineers and analysts to move fast and ship reliable pipelines. You will be at the forefront of our AI agent initiative — embedding LLM-driven capabilities directly into the platform layer so that scheduling, cost optimization, and incident response increasingly run autonomously. Platform Core Design and operate large-scale distributed data systems Own the big data compute and storage infrastructure (MaxCompute/ODPS, Hologres, Spark) Build and maintain multi-site task orchestration that dynamically selects engines and enforces policy Drive reliability and performance improvements across batch and real-time pipelines AI Integration Build the AI-native platform layer Develop and expose MCP (Model Context Protocol) tool interfaces so AI agents can interact with platform APIs Build the scheduling and cost-optimization agents that auto-tune resource allocation and alert severity Instrument platform telemetry to feed AI-driven SLA monitoring and anomaly detection Design context retrieval pipelines (RAG / vector search) for SQL code and config knowledge bases Tooling & DX Evolve the developer experience Own the internal data development platform — IDE integrations, code review automation, deployment tooling Build APIs-first tools (backfill, ingestion automation) designed for future MCP integration Collaborate with data warehouse and service teams to define platform contracts Ops & Governance Drive operational excellence Establish SLA benchmarks, cost metrics, and latency dashboards as AI optimization targets Build automated incident response and root-cause analysis pipelines Define and enforce infrastructure policies across multi-cloud environments Requirements 5+ years of experience building large-scale data platforms (Hadoop/Spark/Flink or equivalent) Deep expertise in distributed storage and compute systems (MaxCompute, Hologres, ClickHouse, Hive) Strong software engineering skills in Java, Scala, or Python; experience with API-first design Hands-on experience with task scheduling systems (Airflow, DolphinScheduler, or in-house equivalents) Solid understanding of multi-cloud architectures and cost governance Familiarity with LLM integration patterns: tool calling, RAG pipelines, context management Experience with MCP or similar agent-tool frameworks is a strong plus Passion for building systems that make other engineers 10x more productive Preferred Qualifications IELTS score of 7 or above in all four components. 3+ years of work experience in English-speaking regions. Experience in cross border e-commerce, and familiarity with multi-country, multi-language architectural design is a plus. Perks & Benefits Competitive total compensation package L&D programs and Education subsidy for employees' growth and development Various team building programs and company events Wellness and meal allowances Comprehensive healthcare schemes for employees and dependants Information collected and processed as part of the recruitment process of any job application you choose to submit is subject to OKX's Candidate Privacy Notice. #J-18808-Ljbffr
- ...IDT Corporation is seeking a skilled Data/ML Engineer to join their BI team. This remote opportunity involves designing and maintaining data... ...excellent communication skills, and proficiency in Python and big data technologies. The role offers competitive compensation, continuous...Big dataRemote work
- ...leading football intelligence technology company is looking for a Data Engineer to design and maintain data pipelines that support deep... ...experience with strong Python and SQL skills, alongside expertise in big-data frameworks like Databricks and orchestration tools such as...Big dataRemote work
- ...Cotiviti is seeking a Data Engineer to enhance operational functions through the creation and maintenance of Spark and SQL scripts. This role... ...Science and at least 6 years of relevant experience in big data technologies and cloud platforms. The position offers a competitive...Big dataRemote work
- ...• 3-10 years of hands-on experience in data engineering with a focus on ETL workflows, data pipelines... ...systems. • Familiarity with AI/ML tools and frameworks (e.g., TensorFlow... ...into data pipelines. • Experience with big data technologies like Apache Spark, Kafka...Big data
- ...Role: Sr. Data Engineer Location: New York,NY Longterm Client: Mphasis... ...(JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or... ...Bedrock APIs Knowledge of Generative AI concepts (such as RAG, Vector embeddings,...Big data
- ...Title: Senior Data Science Engineer Location : Cary, NC - Onsite (5 days/week, local candidates... ...Science Engineer to join a high-impact AI engineering team responsible for... ...Google Cloud Platform (GCP) Utilize big data and orchestration tools such as BigQuery...Big dataContract workLocal area
- ...AI/ML – Data Engineer (Python, Gen AI, ML Modeling) Location: New York, NY (Hybrid – 3 Days Onsite) We are seeking an experienced AI/ML Data... ...strong experience in Python, machine learning modeling, and big data technologies, along with the ability to collaborate with...Big data
- ...AI/ML Data Engineer Location: New York, NY (Hybrid – 3 Days Onsite) Duration: Contract Rate: DOE Job Overview: We are seeking an... ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable...Big dataContract work
- ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC... ...scalable, production-grade data platforms supporting Agentic AI and LLM-based systems. The role focuses on building event-driven...Big dataContract work
- ...Sdna Global is looking for a skilled Data Engineer 1.0 to design and build AI-driven data pipelines. The role involves integrating machine learning models... ...candidates should have over 6 years of experience with big data technologies like Azure, AWS, or GCP, along with proficiency...Big data
- ...Big Data Engineer Mandatory skills: Apache Spark/ Hive/ Kafka/ Amazon Glue/ Google Dataflow/ Talend MDM/ Hadoop/ Presto/ Strong experience... ...optimizing data systems, building ETL pipelines, and deploying AI models in cloud environments. Key responsibilities: Data ingestion...Big data
- ...Data Engineer (Lead) Data Engineer (Lead) Role NY 10036 (4 Days onsite) Long term rates upto... ...15 years of exp - Min 4+ exp in hadoop, big data tech, map reduce, hive, spark etc overall... ...external feeds, API, web scraping Knowledge of AI/Client implementation is aplus...Big data
- ...About the job Data Engineer - Palantir Job Description: Palantir Data Engineer We... ...enterprise datasets and enabling analytics and AI/ML use cases on Palantir Foundry.... ...into data pipelines. Experience with big data technologies like Snowflake. Strong...Big dataWork experience placement
- ...Role: - Sr. Big Data Engineer Location : - Jersey City, NJ (Onsite) Duration : - Long term Contract Position: - Full-time INTERVIEW... ...Experiences • Nice to have development experience in Python based AI/ML workloads on Hadoop. • Experience of working on Nifi,...Big dataLong term contractFull timeWork experience placementFlexible hours
$150k - $275k
...chaos of fragmented financial data, manual workflows, and opaque... ...Joyful Health is building the AI-powered financial operating system... ...to shape the future of our engineering team and are excited to lead by... ...pipelines Familiarity with big data technologies and...Big dataFull timePrivate practiceWork at office3 days per week- ...of cloud technology, pioneering advanced, AI-driven solutions to revolutionize how... ...Overview: We are seeking a skilled Data Engineer to join our dynamic team. This role involves... ...optimizing data pipelines, implementing big data solutions, and contributing to our advanced...Big dataContract workRemote workFlexible hours
- ...We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines... ...engineering, cloud technologies, and big data processing. Qualifications Bachelor'... ...Smart Cities. We are pioneers in geospatial AI technology, providing public leaders with...Big dataFull timeWork at officeRemote work
- ...A leading AI and Big Data company in the USA is seeking an experienced Senior Data Engineer to design and maintain scalable data pipelines. This role requires over 10 years of experience in data architecture, specifically with Google Cloud Platform and BigQuery. You will...Big dataRemote work
- ...Solvd is looking for a highly skilled Data Engineer to help design and build modern data platforms... ...role requires strong technical depth in big data technologies, AWS services, and... ...best practices Benefits Shape real‑world AI‑driven projects across key industries, working...Big data
- ...Data Engineer - AWS New York, New York, United States About the Job Our client provides... ...workloads like Data marts, Data warehouses, and AI/ML. The person will also be required to... ...AWS Solutions Architect or AWS Big Data Certification preferred Ability to...Big dataContract workWork experience placementImmediate start
$200k - $220k
...Senior Data Engineer New York, New York, United States The Role... ...research, systematic trading, AI and risk analytics. On top of... ...APIs consumed by quants and AI agents Optimize workflows to meet... ...and SQL ~ Deep expertise in big-data architecture: partitioning...Big data- ...Computing, Inc. (OCI) OCI is seeking experienced Data Engineers to design, develop, and manage data... ...internal and client projects within our AI/ML & Data Insights team. About OCI We... ...APIs and ensure system performance. Manage big data infrastructure and cloud deployments...Big data
- ...clubs. We are a collection of executives, engineers, data scientists, and visionaries from NFL... ...What sets us apart is our unique blend of big tech talent, data scientists, and former... ...experience. Our domain knowledge is augmented by AI and machine learning technologies to...Big dataRemote workFlexible hours
- ...As a Sr. Big Data Engineer in our Professional Services team, you will work with clients on short to medium-term customer engagements on their... ...design, build and deployment of industry-leading big data and AI applications Consult on architecture and design; bootstrap or...Big dataTemporary workWorldwide
- ...Data Engineer You will be part of a growing Data Engineering team that handles CLIENT data for... ...with the use of a variety of NoSQL and AI/Client frameworks and languages like R, Python... ...LearningEvaluate readiness of new big/fast data capabilities to be used to support...Big dataImmediate start
$105k - $145k
...Digital Group (BDG) is looking for a talented Data Engineer to join our growing data team. You will... ...for scripting and automation. Cloud & Big Data Savvy: Hands-on experience with... .... We may use artificial intelligence (AI) tools to support parts of the hiring...Big dataWork at officeRemote workFlexible hours- ...Data Engineer Do you want to be a part of the team that is reinventing drug research & development... ...in the white-hot space of life science AI. At Tellic, we value culture as much... ...plus) ~ Hands-on experience supporting Big Data technologies (e.g., Hadoop, Spark)...Big dataVisa sponsorship
- ...Role Data Engineer + Gen AI Location NYC (Hybrid) Duration: 12+ Months Interview Mode In-Person Interview Company Description... ...preferable ~ Experience with Google Cloud Platform services (Big Query, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer,...Big dataWorldwide
$65 - $70 per hour
...Position: Data Engineer- AWS Location: Jersey City, New Jersey Duration: Contract Job... ...Advanced proficiency in leveraging Gen AI models using APIs/SDKs. Expertise in cloud... ...JSON, AVRO, or Protobuf. Knowledge of big-data storage formats such as Parquet or...Big dataFull timeContract work$60 - $62 per hour
...Data Engineering New York, NY Contract Role Rate: $60 - $62/hr Onsite from Day 1 Data & AI Engineer - Lounge Services Required Skill: Bachelor's degree in... ...experience with proven hands-on experience in Big Data technologies and Business...Big dataContract workWork experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Platm Engineer AI Agent Platm. Be the first to apply!
- junior data developer New York, NY
- director data engineering New York, NY
- junior big data engineer New York, NY
- data engineer graduate New York, NY
- senior data engineer New York, NY
- data platform engineer New York, NY
- sr information security engineer New York, NY
- senior data integration developer New York, NY
- data developer New York, NY
- data engineer New York, NY

