Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Technical Architect

Artificial Intelligence Technologies LLC

  • Bachelor's or master's degree in computer science, Engineering, or a related quantitative field.
  • 15+ years of progressive experience in software engineering, with at least 5+ years in a Technical Architect, Lead Data Architect, or Principal Data Engineer role, specifically focused on data quality, data governance, or data platform architecture.
  • Exceptional hands-on proficiency and deep architectural understanding of the Big Data ecosystem:
  • Apache Spark (PySpark, Scala, or Java): Expert-level experience with Spark SQL, DataFrames/Datasets, streaming, and advanced performance tuning techniques.
  • Distributed Storage & Processing: Hadoop, HDFS, S3, Delta Lake, Apache Iceberg, or similar data lake technologies.
  • Streaming Technologies: Apache Kafka, AWS Kinesis, or similar high-throughput messaging systems.
  • Cloud Data Platforms: Extensive experience designing and implementing solutions on AWS (e.g., EMR, Glue, Redshift, Lambda, Step Functions, S3), Azure (e.g., Databricks, Synapse Analytics, Data Lake Storage), or Google Cloud Platform (e.g., Dataproc, BigQuery, Cloud Storage).
  • Expert-level hands-on experience with Advanced SQL for complex data analysis, validation, and optimization.
  • Expert-level hands-on experience with Python for data engineering, automation, and developing robust data quality solutions.
  • Proven track record of defining, designing, and implementing large-scale data automation frameworks.
  • Demonstrated expertise in data quality engineering principles, methodologies, and tools (profiling, validation, cleansing, reconciliation, anomaly detection).
  • Experience in leading and mentoring technical teams, fostering a culture of technical excellence and continuous improvement.
  • Strong understanding of software development lifecycle (SDLC), DevOps practices, and integrating quality gates into CI/CD pipelines.
  • Excellent communication, presentation, and interpersonal skills, with the ability to articulate complex technical concepts to diverse audiences, including senior leadership and non-technical stakeholders.

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

#J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Big Data Technical Architect in New York, NY vacancy
  •  ...Big Data ArchitectblueStone Recruiting is a national search firm with a focus of placing top Web and Applications talent from the Analyst level to Directors of Networking and Infrastructure with prestigious organizations nationwide. We are working with a large Financial... 
    Big data

    Bluestone Solutions Group

    New York, NY
    1 day ago
  •  ...understanding of NoSQL databases like HBase, Mongo, Cassandra etcRequirements Gathering, designing and developing scalable big data solutions with HadoopStrong technical skills on Spark, HBase, Hive, Sqoop, Oozie, Flume, Java, Scala, Pig, Python etcPractical experience of... 
    Big data

    Sonsoft

    New York, NY
    2 days ago
  •  ...Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionThe Data Lake engineer should come from the background of a Big Data Architect. The position will be in support of data management, ingestion, and client consumption. This individual... 
    Big data
    Permanent employment
    Full time
    H1b
    Flexible hours

    Sonsoft

    New York, NY
    18 hours ago
  • $175k - $205.9k

    Are you ready to make an impact?As a Data Architect at West Monroe, you will lead the design, implementation...  ...data systems. This role requires deep technical expertise, strategic thinking, and...  ..., SQL, Java, or Scala.Experience with big data technologies (e.g., Hadoop, Spark,... 
    Big data
    Work at office
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    2 days ago
  •  ...services company is looking for a Senior Data Architect based in New Jersey. This role involves...  ...data governance frameworks, and provide technical leadership to various teams on analytics...  ...expertise in cloud-native architectures, Big Data engineering, and multi-cloud... 
    Big data

    EXL

    New York, NY
    18 hours ago
  • $240k - $330k

    Security Data Product Architect - CTO Office Location New York Business Area Engineering...  ...of the CTO is the forward-looking technical arm of Bloomberg L.P. We envision the...  ...love to see: Breadth of knowledge in big data, SIEM, federated search, and related... 
    Big data
    Temporary work
    For contractors
    Work experience placement
    Work at office

    Bloomberg

    New York, NY
    2 days ago
  • $147k - $260.7k

     ...empowers you to thrive both personally and professionally. There’s no one like you and that’s why there’s nowhere like RSM.Solution Architect - Data Solutions ArchitectThe Solution Architect - Data Solutions Architect owns enterprise data modeling standards and the... 
    Full time
    Contract work
    Work experience placement
    Internship
    Work at office
    Local area

    RSM International

    New York, NY
    2 days ago
  •  ...DescriptionJob Description: Principal, Business Consulting -Solution Architect The vision of the Data &Analytics team is to help our clients become Data/...  ...and manage data product roadmaps while providing technical leadership and solution architecture guidance. We are... 
    Full time
    Temporary work
    Work experience placement
    Local area

    Infosys Technologies

    New York, NY
    18 hours ago
  • $155.6k - $306.8k

     ...Solution ArchitectDeloitte’s Industrial Data Operations (IDO) practice helps clients...  ...enterprise systems. You will also act as the technical voice in vice president- and director-...  ...you will work with the Cognite Platform Architect to align architecture decisions with... 
    Local area

    Deloitte

    New York, NY
    1 day ago
  • $144.5k - $195.4k

     ...Healthcare & Life Sciences (HCLS) Solutions Architect to join our HCLS organization within AWS...  ...sciences organizations. You will have technical depth, business aptitude, and the...  ...Container-based architectures, Analytics and Big Data, DevOps, and Security). In collaboration... 
    Big data
    Flexible hours
    Day shift

    AmazonWebServices

    New York, NY
    4 days ago
  • $153.6k - $207.8k

     ...Services (AWS) is looking for solutions architects in the who will help high-growth Independent...  ...are experienced technologists with technical breadth and depth coupled with strong interpersonal...  ..., RDBMS & NoSQL databases, big data/analytics, and mid-tier technologies (application... 
    Big data
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    New York, NY
    18 hours ago
  • $180k - $247.5k

    FEQ327R400MissionSolutions Architects at Databricks lead the growth of...  ...expertise in cloud platforms, data engineering, data analytics, and...  ...business problemsProvide technical leadership for customers to evaluate...  ...adopt DatabricksConsult on big data architecture, implement proof... 
    Big data
    Local area
    Worldwide

    DataBricks

    New York, NY
    4 days ago
  •  ...early‑stage B2B SaaS company with a proven platform, trusted by big‑name clients, and already generating millions in revenue. Our mission...  ..., analytics, and finance teams to organize, analyze, and action data at scale—unlocking and optimizing the true drivers of sustainable... 
    Big data

    Mutinex

    New York, NY
    8 hours ago
  • $169k - $228.6k

     ...You will leverage your program management, technical, organizational, and transformation...  ...Development, Infrastructure Architecture, Data Engineering or DevOps- 7+ years of senior...  ...., compute, hardware, network, software, big data, security, etc.)- Experience communicating... 
    Big data
    Flexible hours

    AmazonWebServices

    New York, NY
    3 days ago
  •  ...Job Description Role: Architect - Data Engineering Location: New York City, NY (Hybrid) Experience: 10-14 Years Job description...  ...requirements include a Master of Technology (M.Tech) in Data Science or Big Data and a Bachelor of Engineering (B.E) in Computer Science... 
    Big data

    Zapcom Group Inc

    New York, NY
    2 days ago
  • $115.5k - $181.5k

     ...FICO? At FICO, you can develop your career with a leading organization in one of the fastest‑growing fields in technology today - Big Data analytics. You’ll play a part in our commitment to help businesses use data to improve every choice they make, using advances in artificial... 
    Big data
    Remote work
    Worldwide

    FICO

    New York, NY
    2 days ago
  • $229.9k - $262.4k

     ...environment? At Capital One, you‘ll be part of a big group of makers, breakers, doers and...  ...disciplines, such as Ops, Modeling, and Data Engineering. In this role, you‘ll be...  ...patents ~ Ability to communicate complex technical and machine learning concepts clearly to... 
    Big data
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    4 days ago
  • $215.2k - $245.6k

     ...environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...  ...disciplines, such as Ops, Modeling, and Data Engineering. In this role, you'll be...  ...ML models. ~1+ years of experience as a technical lead developing ML solutions using industry... 
    Big data
    Full time
    Part time
    H1b
    Local area

    Capital One

    New York, NY
    4 days ago
  • $132.23k - $176.31k

     ...the AI‑powered world, connecting people, data, and applications through our expansive...  ...The Senior Lead Marketing Data Platform Architect is responsible for defining, governing,...  ...platform architecture. This role provides technical leadership for the design and... 
    Full time
    Temporary work

    Lumen

    New York, NY
    3 days ago
  • $210.5k - $282.3k

     ...product developers,designers, technologists, data scientists, and more – all working to...  ...norms, and solve complex and distinctive technical problems.Product Engineering is a unified...  ...Personalize)Deep hands-on experience with big data technologies such as Databricks,... 
    Big data
    Full time

    Hulu

    New York, NY
    4 days ago
  • $229.9k - $262.4k

     ...environment? At Capital One, you'll be part of a big group of makers, breakers, doers and...  ...disciplines, such as Ops, Modeling, and Data Engineering. In this role, you'll be...  ...patents ~ Ability to communicate complex technical and machine learning concepts clearly to... 
    Big data
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    4 days ago
  •  ...Job Description Skill: Data & Analytics Solutions Architect (AWS + Snowflake + Cortex) Location: NJ/NYC, Columbus OH, Washington DC...  ...Milwaukee, Boston, Pittsburg PA, Troy MI Must Have Technical/Functional Skills: • 14+ years of experience in... 
    Full time

    Purple Drive

    New York, NY
    19 hours ago
  • $197.3k - $225.1k

     ...Capital One, you'll be part of a big group of makers, breakers,...  ..., such as Ops, Modeling, and Data Engineering. In this role,...  ...diagnostic debugging. ~3+ years architecting and scaling distributed, end-...  ...~1+ years of experience as a technical lead developing ML solutions... 
    Big data
    Full time
    Part time
    H1b
    Local area

    Capital One

    New York, NY
    4 days ago
  •  ...Candidates only based in NY will be considered The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business... 
    Big data
    Full time

    RED Global

    New York, NY
    4 days ago
  • $159k - $208.95k

     ...opening with your name on it At FanDuel, data is the heartbeat of our organization. As...  ...who may be looking to make the move to a big data environment. If this describes you,...  ...across teams Contributing to technical strategy and influencing adoption of ML and... 
    Big data
    Temporary work
    Local area
    Worldwide

    FanDuel

    New York, NY
    1 day ago
  •  ...As a Senior Analytics Engineer, you will support the BI lead data pipeline and ecosystem from end to end. You will be partnering with...  ...enhancements of data tools. This role will report to the Director, Business Intelligence. Required Skills: SQL Additional Skills: Big Data... 
    Big data

    Samprasoft

    New York, NY
    18 hours ago
  •  ...to succeed in this position, including skills, qualifications, and experience. Note: This role focuses strictly on the core Apache Big Data ecosystem running on bare metal. Please note: This is not a cloud data engineering role. We do not utilize AWS, Azure, or GCP.... 
    Big data
    Contract work

    Arkhya Tech Inc

    New York, NY
    18 hours ago
  •  ...Technical ArchitectRemote-Friendly (Travel-Required) | San Francisco,...  ...them how. That's you.Technical Architects help customers get real work done...  ..., connectors, spend controls, data-handling policy, and other...  ...day and have opinions about it.Big-stage presence. You've held large... 
    Work at office
    Visa sponsorship
    Shift work
    Day shift

    anthropic

    New York, NY
    2 days ago
  •  ...Snowflake Data Architect About the Role We’re hiring a Snowflake Data Architect on behalf of a financial services client to support...  ..., data protection requirements, and governance standards. Technical leadership: Work closely with data engineering, analytics, and... 
    Contract work
    For contractors

    CloudHive

    New York, NY
    4 days ago
  • $80k - $100k

     ...Job Overview Data Architect at a leading financial services firm. Hybrid role in New York, NY. Responsibilities End-to-end design for data transformation from source (JSONs, tables, APIs etc.) to target. Execute POCs and create frameworks. Assist the implementation team... 

    Staffworthy

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Technical Architect. Be the first to apply!