Big Data Technical Architect
Cloud Analytics Technologies LLC
Job Description :
- Bachelor's or master's degree in computer science, Engineering, or a related quantitative field.
- 15+ years of progressive experience in software engineering, with at least 5+ years in a Technical Architect, Lead Data Architect, or Principal Data Engineer role, specifically focused on data quality, data governance, or data platform architecture.
- Exceptional hands-on proficiency and deep architectural understanding of the Big Data ecosystem:
- Apache Spark (PySpark, Scala, or Java): Expert-level experience with Spark SQL, DataFrames/Datasets, streaming, and advanced performance tuning techniques.
- Distributed Storage & Processing: Hadoop, HDFS, S3, Delta Lake, Apache Iceberg, or similar data lake technologies.
- Streaming Technologies: Apache Kafka, AWS Kinesis, or similar high-throughput messaging systems.
- Cloud Data Platforms: Extensive experience designing and implementing solutions on AWS (e.g., EMR, Glue, Redshift, Lambda, Step Functions, S3), Azure (e.g., Databricks, Synapse Analytics, Data Lake Storage), or Google Cloud Platform (e.g., Dataproc, BigQuery, Cloud Storage).
- Expert-level hands-on experience with Advanced SQL for complex data analysis, validation, and optimization.
- Expert-level hands-on experience with Python for data engineering, automation, and developing robust data quality solutions.
- Proven track record of defining, designing, and implementing large-scale data automation frameworks.
- Demonstrated expertise in data quality engineering principles, methodologies, and tools (profiling, validation, cleansing, reconciliation, anomaly detection).
- Experience in leading and mentoring technical teams, fostering a culture of technical excellence and continuous improvement.
- Strong understanding of software development lifecycle (SDLC), DevOps practices, and integrating quality gates into CI/CD pipelines.
- Excellent communication, presentation, and interpersonal skills, with the ability to articulate complex technical concepts to diverse audiences, including senior leadership and non-technical stakeholders.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Technical Architect in New York, NY vacancy
$120k - $180.06k
...The Information Technology Specialist II (Data Architect) is an experienced technician who is... ...transformation processing, and storage of Big Data. This individual works with both current... ...systems and develops and documents the technical design for the integration and...Big dataTraineeshipLocal areaRemote workFlexible hours- General Electric - GE is seeking a Solution Architect to provide technical leadership and consult on Data and AI solutions. You will play a critical role in evaluating and adopting strategies for big data architecture, data science, and machine learning projects. With a...Big data
- ...understanding of NoSQL databases like HBase, Mongo, Cassandra etcRequirements Gathering, designing and developing scalable big data solutions with HadoopStrong technical skills on Spark, HBase, Hive, Sqoop, Oozie, Flume, Java, Scala, Pig, Python etcPractical experience of...Big data
- ...Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionThe Data Lake engineer should come from the background of a Big Data Architect. The position will be in support of data management, ingestion, and client consumption. This individual...Big dataPermanent employmentFull timeH1bFlexible hours
- ...Big Data Architect Location: New York Duration: 1 year Min Exp.: 10 years Must Have: 1. HDFS, 2. Java, 3. Scala Detailed JD: 1. Need to have 10 - 15 yrs experience in core technology 2. Should be able to work independently as well as team member 3. Need to have hand...Big data
ClifyX
New York, NY5 days ago $122k - $163k
...Slalom, we co-create custom software, data, and cloud products with clients... ...day that talent, creativity, and technical excellence have no borders by... ...solutions that inspire people to dream big and move faster.What You’ll DoAs a Data Architect at Slalom, you will work in...Big dataTemporary workLocal area- ...Data Architect Location: NY/NJ Duration: 11 Months Remarks: Years' of experience: 12-15 Skills... ..., including 2+ years managing technical teams. Proven experience in Life Sciences... ...platforms (AWS, Snowflake, Databricks) and big data architecture patterns (Lambda, Kappa...Big dataContract work
InterSources
New York, NY2 days ago $175k - $205.9k
Are you ready to make an impact?As a Data Architect at West Monroe, you will lead the design, implementation... ...data systems. This role requires deep technical expertise, strategic thinking, and... ..., SQL, Java, or Scala.Experience with big data technologies (e.g., Hadoop, Spark,...Big dataWork at officeLocal areaImmediate startFlexible hours$300k
...Big Data Architect Company needs Architect with Big Data Technologies experience (BigTable, Hadoop/Hbase, Cassandra, etc), that can provide technical direction towards re-architecting the Data Model and Access Platform that will in turn create a reliable and scalable...Big dataMackenzie HealthCare
New York, NY5 days ago- ...Data Architect We are seeking a highly skilled and forward-thinking Data Architect who combines... ...strong strategic vision with hands-on technical expertise. This role will be responsible... ..., Cloud platforms (Azure, AWS, GCP), Big Data ecosystems. Define data models (...Big data
United IT
New York, NY5 days ago - ...Big Data Architect Location: Chicago, IL / Nashville, TN / New York, NY / Phoenix, AZ Duration: Full Time Skills Required:... ...executing couple of big data projects (end to end) Strong technical expertise and hands on experience on Hive, Flume, Hbase & other...Big dataFull timeFlexible hours
Staffing the Universe
New York, NY5 days ago - ...Big Data Architect blueStone Recruiting is a national search firm with a focus on placing top Web and Applications talent from the Analyst level to Directors of Networking and Infrastructure with prestigious organizations nationwide. We are working with a large Financial...Big data
Bluestone.com
New York, NY1 day ago - ...Big Data Architect Sonsoft, Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc.... ...developing scalable big data solutions with Hadoop Strong technical skills on Spark, HBase, Hive, Sqoop, Oozie, Flume, Java, Scala...Big dataPermanent employmentFull timeH1b
SonSoft
New York, NY5 days ago - ...Senior Data Architect New York, New York, United States About the Job Experience Level... ...Assistance: No Skills: Data Architect, NoSQL, Big Data, SQL, SQL-like Query, Relational,... ...a senior data architect, with strong technical background as well as leadership...Big dataRelocation packageFlexible hours
VS Tech Solutions
New York, NY1 day ago - Mount Sinai Health System is seeking an Information Technology Specialist II (Data Architect) to lead data collection, movement, storage, and processing for Big Data and ETL/Data Warehousing initiatives. This hybrid/remote role requires onsite presence and interviews at...Big dataRemote work
- ...technology solutions provider in New York seeks an experienced Technical Architect/Data Engineer to lead data quality and governance initiatives.... ...has 15+ years in software engineering and is proficient in Big Data technologies like Apache Spark, SQL, and cloud platforms...Big data
- MACHINE LEARNING TECHNOLOGIES LLC in New York City seeks a Big Data Technical Architect to lead data quality, governance, and platform architecture. You will drive designs across Spark, Hadoop ecosystems, and cloud data services, shaping scalable data solutions. Ideal...Big dataContract work
- ...pipelines using PySpark and Databricks for batch and streaming data. Define and enforce data architecture standards, ensuring... ...align with investment banking goals and regulatory frameworks. Architect big data solutions across platforms like Azure Synapse, Snowflake,...Big dataFull timeContract workLocal area
- ...are seeking a highly experienced Senior Data Architect with expertise in both Microsoft Azure and... ...architectures , data governance , Big Data engineering , and multi-cloud deployment... ..., and cost of cloud data workloads. Technical Leadership: Guide and mentor data engineers...Big dataWork at office
$161k - $245.5k
...Senior Technical Architect Information Technology – Epic Patient AccessAt NewYork-Presbyterian Hospital, Information Technology is at the forefront... ...Fluency (SAS, SPSS, Python ML, Scala, Spark ML, etc)Big Data Tools (MapReduce, Hadoop, Cloudera, IBM Big Insights, Hortonworks...Big dataWork experience placementRemote workNewYork-Presbyterian Hospital
New York, NY1 day ago- Hyrhub is seeking a highly skilled Databricks SME to lead the architecture and implementation of enterprise-scale Big Data solutions on the Databricks Lakehouse Platform. The ideal candidate will have 12+ years of architecture experience and proven expertise in migrating...Big data
- ...-10 years of experience, including at least 2 years working specifically with Hadoop technologies. Candidates must possess strong technical skills in tools like Spark, HBase, and Hive, plus proficiency in programming languages such as Java and Python. This full-time, permanent...Big dataPermanent employmentFull time
- ...services company is looking for a Senior Data Architect based in New Jersey. This role involves... ...data governance frameworks, and provide technical leadership to various teams on analytics... ...expertise in cloud-native architectures, Big Data engineering, and multi-cloud...Big data
- ...Job Description Cloud Data Architect Must Have Technical/Functional Skills Cloud Data Architect in Data & Analytics will play a key role... ...Virtualization tools Demonstrated experience in Big Data, data warehouse, data analytics projects, and/or...Big data
ClifyX
New York, NY5 days ago - ...experienced Information Technology Specialist II (Data Architect) to lead data collection, movement, storage, transformation and pipelines for Big Data. You will translate business... ...with business partners, designing technical solutions, and supporting cross-functional...Big data
$70 per hour
Job Title: OA-Enterprise Data Architect Job Location: Dauphin County- PA Client Name: Commonwealth... ...bridge between business processes and technical implementation, ensuring that new... ...such as Snowflake, Databricks, MongoDB and big data on cloud-based ecosystems (AWS, Azure...Big dataLocal areaRelocationVisa sponsorship$170k - $210k
...an opening with your name on it As a Staff Data Architect within Data Architecture who focuses on AI &... ...experience in data architecture, data platforms, and Big Data with demonstrated experience in ML engineering Deeply technical and analytical, with hands‐on architectural...Big dataOdd jobTemporary workLocal areaWork from homeWorldwide$125k - $190k
...bold business leaders. We deliver cloud, data and customer experience solutions. Our... ...requires:The Google Cloud Data and AI Solution Architect (SA) is a customer-facing, pre-sales... ...complex business challenges into robust technical architecture and Statements of Work (...Permanent employmentFull timeContract workTemporary workRemote work- ...DescriptionJob Description: Principal, Business Consulting -Solution Architect The vision of the Data &Analytics team is to help our clients become Data/... ...and manage data product roadmaps while providing technical leadership and solution architecture guidance. We are...Full timeTemporary workWork experience placementLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Technical Architect. Be the first to apply!
Related searches
- data center architect New York, NY
- hadoop big data architect New York, NY
- enterprise data architect New York, NY
- database designer New York, NY
- data integration architect New York, NY
- senior data architect New York, NY
- sr data modeler New York, NY
- big data architect New York, NY
- data architect New York, NY
- senior data modeler New York, NY