Big Data Architect
Staffing the Universe
Big Data Architect
Location: Chicago, IL / Nashville, TN / New York, NY / Phoenix, AZ
Duration: Full Time
Skills Required:
- Minimum 12-15 years of experience in IT space and minimum 4 years of Big Data platform experience
- Should be well versed with overall IT landscape, technologies and should be able to analyze how different technologies integrates with each other
- Well versed with presales and creating proposal / responding to RFIs/RFPs
- Should be able to provide scalable and robust solution architecture depending on the needs
- Should be able to compare tools and technologies and recommend a tool or technology
- Must have good understanding of Data Structures, Distributed processing framework.
- Must have experience of executing couple of big data projects (end to end)
- Strong technical expertise and hands on experience on Hive, Flume, Hbase & other Hadoop components
- Candidate must have strong background & hands on experience of SPARK or JAVA or Data warehouse / ETL/BI or DWH appliances
- Must have strong customer service skills and excellent verbal and written communication skills.
- Excellent problem solving and analytical skills.
- Ability and desire to work in a fast-paced environment stay motivated and flexible.
- Ability to work cross functionally to deliver appropriate resolution of technical, procedural, and operational issues.
- Deep Knowledge of either Cloudera/Horton Works/MapR/Pivotal
- Good knowledge of NoSQL Databases/Hbase/ MongoDB
- Very good understanding of in-memory databases and distributed databases
- Thoroughly understanding of how to handle real time data integration
- Good understanding of security aspects including Kerberos, Sentry etc
- Good experience with databases and SQL
- Good experience with at least one programming language like Scala, Java, Python, Pig etc
- Proven expertise of delivering end to end projects working with virtual teams
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Big Data Architect in New York, NY vacancy
- ...componentsThorough understanding of NoSQL databases like HBase, Mongo, Cassandra etcRequirements Gathering, designing and developing scalable big data solutions with HadoopStrong technical skills on Spark, HBase, Hive, Sqoop, Oozie, Flume, Java, Scala, Pig, Python etcPractical...Big data
- ...Development, Software Consultancy and Information Technology Enabled Services.Job DescriptionThe Data Lake engineer should come from the background of a Big Data Architect. The position will be in support of data management, ingestion, and client consumption. This individual...Big dataPermanent employmentFull timeH1bFlexible hours
$122k - $163k
...ll Work WithAt Slalom, we co-create custom software, data, and cloud products with clients who are ready to... ...world-class solutions that inspire people to dream big and move faster.What You’ll DoAs a Data Architect at Slalom, you will work in collaborative teams to deliver...Big dataTemporary workLocal area- ...Data Architect Location: NY/NJ Duration: 11 Months Remarks: Years' of experience: 12-15 Skills needed: Need an experienced data architect... ...in cloud data platforms (AWS, Snowflake, Databricks) and big data architecture patterns (Lambda, Kappa). Strong communication...Big dataContract work
InterSources
New York, NY3 days ago $175k - $205.9k
Are you ready to make an impact?As a Data Architect at West Monroe, you will lead the design, implementation, and optimization of data solutions... ...languages such as Python, SQL, Java, or Scala.Experience with big data technologies (e.g., Hadoop, Spark, Kafka).Hands-on...Big dataWork at officeLocal areaImmediate startFlexible hours$300k
...Big Data Architect Company needs Architect with Big Data Technologies experience (BigTable, Hadoop/Hbase, Cassandra, etc), that can provide technical direction towards re-architecting the Data Model and Access Platform that will in turn create a reliable and scalable...Big dataMackenzie HealthCare
New York, NY5 days ago- Jobtailor seeks a senior data engineer to design and implement scalable data applications on big data platforms. You will architect secure on-premises data processing and lead integration across diverse sources. Experience with Kafka streaming and Linux-based Apache ecosystems...Big data
- ...pipelines using PySpark and Databricks for batch and streaming data. Define and enforce data architecture standards, ensuring... ...align with investment banking goals and regulatory frameworks. Architect big data solutions across platforms like Azure Synapse, Snowflake,...Big dataFull timeContract workLocal area
$120k - $180.06k
...Street, New York, NY The Information Technology Specialist II (Data Architect) is an experienced technician who is responsible for data... ...movement, storage, transformation processing, and storage of Big Data. This individual works with both current ETL/Data Warehousing...Big dataTraineeshipLocal areaRemote workFlexible hours- A technology services company is seeking a skilled Hadoop Developer with a minimum of 6-10 years of experience, including at least 2 years working specifically with Hadoop technologies. Candidates must possess strong technical skills in tools like Spark, HBase, and Hive...Big dataPermanent employmentFull time
- ...Job Description Cloud Data Architect Must Have Technical/Functional Skills Cloud Data Architect in Data & Analytics will... ...dbt, Data Virtualization tools Demonstrated experience in Big Data, data warehouse, data analytics projects, and/or any...Big data
ClifyX
New York, NY5 days ago - A leading analytics services company is looking for a Senior Data Architect based in New Jersey. This role involves designing and implementing... .../ML projects. Strong expertise in cloud-native architectures, Big Data engineering, and multi-cloud strategy is essential....Big data
- ...Position: Lead Data Engineer / Senior Data Engineering Lead Location: Greenwich Street... ...data engineering solutions. Architect and implement modern cloud-based data platforms... ...professional experience in data engineering, big data, analytics engineering, or a closely...Big dataContract work
Apetan Consulting llc
New York, NY3 days ago - ...Data Modeler with Relational Database and AWS Cloud experience. Client: Jefferies... ...will involve collaboration with data architects, engineers, and business stakeholders to... ...Experience with NoSQL databases and big data technologies (e.g., DynamoDB, Athena...Big dataFull timeLocal area3 days per week
RIT Solutions, Inc.
New York, NY4 days ago - ...cross-functional teams to understand business needs and provide data-driven solutions. Communicate findings and recommendations to... ...modern ML frameworks such as PyTorch, TensorFlow Experience with big data technologies such as PySpark Experience with ML model...Big data
Georgia IT Inc
New York, NY4 days ago $229.5k - $360k
...fluent with one of the high-level programming languages like Java, Scala, Kotlin, or PythonWe’d love to see that you’ve worked with big data systems (Spark, Kafka, Flink, S3, AirFlow)Familiar with model ML frameworks and tools: Ray, PyTorch, HuggingFace, AWS SagemakerAI...Big dataWork at officeLocal areaRemote workMonday to ThursdayFlexible hours- ...role overlaps with many disciplines, such as Ops, Modeling, and Data Engineering. In this role, you'll be expected to perform many ML... ...team to create and enhance software that enables state-of-the-art big data and ML applications Retrain, maintain, and monitor models...Big dataInternship
Capital One
New York, NY3 days ago - ...pipelines and integrate knowledge graphs for biological and clinical data. Full-Stack AI Engineering: Write maintainable, high-... ...relational databases, and data platforms like Snowflake or Databricks. Big Data & ML Frameworks: Familiarity with Big Data tools (e.g.,...Big dataFull timeRemote work3 days per week
Drh Search Llc
New York, NY1 day ago $130k - $250k
...and operates the platforms, applications, data solutions, models, and analytics that... ...build responsive and intuitive UX/UI and Big Data applications.Within Compliance engineering... ...Prompt EngineeringPrior experience in architecting/ deploying ML applications on AWS/ GCPPrior...Big dataFull timeTemporary workPart time$207.4k - $278.1k
...organization of engineers, product developers,designers, technologists, data scientists, and more - all working to build and advance... ...Lambda, Glue, SQS, SNS, Personalize)Deep hands-on experience with big data technologies such as Databricks, Spark, Kinesis, and KafkaExperience...Big dataFull time- ...driven fraud detection platform. You will architect large-scale ML systems that detect and... ...threat patterns through automation, data intelligence, and generative AI–enhanced... ...statistical modeling. ~ Experience with big data and distributed systems (e.g., Spark...Big data
Appgate
New York, NY1 day ago - ...Job Title: Machine Learning Engineer / Data Scientist Location: New York, NY (Hybrid - 2-3 Days Onsite, F2F Interview Required)... ...have strong hands-on experience with Python-based ML ecosystems, big data technologies, and production model deployment. This role...Big dataContract work
Georgia IT Inc
New York, NY2 days ago - ...AI/ML Data Engineer Location: New York, NY (Hybrid – 3 Days Onsite) Duration: Contract Rate: DOE Job Overview: We are seeking... ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable ML...Big dataContract work
Staffing the Universe
New York, NY5 days ago $168.5k - $206k
General Information Job Title Principal Data Architect Job ID 108701 Work Areas Analytics, Data & Research, Management Consulting, Technology & Engineering Employment Type Permanent Full-Time Location(s) Atlanta, Austin, Boston, Chicago, Dallas...Permanent employmentFull timeWork at officeLocal area- ...by DOHMH. Program Description: The Center for Population Health Data Science (CPHDS)- launched in October of 2023- aims to catalyze... ...hybrid work. Specifically the Data Confidentiality and Privacy Architect will:In the context of the New York City Department of Health...Temporary workWork at officeLocal areaMonday to FridayFlexible hours
- The AI & Data Architect will define the AI and data foundation that enables Trust & Safety (T&S) to scale decision intelligence, automation, and operational excellence. This role will bridge AI, data, product, engineering, and safety teams to translate complex safety challenges...
$170k - $200k
...technology (FinTech) organization focused on delivering innovative data, analytics, and technology solutions that support decision-... ...internal operations.They are seeking a strategic and hands-on Data Architect to design and implement scalable, secure, and modern data...Permanent employmentRemote work- ...Software Consultancy and Information Technology Enabled Services.Job DescriptionJob Description:-The candidate should be an expert on Data masking, especially with Informatica DM tool and should have experience in multiple DM implementations. Responsibilities include:...Full timeH1b
- ...Machine Learning Engineer, iOS and Android, data scientist, Developer solutions to... ...forward. Key Responsibilities: · Architect and refine sophisticated ML models and algorithms... ...Strong background in cloud computing and big data platforms (AWS, Azure, GCP), with...Big dataFull timeRemote workVisa sponsorshipRelocation package
Adidev Technologies Inc
New York, NY1 day ago $229.9k - $262.4k
...role overlaps with many disciplines, such as Ops, Modeling, and Data Engineering. In this role, you'll be expected to perform many ML... ...team to create and enhance software that enables state-of-the-art big data and ML applications. Retrain, maintain, and monitor models...Big dataFull timePart timeInternshipLocal areaCapital One Financial Corporation
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Architect. Be the first to apply!
Related searches
- senior data modeler New York, NY
- big data architect New York, NY
- data center architect New York, NY
- database designer New York, NY
- senior data architect New York, NY
- data architect New York, NY
- data integration architect New York, NY
- sr data modeler New York, NY
- remote data architect New York, NY
- big data developer New York, NY