Data Platform Engineer
3B Staffing LLC
Position: Data Platform Engineer
Location: Rochester, NY
Duration: 12+ Months
Hadoop and Informatica experience are a MUST
Description:
The Data Platform Engineer engages in the design, development and maintenance of the big data platform. This platform hosts structured and non-structured data sets that support various business operations and enable data-driven decisions. The role involves administering various data-hub ecosystem open source software tools along with other vendor supported tools like HortonWorks Hadoop, CISCO DV, IBM COGNOS tools . The DPE will work closely with Data Scientists, infrastructure Administrators and Data Platform Architects to ensure the platform meets business demands.
Essential Resource Responsibilities / Accountabilities: Level I- Installs and /or upgrades, configures, administers and troubleshoots the data hub software environment in order to achieve a reliable, highly available, well performing system- Provides direct technical support to data warehouse user community, and triages support to appropriate personnel when technical support is not sufficient.- Develops standards, policies and procedures for the form, structure and attributes of the data warehouse tools and systems - Develops data/information quality metrics- Develops processes to monitor cluster performance and resource usage- Works with Server Engineers to install new nodes, resolve node failures, and apply patches and upgrades- Maintains processes that feed data from various systems across the enterprise, ensuring data quality and process efficiency- Follows and helps streamline procedures for provisioning access to the BI system and establishing security Minimum Resource Qualifications:- Bachelor's degree in Information Technology, Computer Science, Software Engineering, or closely related field (or four additional years related work experience in lieu of bachelors)- Related work experience (i.e. Co-ops/Internships) preferred- Ability to take initiative and have a strong vision for driving large scale distributed data platforms- Experience with ecosystem components such as Hadoop, Cisco DV, Cognos, etc- Familiarity with Linux system administration, Linux scripting and networking skills- Proficiency in a programming language such as Python or Java is a plus- Experience with relational and NoSQL databases, including modeling and writing complex queries is a plus- MUST have EXCELLENT communication and
analytical skills Level I - Ability to perform routine tool maintenance working with the vendors and others on the team- Ability to identify data warehouse application and data issues- Monitor system uptime and performance- Escalate appropriately to management and/or more senior Tool Administrators- Minimum of 3 years' experience in tool administration- Demonstrated experience with Data Warehousing- Proactively identify and address risks on system before they become systems issues- Research and resolve data warehouse application and data issues
Physical Requirements- Ability to travel across regions Physical Requirements: In support of the Americans with Disabilities Act, this resource requirements document lists only those responsibilities and qualifications deemed essential to the position Equal Opportunity
Employer: As such, requires all suppliers of temporary staffing resources to affirm the rights of every person to participate in all aspects of employment without regard to race, color, sex/gender, age, disability, religion, creed, citizenship status, national origin, veteran status, military status, marital status, familial status, domestic violence victim status, sexual orientation, gender identity, predisposing genetic characteristic, genetic information, or any other status protected under the law
Location: Rochester, NY
Duration: 12+ Months
Hadoop and Informatica experience are a MUST
Description:
The Data Platform Engineer engages in the design, development and maintenance of the big data platform. This platform hosts structured and non-structured data sets that support various business operations and enable data-driven decisions. The role involves administering various data-hub ecosystem open source software tools along with other vendor supported tools like HortonWorks Hadoop, CISCO DV, IBM COGNOS tools . The DPE will work closely with Data Scientists, infrastructure Administrators and Data Platform Architects to ensure the platform meets business demands.
Essential Resource Responsibilities / Accountabilities: Level I- Installs and /or upgrades, configures, administers and troubleshoots the data hub software environment in order to achieve a reliable, highly available, well performing system- Provides direct technical support to data warehouse user community, and triages support to appropriate personnel when technical support is not sufficient.- Develops standards, policies and procedures for the form, structure and attributes of the data warehouse tools and systems - Develops data/information quality metrics- Develops processes to monitor cluster performance and resource usage- Works with Server Engineers to install new nodes, resolve node failures, and apply patches and upgrades- Maintains processes that feed data from various systems across the enterprise, ensuring data quality and process efficiency- Follows and helps streamline procedures for provisioning access to the BI system and establishing security Minimum Resource Qualifications:- Bachelor's degree in Information Technology, Computer Science, Software Engineering, or closely related field (or four additional years related work experience in lieu of bachelors)- Related work experience (i.e. Co-ops/Internships) preferred- Ability to take initiative and have a strong vision for driving large scale distributed data platforms- Experience with ecosystem components such as Hadoop, Cisco DV, Cognos, etc- Familiarity with Linux system administration, Linux scripting and networking skills- Proficiency in a programming language such as Python or Java is a plus- Experience with relational and NoSQL databases, including modeling and writing complex queries is a plus- MUST have EXCELLENT communication and
analytical skills Level I - Ability to perform routine tool maintenance working with the vendors and others on the team- Ability to identify data warehouse application and data issues- Monitor system uptime and performance- Escalate appropriately to management and/or more senior Tool Administrators- Minimum of 3 years' experience in tool administration- Demonstrated experience with Data Warehousing- Proactively identify and address risks on system before they become systems issues- Research and resolve data warehouse application and data issues
Physical Requirements- Ability to travel across regions Physical Requirements: In support of the Americans with Disabilities Act, this resource requirements document lists only those responsibilities and qualifications deemed essential to the position Equal Opportunity
Employer: As such, requires all suppliers of temporary staffing resources to affirm the rights of every person to participate in all aspects of employment without regard to race, color, sex/gender, age, disability, religion, creed, citizenship status, national origin, veteran status, military status, marital status, familial status, domestic violence victim status, sexual orientation, gender identity, predisposing genetic characteristic, genetic information, or any other status protected under the law
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Platform Engineer in Rochester, NY vacancy
$90k - $140k
...products like SchoolTool, Advanced Analytics, and our Integrations Platform from the ground up, giving us deep expertise in developing... ...our team to grow and make an impact. We are looking for a Data Engineer who enjoys solving complex problems and building scalable data...SuggestedWork at officeWork visaFlexible hours- ...Mindex, a software development and cloud services company with 30+ years of success, seeks a Data Engineer to design, develop, and optimize data platforms for analytics, reporting, ML and AI initiatives. You’ll work with cross-functional teams to influence architecture...Suggested
$110k - $140k
...Megazone Cloud is looking for a Data Engineer to be a backbone of our data‑driven culture. You are a "builder" with a true thirst for knowledge and a startup mentality. You're not afraid to be a "jack of all trades" and you thrive in an environment where you can think...SuggestedInternshipImmediate startFlexible hours- ...Who We’re Looking For Megazone Cloud is looking for a Data Engineer Co‑op who is a "builder" at heart and eager to apply technical skills to real‑world customer problems. We need students who are curious, driven, and comfortable asking "what if?" to solve complex challenges...SuggestedImmediate start
$82.6k - $162.8k
...) using OneStream development tools and best practices.Support data management activities including data loads, mappings, transformations... ..., and error handling within OneStream (and/or comparable CPM platforms such as Hyperion or SAP BPC).Develop scripts and queries using...SuggestedLocal areaRemote work- ...Channel Outdoor (CCO) has developed an industry-leading platform (RADAR) that provides data-driven audience insights and measurement for out-of-home... ...looking for a detail-oriented and business-minded Analytics Engineer to join the RADAR Data Products team. In this role, you...Temporary workWork experience placementWork at officeFlexible hours
- ...services together into a single connected HCM platform. As Paychex and Paycor come together, we're combining innovative technology, data-driven insights, AI, and human expertise... .... Overview The Data Solutions Engineer will play a key role in integrating, architecting...Full timeContract workPart timeInternshipLocal area
$107.9k - $179.9k
...you an experienced, passionate pioneer in data and technology who wants to work in a... ...Senior Data Product Analyst - Data Management Engineer III, you will have the opportunity to... ...clients to modernize technology and data platforms while delivering scalable, high-value outcomes...Local areaVisa sponsorship- ...DevSecOps Platform Engineer – Enterprise Analytics Services Position Summary The DevSecOps Platform Engineer enables the Enterprise Analytics Services product squads by designing, securing, automating, and operating the software delivery platform supporting a common...
$102.75k - $171.25k
...wants to work in a collaborative environment? As an experienced Data Engineer - Project Delivery Specialist you will have the ability to... ...designing, building, and operating modern data products and platforms across a scale delivery program (onshore/offshore). Your focus...Local areaVisa sponsorship- ...with other market leaders, sophisticated data analytics and research, and policy... ...visit: As a Senior Associate of Analytics Engineering within Morgan Health, you will utilize your... ...engineering, product/architecture, and platform partners) Preferred Qualifications, Capabilities...Work at officeVisa sponsorship
$108k - $122k
...is looking for a qualified IT Service Management professional in Rochester, NY. This role involves managing the service management platform, mentoring team members, and enhancing workflows. Ideal candidates have extensive IT experience and strong communication skills....Full time$153k - $297k
...join our team.KPMG is currently seeking an Associate Director, Platform Engineering to join our Enterprise Security Services organization.... ...continuous improvement of tool interoperability, workflow automation, data exchange, and operational effectivenessDrive the...H1bLocal area$112k - $168k
...subsidiaries by implementing core technologies across industrial platforms in diverse growth markets. Our goal is to help revitalize the... ..., working closely with security, IT personnel, software engineers, and partners across our businesses to identify and remediate...Permanent employmentWork at officeRemote work1 day per week- ...Fair360 and others. If you're as passionate about your future as we are, join our team.KPMG is currently seeking a Lead Engineer, Network Security Platform to join our Digital Nexus technology team.Responsibilities:Assist in the development of technology architecture...H1bLocal area
- SGS Société Générale de Surveillance SA in Rochester, NY is seeking a Junior Quantitative Analyst to support the FIC and EQD quants in the AMER region. The role focuses on derivatives pricing, margin models and model monitoring, with gradual ownership of recurring items...
$100k
...we are looking for entry-level software programmers, Java full stack developers, Python/Java developers, data analysts/data scientists, machine learning engineers for full time positions with clients. Who should apply? Recent computer science/engineering/mathematics/statistics...Full timeH1b- ...Technical Skills ~7–8+ years of experience in DevOps, Cloud Engineering, or related roles. ~ Strong hands-on experience with Azure DevOps... ...CD, and release automation. Experienced in managing DevOps platforms and processes at scale. Comfortable partnering with...
- ...for all . Join our mission as our next Senior DevOps Engineer to join our R&D Instrument Platforms organization. This role will focus on the design,... ...addition to internal equity and alignment with market data. At QuidelOrtho, it is not typical for an individual to...Local areaRemote workFlexible hours
- ...150kWork across the product development and IS organizations to engineer infrastructure, tools, and best practices to improve the organization... ...demonstrated the ability to develop, implement and support data center cloud environmentsJob Responsibilities:Automate deployment...Work at office
$105.4k - $207.8k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant impact on our clients... ...supporting artificial intelligence (AI) solutions, data lake deployment, analytics platforms, or using AI-...Local area$125k - $350k
...in technology, research, and finance to create innovative solutions that impact the financial markets and take data analysis to new levels. Software Engineers create next generation software solutions to support business areas across the firm. Software Engineers work closely...- ...continuously looking for entry-level software programmers, Java full stack developers, Python/Java developers, data analysts/data scientists, data engineers, machine learning engineers for full time positions with clients. Who should apply? Recent computer science/engineering...Full time
- ...and fulfillment. We use machine learning and Internet-scale data to elevate customer experience, improve efficiency, and reduce... ...and Discovery ML team at Instacart works alongside world-class engineers, data scientists, and product managers to shape the future of search...Remote jobPermanent employmentWork experience placementInternshipWork at officeWork from homeFlexible hours
- ...Job Description Job Description As a Data & AI Engineer, you’ll build and deploy modern data pipelines and generative AI solutions on AWS — from scalable ETL/ELT workflows and cloud data platforms to production-grade RAG systems and AI agents. One engagement you may...
- ...software programmers, IT enthusiasts, Python/Java developers, data analysts/data scientists. We welcome candidates with all visas and citizens to apply.Who Should Apply:Recent computer science/engineering/mathematics/statistics or science graduates looking to make their...
- ...available for US based applicants only. AI Engineer Rochester, New York Contract-9 to 1... ...Payroll problems. Leads creation of data analytics capability for identifying key... .... ~2 years of experience in cloud platforms (e.g. AWS, Azure, Google Cloud) and containerization...Contract workWork visa
$50.5k - $112.5k
...The Opportunity As an AI Engineer, you will be at the forefront of transforming raw data into actionable insights, enabling informed decision-making and driving... ...engineering to build and deploy software and platform systems that create Artificial Intelligence and Machine...Work experience placementH1bLocal area- ...We are seeking a highly skilled AI/LLM Engineer to design, develop, and deploy intelligent agent-based systems capable of reasoning... ...frameworks, and experience integrating LLM solutions with enterprise data platforms. Roles and Responsibilities Agent & AI System Development...
$73.5k - $212.28k
...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision...H1b
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Platform Engineer. Be the first to apply!
Related searches
- data center engineer Rochester, NY
- data engineer analytics Rochester, NY
- data engineer machine learning Rochester, NY
- finance data engineer Rochester, NY
- data engineer Rochester, NY
- junior data engineer remote Rochester, NY
- data developer Rochester, NY
- senior data center engineer Rochester, NY
- data engineering intern summer Rochester, NY
- data science developer Rochester, NY


