Big Data Engineer
$86.4kHighmark Health
Company : Highmark Health Job Description :
JOB SUMMARY
***CANDIDATE MUST BE US Citizen (due to contractual/access requirements)*** This job is responsible for designing and engineering data solutions for the enterprise and, working closely with business, analytic and IT stakeholders, assists with the development and maintenance of these solutions. This includes coding data ingestion pipelines, transformations and delivery programs/logic for people and systems to access data for operational and/or analytic needs. Duties include but are not limited to the coding, testing, and implementation of ingestion and extraction pipelines, transformation and cleansing processes, and processes that load and curate data in conformed, fit‑for‑purpose data structures. The incumbent is expected to partner with others throughout the organization (including other engineers, architects, analysts, data scientists, and non‑technical audiences) in their daily work. The incumbent will work with cross‑functional teams to deliver and maintain data products and capabilities that support and enable strategies at business unit and enterprise levels. The incumbent is expected to utilize technologies such as, but not limited to: Google Cloud Platform, Hadoop, Hive, NoSQL, Kafka, Spark, Python, Linux shell scripting, SAS, Teradata, Oracle and Informatica.ESSENTIAL RESPONSIBILITIES
In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well‑engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud‑oriented platforms. Work with internal and external platforms and systems to connect and align on data sourcing, flow, structure, and subject matter expertise. Work with business stakeholders and strategic partners to implement and support operational and analytic platforms. This may include products purchased by the organization that must be ingested or modeled/derived data maintained by enterprise platforms and data consumers. Working across multiple, disparate systems and platforms, code, test, implement, and maintain scalable and extensible frameworks that support data engineering services. Align with security, data governance and data quality programs by contributing to assigned components of metadata management, data quality management, and the application of business rules. Develop and maintain associated data engineering processes and participate in required operating procedures as part of the enterprise’s overall information management activities. Includes data cleansing, standardization, technical metadata documentation, and the de‑identification and/or tokenization of data. Maintain machine learning and AI engineering processes (MLOps) that are deployed to cloud or big data environments. Responsible for delivery of assigned projects, this may include providing guidance to Junior contributors within team. Will attend meetings with customers as needed. Assist with the establishment of standards and patterns for high performance data ingestion, transformation, and delivery. Keep current with cloud, big data, and data science technologies and recommend and use best tools to perform current and future work. Other duties as assigned or requested.EDUCATION
Required Bachelor's Degree in Software Engineering, Information Systems, Computer Science, Data Science or related field Substitutions None Preferred Master's Degree in Software Engineering, Information Systems, Computer Science, Data Science or related fieldEXPERIENCE
Required 3 years of Data platform development, data engineering, software development, or data science 1 year of Big data or cloud data platform Preferred 1 year of Google Cloud Platform, AWS, Azure or other cloud platform 1 year of Spark or Python 1 year of Data science, AI & machine learning engineering 1 year of Healthcare Industry 1 year of Database AdministrationLICENSES AND CERTIFICATIONS
Required None Preferred NoneSKILLS
SQL Data Warehousing Problem‑Solving Communication Skills Analytical Skills Language (Other than English) None Travel Required 0% - 25% PHYSICAL, MENTAL DEMANDS and WORKING CONDITIONS Office‑Based Teaches / trains others regularly Rarely Travel regularly from the office to various work sites or from site‑to‑site Does Not Apply Works primarily out‑of‑the office selling products/services (sales employees) Never Physical work site required No Lifting: up to 10 pounds Frequently Lifting: 10 to 25 pounds Occasionally Lifting: 25 to 50 pounds Rarely The job description has been designed to indicate the general nature and essential duties and responsibilities of work performed by employees within this job title. It may not contain a comprehensive inventory of all duties, responsibilities, and qualifications required of employees to do this job. Compliance Requirement: This job adheres to the ethical and legal standards and behavioral expectations as set forth in the code of business conduct and company policies. As a component of job responsibilities, employees may have access to covered information, cardholder data, or other confidential customer information that must be protected at all times. In connection with this, all employees must comply with both the Health Insurance Portability Accountability Act of 1996 (HIPAA) as described in the Notice of Privacy Practices and Privacy Policies and Procedures as well as all data security guidelines established within the Company’s Handbook of Privacy Policies and Practices and Information Security Policy. Furthermore, it is every employee’s responsibility to comply with the company’s Code of Business Conduct. This includes but is not limited to adherence to applicable federal and state laws, rules, and regulations as well as company policies and training requirements. Pay Range Minimum: $86,400.00 Pay Range Maximum: $138,600.00 Base pay is determined by a variety of factors including a candidate’s qualifications, experience, and expected contributions, as well as internal peer equity, market, and business considerations. The displayed salary range does not reflect any geographic differential Highmark may apply for certain locations based upon comparative markets. Highmark Health and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law. We endeavor to make this site accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact the email below. For accommodation requests, please contact HR Services Online at View email address on click.appcast.io. California Consumer Privacy Act Employees, Contractors, and Applicants Notice #J-18808-Ljbffr Highmark HealthVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in New York, NY vacancy
- ...Linux servers troubleshooting and support tasks Oversee governance and mitigate risk Qualifications Masters or Bachelor in CIS / Engineering / Science / Mathematics / Statistics / Design… etc. Should be Mexican Citizen eligible for TN visa sponsorship Should have hands...Big dataFull timeRelocationVisa sponsorship
- ...Big Data Engineer Job Type: Full Time Employment Location: Phoenix, AZ or New York Experience Required: 6+ Years Responsibilities: Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms...Big dataFull time
- ...Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and...Big dataWork experience placement
- Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...Big data
- ...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are... ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open...Big data
- ...Senior Data Lake Engineer/Developer-Tech Lead Duration: 6 months CTH Location: New York Hands-on Tech lead responsible for designing a... ...solving skills, and algorithms. Must Haves: Strong experience in Big Data Technologies such as Hadoop Data Management Tools for...Big data
- ...A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various... ...ideal candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among...Big data
- ...the energy sector by creating a unified data network. Backed by experienced founders and... ...for complex analysis by data scientists, engineers, and other stakeholders. Who we are... ...tools like dbt You have experience with big data technologies like Hadoop, Spark, or...Big data
- ...We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands‑on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark...Big data
- ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15...Big dataContract work
- ...reliably. Join our team to help build the data infrastructure that supports and scales our... ...a highly motivated and experienced Data Engineer to join our growing team. You will be responsible... .../S3 General/S3 Express. Experience with big data technologies Experience with Airflow....Big data
- ...We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial... ...and best practices in data engineering, cloud technologies, and big data processing. Qualifications Bachelor's or Master's degree in...Big dataFull timeWork at officeRemote work
$60 - $70 per hour
...Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions... ...from a wide variety of data sources using SQL and GCP or AWS “big data” technologies Build analytics tools that utilize the data...Big dataHourly pay- ...A major client of ours has a need for a Lead Data & AI Solutions Engineer for their NY, NY office. This is a contract, hybrid role and will require... ...with AI/advanced machine learning frameworks Familiarity with big data technologies (Spark, Hadoop) Experience setting up new...Big dataContract workWork at office
$60 - $72 per hour
...Data Engineer 4 Corner Resources is hiring Data Engineers for a leading healthcare organization. This is a chance to join a fast-moving,... ...pipelines Strong Java or Python skills Working knowledge of Big Data systems, automation, and security Production cloud...Big dataContract workRemote work- ...Our client provides data-driven, action-oriented solutions to business problems through... ...industries. ROLE We are seeking a Databricks Data Engineer. RESPONSIBILITIES Lead and/or assist in... ...Deep understanding of one or more of the big data computing technologies such as...Big data
$165k - $230k
...Position Summary We're hiring a Senior Data Engineer to own data at truly massive scale. You'll design and run pipelines that clean, enrich... ...run data partnerships. Nice to have ~ Experience with big data, columnar storage formats, vector indexes, and privacy/...Big dataPermanent employmentWork at officeMonday to Friday$105k - $145k
...Data Engineer Opportunity Bustle Digital Group (BDG) is looking for a talented Data Engineer to join our growing data team. You will work... ...experience with Python for scripting and automation. Cloud & Big Data Savvy: Hands-on experience with cloud platforms (AWS, GCP,...Big dataWork at officeRemote workFlexible hours$200k - $220k
...force behind Schonfeld’s next-generation data platforms, you will architect, operate, and... ...with quants, data scientists, and fellow engineers to achieve sub-minute SLAs, shape firm-... ...platforms with Python and SQL Deep expertise in big-data architecture: partitioning, sharding...Big data- ...currently requesting resumes for the following position: Senior Data Engineer Job Overview Design, build and productionize modular and... ...modeling, data warehouse design and data solution architecture in a Big Data environment. Experience as a Data Engineer in a Big Data environment...Big data
- ...degree in the areas of Computer Science, Engineering, Information Systems, Business, or equivalent... ...7+ years of experience in working with data solutions. 3+ years of experience coding... ...or similar) 1+ years experience with big data technologies like EMR, Hadoop, Spark...Big data
- ...intelligence across a federated network of data, and interact across the network through... ...team is looking for talented Data Engineers who are passionate about data and all things... ...to have, but not required Experience in a big data processing framework such as Spark Experience...Big data
$60k - $80k
...consulting and staffing company that places elite engineering talent into high-impact roles at leading... ...on modern technologies across cloud, data, and software disciplines. Our client... ...with Snowflake , Apache Spark , or similar big data technologies Proven experience in...Big dataFull timeContract workRemote work- Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows... ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg...Big data
$136.04k - $182.49k
...Role Overview Engineering Services designs, builds, and sustains technology that powers DE&E... ...technologies, including Quality Assurance, Data Analytics, Software Development, Broadcast... ...model development. Experience working in big data environments (Hadoop, S3, HBase)....Big dataWorldwide$220k - $245k
...benefits using clear incentives and powerful, data-driven insights. Our approach guides... ...We are seeking an exceptional Senior Data Engineer with a high sense of ownership who is excited... ..., data warehousing, data governance, Big Data, data variance, data privacy, and data...Big dataWork at officeFlexible hours3 days per week- ...Description : Client needs a forward-thinking Lead Data Engineer willing to work on-site) in New York NY. This opportunity is in... ...Strong in Git repo and CI/CD deployment process Experience with Big Data - Hadoop, Spark. Job Description: Job Duties: • At...Big data
- Job Title: Data Engineer - MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description We are looking for an experienced Data Engineer... ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain experience...Big data
- ...we are. Integrated Technology Strategies is looking to hire a Data Engineer to be a part of our Consulting team. We are looking for someone... ...implementing scalable ETL and data processing systems to handle the big data ecosystem including data collection, processing, ETL and...Big dataFlexible hours
$144.77k - $209.11k
...Sr. Data Engineer Employment Type: Full-Time, Mid-level. Department: Business Intelligence. CGS is seeking a passionate and driven Data Engineer... ...data using Python, R, SQL, and SAS. Strong knowledge of big data analysis and storage tools and technologies. Strong understanding...Big dataFull timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- junior data engineer remote New York, NY
- data engineering intern summer New York, NY
- hadoop big data developer New York, NY
- senior data quality engineer New York, NY
- aws data engineer New York, NY
- associate data engineer New York, NY
- staff data engineer New York, NY
- data engineer New York, NY
- finance data engineer New York, NY
- senior data center engineer New York, NY

