GCP Data Engineer
Damco
Data Engineer
Location: Hybrid (3x onsite) 2 location options: Houston TX (Downtown) Evansville IN 47708
Project Details: Looking for a Data Engineer that will work in the IT and Data Analytics group at. They will help with developing, constructing, testing and maintaining data acquisition pipelines for large volumes of data. This includes batch and real time processing. They will build help with building large datasets, and collaborate with stakeholders to identify opportunities for data acquisition. Looking for someone who can facilitate the overarching data process from python all the way through to SQL.
Must Have Skills:
- Level 2: Bachelor's degree in Data Science, Analytics, Mathematics, Statistics, Computer Science or STEM
- Minimum of 2 years' experience of related experience in data engineering, data analysis, ETL or similar role delivering data pipelines
- Must have experience with Python and Strong Proficiency in SQL with direct working experience leveraging this skill
- Understanding in data modeling concepts and experience with data modeling tools
- Bachelor's degree in Data Science, Analytics, Mathematics, Statistics, Computer Science or related field
- Level 3: Minimum of 5 years' experience of related experience in data engineering, data analysis, ETL or similar role delivering data pipelines
- Experience with Google Big Query, Python and Strong Proficiency in SQL with direct working experience leveraging this skill
- Understanding in data modeling concepts and experience with data modeling tools
- GCP experience
Nice to have Skills:
- Utility experience
- Experience with data governance
- Experience working in an agile team environment
Day to Day Responsibilities:
- Develop, construct, test and maintain data acquisition pipelines for large volumes of structured and unstructured data. This includes batch and real-time processing.
- Build large and complex datasets based on business requirements.
- Construct 'big data' pipeline architecture.
- Identifies opportunities for data acquisition via collaborating with stakeholders and business clients.
- Leverages a variety of tools such as Python, SAP Data Services, Dataflow, DataStream, Google Cloud Functions, Spark, Google Cloud Run, SAP SLT, Google Pub Sub, etc. to integrate systems and data pipelines.
- Recommends ways to improve data quality, reliability, and efficiency.
- Develop JSON messaging structure for integrating with various applications.
- ...provides the opportunity to work in a modern enterprise networking environment with a strong emphasis on wireless engineering, campus networking, and data center infrastructure.Key aspects of the environment include:Campus wireless and switching infrastructure is from...SuggestedFull time
- ...Implement and operationalize modern AI-enabled data capabilities on Google Cloud to ingest,... ...5 plus years of experience in data engineering including hands-on experience working with... ...Flink, and Spark streaming Must Have: GCP - 5 to 6 years. AI exposure - 6 months to...SuggestedContract work
$40 per hour
...As a Machine Learning Engineering Intern, you will be part of a collaborative team supporting the development, deployment, and monitoring... ...learning models. Your primary role is to contribute to Workiva's data scientists' efforts within the Data Management and Analytics...SuggestedRemote jobFull timeSummer workInternshipSummer internshipWork at office- ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with... ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning...SuggestedPermanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
$107.66k - $161.7k
...working on our Poe product. About the Team and Role: Our small engineering team works on challenging problems every day. We have a culture... ...end ownership of Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM application at scale...SuggestedRemote jobFull timeWork experience placementInternship- ...and fulfillment. We use machine learning and Internet-scale data to elevate customer experience, improve efficiency, and reduce... ...and Discovery ML team at Instacart works alongside world-class engineers, data scientists, and product managers to shape the future of search...Remote jobPermanent employmentWork experience placementInternshipWork at officeWork from homeFlexible hours
- ...States and globally. We are currently seeking a Senior Software Engineer to join our team. As a Senior Software Engineer, you will be... ...environments. ~ Strong understanding of software design patterns, data structures, and algorithms. ~ Experience with version control...Full timeTemporary workWork at officeHome officeShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GCP Data Engineer. Be the first to apply!
- data engineering intern summer Evansville, IN
- data processor Evansville, IN
- data Evansville, IN
- health data Evansville, IN
- data visualization Evansville, IN
- data capturer Evansville, IN
- provider data management Evansville, IN
- data internship Evansville, IN
- data collection researcher Evansville, IN
- data network cabling Evansville, IN


