Senior Big Data Developer
Automation Image
Responsibilities Define technical scope and objectives through research and participation in requirements-gathering and definition of processes. Gather and process raw, structured, semi-structured, and unstructured data at scale, including writing scripts and developing programmatic interfaces against web APIs. Design, review, implement and optimize data transformation processes in the Hadoop ecosystem. Test and prototype new data integration tools, techniques and methodologies. Participate in functional test planning and testing for the assigned application integrations, functional areas and projects. Work with the team in an Agile environment to ensure a quality product is delivered. Rapid response and cross‑functional work to deliver appropriate resolution of technical, procedural, and operational issues. Qualifications MS/BS degree in Computer Science, related technical field, or equivalent work experience. Minimum of 5 years of experience with the following: Experience architecting and integrating the Hadoop platform with traditional RDBMS data warehouses. Experience with major Hadoop distributions such as Cloudera (preferred), HortonWorks, MapR, BigInsights, or Amazon EMR is essential. Experience developing within the Hadoop platform including Java, MapReduce, Hive, Spark, Python. Experience with scheduling technologies such as Azkaban, Oozie, or Control‑M. Excellent oral and written communication skills Excellent analytical and problem solving skills Working knowledge of Linux O/S and Solaris environments Experience with logical, 3NF or Dimensional data models. Experience with Netezza, Oracle, SQL Server. Experience with Hadoop ecosystem technologies like Flume, Sqoop, NiFi, Spark Streaming. Knowledge of Java SE, Java EE, JMS, XML, XSL, Web Services and other application integration‑related technologies Experience with NoSQL databases such as HBase, Cassandra, Redis or MongoDB. Experience with Pig and Pig UDF development. Certifications from Cloudera, HortonWorks and/or MapR. Familiarity with Business Analytics tools and platforms such as Tableau, Jaspersoft, Business Objects, MicroStrategy, Platfora, a plus. Experience in working in an Agile. Desirable Skills & Experience Experience with logical, 3NF or Dimensional data models. Experience with Netezza, Oracle, SQL Server. Experience with Hadoop ecosystem technologies like Flume, Sqoop, NiFi, Spark Streaming. Knowledge of Java SE, Java EE, JMS, XML, XSL, Web Services and other application integration‑related technologies Experience with NoSQL databases such as HBase, Cassandra, Redis or MongoDB. Experience with Pig and Pig UDF development. Certifications from Cloudera, HortonWorks and/or MapR. Familiarity with Business Analytics tools and platforms such as Tableau, Jaspersoft, Business Objects, MicroStrategy, Platfora, a plus. Experience in working in an Agile. Location Dallas, TX. Job may require some travel in the US with expenses paid by employer. 40 hours per week. Applicant must be authorized to work in the USA. #J-18808-Ljbffr Automation Image
$100k - $125k
...Consultancy Services is looking for an experienced ETL Informatica Developer based in Addison, Texas. The role requires a minimum of 10... ...development using Informatica and strong SQL proficiency to manage data transformations. Responsibilities include designing ETL...SeniorBig data- Automation Image in Dallas, TX is seeking a skilled professional to define technical scopes, integrate data in the Hadoop ecosystem, and ensure quality delivery in an Agile environment. The ideal candidate will possess 5+ years of experience with Hadoop and data integration...SeniorBig data
- System One is seeking a Senior Data Engineer with expertise in Apache Spark and Airflow for a role based in Dallas, TX. This position requires... ...analytics and reporting needs, along with strong skills in big data processing, SQL, and scripting. The ideal candidate will collaborate...SeniorBig data
$115k - $129k
PDF Solutions is hiring a Data Engineer in Dallas, Texas to enhance their Big Data Analytics platform. The role involves architecting scalable NoSQL databases, maintaining high performance of Cassandra clusters, and utilizing DevOps practices for infrastructure automation...SeniorBig data- Cloud BC Labs is seeking a Data Engineer with 5+ years of experience in designing and maintaining data pipelines. The role involves processing large datasets and ensuring data quality across various systems, utilizing technologies like Apache Spark, PySpark, and Airflow...SeniorBig data
- Dormont Manufacturing Co is looking for a passionate Data Engineer to enhance our Data Analytics and Business Intelligence platform. The... ..., proficiency in ETL processes, and skills in Python, SQL, and big data technologies. We offer a supportive work environment, competitive...SeniorBig data
- ...Position Senior PySpark Data Engineer Work Location Irving, TX (Onsite) Experience 8+ Years Employment... ...utilization. Diverse Data Integration: Develop robust solutions for ingesting high-... ...data solutions. Qualifications Big Data Frameworks Expertise: Demonstrated...SeniorBig dataPermanent employmentFull time
- ...Job Title Big data Developer Work Location: Irving, Texas Job Summary Seeking a Senior Python Data Engineer with 3 to 5 years of experience specializing in Apache Spark and Python to design and implement scalable data solutions Job Description Develop and maintain large...SeniorBig dataTemporary workLocal area
$157.41k - $207.8k
...Function: Software Engineering About the Job Senior Data Engineer Location: Irving, Texas Job... ...analysts to elevate our data ecosystem. Develop and maintain scalable data pipelines for... ...solutions. Enhance real-time data insights for big data processing and analytics. Support BI...SeniorBig dataFor contractorsWork at officeLocal areaRemote work- ...ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable... ...pipelines, orchestrate workflows with Airflow, develop ingestion workflows from third-party APIs... ...; - 2+ years of experience with Big Data technologies ( Spark , Snowflake )...SeniorBig dataWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...the time to celebrate both the small & big wins. INCLUSION is a core tenant of your... ...interview process. Lantern is looking for a Senior Data Engineer to join our Data Engineering... ...engineering mindset and an interest in developing enterprise scale solutions using industry...SeniorBig dataTemporary workWork at office
- ...the time to celebrate both the small & big wins. INCLUSION is a core tenant of your... ...change. Position Lantern is looking for a Senior Data Engineer to join our Data Engineering... ...engineering mindset, and an interest in developing enterprise‑scale solutions using industry...SeniorBig dataTemporary workWork at office
- A technology solutions firm in Dallas is seeking a Big Data Infrastructure DevOps/Support Administrator. This role involves supporting and developing the Enterprise Infrastructure Big Data Service using Java, Python, and Hadoop. Ideal candidates will have a strong background...SeniorBig data
- ...among the top echelon in site reliability. As a Senior Lead Site Reliability Engineer at JPMorgan Chase within the Chief Data & Analytics Office (CDAO) AI/ML & Data... ...distributed compute frameworks Familiarity with big data ecosystem tools (e.g., Spark, Glue, MapReduce...SeniorBig dataWork at office
$100k - $105k
Tata Consultancy Services is looking for a Data Engineer to design, develop, and maintain data pipelines using PySpark in a Big Data environment. You will ensure data quality and implement ETL processes to migrate data across systems. The ideal candidate has over 8 years...SeniorBig data$106.9k - $176.5k
...world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering... ...target data platform designs. Design, develop, and implement data engineering... ...and experience with Spark for big data processing. Proven experience in at...SeniorBig dataSummer holidayFlexible hours- Dallas County is seeking a technical leader for its data engineering function, responsible for overseeing data systems and services. The... ..., and leadership skills. A mastery of SQL, cloud platforms, and big data frameworks is essential. The position supports a commitment...SeniorBig data
$65k - $149.5k
Responsibilities Leads in developing, supporting and implementing data solutions for multiple applications in order to meet business objectives and user requirements... ...Learning Competencies Application Delivery Process Big Data Management and Analytics Business Intelligence...SeniorBig dataFull timeTemporary workWork experience placement$212k - $259k
...involves We are seeking an experienced Senior Manager, Data Engineering, to lead the Enterprise Platform... ...by delivering reliably and by developing engineers who grow in scope and impact.... ...of experience in data engineering and Big Data development, with extensive experience...SeniorBig dataDaily paidLocal areaRemote work$186k - $223k
...relationship, for all. About the Role As a Senior Engineer for our Data Platform team, you will be responsible... ...of people. Responsibilities Design, develop, and maintain core services within... ...Kafka, PubSub, Dataflow Databases and Big Data Tooling : Redshift, BigQuery, Databricks...SeniorBig dataWork experience placement- ...Big Data Developer Location: Strongsville OH, Pittsburgh, PA, Dallas, TX Duration: Fulltime Skill: Big Data Must Have Technical/Functional Skills: Bigdata Hadoop & ecosystem, Scala/Python, PySpark. Oracle PL/SQL, CI/CD, Excellent communication, Data...Big dataFull time
- ...Position: Big Data Developer Location: Irving, TX Duration: Long Term Responsibilities: 1). Develop software using Hadoop technologies like Spark, Scala, Python, Hbase, Hive, Cloudera. 2). Fine tune application performance...Big data
- ...Job Title: Sr. DATA Engineer Work Location Irving TX Job Description Seeking a Senior professional with 3 to 5 years of experience in... ...Spark SQL to design and optimize big scalable data processing... ...SQL Scala Python Java ecosystem Develop and maintain scalable data processing...SeniorBig dataTemporary workLocal area
- ...service while fostering opportunity and growth for associates. Sr Data Engineer A Sr. Data Engineer is an experienced professional... ...as AWS Redshift, Azure Synapse, or Google BigQuery. Knowledge of big data technologies, including Hadoop, Spark, Kafka, and HBase, with...SeniorBig dataLocal area
$157.41k
...CVS Pharmacy, Inc., a CVS Health company, is hiring a Senior Data Engineer in Irving, TX to develop, build, and manage large‑scale data structures, pipelines... ...and reporting use cases. Data warehousing and big‑data implementation. Pay Range $157,414.00 per year (base...SeniorBig dataTemporary workLocal areaRemote work$157.41k
...Position Summary Sr. Data Engineer at Aetna Resources, LLC. (a CVS Health company) located... ...analyzing data engineering problems and developing, building, and managing large‑scale data... ...SAP Crystal, Cognos BI reporting tools. Big data platforms (Hadoop on GCP or AWS). Analyzing...SeniorBig dataTemporary workLocal area- ...AI Center of Excellence within the Chief Data and Analytics Office. We work on projects... ...analysts, and applying advanced data science and big data mining techniques to uncover trends,... ...business decision making. Mentors and develops junior data scientists and analysts. Core...SeniorBig dataWork experience placementWork at office
$157.41k
...hiring for the following role in Irving, TX: Sr. Data Engineer to analyze data engineering problems and develop, build and manage large‑scale data structures, pipelines... ...Crystal reporting, Cognos BI Reporting tools; “Big data” platforms including Hadoop (GCP or AWS); and...SeniorBig dataHourly payFull timeTemporary workLocal areaRemote work$90k - $104k
Tata Consultancy Services Limited is seeking an ETL Informatica Developer with a strong background in developing and maintaining ETL... ...experience, proficiency in SQL/PLSQL, and a deep understanding of data integration and warehousing. This position is based in Addison,...SeniorBig data$100k - $125k
...Services Limited is looking for an experienced ETL Informatica Developer in Addison, Texas. This role requires a minimum of 10 years of... ...Science and proficiency in SQL, along with exposure to big data technologies like Spark and Kafka. The position offers a competitive...SeniorBig data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Big Data Developer. Be the first to apply!
- senior data center engineer Dallas, TX
- data operations engineer Dallas, TX
- data engineer machine learning Dallas, TX
- remote data engineer Dallas, TX
- data systems engineer Dallas, TX
- azure data engineer Dallas, TX
- data science developer Dallas, TX
- big data engineer Dallas, TX
- data engineering intern summer Dallas, TX
- senior data engineer Dallas, TX


