Big Data Engineer (Spark & SQL)
Computer Task Group, Inc
Job Description
Job Description
Overview
CTG is seeking a Big Data Engineer (Spark & SQL) to support a Cyber Data Active Intelligence team. This role partners with data engineers, cybersecurity teams, and business stakeholders to deliver scalable data solutions and actionable insights from complex security datasets.
Location: Phoenix, AZ
Duration: 12 months
Key Responsibilities:
- Build and optimize Spark-based data pipelines (batch and near real-time)
- Analyze cybersecurity data (threats, vulnerabilities, telemetry) to generate insights
- Develop SQL-driven analytics and reporting solutions
- Ensure data quality, integration, and governance across platforms
- Collaborate with stakeholders to translate business needs into technical solutions
- Support BI reporting and dashboard development
- Contribute to API and enterprise data platform development
Required Skills:
- Strong Apache Spark and advanced SQL analytics expertise
- Experience with data integration, data quality, and data analysis
- Knowledge of security data / cybersecurity analytics
- Strong business translation and stakeholder communication skills
- Experience with BI reporting tools
- Ability to adapt in fast-paced, evolving technical environments
Preferred Qualifications:
- Experience with API development and distributed data platforms
- Familiarity with analytics libraries, NLP, or statistical computing frameworks
- Background in cybersecurity or enterprise data environments
Experience:
- 5+ years in data engineering / big data development
- Proven experience building scalable data pipelines using Spark
Education:
- Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience)
Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.
CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee based recruitment services for this role.
To Apply:
To be considered, please apply directly to this requisition using the link provided. For additional information, please contact Rebecca Olan at View email address on ziprecruiter.com . Kindly forward this to any other interested parties. Thank you!
- ...Big Data Engineer Big Data Engineer with mapreduce, spark, hive, sql Location: Phoenix, AZ (Onsite) Duration: C2C Contract Experience: 8+ Years Job Description Big Data Engineer with mapreduce, spark, hive, sql Expert in SQL and data warehousing concepts...SQLBig dataContract work
- A leading IT services firm is seeking a Mid-Senior level Big Data professional with strong SQL and Basic Java knowledge. The role requires expertise in Hadoop ecosystem, Apache Spark, and Scala programming. Responsibilities include data modeling, ETL processes, and solving...SQLBig dataFull time
- ...CTG is seeking a Big Data Engineer (Spark & SQL) to support a Cyber Data Active Intelligence team. This role partners with data engineers, cybersecurity teams, and business stakeholders to deliver scalable data solutions and actionable insights from complex security datasets...SQLBig dataLocal area
- Computer Task Group, Inc is seeking a Big Data Engineer (Spark & SQL) to support their Cyber Data Active Intelligence team in Phoenix, AZ. The role involves developing scalable data solutions and collaborating with various stakeholders to provide actionable insights from...SQLBig dataContract work
- Position Overview CTG is seeking a Big Data Engineer (Spark & SQL) to support a Cyber Data Active Intelligence team. This role partners with data engineers, cybersecurity teams, and business stakeholders to deliver scalable data solutions and actionable insights from complex...SQLBig dataLocal area
$100k - $125k
...including HDFS, MapReduce, Spark, Scala, Hive Expertise in Hive for data warehousing and querying... ...Cloud composer, Big Query, Airflow, GCP hands... ...Java, Spring Boot Strong SQL skill Architect and design... ...functional teams, including data engineers, analysts, and business...SQLBig data- ...1) Strong proficiency in SQL and database technologies 2) Familiarity with data warehousing and data modelling concepts... ...Cloud Platform (GCP) tools such as Big Query, Cloud Storage, Dataproc,... ...technologies such as Hadoop, Spark, Hive, Kafka etc 5) Familiarity...SQLBig data
$100k - $120k
...Sr Data Engineer Location - Phoenix, AZ Fulltime/FTE $100000 to $120000/Annum... ...Strong hands-on experience in Big Data technologies and distributed data... ...Extensive experience with Apache Spark (PySpark/Spark SQL) for large-scale data transformation...SQLBig dataFull time- ...Data Engineer 3 days Phoenix, As a Data Engineer at our client, you will... ...a similar role. Proficiency in SQL and experience with relational... ..., PostgreSQL). Experience with big data technologies (e.g., Hadoop, Spark, Kafka). Proficiency in programming...SQLBig data
- ...Data Architect 6-8 years of IT experience focusing on enterprise... ...tables required Experience with Spark Scala and Java programming... ...data freshness Advanced level SQL experience (Joins, Aggregation,... ...scale, high-performance enterprise big data application deployment and...SQLBig data
- ...Data Engineer I-(DE) Location: Scottsdale AZ (day 1 onsite) Duration... ...Description: Must have skill set: Spark, S3, Glue, AWS Redshift and... ...components, data security, SQL, and Python 6-8 years of IT... ..., high-performance enterprise big data application deployment and...SQLBig dataFull time
- ...Implementation of recommended ETL tools Strong in SQL and Python, with 3+ years hands-on coding... ...both Experience building automated big data pipelines Experience performing data... ...big data frameworks (i.e. Hadoop and Spark) Experience with cloud-based platforms...SQLBig data
- ...services in IT, Telecom, Finance & Accounting and Engineering categories. Position: Big Data Engineer Location: Phoenix, AZ (On-site) Job... ..., and maintain scalable data pipelines using Spark, SQL, and other big data technologies. • Extract, transform...SQLBig dataContract workImmediate start
- ...Data Engineer Qualifications Required in the Job: Advanced working SQL/PLSQL knowledge and experience working with relational databases... ..., and highly scalable big data data stores. Experience supporting... ...to SaaS solutions), Hadoop, Spark, Kafka, Linux scripting, etc. Experience...SQLBig data
- ...Description Job Title: GCP Data Engineer Job Location: Phoenix... ...to help build and enhance our Big data application. This... ...involve using Java, Scala, SQL, Big Data, Linux, git, and maven... ...such as Hadoop (MapR), Spark, Yarn Big Data querying tools...SQLBig dataContract workFlexible hours
- ...development experience and leading teams of engineers and scrum teams 3+ years of hands-on... ...of working with Map-Reduce, Hive, Spark (core, SQL and PySpark) Solid Datawarehousing concepts... ...joins while processing huge amount of data Experience in UNIX shell scripting...SQLBig data
- ...Data Engineer On-site role in Phoenix, AZ US citizenship or green card required.... ...as Python (including PySpark) and SQL (including advanced SQL, PL/SQL, query... .... ~ Experience with big data technologies like Apache Spark, Hadoop, Kafka, and potentially real...SQLBig dataLocal areaNight shift
- ...divh2GCP Bigdata Engineer/h2pLooking for a Senior Software Engineer... ...to help build and enhance our Big data application./ppThis individuals... ...will involve using Java, Scala, SQL, Big Data, Linux, git, and... ...Frameworks such as Hadoop (MapR), Spark, Yarn/ppBig Data querying...SQLBig dataFlexible hours
$117.6k - $161.7k
Senior Data Engineer Become a part of our caring community. The Senior Data... ..., and maintain complex SQL queries to support data transformation... ..., implement, and support Big Data tools and frameworks for... ...SQL, Databricks, Python, Apache Spark, Git, Azure Services (Synapse,...SQLBig dataTemporary workRemote workWork from home- ...Job Title: GCP Bigdata Engineer Location: Phoenix (Day 1 onsite)... ...to help build and enhance our Big data application. This individual... ...involve using Java, Scala, SQL, Big Data, Linux, git, and maven... ...such as Hadoop (MapR), Spark, Yarn Big Data querying tools...SQLBig dataFor contractorsFlexible hours
- ...Principal Engineer I - Senior Data Engineer Location: Block 23 As the Principal... ...tuning and optimization of Spark workloads Implement... ...unstructured data and big data. What you'll need:... ...such as T-SQL, PL/SQL, Spark SQL. ~ Design and build reusable...SQLBig data
- ...Infomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to... ...-based Data Lake and other Big Data technologies. Essential... ...Demonstrated advanced experience in SQL tuning, indexing, distribution... ...Big Data pipelines including Spark, Hive, Sqoop or related...SQLBig data
$106.9k - $176.5k
...better working world. Technology – Data and Decision Science – Data Engineering – Senior We are seeking a... ...in Databricks and experience with Spark for big data processing. ~ Proven experience... ...such as Python, Scala, or SQL. Experience with data modeling,...SQLBig dataSummer holidayFlexible hours- ...better working world. Technology – Data and Decision Science – Data Engineering – Manager We are looking for a... ...in Databricks and experience with Spark for big data processing. Strong... ...languages such as Python, Scala, or SQL. Excellent problem‑solving skills...SQLBig dataSummer holidayFlexible hours
$99k - $232k
...Specialty/Competency: Data, Analytics & AI Industry/... ...people in data and analytics engineering focus on leveraging... ...Storage, Azure Cosmos DB, Azure SQL DB, GCP Cloud Storage etc.... ...- Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus - Experience...SQLBig dataFull timeH1b- ...industry player is seeking a skilled Java Developer with expertise in big data technologies to enhance their finance portfolio. In this dynamic role, you will leverage your experience with Apache Spark, HIVE, and programming languages like Java and Python to build robust...Big data
$207k - $276k
...those practices into the engineering organization.... ...point of expertise on Data Engineering, Data Science... ...JMS Oracle PL/SQL / Sql Server JavaScript and... ...(JQuery, AngularJS) Big Data (Cloudera / S3), AI... ...using python, pySpark, Spark), BI Reporting, Python...SQLBig dataHourly payWork at officeImmediate startVisa sponsorshipWork visaFlexible hours- ...Technical/Functional Skills Hive & Spark Architecture including Spark Core, Spark SQL, Data Frames. Experience Required 6-8 Years... ...providers (GCP preferable); Experience working in GCP based Big Data deployments (Batch/Real-Time) leveraging Big...SQLBig data
- ...Storage (GCS) Proficiency in Scala and/or Python for data engineering workflows. Strong experience with Apache Spark for large scala data processing. Experience with... ...Airflow for workflow orchestration. Advanced SQL skills for data analysis and transformation. Experience...SQLTemporary workRelocation
- ...including HDFS| MapReduce| Spark | Scala | HiveExpertise in Hive for data warehousing and querying... ...in Scala programming for big data application... ...JAVA | SpringbootStrong SQL skill.Roles ResponsibilitiesArchitect... ...teams| including data engineers| analysts| and business stakeholders...SQLBig data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer (Spark & SQL). Be the first to apply!
- data visualization developer Phoenix, AZ
- data science developer Phoenix, AZ
- senior data center engineer Phoenix, AZ
- sr information security engineer Phoenix, AZ
- junior big data engineer Phoenix, AZ
- entry level big data engineer Phoenix, AZ
- data engineer contract Phoenix, AZ
- aws data engineer Phoenix, AZ
- data engineer manager Phoenix, AZ
- senior data engineer Phoenix, AZ


