Senior Python & Spark Data Engineer | AWS Pipelines
CGI Njoyn
CGI Njoyn in Reston, Virginia, seeks a Senior Python Developer with Spark expertise to design and optimize large-scale data systems. Responsibilities include developing data pipelines, writing advanced SQL, and working with relational datasets in a hybrid model. Candidates should have over 8 years of experience in Python and Spark, with extensive knowledge of AWS services and big-data ecosystems. Competitive compensation and comprehensive benefits are offered. #J-18808-Ljbffr
Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Senior Python & Spark Data Engineer | AWS Pipelines in Reston, VA vacancy
- ...Virginia is seeking a highly skilled Senior Software Developer / Data Engineer. This role requires strong experience in Python and SQL to develop data pipelines and manage data streaming solutions... ...with big data technologies like Spark. Experience in financial services is...Amazon Web ServicePipelineSeniorPython
Compunnel
McLean, VA6 hours ago - Capital One is looking for a Senior Lead Data Engineer in McLean, VA to spearhead data projects using Python, AWS, and Snowflake. You will collaborate with Agile teams to... ..., leveraging AI tools, and optimizing data pipelines. The position requires extensive experience...Amazon Web ServicePipelineSeniorPython
- ...national security. Job Title: Senior Data Engineer (Databricks) Location... ...built on Databricks and AWS. This role will be... ...governing enterprise-scale data pipelines while enabling secure, compliant... ...~ Delta Lake ~ Spark ~ Python ~ SQL ~ AWS...Amazon Web ServicePipelineSeniorPythonFull timeRemote work
Sky Solutions LLC
Vienna, VA1 day ago $3,000 per month
...Acuity, Inc. seeks a Senior Data Engineer to lead the design, development... ...of modern data pipelines and analytics... ...programming skills in Python, Scala, SQL , or similar... ...frameworks such as Apache Spark Experience... ...native data services in AWS or similar environments...Amazon Web ServicePipelineSeniorPythonWork from homeAcuity
Reston, VA1 day ago- ...Position: Senior Data Engineer Duration: 6+ Months Contract (... ...Data Analysis; Apache Spark for Big Data Processing... ...remediation processes across pipelines and platforms, working... .... ~ Use SQL, Python, and cloud data tools... ...and tools such as AWS, Redshift, Athena, Snowflake...Amazon Web ServicePipelineSeniorPythonContract workRemote work
TalentBurst
Reston, VA1 day ago - ...experienced ETL Engineer to join our data engineering team.... ...maintaining data pipelines and integration processes... ...solutions (AWS) aligned to... ...operators, analysts, and senior stakeholders to... ...programming. Python is preferred software... ...(e.g., Spark, Hadoop, Databricks...Amazon Web ServicePipelineSeniorPython
Sabree-Software-Services
Herndon, VA1 day ago - ...A technology solutions provider in the United States is seeking an experienced Data Engineer to build and maintain ETL pipelines using Python and Pyspark on AWS Glue. Key responsibilities include orchestrating workflows, implementing messaging patterns, and ensuring data...Amazon Web ServicePipelineSeniorPython
Robotics Technologies LLC
Reston, VA1 day ago - ...A leading automation solutions provider in Virginia is seeking a skilled data engineer to build and maintain ETL pipelines using Python and PySpark on AWS Glue. You will work extensively with various AWS services to orchestrate workflows and ensure data quality. The ideal...Amazon Web ServicePipelineSeniorPython
Robotics Prcocess Automation, LLC
Reston, VA6 hours ago - ...A data analytics company seeks an experienced developer to build and maintain ETL pipelines using Python and PySpark on AWS. The role involves orchestrating workflows with AWS Step Functions, implementing event-driven patterns, and ensuring data quality. The ideal candidate...Amazon Web ServicePipelineSeniorPython
Cloud Analytics Technologies, LLC
Reston, VA6 hours ago - ...Permanent Full Time Title Senior Python Developer with Spark Category Software Development / Engineering Location Reston,... ...optimize large-scale data processing systems in a cloud-native AWS environment. This role... ...high-performance data pipelines using Spark and Python...Amazon Web ServicePipelineSeniorPythonPermanent employmentFull timeLocal area
CGI Njoyn
Reston, VA1 day ago - ...Data Engineering Testing Specialist Key Responsibilities Define the end-to-end... ...across key technologies, including: AWS Redshift AWS DMS (Data Migration... ...Event Bridge Data Lakes Python-based data pipelines Apache Airflow dbt (data build...Amazon Web ServicePipelineSeniorPython
Talent Software Services
Reston, VA2 days ago - ...This Software Engineer Senior Associate will be responsible... ...development and delivery of data analytics for the FP&A's... ...enterprise cloud-native AWS data applications. Experience... ...data engineering pipelines on AWS stack using Python. Deep technical knowledge...Amazon Web ServicePipelineSeniorPython
TriOptus LLC
Reston, VA4 days ago $99.2k - $154.3k
...Senior Python Developer with Spark Category: Software Development/ Engineering Main location: United States, Virginia... ...processing your data and using cookies -... ...systems in a cloud-native AWS environment. This... ...high-performance data pipelines using Spark and...Amazon Web ServicePipelineSeniorPythonFull timeLocal areaCGI
Reston, VA5 days ago- ...seeking a talented and experienced Senior Data Engineer to serve as an integrator... ...robust ETL processes and data pipelines. You will leverage your expertise in Python and SQL to condition and normalize... ...Experience with Amazon Web Services (AWS) will be crucial as you deploy...Amazon Web ServicePipelineSeniorPython
VTG
Herndon, VA2 days ago - ...I have an opportunity for "Senior Data Engineer" _ McLean, VA - HYBRID" and I am looking... ...Must have tech stack: Python (3 years), Spark (2years), SQL (advance level), Unix... ...and Big Data platform (Hadoop OR AWS). Data pipelines built in Python and Spark. AutoSys...Amazon Web ServicePipelineSeniorPythonImmediate start
Navtech
McLean, VA1 day ago - ...an operations and maintenance team specializing in travel data applications in Tysons, Virginia. The role requires building data pipelines and utilizing AWS services, with a strong focus on Python and Apache Spark. Additionally, a Top Secret Security Clearance with...Amazon Web ServicePipelinePython
J5 Consulting
Falls Church, VA1 day ago - ...Job Description Senior Data Engineer Candidates can be located... ...You'll deploy and develop pipelines and workflows that... ...years of experience with Python, SQL, Scala, or R ~ Experience... ...tools including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka Experience...Amazon Web ServicePipelineSeniorPython
Centurion Consulting Group, LLC
McLean, VA2 days ago - ...Job Title: Senior Data Engineer Location: Vienna, VA Position Type: Full-... ...maintain batch and real-time data ingestion pipelines Lead design and implementation... ...data via Apache Kafka Use AWS Glue, Python, and SQL to transform and prepare data...Amazon Web ServicePipelineSeniorPythonFull timeRelocation package
Ztek Consulting
Vienna, VA1 day ago - ...skilled and experienced Systems Engineer/Senior Data Engineer with a strong... ...implementing, and optimizing data pipelines and solutions for critical... .../secured enclaves (e.g., AWS). Experience with SIEM... ...scripting skills (e.g., BASH, Python, PowerShell). Excellent...Amazon Web ServicePipelineSeniorPython
KDA CONSULTING INC
Herndon, VA3 days ago $229.9k - $262.4k
...Overview Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI) Do you love building and pioneering in... ...quality, governance and permissible use and building data pipelines with emerging technologies. As a Capital One Senior...Amazon Web ServicePipelineSeniorPythonFull timePart timeInternshipLocal area- ...Team. Job Title: Senior Data Engineer Location(s): Reston, VA... ...include microservices, SQL and AWS services such as Lambda, S3,... ...building serverless ETL pipelines with Lambda to automate data... ...Redshift Experience with Python required; React and Node.js...Amazon Web ServicePipelineSeniorPython
Ampcus
Reston, VA1 day ago $125k - $165k
...an organization's data has never been a more... ...for seasoned Senior Data Engineer to work with our... ...platforms, services, and pipelines. We are looking... ...cloud (Preferably AWS. Alternatively... ...have skill sets - Python, AWS Support an... ...data tools: Hadoop, Spark, Kafka, etc. ~ Relational...Amazon Web ServicePipelineSeniorPythonSteampunk.com
McLean, VA3 days ago$140k - $180k
...an organization's data has never been a... ...looking forseasoned Senior Data Engineer to work with our... ...(Preferably AWS. Alternatively Azure... ...,SQL,PySpark/Python,AWS Support an... ...Databricks, Apache Spark, Delta Lake, etc.... ...MySQL). ~ Data pipeline and workflow management...Amazon Web ServicePipelineSeniorPythonSteampunk.com
McLean, VA4 days ago$125k - $165k
...looking for seasoned Senior Data Engineer to work with our team... ...platforms, services, and pipelines. We are looking for... ...in cloud (Preferably AWS. Alternatively Azure,... ...must have skill sets - Python, AWS. Support an Agile... ...Big data tools: Hadoop, Spark, Kafka, etc. Relational...Amazon Web ServicePipelineSeniorPython- ...Developer with Big Data expertise to... ...mix of full stack engineering capabilities and data... ...as Hadoop, Apache Spark, and Kafka Design... ...and implement data pipelines to ingest, transform... ...hybrid environments (AWS preferred) Design... ...such as Java, Python, or C# Experience...Amazon Web ServicePipelineSeniorPython
KDA CONSULTING INC
Herndon, VA1 day ago $151.5k - $227.3k
...About the Role This senior SRE role supports... ...automate CI/CD pipelines and automation for the Prism engineering and SRE teams.... ...experience with AWS cloud services in... ...programming (Go or Python). Experience with ORM, big data technologies (Apache Spark, Hadoop, HDFS, Storm...Amazon Web ServicePipelineSeniorPythonWork experience placementWorkday
Reston, VA7 hours ago- ...About the TeamAt Slack, data isn't just infrastructure — it's the engine behind every great... ...builds the products and pipelines that power our largest... ...Strong proficiency in Python and SQL* Familiarity with... ...Hands-on experience with Spark SQL, AWS (S3, EMR), Apache Pinot...Amazon Web ServicePipelineSeniorPythonPermanent employment
Slack Enterprise
Herndon, VA6 hours ago $98.61k - $167.64k
...Description Senior Data Engineer (Governance Focus) The Role We are... ...role goes beyond traditional pipeline development and plays a critical... ...engineering experience on AWS, Databricks, or other modern... .../ELT processes using SQL, Python, and PySpark with strong error...Amazon Web ServicePipelineSeniorPythonFull timeContract workWork experience placementWork at officeRemote workICF
Reston, VA2 days ago- ...our talented Team. Job Title: Senior Data Engineer / AI ML Engineer with Python, AI/ML & LLMs. Location: Reston... ...about building scalable data pipelines, enabling machine learning workflows... ...Familiarity with cloud platforms (AWS, GCP, Azure) and containerization...Amazon Web ServicePipelineSeniorPythonRemote work
Ampcus
Reston, VA5 days ago - ...looking for multiple cleared Senior Data Engineers to support our client.... ...'ll deploy and develop pipelines and workflows that... ...years of experience with Python, SQL, Scala, or R ~ Experience... ...tools including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka Experience...Amazon Web ServicePipelineSeniorPython
Apex Systems
McLean, VA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Python & Spark Data Engineer | AWS Pipelines. Be the first to apply!
Related searches
- python programmer Reston, VA
- python developer data analytics Reston, VA
- python engineer Reston, VA
- python developer Reston, VA
- full stack / python developer (remote) Reston, VA
- senior data center engineer Reston, VA
- data science developer Reston, VA
- etl data engineer Reston, VA
- entry level big data engineer Reston, VA
- data engineer Reston, VA