Senior Spark & Python Developer
Mavens Guild
What we would like to see:
In a senior developer role, you will design and build data flow and data integration processes to enhance loss prevention technologies for a leading financing firm. Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you will develop, test, and deploy end-to-end solutions using full-stack development tools within AWS (EMR, S3) cloud based infrastructure.
A typical day as a Senior Spark Programmer:
- Develop fault tolerant, streaming as well as batch data integration processes using Spark/PySpark, Java and performance enhanced SQL
- Develop and lead development efforts of application programming interfaces to enable integration of fraud detection systems with a host of new reporting and data mining tools
- Design and develop automation of data flow tasks and end-to-end process testing
- Design and develop scalable frameworks to ingest, transform, store, and present loss prevention information to downstream systems
- Implement and lead implementation of Agile best practices and a continuous integration ecosystem
- Implement and lead implementation efforts of Spark/Python based solution architecture, scalable process frameworks, advanced analytics, and responsive RESTful services
What you will need to bring to the table:
- 5+ years experience with processing of structured, unstructured and semi-structured data using in-memory cluster computing technologies, specifically with Spark
- 5+ years experience as a Java programmer
- 3+ years experience programming in Python (PySpark API)
- 3+ years experience with cloud services offered through AWE, like EMR, Redshift, or S3
- 3+ years experience in developing, testing and deploying RESTful APIs for high volume data streams
- Experience with continuous integration tools like Jenkins
- Experience working in a distributed computing infrastructure like Hadoop and/or Spark
- Critical and analytical approach to solving technical problems
- Excellent interpersonal skills and ability to clearly communicate highly technical concepts to business stakeholders and technical developers alike
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Spark & Python Developer in McLean, VA vacancy
- ...Python Developer Location: McLean, VA (Hybrid -Tues-Thru) Duration: 10+ Month Job Description: Must Haves: 6+ years of hands-on Python development experience using PySpark, XML, Json. Database side they need to have experience with SQL using Hive. 6+ years...SeniorContract work
Samprasoft
McLean, VA1 day ago - ...Python API Developer Looking for a Python API Developer. Python, Flask, SQL, Pandas, NumPy & Pytest, Unitest, Monkey patch are all mandatory. Experience with Linux and Docker are mandatory. Position Overview: Financial Engineering team is seeking Python Developers...Senior
Samprasoft
McLean, VA1 day ago - ...Senior Python Developer We are seeking a Senior Python Developer to support the development of mission-critical applications built on modern software development frameworks. The selected candidate will collaborate with engineering teams to design, develop, enhance,...SeniorFull timeMonday to Friday
eSolutionsFirst
McLean, VA5 days ago - ...Must-Have Skills: ~5+ years of hands-on experience as a Python Developer ~ Expertise in frameworks such as Django, Flask, or FastAPI ~ Strong knowledge of NumPy, pandas, and relational databases ~ Experience with unit testing and automation tools...Senior
Saxon Global
McLean, VA5 days ago $229.9k - $262.4k
{"description": "Senior Lead, Machine Learning Engineer (GenAI, Python, AWS) As a Capital One Senior Lead Machine... ...learning architectural design , develop and review model and application... ...as scikit-learn, PyTorch, Dask, Spark, or TensorFlow ~3+ years of...SeniorFull timePart timeInternshipLocal areaCapital One Financial Corporation
McLean, VA1 hour ago- ...Technical Skills: Experience writing Python code and RESTful web services using framework such as Flask, FastAPI etc. in a professional environment Back End Skills : Python, Django/Flask/FastAPI, NumPy, pandas and Relational Database Automation Testing...SeniorLocal area
PALNAR
McLean, VA3 days ago - ...Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Sr. Python Developer Job Location: Mclean, VA Job Description: The candidate will mainly be involved in design, development, and documentation...Senior
Ampcus
McLean, VA6 days ago - ...Full-Stack Developer Are you a developer, with a passion for delivering end to end technical solutions? Do you excel in an agile and... ...are looking for a user centric full-stack developer to develop Python and React (or Angular) based solutions for operational metrics...Senior
Samprasoft
McLean, VA1 day ago $229.9k - $262.4k
...Overview Senior Lead Data Engineer (Python, AWS, Spark, Kakfa, SQL, Snowflake, DynamoDB, Databricks, GenAI) Do you love building and pioneering in... ...Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using...SeniorFull timePart timeInternshipLocal area- ...Java is the primary language with some pipelines written in Python, knowledge of Spark, SQL and AWS will also be critical to succeed in the role. Tech Stack: Python, Java, Spark, SQL, Databricks, RESTful APIs, AWS Glue, ECS S3 Job Description: The role is to...Senior
PALNAR
McLean, VA2 days ago - ...Senior Data Developer Seeking a Senior Data Developer to implement data processing and ingestion of structured and semi-structured data as... ...Structured and Unstructured data – XMLs, JSONs, CSVs, PDFs) using python and Snowflake database. ~ Develop Python scripts to filter...Senior
Software Technology Inc
McLean, VA1 day ago - ...Data Analytics Developer The hiring team provides data analytics on software delivery primarily via Tableau dashboards. Daily responsibilities... ...business and operational capabilities ~ Solid experience as Python Developer ~ Experience with Python frameworks e.g. Django,...SeniorWork experience placement
Samprasoft
McLean, VA1 day ago $140k - $190k
...We are looking for a seasoned Senior Machine Learning Engineer to... ...functional teams to design and develop machine learning models and... ...processing frameworks (e.g., Spark) to extract meaningful insights... ...programming skills in languages such as Python, R, or Java. ~ Solid...SeniorSteampunk.com
McLean, VA4 days ago- ...is seeking a Software Engineer for a full-time remote position. Responsibilities include designing backend systems, developing APIs with Django and Python, and managing databases. Candidates should have 5+ years of full stack experience, knowledge of cloud technologies,...SeniorFull timeRemote work
Astor & Sanders
McLean, VA1 day ago - ...Senior Data Engineer Location: Mclean VA Duration: 12+ months contract Responsibilities include: Cleanse, manipulate... ...data – XMLs, JSONs, PDFs) using Hadoop platform. Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data. Be able...SeniorContract work
Samprasoft
McLean, VA1 day ago - ...projects in the industry. You'll deploy and develop pipelines and workflows that organize and... ...scale ~3+ years of experience with Python, SQL, Scala, or R ~ Experience creating... ...with Palantir tools, such as Foundry Sparks Group is an equal opportunity employer....Senior
Sparks Group
McLean, VA8 hours ago $147.1k - $167.9k
...Senior Machine Learning Engineer As a Capital One Machine Learning... ...architectural design, develop and review model and application... ...Use programming languages like Python, Scala, or Java. Basic Qualifications... ...(scikit-learn, PyTorch, Dask, Spark, or TensorFlow) At least 1...SeniorFull timePart timeInternshipH1bLocal areaCapital One
McLean, VA4 days ago- ...Senior Data Engineer Qualifications: Bachelor's Degree At least 3 years... ...in application development including Python, SQL, Scala, or Java ~2+ years of experience... ...(MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~2+ year experience...SeniorInternship
3B Staffing LLC
McLean, VA1 day ago - ...I have an opportunity for "Senior Data Engineer" _ McLean, VA - HYBRID" and I am... ...INTERVIEW Must have tech stack: Python (3 years), Spark (2years), SQL (advance level), Unix... ...understanding technical requirements, developing unit test cases, working with users etc...SeniorImmediate start
Navtech
McLean, VA4 days ago $229.9k - $262.4k
...Senior Manager, Machine Learning Engineering As a Capital One Machine... ...architectural design, develop and review model and application... ...Use programming languages like Python, Scala, or Java. Basic Qualifications... ...scikit-learn, PyTorch, Dask, Spark, or TensorFlow ~3+ years...SeniorFull timePart timeInternshipLocal areaCapital One
McLean, VA4 days ago- ...Job Description Senior Data Engineer The Opportunity: Ever... ...industry. You'll deploy and develop pipelines and workflows that organize... ...~3+ years of experience with Python, SQL, Scala, or R ~... ...data/computing tools including Spark, Databricks, Hadoop, Hive, AWS...Senior
Centurion Consulting Group, LLC
McLean, VA5 days ago - ...Collaborate with and across Agile teams to design, develop, test, implement, and support technical... ...Utilize programming languages like Python and Open Source RDBMS and NoSQL databases... ...(MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~4+ years of experience...SeniorLocal area
Tiger Analytics
McLean, VA1 day ago $99k - $225k
...Data Scientist, Senior The Opportunity: As a data scientist... ...programming languages such as Python or R ~ Experience creating ETL... ...~ Ability to design and develop automated analytic sof tware,... ...MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL...SeniorFull timeContract workPart timeWork at officeLocal areaRemote workBOOZ, ALLEN & HAMILTON, INC.
McLean, VA8 days ago- ...Distributed Data Processing and Big Data Architectures (e.g., Spark, Hadoop, Ray, Dask, Kafka) Data Pipeline/ETL Development and Orchestration... ...MLOps Computer Programming and Databases – Proficiency in Python and SQL required Software Engineering Best Practices (e.g.,...SeniorInternshipLocal area
The MITRE Corporation
McLean, VA2 days ago - ...Engineer Location: Hybrid onsite (Mclean, VA) Duration: 6-12 Months – (With possible extension) Must Haves Overall exp of 5 years SQL – 3 years Python (building data pipeline) – 3 years Spark – 3 years Big Data/Hadoop Unix/Shell Scripting...Senior
Samprasoft
McLean, VA1 day ago $99k - $225k
...Number: R0237471 Data Scientist, Senior The Opportunity: As a... ...languages, such as Python or R ~ Experience creating... ...methods ~ Ability to design and develop automated analytic software, techniques... ..., Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL...SeniorFull timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
McLean, VA4 days ago$140k - $180k
...Senior Data Engineer We are looking for a seasoned Senior Data... ...with our team and our clients to develop enterprise grade data... ...- Databricks, SQL, PySpark / Python, AWS Support an Agile software... ...data tools: Databricks, Apache Spark, Delta Lake, etc. ~ Relational...SeniorNavstar
McLean, VA20 hours ago$125k - $165k
...Steampunk you will design and develop solutions to high-impact, complex... ...We are looking for seasoned Senior Data Engineer to work with... ...Key must have skill sets - Python, AWS Support an Agile software... ...: ~ Big data tools: Hadoop, Spark, Kafka, etc. ~ Relational SQL...SeniorSteampunk.com
McLean, VA6 days ago$229.9k - $262.4k
...Senior Lead Software Engineer, Back End (Python/Node.js) Do you love building and pioneering in the technology space? Do you enjoy solving complex business... ...of diverse technology projects and a team of developers with deep experience in distributed microservices, and...SeniorFull timePart timeInternshipLocal areaCapital One
McLean, VA1 day ago- ...pipelines to facilitate the massive data transfer and integration Data Processing: Write clean, efficient code using Java and Apache Spark to process large-scale, complex datasets. Cloud Architecture & Orchestration: Leverage AWS cloud services, specifically...SeniorHourly payContract workTemporary workWork experience placement
Randstad
McLean, VA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Spark & Python Developer. Be the first to apply!
Related searches
- python engineer McLean, VA
- python developer McLean, VA
- python developer part time McLean, VA
- python programmer McLean, VA
- python developer internship McLean, VA
- full stack / python developer (remote) McLean, VA
- python developer data analytics McLean, VA
- senior python developer McLean, VA
- senior development executive McLean, VA
- senior manager data science McLean, VA