Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Splunk & Observability Engineer Job Type: Permanent Full Time

System One Holdings, LLC

Senior Splunk & Observability Engineer Seeking an experienced Senior Splunk & Observability Engineer to support enterprise scale observability platforms within a complex, AWS based production environment. This is a senior hands on role combining advanced Splunk administration and engineering, AWS production support, observability, and automation. The engineer will manage and support Splunk Enterprise running on AWS, working across the full data lifecycle from source onboarding and ingestion through indexing, search, dashboards, alerts, retention, and recovery. Responsibilities include developing and optimizing SPL queries, troubleshooting ingestion and performance issues, improving platform stability, supporting upgrades and vulnerability remediation, and restoring or replaying data following service interruptions. The role will also work extensively with AWS, Amazon CloudWatch, OpenTelemetry, and Python based automation to improve enterprise monitoring and resiliency. The engineer will build and maintain OpenTelemetry agents and collectors, support observability integrations across technology stacks, and help automate platform operations and vulnerability remediation. This position is required in one of the following locations: Lafayette, LA, Knoxville, TN, Columbia, SC, Birmingham, AL Your future duties and responsibilities: Administer, engineer, upgrade, and support Splunk Enterprise in AWS. Deploy, configure, and troubleshoot Splunk components hosted on Amazon EC2. Manage the end to end Splunk data lifecycle, including ingestion, indexing, search, dashboards, alerts, retention, and recovery. Develop and optimize complex SPL queries and troubleshoot query performance issues. Build and maintain enterprise dashboards for production monitoring, resiliency, incident response, and outage triage. Troubleshoot ingestion failures, problematic indexes, missing or delayed data, unexpected data volume growth, and platform availability issues. Restore data flow and replay data following ingestion or platform interruptions. Optimize data ingestion and retention to reduce noise, storage consumption, and operating costs. Integrate Splunk, Amazon CloudWatch, and OpenTelemetry for logs, metrics, dashboards, and alerts. Develop Python based automation for observability and platform operations. Build and maintain OpenTelemetry agent and collector packages across multiple technology platforms. Support Splunk upgrades, patching, configuration changes, plugins, and vulnerability remediation. Use GitLab, GitHub, Terraform Enterprise, JSON, and CI/CD tooling to support infrastructure, configuration, automation, and package deployments. Lead technical troubleshooting calls and coordinate incident investigation and remediation across multiple teams. Participate in an on call rotation and provide after hours support when required for production incidents, upgrades, and planned changes. Required qualifications to be successful in this role: 5+ years of hands on Splunk Enterprise administration and engineering experience in large production environments. Strong understanding of the Splunk ecosystem, including data ingestion, forwarders, indexers, search heads, indexes, dashboards, alerts, and recovery. Advanced SPL query development and performance optimization skills. Hands on experience deploying, configuring, upgrading, troubleshooting, and supporting Splunk on AWS. Strong AWS production experience, particularly with Amazon EC2, Application Load Balancer, and Amazon CloudWatch. Experience building complex Splunk dashboards for production monitoring, resiliency, incident triage, and operational use cases. Strong understanding of OpenTelemetry, including agents, collectors, logs, metrics, instrumentation, and Splunk integration. Experience building or maintaining OpenTelemetry agent and collector packages. Working knowledge of Python for automation and operational tooling. Experience with GitLab, Terraform Enterprise, CI/CD, GitHub, and JSON. Strong production troubleshooting skills, including ingestion failures, data volume issues, platform outages, performance problems, and data recovery. Experience with platform upgrades, patching, vulnerability remediation, and controlled production changes. Ability to lead technical troubleshooting calls, communicate findings clearly, and coordinate effectively across cloud, application, security, database, and production support teams. Educational Requirements: Bachelor's degree in Computer Science, Information Systems, or a related field. Ref: #404-IT Pittsburgh System One Holdings, LLC

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Splunk & Observability Engineer Job Type: Permanent Full Time in Columbia, SC vacancy
  • Job Title: Senior ServiceNow Custom Application Developer Location: Lafayette, LA...  ...TN, Columbia, SC or Birmingham, AL Type: Permanent Full Time Responsibilities • Build and support...  ...Science, Information Technology, Engineering, or a related field, or equivalent professional... 
    Permanent employment
    Full time
    Senior
    Local area

    System One

    Columbia, SC
    3 days ago
  •  ...Job Title: Senior Product Analyst/System Analyst Location: Birmingham, AL, Columbia, SC, Knoxville, TN, Lafayette, LA or Plano, TX. Job Type: Permanent Fulltime Responsibilities Analyze complex business processes, system interactions, and data flows within... 
    Permanent employment
    Full time
    Senior
    Local area

    System One

    Columbia, SC
    a month ago
  •  ...Job Description Job Description Job Title: Senior AWS Full Stack Software Engineer Location: Plano, TX/Reston, VA/Columbia, SC/Knoxville, TN/Lafayette, LA/Birmingham, AL Type: Permanent Full Time Responsibilities • Develop and maintain full stack applications... 
    Permanent employment
    Full time
    Senior
    Local area

    System One

    Columbia, SC
    1 day ago
  • $120k - $150k

     ...Senior Estimator Job Title: Senior Estimator or Estimator Job Location: Columbia...  ...on commercial projects. This is a full time/permanent position with a well established General...  ...'s degree in Construction Management, Engineering, or a related field (preferred)... 
    Permanent employment
    Full time
    Senior
    For contractors
    For subcontractor
    Currently hiring

    Cohn Construction Services

    Columbia, SC
    3 days ago
  • $80.42k - $106.05k

    Senior Full Stack Engineer Choosing Capgemini means choosing a company where you will be empowered to...  ...Employee Share Ownership Plan Paid time off and paid holidays Paid parental...  ...Experienced Professionals Contract Type: Permanent Location: Columbia, SC, US Brand:... 
    Permanent employment
    Full time
    Senior
    Contract work
    Local area
    Flexible hours
    Shift work

    Capgemini

    Columbia, SC
    3 days ago
  •  ...Job Description Job Description Job Title : Senior Information Protection & AI Security Engineer Location: Lafayette, LA, Knoxville, TN, Columbia, SC, Birmingham, AL Type: Permanent Fulltime Overview Seeking a Senior Information Protection & AI Security... 
    Permanent employment
    Full time
    Senior

    System One

    Columbia, SC
    5 days ago
  •  ...Description Job Description Job Title: Senior Vulnerability Management Analyst...  ...Knoxville, TN, Columbia, SC, Birmingham, AL Type: Permanent Fulltime Overview Seeking a Senior...  ...s degree in Computer Science, Computer Engineering, Cybersecurity, Information Technology,... 
    Permanent employment
    Full time
    Senior

    System One

    Columbia, SC
    5 days ago
  •  ...Job Title: Senior CyberArk PAM Engineer Location: Columbia, SC Type: Permanent Full-Time Work Model: Hybrid – onsite and remote Responsibilities Build, deploy, and maintain CyberArk Vault and related PAM component integrations, ensuring secure and reliable... 
    Permanent employment
    Full time
    Senior
    Local area
    Remote work

    System One

    Columbia, SC
    a month ago
  •  ...Description Job Description Job Title: Senior Salesforce Developer Location:...  ...Knoxville, TN, Columbia, SC (Hybrid) Type: Permanent Fulltime (W2) Responsibilities Support...  ...closely with business stakeholders and engineering teams to translate requirements into... 
    Permanent employment
    Full time
    Senior

    System One

    Columbia, SC
    26 days ago
  •  ...Job Title: Senior Atlassian Tools Administrator Location: Lafayette, LA, Birmingham...  ...Columbia, SC or Knoxville, TN Job Type: Permanent Full Time Seeking a Senior Atlassian Tools...  ...broader Atlassian Cloud platform. The engineer will develop and maintain Atlassian... 
    Permanent employment
    Full time
    Senior
    Local area

    System One

    Columbia, SC
    more than 2 months ago
  •  ...Job Title: Senior AWS Java Full Stack Developer Location: Lafayette, LA / Knoxville, TN / Columbia, SC / Birmingham, AL / Plano, TX. Type: Permanent Full Time Work Model: Hybrid – onsite and remote We are hiring a Senior AWS Java Full... 
    Permanent employment
    Full time
    Senior
    Local area
    Remote work

    System One

    Columbia, SC
    16 days ago
  •  ...50.00 Pay Band: SV-F Appointment Type: Fulltime Transportation-security operations...  ...procedures, operational information, observation, and professional judgment Review...  ...Supervisory TSO vacancies are limited to current permanent or eligible temporary TSA employees.... 
    Permanent employment
    Full time
    Temporary work
    Trial period
    Flexible hours
    Shift work
    Night shift
    Weekend work
    Day shift
    Afternoon shift
    Early shift

    Travel Security Careers

    West Columbia, SC
    19 days ago
  •  ...public service missions. This full time position is contingent upon...  ...- Consult with managerial, engineering, and technical personnel to...  ...be a US Citizen or a Legal Permanent Resident (Green Card status)...  ...internal value analysis including seniority and merit systems, as well... 
    Permanent employment
    Full time
    Senior
    Minimum wage
    Contract work
    Temporary work
    Work experience placement
    Remote work

    MAXIMUS

    Columbia, SC
    3 days ago
  • $90k - $220k

     ...fast-paced environment as a Senior Scientist / Engineer supporting the Advanced...  ...U.S. citizenship or lawful permanent residency is required per contract...  ...good-faith estimate at the time of posting and reflects the...  ...LLC offers eligible full-time employees medical, dental... 
    Permanent employment
    Full time
    Senior
    Contract work
    Work at office
    Local area
    Remote work
    Flexible hours

    Intertwine Associates LLC

    Columbia, SC
    5 days ago
  •  ...50.00 Pay Band: SV-F Appointment Type: Fulltime Transportation-security operations...  ...procedures, operational information, observation, and professional judgment Review...  ...Supervisory TSO vacancies are limited to current permanent or eligible temporary TSA employees.... 
    Permanent employment
    Full time
    Temporary work
    Immediate start
    Trial period
    Flexible hours
    Shift work
    Night shift
    Weekend work
    Day shift
    Afternoon shift
    Early shift

    Airport Security Hiring

    Columbia, SC
    19 days ago
  • $2,873 per week

     ...comprehensive range of staffing services designed to meet every type of need. Whether you're looking for a traditional travel...  ...travel placement (4–8 weeks), flexible per diem coverage, or a permanent career opportunity, Infojini Healthcare has the connections and... 
    Permanent employment
    Full time
    Daily paid
    Contract work
    Temporary work
    Summer work
    Immediate start
    Flexible hours
    Shift work

    TravelNurseSource

    Columbia, SC
    1 day ago
  •  ...| Acute Care Hospital Schedule / Job Type Contract | Days | 4x10-hour rotating shifts...  ...on a case-by-case basis Previous permanent or PRN staff must have been separated from...  ...procedural or interventional setting First-time travelers will be considered Why Join... 
    Permanent employment
    Full time
    Weekly pay
    Contract work
    Relief
    Local area
    Immediate start
    Shift work
    Rotating shift
    Day shift
    Weekday work

    Concentric Healthcare Staffing

    Columbia, SC
    1 day ago
  • $100k - $155k

    USA - Remote Full time R29607 As a global leader in cybersecurity...  ...a Sr. Data Infrastructure Engineer, you will be a key member of...  ...monitoring, alerting, and observability systems for infrastructure...  ...role is open to US Citizens or Permanent Residents. \#LI-Remote \... 
    Permanent employment
    Full time
    Senior
    Work experience placement
    Work at office
    Local area
    Remote work

    CrowdStrike

    Columbia, SC
    a month ago
  •  ...| Acute Care Hospital Schedule / Job Type Contract | Days | 4x10-Hour Shifts | Rotating...  ...that extend beyond scheduled shift end times Participate in rotating on-call...  ...considered on a case-by-case basis Previous permanent or PRN staff must have been separated... 
    Permanent employment
    Full time
    Weekly pay
    Contract work
    Relief
    Local area
    Immediate start
    Shift work
    Rotating shift
    Day shift
    Weekday work

    Concentric Healthcare Staffing

    Columbia, SC
    1 day ago
  •  ...Acute Care Hospital Schedule / Job Type Contract | Days | 4×10-Hour...  ...shifts as required. Maintain accurate and timely documentation using Epic electronic health...  ...on a case-by-case basis. Previous permanent or PRN staff must have been separated from... 
    Permanent employment
    Full time
    Weekly pay
    Contract work
    For contractors
    Relief
    Local area
    Immediate start
    Shift work
    Rotating shift
    Weekday work

    Malone Healthcare

    Columbia, SC
    1 day ago
  •  ...Lafayette, LA - Knoxville, TN - Columbia, SC - Birmingham, AL Splunk Observability Engineer : Hands on role supporting large Splunk and...  ...and support Splunk Enterprise on AWS (EC2) Manage the full data lifecycle: ingestion, indexing, search, dashboards, alerts... 
    For contractors
    H1b
    Immediate start

    System One

    Columbia, SC
    6 days ago
  •  ...will serve as the Tax Senior Manager in our Closely...  ...Significant experience on all types of entity and...  ...well-being: • generous time away and paid firm holidays...  ...information, and documents. • Observe and interpret...  ...Remote; Charleston, SC; Nashville, TNType: Full time
    Full time
    Senior
    Contract work
    Work at office
    Remote work
    Flexible hours

    Elliot Davis

    Columbia, SC
    1 day ago
  •  ...We are searching for a Senior Manager to help lead our...  .... This is an exciting time to help shape the future...  ...industry and on all types of entity and individual...  ...information, and documents. • Observe and interpret...  ...Columbia, SC; Nashville, TN; Charleston, SCType: Full time
    Full time
    Senior
    Contract work
    Work at office
    Flexible hours

    Elliot Davis

    Columbia, SC
    5 days ago
  •  ...SummaryWe are looking for a Tax Senior Manager to join our Real...  ..., analyze and observe industry trends to advise customers through times of disruption and uncertaintyContinuously...  ...estate industry on all types of entity and individual...  ...FL Remote; Columbia, SC; US NC RemoteType: Full time
    Full time
    Senior
    Contract work
    Work at office
    Local area
    Remote work
    Flexible hours

    Elliot Davis

    Columbia, SC
    5 days ago
  • Production Support Engineer - AWS Duration: Full Time / Permanent Role Location: Birmingham, AL, Columbia, SC, Knoxville, TN or Lafayette, LA Work Mode: 5 Days Onsite Position Overview Provide production support for critical HR, Finance, and other back-office applications... 
    Permanent employment
    Full time
    Senior
    Monday to Friday
    Flexible hours
    Night shift
    Rotating shift
    Weekend work

    System One Holdings, LLC

    Columbia, SC
    3 days ago
  •  ...Job Description Job Description Job Title: Senior Ping Directory Engineer Duration: Full Time / Permanent Position Location: Birmingham, AL, Knoxville, TN, Columbia, SC or Lafayette, LA. Work Mode: 5 Days Onsite Systemone is seeking a Senior PingDirectory... 
    Permanent employment
    Full time
    Senior

    System One

    Columbia, SC
    27 days ago
  • $18 - $40 per hour

     ...Senior Roadway Inspector West Columbia, SC...  ...Infrastructure Consulting & Engineering, LLC (ICE) is actively...  ...Provide daily observation of construction activities...  ...structures and work in various types of weather and field...  ...This position is full-time (40 hours per week). The... 
    Full time
    Senior
    Hourly pay
    Contract work
    For contractors
    Work at office
    Local area
    Immediate start
    Relocation package
    Monday to Friday
    Night shift

    INFRASTRUCTURE CONSULTING & ENGINEERING

    West Columbia, SC
    3 days ago
  •  ...9, 000-$99, 000/annually Wound Care Coordinator Opportunity: Full-time, permanent, direct-hire position $10, 000 sign-on bonus available The Wound...  ..., or Occupational Therapist license as required by facility type Minimum of one year of wound care experience required... 
    Permanent employment
    Full time
    Local area
    Relocation package

    Ironside Human Resources

    Columbia, SC
    3 days ago
  • $65k - $90k

     ...line is looking for a dynamic Staff or Senior Consultant to assist our clients in...  ...process solutions including process re-engineering gap analysis and requirements...  ...then we want to hear from you. This is a permanent full-time position to work alongside incredibly... 
    Permanent employment
    Full time
    Senior

    SC&H Group External

    Columbia, SC
    8 days ago
  •  ...Job Title : Senior Information Protection & AI Security Engineer Location: Lafayette, LA, Knoxville, TN, Columbia, SC, Birmingham, AL Type: Permanent Fulltime Overview Seeking a Senior Information Protection & AI Security Engineer to support enterprise data... 
    Permanent employment
    Full time
    Senior
    Local area

    System One

    Columbia, SC
    more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Splunk & Observability Engineer Job Type: Permanent Full Time. Be the first to apply!