Senior Engineer - Observability

As a Sr. Engineer, you will be a self-starter who is seen as a technical expert in Observability Engineering, responsible for building high performance next generation Observability systems. This will be accomplished with a combination of general application/environment understanding and building new engineering capabilities to improve and enhance existing distributed solutions to solve critical Observability Engineering problems for both cloud and on-premises. You will also participate in a 24x7 on-call rotation and be accountable for all aspects of IT Service Delivery, including incident, problem, and change management and ensure adherence to these processes, from coding to scaling applications, performance tuning and post-mortem analysis. Lastly, as the Sr. Engineer, you will drive thought leadership and function as an interim leader in the absence of the Sr. Manager, partnering with SRE and DevOps teams to define and implement observability and monitoring practices during the SDLC. The ideal candidate has deep technical expertise in Python/Java coding, Kubernetes and building cloud Observability Platform solutions.

• Collaborate proactively with interdisciplinary teams across the IT department to identify and mitigate unplanned application downtime and engage in thorough root cause analysis post-outage, improving system designs for automated troubleshooting

• Partner with Application Development, Site Reliability Engineering and DevOps teams to continuously refine application instrumentation in order to maximize reliability and availability, enforcing best practices and enhancing system optimization, defining and implementing SLI, SLO and SLA
• Continuously build upon knowledge of the assigned portfolio of applications to understand architecture, usage patterns, performance trends, outages, and business impact, creating strategies to proactively identify and report application performance problems and failures, detecting and preventing issues to mitigate operational risks
• Be responsible for building Observability solutions towards the long-term goals, being a strong champion of Observability Principles
• Consistently share best practices and improve processes within and across teams
• Continuously monitor the production environment availability and take a holistic view of system health, service performance and availability, including real user monitoring, logging, distributed tracing and alerting for cloud and on-premise systems
• Engage with project teams to guarantee that operational monitoring and instrumentation requirements are addressed by defining and implementing SLI, SLO and SLA during application deployment
• Develop expert-level knowledge of Observability toolsets to maintain and enhance our Observability practices and solutions, improving the reliability, stability, and performance of the digital platforms by driving the implementation of fully automated telemetry capabilities to improve problem identification and service restoration through automated alerting and response systems with intelligent, self-healing capabilities
• Serves as mentor to other team members to provide support and guidance in performing core functions, and in championing the adoption of Observability practices