Toggle menu
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

TELEICU/Incident management: Difference between revisions

From OHC Network Wiki
More languages
Content deleted Content added
Create TELEICU incident management guide page (via create-page on MediaWiki MCP Server)
 
Fix both tables: proper MediaWiki || cell separators, add missing headers/labels (via update-page on MediaWiki MCP Server)
 
(One intermediate revision by the same user not shown)
Line 19: Line 19:
{| class="wikitable"
{| class="wikitable"
|-
|-
! Classification
| Power outage | Node stops responding entirely, no network activity, BMC/IPMI reports power state (if available) |
! Description
| Network outage | Node is running (CPU/memory metrics were reporting) but network path to CP is down |
|-
| Other | Node is running, network is up, but middleware service is degraded or down |
| Power outage
| Node stops responding entirely, no network activity, BMC/IPMI reports power state (if available)
|-
| Network outage
| Node is running (CPU/memory metrics were reporting) but network path to CP is down
|-
| Other
| Node is running, network is up, but middleware service is degraded or down
|}
|}


Line 31: Line 39:
|-
|-
! Severity
! Severity
! Condition
! Target
! Channel
! SLA
|-
|-
| P1
| P1 — Site offline > 30 min | Hub admin assigned to that site | Phone call + Slack/PagerDuty | 15 min |
| P2 — Site offline > 10 min | Hub admin assigned to that site | Slack/PagerDuty | 30 min |
| Site offline > 30 min
| P3 — Service degraded | Hub admin assigned to that site | Slack notification | 4 hours |
| Hub admin assigned to that site
| Phone call + Slack/PagerDuty
| P4 — Informational | Ops team | Dashboard alert | Next business day |
| 15 min
|-
| P2
| Site offline > 10 min
| Hub admin assigned to that site
| Slack/PagerDuty
| 30 min
|-
| P3
| Service degraded
| Hub admin assigned to that site
| Slack notification
| 4 hours
|-
| P4
| Informational
| Ops team
| Dashboard alert
| Next business day
|}
|}


Line 55: Line 86:
* Runbook updates if the procedure was incomplete
* Runbook updates if the procedure was incomplete


{{Navbox TELEICU}}
== Related ==

* [[TELEICU/Monitoring & observability|Monitoring & observability]]
* [[TELEICU/Power loss runbook|Power loss runbook]]
* [[TELEICU/Spoke unreachable runbook|Spoke unreachable runbook]]


{{Related}}
{{Related}}