Kernel error Server cloudcephmon1004 may have kernel errors
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	phaultfinder
	Tue, Nov 26, 2:59 PM

Description

Common information

dashboard: https://grafana.wikimedia.org/d/b013af4c-d405-4d9f-85d4-985abb3dec0c/wmcs-kernel-panic-detector?orgId=1&var-instance=cloudcephmon1004
description: The server cloudcephmon1004 logged some kernel errors in the past 24h
runbook: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic
summary: Server cloudcephmon1004 may have kernel errors

alertname: Kernel error
cluster: insetup
instance: cloudcephmon1004:9100
job: node
prometheus: ops
severity: critical
site: eqiad
source: prometheus
team: wmcs

Firing alerts

dashboard: https://grafana.wikimedia.org/d/b013af4c-d405-4d9f-85d4-985abb3dec0c/wmcs-kernel-panic-detector?orgId=1&var-instance=cloudcephmon1004
description: The server cloudcephmon1004 logged some kernel errors in the past 24h
runbook: https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Kernel_panic
summary: Server cloudcephmon1004 may have kernel errors
alertname: Kernel error
cluster: insetup
instance: cloudcephmon1004:9100
job: node
prometheus: ops
severity: critical
site: eqiad
source: prometheus
team: wmcs
Source

Related Objects

Mentioned In: T380960: kernel error detector: have a way to ignore certain messages

Event Timeline

phaultfinder created this task.Tue, Nov 26, 2:59 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptTue, Nov 26, 2:59 PM

Current errors:

root@cloudcephmon1004:~# journalctl -k -p err
-- Journal begins at Tue 2024-11-26 12:46:45 UTC, ends at Tue 2024-11-26 15:12:54 UTC. --
Nov 26 13:11:41 cloudcephmon1004 kernel: x86/cpu: VMX (outside TXT) disabled by BIOS
Nov 26 13:11:41 cloudcephmon1004 kernel: mpt3sas_cm0: Trace buffer memory 2048 KB allocated

The first is expected, the second seems harmless too:
https://hetzbiz.cloud/2024/06/11/those-damn-mpt3sas_cm0-messages/

The first is expected, the second seems harmless too:

Agree, I'm gonna resolve the task.

aborrero mentioned this in T380960: kernel error detector: have a way to ignore certain messages.Wed, Nov 27, 10:27 AM

Kernel error Server cloudcephmon1004 may have kernel errorsClosed, ResolvedPublicActions

Description

Common information

Firing alerts

Related Objects

Event Timeline

Kernel error Server cloudcephmon1004 may have kernel errors
Closed, ResolvedPublic
Actions