ISR4000 シリーズルータにて Memory 関連の問題が発生した場合に取得するログなどを記載しています。
ログ取得前に事前に設定頂きたいコマンド
ログを取得する場合は以下の Link に記載されている設定を行ったうえでログをご取得ください。
IOS/IOS-XE Router でログ取得前に事前に設定頂きたいコマンド
show コマンド
以下の手順で show コマンドを取得してください。
Step1: IOSd 側の問題なのか、Linux 側の問題なのか確認
IOS-XE では Linux 上で IOSd(IOS Daemon) が動作しています。
IOSd の問題であれば、Linux 側の Troubleshooting は不要です。
同様に、Linux 側の問題であれば IOSd 側の Troubleshooting も不要です。
show platform software process slot <slot> active monitor cycles 1 を取得し、IOSd 側の問題なのか、Linux 側の問題なのかを確認します。linux_iosd-imag の Memory 使用率が高ければ IOSd 側の問題です。
Router#show platform software process slot RP active monitor cycles 1
--- snip ---
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
25523 root 20 0 1905m 490m 126m R 1.7 13.0 11:38.84 linux_iosd-imag
--- snip --- |
この例では、linux_iosd-imag のMemory 使用率は 13.0% と低く、IOSd 側は特に問題はないようです。
Step2: show コマンドを取得
Step1 で IOSd 側の問題なのか、Linux 側の問題なのかを確認できたら、問題のある方のコマンドを事象発生中に複数回取得してください。な お、Memory Leak や Buffer Leak などの問題の場合には、問題が発生するまで時間がかかる場合もあるため、数日程度時間をおいて(場合によっては数週間程度時間をおいて)から再度ログをご 取得頂かな いと troubleshooting を行えない場合があります。
show region
show memory
show memory allocating-process
show memory allocating-process totals
show memory dead
show memory dead totals
show memory failures alloc
show memory fragment
show memory fragment detail
show memory statistics history
show memory statistics history table
show memory summary
show memory debug leaks
show processes memory sorted
show processes memory <PID>
show processes
show processes <PID>
show stacks <PID>
show buffers
show buffers all
show buffers all dump
show buffers old
show buffers old dump
show buffers leak
show buffers leak resource user
show ip traffic
show ip route summary
show ipv6 traffic
show ipv6 route summary
show interfaces
show interfaces accounting
show interfaces stats
show interfaces switching
show controllers
show tech-support
show log
＊show memory debug leaks は CPU に負荷をかけるのでご注意ください。
＊show tech-support は多少CPUに負荷がかかります。
----- システム全体 -----
show platform software status control-processor brief
----- RP Active -----
show platform software process environment ios RP active
show platform software process slot RP active monitor cycles 1
show platform software process list RP active sort memory
show platform software process list RP active process-id <Linux PID>
show platform software memory backplaneswitch-manager RP active brief
show platform software memory chassis-manager RP active brief
show platform software memory forwarding-manager RP active brief
show platform software memory host-manager RP active brief
show platform software memory ios RP active brief
show platform software memory license-manager RP active brief
show platform software memory logger RP active brief
show platform software memory pluggable-services RP active brief
show platform software memory shell-manager RP active brief
show platform software memory chunk host-manager RP active
show platform software memory database forwarding-manager RP active | exclude diff:0
show platform software memory messaging backplaneswitch-manager RP active | exclude diff:0
show platform software memory messaging chassis-manager RP active | exclude diff:0
show platform software memory messaging forwarding-manager RP active | exclude diff:0
show platform software memory messaging host-manager RP active | exclude diff:0
show platform software memory messaging ios RP active | exclude diff:0
show platform software memory messaging license-manager RP active | exclude diff:0
show platform software memory messaging logger RP active | exclude diff:0
show platform software memory messaging pluggable-services RP active | exclude diff:0
show platform software memory messaging shell-manager RP active | exclude diff:0
----- FP Active -----
show platform software memory chassis-manager FP active brief
show platform software memory forwarding-manager FP active brief
show platform software memory host-manager FP active brief
show platform software memory logger FP active brief
show platform software memory chunk chassis-manager FP active
show platform software memory chunk forwarding-manager FP active
show platform software memory chunk host-manager FP active
show platform software memory messaging chassis-manager FP active | exclude diff:0
show platform software memory messaging forwarding-manager FP active | exclude diff:0
show platform software memory messaging host-manager FP active | exclude diff:0
show platform software memory messaging logger FP active | exclude diff:0
----- QFP active -----
show platform hardware qfp active infrastructure exmem statistics
show platform software memory qfp-control-process qfp active brief
show platform software memory qfp-driver qfp active brief
show platform software memory qfp-ha-server qfp active brief
show platform software memory qfp-service-process qfp active brief
show platform software memory chunk qfp-control-process qfp active
show platform software memory chunk qfp-driver qfp active
show platform software memory chunk qfp-ha-server qfp active
show platform software memory chunk qfp-service-process qfp active
show platform software memory messaging qfp-control-process qfp active | exclude diff:0
show platform software memory messaging qfp-driver qfp active | exclude diff:0
show platform software memory messaging qfp-ha-server qfp active | exclude diff:0
show platform software memory messaging qfp-service-process qfp active | exclude diff:0
----- Slot 0 -----
show platform software memory chassis-manager 0 brief
show platform software memory host-manager 0 brief
show platform software memory logger 0 brief
show platform software memory chunk host-manager 0
show platform software memory messaging chassis-manager 0 | exclude diff:0
show platform software memory messaging host-manager 0 | exclude diff:0
show platform software memory messaging interface-manager 0 | exclude diff:0
show platform software memory messaging logger 0 | exclude diff:0
----- Slot 1 -----
show platform software memory chassis-manager 1 brief
show platform software memory host-manager 1 brief
show platform software memory logger 1 brief
show platform software memory chunk host-manager 1
show platform software memory messaging chassis-manager 1 | exclude diff:0
show platform software memory messaging host-manager 1 | exclude diff:0
show platform software memory messaging interface-manager 1 | exclude diff:0
show platform software memory messaging logger 1 | exclude diff:0
----- Interface -----
show platform software memory iomd 0/0 brief
show platform software memory ios 0/0 brief
show platform software memory chunk iomd 0/0
show platform software memory iomd 0/1 brief
show platform software memory ios 0/1 brief
show platform software memory chunk iomd 0/1
show platform software memory iomd 0/2 brief
show platform software memory ios 0/2 brief
show platform software memory chunk iomd 0/2
show platform software memory iomd 0/3 brief
show platform software memory ios 0/3 brief
show platform software memory chunk iomd 0/3
show platform software memory iomd 0/4 brief
show platform software memory ios 0/4 brief
show platform software memory chunk iomd 0/4
show platform software memory iomd 1/0 brief
show platform software memory ios 1/0 brief
show platform software memory chunk iomd 1/0
show platform software memory iomd 1/1 brief
show platform software memory ios 1/1 brief
show platform software memory chunk iomd 1/1
show platform software memory iomd 1/2 brief
show platform software memory ios 1/2 brief
show platform software memory chunk iomd 1/2
show platform software memory iomd 1/3 brief
show platform software memory ios 1/3 brief
show platform software memory chunk iomd 1/3
- <PID> の部分には show processes cpu sorted で CPU 使用率が上昇している Process の PID を確認して、PID を入力してください。
|
Router#show processes cpu sorted
CPU utilization for five seconds: 81%/0%; one minute: 3%; five minutes: 1%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
88 12660 71555 176 80.31% 1.62% 0.33% 0 IP Input
101 3880 1508 2572 0.39% 0.07% 0.01% 0 Exec
|
この例であれば、IP Input が上昇していて PID が 88 なので show stacks 88 と入力してください。
- <interface> には関連する interface を入力してください。不明であれば全ての Interface を入力頂ければと思います。
- show ipv6 ... のコマンドは IPv6 使用時のみご取得ください。
- <Linux PID> には show platform software process slot <slot> monitor cycles 1 で確認したプロセスの PID を入力してください。
例えば以下の例であれば、hman の Memory 使用率が 83.7% になっているので、hman の PID 32767 を入力してください。
|
Router#show platform software process slot R0 monitor cycles 1
--- snip ---
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
32767 root 20 0 1963m 518m 191m R 23.7 83.7 93:27.03 hman
1225 root 20 0 21148 7356 4936 S 13.6 0.2 27:43.41 linux_iosd-imag
18352 root 20 0 2652 1168 892 R 3.9 0.0 0:00.02 top
--- snip ---
|
