ASA5585 high cpu

[jack lee]

Hi all, The high cpu in the admin firewall 5585(with context mode).the DATAPATH process is occasionally using 98%+ of the CPU. GMCC-YPT-ASA5585-MDCN# show cpu detail Break down of per-core data path versus control point cpu usage: Core 5 sec 1 min 5 min Core 0 98.2 (96.0 + 2.2) 97.0 (94.7 + 2.3) 97.1 (94.8 + 2.3) Core 1 98.2 (95.9 + 2.4) 97.0 (94.7 + 2.3) 97.1 (94.8 + 2.3) Core 2 98.2 (95.9 + 2.3) 97.0 (94.7 + 2.3) 97.1 (94.8 + 2.3) Core 3 98.2 (95.8 + 2.3) 97.0 (94.7 + 2.3) 97.1 (94.8 + 2.3) Core 4 98.3 (96.1 + 2.1) 97.0 (94.7 + 2.3) 97.1 (94.8 + 2.3) Core 5 98.2 (95.9 + 2.3) 96.9 (94.5 + 2.4) 97.0 (94.6 + 2.4) Core 6 98.3 (96.2 + 2.1) 97.1 (94.8 + 2.3) 97.1 (94.9 + 2.3) Core 7 98.3 (96.1 + 2.2) 97.0 (94.8 + 2.2) 97.1 (94.9 + 2.2) Current control point elapsed versus the maximum control point elapsed for: 5 seconds = 16.7%; 1 minute: 21.0%; 5 minutes: 20.0% GMCC-YPT-ASA5585-MDCN# show xlate count 1410 in use, 18317 most used GMCC-YPT-ASA5585-MDCN# show process cpu-usage sorted non-zero PC Thread 5Sec 1Min 5Min Process - - 11.9% 11.9% 11.9% DATAPATH-6-1510 - - 11.9% 11.8% 11.8% DATAPATH-4-1508 - - 11.9% 11.8% 11.8% DATAPATH-2-1506 - - 11.9% 11.9% 11.8% DATAPATH-7-1511 - - 11.8% 11.8% 11.8% DATAPATH-1-1505 - - 11.8% 11.8% 11.8% DATAPATH-3-1507 - - 11.8% 11.8% 11.8% DATAPATH-5-1509 - - 11.8% 11.8% 11.8% DATAPATH-0-1504 08cc1c26 3ab04570 1.4% 1.5% 1.5% Logger 082b7a86 3aafdf10 0.6% 0.6% 0.6% CP Processing 0854d12e 3aafa7f0 0.3% 0.2% 0.2% ARP Thread GMCC-YPT-ASA5585-MDCN# show process cpu-usage sorted non-zero PC Thread 5Sec 1Min 5Min Process - - 12.0% 11.9% 11.9% DATAPATH-0-1504 - - 12.0% 11.9% 11.9% DATAPATH-2-1506 - - 12.0% 11.9% 11.9% DATAPATH-4-1508 - - 12.0% 11.9% 11.9% DATAPATH-1-1505 - - 12.0% 11.9% 11.9% DATAPATH-3-1507 - - 12.0% 11.9% 11.9% DATAPATH-6-1510 - - 12.0% 11.9% 11.9% DATAPATH-5-1509 - - 12.0% 11.9% 11.9% DATAPATH-7-1511 08cc1c26 3ab04570 1.4% 1.4% 1.4% Logger 082b7a86 3aafdf10 0.6% 0.6% 0.6% CP Processing 0854d12e 3aafa7f0 0.2% 0.2% 0.2% ARP Thread 08cd860b 3aae4d70 0.1% 0.1% 0.1% telnet/ci GMCC-YPT-ASA5585-MDCN# show processes cpu-hog Process: tmatch compile thread, PROC_PC_TOTAL: 11, MAXHOG: 3, LASTHOG: 2 LASTHOG At: 14:21:11 BeiJing Jun 19 2018 PC: 81a823a (suspend) Process: tmatch compile thread, NUMHOG: 3, MAXHOG: 2, LASTHOG: 2 LASTHOG At: 14:21:11 BeiJing Jun 19 2018 PC: 81a823a (suspend) Call stack: 81a823a 81a49d8 81a5269 81b0baa 81ab80c 80675b3 Process: Logger, PROC_PC_TOTAL: 2, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 14:28:48 BeiJing Jun 19 2018 PC: 8cc1c05 (suspend) Process: Logger, NUMHOG: 2, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 14:28:48 BeiJing Jun 19 2018 PC: 8cc1c05 (suspend) Call stack: 8cc1c05 80675b3 Process: intel_82574_esd_detection_threa, PROC_PC_TOTAL: 78, MAXHOG: 2, LASTHOG: 2 LASTHOG At: 14:59:31 BeiJing Jun 19 2018 PC: 845a9cc (suspend) Process: intel_82574_esd_detection_threa, NUMHOG: 300, MAXHOG: 3, LASTHOG: 2 LASTHOG At: 14:59:31 BeiJing Jun 19 2018 PC: 845a9cc (suspend) Call stack: 80675b3 Process: telnet/ci, NUMHOG: 15, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 15:44:00 BeiJing Jun 19 2018 PC: 8068815 (suspend) Call stack: 8068815 8729d85 8a3d4f1 8a567e9 80d078a 80d0eb9 80d202a 80d2c80 80675b3 Process: fover_parse, PROC_PC_TOTAL: 667, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 15:59:56 BeiJing Jun 19 2018 PC: 8421041 (suspend) Process: fover_parse, NUMHOG: 667, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 15:59:56 BeiJing Jun 19 2018 PC: 8421041 (suspend) Call stack: 8421041 80675b3 Process: tmatch compile thread, PROC_PC_TOTAL: 72, MAXHOG: 2, LASTHOG: 1 LASTHOG At: 16:21:24 BeiJing Jun 19 2018 PC: 81a81bb (suspend) Process: tmatch compile thread, NUMHOG: 68, MAXHOG: 2, LASTHOG: 1 LASTHOG At: 16:21:24 BeiJing Jun 19 2018 PC: 81a81bb (suspend) Call stack: 81a81bb 81abd3d 80675b3 Process: telnet/ci, NUMHOG: 1, MAXHOG: 16, LASTHOG: 16 LASTHOG At: 16:25:50 BeiJing Jun 19 2018 PC: 892c935 (suspend) Call stack: 892c935 80ddfcc 80de866 80d1eb1 80d2c80 80675b3 Process: telnet/ci, PROC_PC_TOTAL: 1, MAXHOG: 16, LASTHOG: 16 LASTHOG At: 16:27:23 BeiJing Jun 19 2018 PC: 8cdd7ab (suspend) Process: telnet/ci, NUMHOG: 1, MAXHOG: 16, LASTHOG: 16 LASTHOG At: 16:27:23 BeiJing Jun 19 2018 PC: 8cdd7ab (suspend) Call stack: 8cddfde 8ce7921 892c1a5 93faeae 80de875 80d1eb1 80d2c80 80675b3 Process: telnet/ci, PROC_PC_TOTAL: 23, MAXHOG: 3, LASTHOG: 3 LASTHOG At: 16:29:14 BeiJing Jun 19 2018 PC: 8934955 (suspend) Process: telnet/ci, NUMHOG: 23, MAXHOG: 3, LASTHOG: 3 LASTHOG At: 16:29:14 BeiJing Jun 19 2018 PC: 8934955 (suspend) Call stack: 8934955 892d980 8a04f0c 8a04fd1 93aafc3 8a43304 8a04fd1 892d7f7 892d861 8935826 8936f4a 80d0cd1 80d202a 80d2c80 Process: telnet/ci, NUMHOG: 1, MAXHOG: 82, LASTHOG: 82 LASTHOG At: 17:02:30 BeiJing Jun 19 2018 PC: 892c935 (suspend) Call stack: 892c935 940dfc1 93ec388 93eccf1 80d9de5 80da380 80d078a 80d0eb9 80d202a 80d2c80 80675b3 Process: telnet/ci, PROC_PC_TOTAL: 4, MAXHOG: 8, LASTHOG: 1 LASTHOG At: 17:02:31 BeiJing Jun 19 2018 PC: 93ec5aa (suspend) Process: telnet/ci, NUMHOG: 4, MAXHOG: 8, LASTHOG: 1 LASTHOG At: 17:02:31 BeiJing Jun 19 2018 PC: 93ec5aa (suspend) Call stack: 93ec5aa 93eccf1 80d9de5 80da380 80d078a 80d0eb9 80d202a 80d2c80 80675b3 Process: telnet/ci, PROC_PC_TOTAL: 1, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 17:04:53 BeiJing Jun 19 2018 PC: 8cd860b (suspend) Process: telnet/ci, NUMHOG: 1, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 17:04:53 BeiJing Jun 19 2018 PC: 8cd860b (suspend) Call stack: 8cd8a02 8ce6ef1 8ce69ed 892ca44 940dfc1 8a09b85 8a0a947 8a0b2af 847d1b5 8935826 8936f4a 80d0cd1 80d202a 80d2c80 Process: telnet/ci, PROC_PC_TOTAL: 6, MAXHOG: 82, LASTHOG: 1 LASTHOG At: 17:04:53 BeiJing Jun 19 2018 PC: 892c935 (suspend) Process: telnet/ci, NUMHOG: 1, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 17:04:53 BeiJing Jun 19 2018 PC: 892c935 (suspend) Call stack: 892c935 940dfc1 8a09bd7 8a0a947 8a0b2af 847d1b5 8935826 8936f4a 80d0cd1 80d202a 80d2c80 80675b3 Process: ARP Thread, NUMHOG: 1434, MAXHOG: 1, LASTHOG: 1 LASTHOG At: 17:12:02 BeiJing Jun 19 2018 PC: 8068815 (suspend) Call stack: 8068815 8a3a729 8549893 854cd7a 854d186 80675b3 Process: tmatch compile thread, PROC_PC_TOTAL: 38975, MAXHOG: 7, LASTHOG: 1 LASTHOG At: 17:19:14 BeiJing Jun 19 2018 PC: 81aafc6 (suspend) Process: tmatch compile thread, NUMHOG: 38957, MAXHOG: 7, LASTHOG: 1 LASTHOG At: 17:19:14 BeiJing Jun 19 2018 PC: 81aafc6 (suspend) Call stack: 81aafc6 80675b3 Process: fover_health_monitoring_thread, PROC_PC_TOTAL: 1655916, MAXHOG: 40, LASTHOG: 2 LASTHOG At: 17:37:04 BeiJing Jun 19 2018 PC: 8068815 (suspend) Process: fover_FSM_thread, NUMHOG: 1652502, MAXHOG: 4, LASTHOG: 2 LASTHOG At: 17:37:04 BeiJing Jun 19 2018 PC: 8068815 (suspend) Call stack: 8068815 841322e 8415266 8415c0e 8428373 8428bb0 8437beb 8432d9e 84344c8 80675b3 Process: fover_health_monitoring_thread, PROC_PC_TOTAL: 4957822, MAXHOG: 4, LASTHOG: 2 LASTHOG At: 17:37:19 BeiJing Jun 19 2018 PC: 840417c (suspend) Process: fover_health_monitoring_thread, NUMHOG: 4957822, MAXHOG: 4, LASTHOG: 2 LASTHOG At: 17:37:19 BeiJing Jun 19 2018 PC: 840417c (suspend) Call stack: 840417c 80675b3 Process: DATAPATH-0-1504, NUMHOG: 22020662, MAXHOG: 82, LASTHOG: 1 LASTHOG At: 17:37:22 BeiJing Jun 19 2018 PC: 0 (suspend) Call stack: 81dc1a4 8aeaac8 8af4002 8af8be7 ff6a3a1c ff61f7d7 Process: DATAPATH-0-1504, PROC_PC_TOTAL: 64305048, MAXHOG: 83, LASTHOG: 2 LASTHOG At: 17:37:23 BeiJing Jun 19 2018 PC: 0 (suspend) Process: DATAPATH-1-1505, NUMHOG: 18895458, MAXHOG: 84, LASTHOG: 1 LASTHOG At: 17:37:22 BeiJing Jun 19 2018 PC: 0 (suspend) Call stack: 81dc1a4 8aeaac8 8af4002 8af8be7 ff6a3a1c ff61f7d7 Process: DATAPATH-1-1505, PROC_PC_TOTAL: 49142794, MAXHOG: 84, LASTHOG: 1 LASTHOG At: 17:37:23 BeiJing Jun 19 2018 PC: 0 (suspend) Process: DATAPATH-2-1506, NUMHOG: 19417699, MAXHOG: 149, LASTHOG: 2 LASTHOG At: 17:37:22 BeiJing Jun 19 2018 PC: 0 (suspend) Call stack: 81dc1a4 8aeaac8 8af4002 8af8be7 ff6a3a1c ff61f7d7 Process: DATAPATH-2-1506, PROC_PC_TOTAL: 48695904, MAXHOG: 149, LASTHOG: 1 LASTHOG At: 17:37:23 BeiJing Jun 19 2018 PC: 0 (suspend) Process: DATAPATH-3-1507, NUMHOG: 19112315, MAXHOG: 84, LASTHOG: 1 LASTHOG At: 17:37:21 BeiJing Jun 19 2018 PC: 0 (suspend) Call stack: 81dc1a4 8aeaac8 8af4002 8af8be7 ff6a3a1c ff61f7d7 Process: DATAPATH-3-1507, PROC_PC_TOTAL: 52814933, MAXHOG: 84, LASTHOG: 1 LASTHOG At: 17:37:23 BeiJing Jun 19 2018 PC: 0 (suspend) Process: DATAPATH-4-1508, NUMHOG: 19190719, MAXHOG: 100, LASTHOG: 1 LASTHOG At: 17:37:22 BeiJing Jun 19 2018 PC: 0 (suspend) Call stack: 81dc1a4 8aeaac8 8af4002 8af8be7 ff6a3a1c ff61f7d7 Process: DATAPATH-4-1508, PROC_PC_TOTAL: 52629972, MAXHOG: 100, LASTHOG: 1 LASTHOG At: 17:37:23 BeiJing Jun 19 2018 PC: 0 (suspend) Process: DATAPATH-5-1509, NUMHOG: 19442041, MAXHOG: 82, LASTHOG: 1 LASTHOG At: 17:37:22 BeiJing Jun 19 2018 PC: 0 (suspend) Call stack: 81dc1a4 8aeaac8 8af4002 8af8be7 ff6a3a1c ff61f7d7 Process: DATAPATH-5-1509, PROC_PC_TOTAL: 51674944, MAXHOG: 84, LASTHOG: 1 LASTHOG At: 17:37:23 BeiJing Jun 19 2018 PC: 0 (suspend) Process: DATAPATH-6-1510, NUMHOG: 19238633, MAXHOG: 84, LASTHOG: 1 LASTHOG At: 17:37:21 BeiJing Jun 19 2018 PC: 0 (suspend) Call stack: 81dc1a4 8aeaac8 8af4002 8af8be7 ff6a3a1c ff61f7d7 Process: DATAPATH-6-1510, PROC_PC_TOTAL: 54293610, MAXHOG: 84, LASTHOG: 1 LASTHOG At: 17:37:22 BeiJing Jun 19 2018 PC: 0 (suspend) Process: DATAPATH-7-1511, NUMHOG: 19090491, MAXHOG: 90, LASTHOG: 1 LASTHOG At: 17:37:22 BeiJing Jun 19 2018 PC: 0 (suspend) Call stack: 81dc1a4 8aeaac8 8af4002 8af8be7 ff6a3a1c ff61f7d7 Process: DATAPATH-7-1511, PROC_PC_TOTAL: 52725503, MAXHOG: 90, LASTHOG: 1 LASTHOG At: 17:37:23 BeiJing Jun 19 2018 PC: 0 (suspend) What happens?