%PIM-5-DRCHG: DR change

Unanswered Question
Jun 14th, 2011

Hi my problem is DR flapping basically DR changes from one PE to another, in my current environment I have about 8 PE so recently I see this log messages. This is effecting muticast traffic.

 

Jun 14 09:01:38.758 MY: %PIM-5-NBRCHG: neighbor 10.0.32.36 DOWN on interface Tunnel0 (vrf VPN_ServerFarm) non DR

Jun 14 09:01:39.042 MY: %PIM-5-NBRCHG: neighbor 10.0.32.35 DOWN on interface Tunnel0 (vrf VPN_ServerFarm) non DR

Jun 14 09:01:46.333 MY: %PIM-5-NBRCHG: neighbor 10.0.32.18 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:46.616 MY: %PIM-5-NBRCHG: neighbor 10.0.32.39 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:47.864 MY: %PIM-5-NBRCHG: neighbor 10.0.32.40 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:51.276 MY: %PIM-5-NBRCHG: neighbor 10.0.32.37 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:51.432 MY: %PIM-5-NBRCHG: neighbor 10.0.32.41 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:51.780 MY: %PIM-5-NBRCHG: neighbor 10.0.32.36 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:51.828 MY: %PIM-5-NBRCHG: neighbor 10.0.32.35 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:52.283 MY: %PIM-5-NBRCHG: neighbor 10.0.32.4 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:55.895 MY: %PIM-5-NBRCHG: neighbor 10.0.32.17 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:57.290 MY: %PIM-5-NBRCHG: neighbor 10.0.32.3 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 10:35:03.900 MY: %PIM-5-NBRCHG: neighbor 10.0.32.39 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:04.608 MY: %PIM-5-NBRCHG: neighbor 10.0.32.35 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:05.088 MY: %PIM-5-NBRCHG: neighbor 10.0.32.4 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:06.883 MY: %PIM-5-NBRCHG: neighbor 10.0.32.41 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:08.583 MY: %PIM-5-NBRCHG: neighbor 10.0.32.36 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:09.875 MY: %PIM-5-NBRCHG: neighbor 10.0.32.18 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:10.931 MY: %PIM-5-NBRCHG: neighbor 10.0.32.40 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:11.331 MY: %PIM-5-NBRCHG: neighbor 10.0.32.3 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:12.150 MY: %PIM-5-NBRCHG: neighbor 10.0.32.17 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:12.706 MY: %PIM-5-NBRCHG: neighbor 10.0.32.37 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:14.442 MY: %PIM-5-NBRCHG: neighbor 10.0.32.42 DOWN on interface Tunnel1 (vrf VPN_Wayside) DR

Jun 14 10:35:14.442 MY: %PIM-5-DRCHG: DR change from neighbor 10.0.32.42 to 10.0.32.34 on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:46.516 MY: %PIM-5-NBRCHG: neighbor 10.0.32.39 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:46.520 MY: %PIM-5-DRCHG: DR change from neighbor 10.0.32.34 to 10.0.32.39 on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:47.184 MY: %PIM-5-NBRCHG: neighbor 10.0.32.35 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:48.460 MY: %PIM-5-NBRCHG: neighbor 10.0.32.4 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:49.440 MY: %PIM-5-NBRCHG: neighbor 10.0.32.41 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:49.440 MY: %PIM-5-DRCHG: DR change from neighbor 10.0.32.39 to 10.0.32.41 on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:51.035 MY: %PIM-5-NBRCHG: neighbor 10.0.32.36 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:52.719 MY: %PIM-5-NBRCHG: neighbor 10.0.32.18 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:53.347 MY: %PIM-5-NBRCHG: neighbor 10.0.32.40 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:53.739 MY: %PIM-5-NBRCHG: neighbor 10.0.32.3 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:54.223 MY: %PIM-5-NBRCHG: neighbor 10.0.32.37 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:55.630 MY: %PIM-5-NBRCHG: neighbor 10.0.32.17 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:57.630 MY: %PIM-5-NBRCHG: neighbor 10.0.32.42 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 09:01:38.758 MY: %PIM-5-NBRCHG: neighbor 10.0.32.36 DOWN on interface Tunnel0 (vrf VPN_ServerFarm) non DR

Jun 14 09:01:39.042 MY: %PIM-5-NBRCHG: neighbor 10.0.32.35 DOWN on interface Tunnel0 (vrf VPN_ServerFarm) non DR

Jun 14 09:01:46.333 MY: %PIM-5-NBRCHG: neighbor 10.0.32.18 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:46.616 MY: %PIM-5-NBRCHG: neighbor 10.0.32.39 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:47.864 MY: %PIM-5-NBRCHG: neighbor 10.0.32.40 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:51.276 MY: %PIM-5-NBRCHG: neighbor 10.0.32.37 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:51.432 MY: %PIM-5-NBRCHG: neighbor 10.0.32.41 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:51.780 MY: %PIM-5-NBRCHG: neighbor 10.0.32.36 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:51.828 MY: %PIM-5-NBRCHG: neighbor 10.0.32.35 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:52.283 MY: %PIM-5-NBRCHG: neighbor 10.0.32.4 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:55.895 MY: %PIM-5-NBRCHG: neighbor 10.0.32.17 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 09:01:57.290 MY: %PIM-5-NBRCHG: neighbor 10.0.32.3 UP on interface Tunnel0 (vrf VPN_ServerFarm)

Jun 14 10:35:03.900 MY: %PIM-5-NBRCHG: neighbor 10.0.32.39 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:04.608 MY: %PIM-5-NBRCHG: neighbor 10.0.32.35 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:05.088 MY: %PIM-5-NBRCHG: neighbor 10.0.32.4 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:06.883 MY: %PIM-5-NBRCHG: neighbor 10.0.32.41 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:08.583 MY: %PIM-5-NBRCHG: neighbor 10.0.32.36 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:09.875 MY: %PIM-5-NBRCHG: neighbor 10.0.32.18 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:10.931 MY: %PIM-5-NBRCHG: neighbor 10.0.32.40 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:11.331 MY: %PIM-5-NBRCHG: neighbor 10.0.32.3 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:12.150 MY: %PIM-5-NBRCHG: neighbor 10.0.32.17 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:12.706 MY: %PIM-5-NBRCHG: neighbor 10.0.32.37 DOWN on interface Tunnel1 (vrf VPN_Wayside) non DR

Jun 14 10:35:14.442 MY: %PIM-5-NBRCHG: neighbor 10.0.32.42 DOWN on interface Tunnel1 (vrf VPN_Wayside) DR

Jun 14 10:35:14.442 MY: %PIM-5-DRCHG: DR change from neighbor 10.0.32.42 to 10.0.32.34 on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:46.516 MY: %PIM-5-NBRCHG: neighbor 10.0.32.39 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:46.520 MY: %PIM-5-DRCHG: DR change from neighbor 10.0.32.34 to 10.0.32.39 on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:47.184 MY: %PIM-5-NBRCHG: neighbor 10.0.32.35 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:48.460 MY: %PIM-5-NBRCHG: neighbor 10.0.32.4 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:49.440 MY: %PIM-5-NBRCHG: neighbor 10.0.32.41 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:49.440 MY: %PIM-5-DRCHG: DR change from neighbor 10.0.32.39 to 10.0.32.41 on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:51.035 MY: %PIM-5-NBRCHG: neighbor 10.0.32.36 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:52.719 MY: %PIM-5-NBRCHG: neighbor 10.0.32.18 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:53.347 MY: %PIM-5-NBRCHG: neighbor 10.0.32.40 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:53.739 MY: %PIM-5-NBRCHG: neighbor 10.0.32.3 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:54.223 MY: %PIM-5-NBRCHG: neighbor 10.0.32.37 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:55.630 MY: %PIM-5-NBRCHG: neighbor 10.0.32.17 UP on interface Tunnel1 (vrf VPN_Wayside)

Jun 14 10:35:57.630 MY: %PIM-5-NBRCHG: neighbor 10.0.32.42 UP on interface Tunnel1 (vrf VPN_Wayside)

I have this problem too.
0 votes
  • 1
  • 2
  • 3
  • 4
  • 5
Average Rating: 0 (0 ratings)
Luc De Ghein Tue, 06/14/2011 - 22:56

Hi,

You're running MVPN and have the issue that PIM neighbors are flapping in the VRF over the tunnel. Basically, PIM is established over the default MDT. This means that it looks like there is an issue with the default MDT multicast group in the core. You need to check if this multicast group is stable and forwarding all traffic.

There is quite a few things to check and MVPN is rather complex, so it might be a good idea to open a TAC case to follow up on this issue.

Thanks,

Luc

khaleel80 Tue, 06/14/2011 - 23:38

I did some debug on PE it get this

Jun 15 13:38:55.672 MY: PIM(4): Expire DF nbr on Tunnel0, nbr 10.0.32.12

Jun 15 13:38:58.552 MY: PIM(4): Expire DF nbr on Tunnel0, nbr 10.0.32.33

Jun 15 13:50:44.550 MY: PIM(4): Expire DF nbr on Tunnel0, nbr 10.0.32.32

Jun 15 14:00:04.776 MY: PIM(4): Expire DF nbr on Tunnel0, nbr 10.0.32.10

Jun 15 14:22:42.805 MY: PIM(4): Expire DF nbr on Tunnel0, nbr 10.0.32.32

Jun 15 14:34:03.523 MY: PIM(4): Expire DF nbr on Tunnel0, nbr 10.0.32.34

Actions

Login or Register to take actions

This Discussion

Posted June 14, 2011 at 9:10 AM
Stats:
Replies:2 Avg. Rating:
Views:5708 Votes:0
Shares:0
Tags: No tags.

Discussions Leaderboard