Re: QOS config- Phones issue-urgent

ccie.7861 · ‎08-19-2013

Hi All,

Below is the Qos config from one of the router. We are facing issues in 2 projects Avaya phones explaining below.

Every day at 6:45 to 7 pm all phones go in hang state & after resting the phones it started working fine, these phones are registering in PHX ACD from India. In India we have two location going to same PHX ACD but faing this issue with only one location. below is config on router where ISP link is terminated & Qos configured, so wanted to troubleshoot from every point of view. I am not confident enough in Qos so pasted the config below.Can someone check and let me know if there are some drops in RTP packet which are causing this issue or this config is fine and this can not be because this.

Quick response will be highly appreciated.

interface GigabitEthernet0/1.390

description XXX VRF interface 12Mb

bandwidth 12000

Service-policy : ENT-COS

        queue stats for all priority classes:
          Queueing
          queue limit 64 packets
          (queue depth/total drops/no-buffer drops) 0/0/0
          (pkts output/bytes output) 125266869/2799611140050

        Class-map: RT (match-any)
          34485005189 packets, 2799611195630 bytes
          5 minute offered rate 3725000 bps, drop rate 0 bps
          Match: ip dscp ef (46)
            3660024 packets, 215453414 bytes
            5 minute rate 0 bps
          Match: ip dscp cs5 (40)
            0 packets, 0 bytes
            5 minute rate 0 bps
          Match: ip precedence 5
            0 packets, 0 bytes
            5 minute rate 0 bps
          Match: protocol rtp audio
            34481345047 packets, 2799395744458 bytes
            5 minute rate 3725000 bps
          Priority: 30% (3600 kbps), burst bytes 90000, b/w exceed drops: 0

        Class-map: BH (match-any)
          320721645 packets, 21914063688 bytes
          5 minute offered rate 8000 bps, drop rate 0 bps
          Match: access-group name BURSTY-HI
            320721643 packets, 21914063958 bytes
            5 minute rate 8000 bps
          Match: ip dscp af31 (26)
            0 packets, 0 bytes
            5 minute rate 0 bps
          Match: ip precedence 3
            2 packets, 140 bytes
            5 minute rate 0 bps
          Match: ip dscp cs3 (24)
            0 packets, 0 bytes
            5 minute rate 0 bps
          Queueing
          queue limit 64 packets
          (queue depth/total drops/no-buffer drops) 0/0/0
          (pkts output/bytes output) 320721646/21748624987
          bandwidth remaining 40% (3360 kbps)
            Exp-weight-constant: 9 (1/512)
            Mean queue depth: 0 packets
            dscp     Transmitted       Random drop      Tail drop          Minimum        Maximum     Mark
                      pkts/bytes     pkts/bytes       pkts/bytes          thresh         thresh     prob

            default350148468/23771060691      0/0              0/0                 20            40 1/10
            cs3            2/140             0/0              0/0                 26            40 1/10
            cs6      1288732/90503870        0/0              0/0                 32            40 1/10

        Class-map: BL (match-any)
          92397717 packets, 24878760631 bytes
          5 minute offered rate 3000 bps, drop rate 0 bps
          Match: access-group name BURSTY-LO
            92397126 packets, 24878667772 bytes
            5 minute rate 3000 bps
          Match: ip dscp af21 (18)
            590 packets, 92859 bytes
            5 minute rate 0 bps
          Match: ip dscp cs2 (16)
            0 packets, 0 bytes
            5 minute rate 0 bps
          Match: ip precedence 2
            0 packets, 0 bytes
            5 minute rate 0 bps
          Queueing
          queue limit 64 packets
          (queue depth/total drops/no-buffer drops) 0/11379/0
          (pkts output/bytes output) 92386339/24863143846
          bandwidth remaining 25% (2100 kbps)
            Exp-weight-constant: 9 (1/512)
            Mean queue depth: 0 packets
            dscp     Transmitted       Random drop      Tail drop          Minimum        Maximum     Mark
                      pkts/bytes     pkts/bytes       pkts/bytes          thresh         thresh     prob

default101919739/27332128932 164/224108 690/942028 20 40 1/10
af21 590/92859 0/0 0/0 32 40 1/10

        Class-map: VIDEO (match-any)
          11580 packets, 3543363 bytes
          5 minute offered rate 0 bps, drop rate 0 bps
          Match: ip dscp af41 (34)
            11579 packets, 3542745 bytes
            5 minute rate 0 bps
          Match: ip precedence 4
            1 packets, 618 bytes
            5 minute rate 0 bps
          Match: ip dscp cs4 (32)
            0 packets, 0 bytes
            5 minute rate 0 bps
          Match: access-group name video-class
            0 packets, 0 bytes
            5 minute rate 0 bps
          Queueing
          queue limit 64 packets
          (queue depth/total drops/no-buffer drops) 0/0/0
          (pkts output/bytes output) 11580/3543363
          bandwidth remaining 25% (2100 kbps)
            Exp-weight-constant: 9 (1/512)
            Mean queue depth: 0 packets
            dscp     Transmitted       Random drop      Tail drop          Minimum        Maximum     Mark
                      pkts/bytes     pkts/bytes       pkts/bytes          thresh         thresh     prob

cs4 1/618 0/0 0/0 28 40 1/10
af41 14470/4447842 0/0 0/0 32 40 1/10

        Class-map: class-default (match-any)
          21037363517 packets, 8433752723740 bytes
          5 minute offered rate 666000 bps, drop rate 0 bps
          Match: any
          Queueing
          queue limit 64 packets
          (queue depth/total drops/no-buffer drops/flowdrops) 0/3349156/0/0
          (pkts output/bytes output) 3854145131/8430646107753
          Fair-queue: per-flow queue limit 16
            Exp-weight-constant: 9 (1/512)
            Mean queue depth: 0 packets
            dscp     Transmitted       Random drop      Tail/Flow drop Minimum Maximum Mark
                      pkts/bytes    pkts/bytes       pkts/bytes    thresh thresh prob

default23671805234/9791021101435 92116/86714596 459438/399160871 20 40 1/10
cs6 7151908/526899130 12/868 137/9987 32 40 1/10

Lei Tian · ‎08-19-2013

Hi Manoj,

I don't see packet drop under priority queue. However, looks like the WAN circuit is 12M, are you shaping down the interface to 12M on your end? What's the TE interval you using on your end?

HTH
Lei Tian

Sent from Cisco Technical Support iPhone App

ccie.7861 · ‎08-20-2013

Thanks Lei,

Our total circuit B/w is 40 mb which is further devided into 3 VRFs (23-12-5 Mb). this VRF is having 12 Mb configured on it.

if there is no packet drops then what could be the cause of phones going down in particular time frame.

Lei Tian · ‎08-20-2013

Hi Manoj,

Are the voice and singling packet from AVAYA marked correctly? How do you rate limit this VRF to 12M, and how do you rate limit the total to 40M?

HTH,
Lei Tian

Sent from Cisco Technical Support iPhone App

ccie.7861 · ‎08-20-2013

This is the config on our router i am not expert in Qos, so can you please check the below config let me know this could be because of Qos.

class-map match-any RT

match ip dscp ef

match ip dscp cs5

match ip precedence 5

match protocol rtp audio

class-map match-any BE

match access-group name BEST-EFFORT

class-map match-any BH

match access-group name BURSTY-HI

match ip dscp af31

match ip precedence 3

match ip dscp cs3

class-map match-any BL

match access-group name BURSTY-LO

match ip dscp af21

match ip dscp cs2

match ip precedence 2

class-map match-any VIDEO

match ip dscp af41

match ip precedence 4

match ip dscp cs4

match access-group name video-class

class-map match-any CBS-BL

match access-group name CBS-BL

match ip dscp af21

match ip dscp cs2

match ip precedence 2

class-map match-any CBS-BH

match access-group name CBS-BH

match ip dscp af31

match ip precedence 3

match ip dscp cs3

class-map match-any CBS-BE

match access-group name CBS-BE

class-map match-any CBS-RT

match ip dscp ef

match access-group name CBS-RT

match ip dscp cs5

match ip precedence 5

match protocol rtp audio

!

policy-map CBS-COS

class CBS-RT

priority percent 30

class CBS-BH

bandwidth remaining percent 40

random-detect dscp-based

class CBS-BL

bandwidth remaining percent 25

random-detect dscp-based

class VIDEO

bandwidth remaining percent 25

random-detect dscp-based

class class-default

fair-queue

random-detect dscp-based

policy-map ENT-COS

class RT

priority percent 30

class BH

bandwidth remaining percent 40

random-detect dscp-based

class BL

bandwidth remaining percent 25

random-detect dscp-based

class VIDEO

bandwidth remaining percent 25

random-detect dscp-based

class class-default

fair-queue

random-detect dscp-based

policy-map CBS-input-mark

class CBS-RT

set ip dscp ef

class CBS-BH

set ip dscp af31

class CBS-BL

set ip dscp af21

class CBS-BE

set ip dscp default

policy-map MPLS-EFD

class class-default

shape average 12000000

service-policy ENT-COS

policy-map MPLS-FIS

class class-default

shape average 15000000

service-policy ENT-COS

policy-map MPLS-CBS

class class-default

shape average 3000000

service-policy CBS-COS

Lei Tian · ‎08-20-2013

Hi,

Are the signing marked to CS3 for AVAYA phones? Where do you mark the packet? If you look the policy-map output, there are not many packets match DSCP CS3.

HTH
Lei Tian
Sent from Cisco Technical Support iPhone App

ccie.7861 · ‎08-21-2013

Hi Lei,

I believe Yes!! then what could be the best config for this setup?

Regards,

Bhisham

Lei Tian · ‎08-22-2013

Hi,

This qos config is fine, but you need make sure the phones are marked correctly. Assume there is one switch connects to the phone, if the switch is trusting DSCP from phone, then you need make sure packets are not being remarked; if the switch is doing classification/marking, you need make sure the ACL is configured correctly to match phone packets. I suspect packets are not marked correctly, because there are not many packets matching singling class, and packet drops are in default class.

HTH,
Lei Tian

Sent from Cisco Technical Support iPhone App

stephenshaw · ‎08-22-2013

Hi, Lei Tan is probably leading you in the right direction ...

what are the phones actually marked at?? Some of the older Avaya phones are rebranded Nortel phones.Nortel mark using COS6.

If that's the case, trusting DSCP on the port the phone connects to won't help - you'd need to trust COS and then do a COS-DSCP map to change COS 6 to be EF (46) and then all ports beyond could trust DSCP.

Let us know what you find.

Cheers,

Steve