Cisco Support Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Announcements

Welcome to Cisco Support Community. We would love to have your feedback.

For an introduction to the new site, click here. If you'd prefer to explore, try our test area to get started. And see here for current known issues.

Ask the Expert: Carrier Routing System (CRS) Hardware Architecture

With Vinay Kumar, Sudhir Kumar and Raj Pathak 

 

Read the bioRead the bioRead the bio

Welcome to the Cisco Support Community Ask the Expert conversation. This is an opportunity to learn and ask questions about Cisco Carrier Routing System (CRS) single-chassis and multichassis router hardware design and architecture with Cisco experts Vinay Kumar, Sudhir Kumar, and Raj Pathak. 

 

CRS routers are modular and distributed core routers developed by Cisco that enable service providers to deliver data, voice, and video services over a scalable IP next-generation network infrastructure. Today, CRS is one of the most trusted devices in the core of the service provider network and a proven architecture that has delivered 10 times the capacity over a period of 10 years.  Our three experts will cover the difference between CRS single-chassis and multichassis routers. They will also answer your questions about how CRS routers work and help in easily scaling the networks and different components of the CRS routers. 

 

For more details about CRS multichassis, read the blog and tech talk video. 

 

Hyperlink blog: https://supportforums.cisco.com/community/netpro/service-providers/ios-xr/blog/2013/11/06/community-tech-talk-crs-multichassis     

 

Vinay Kumar is an experienced support engineer with the High-Touch Technical Support Team, Bangalore, India. He has been supporting major service providers and large enterprise customers for routing, Multiprotocol Label Switching (MPLS), multicast, and Layer 2 VPN issues on all routing platforms. He has more than eight years of experience with service providers and has been in his current role from more than three years. Vinay has completed his CCIE routing and switching certification (CCIE no. 35210) and is a Cisco IOS XR Software specialist.

 

Sudhir Kumar is a customer support engineer in High-Touch Technical Services at Cisco specializing in service provider technologies and platforms. He serves as a support engineer for technical issues supporting Cisco IOS XR Software customers on Cisco CRS and Cisco XR 12000 Series Routers. Sudhir has more than eight years of experience in the IT industry and holds CCIE certification no. 35219 in routing and switching. 

 

Raj Pathak is a customer support engineer in High-Touch Technical Services at Cisco in Bangalore, India. He supports service provider customers for technical issues with Cisco IOS XR Software on Cisco CRS and Cisco XR 12000 Series Routers. He covers many technologies, including routing protocols, service provider, CRS, and Cisco IOS XR Software. He has more than seven years of experience in the IT industry and holds CCIE certification no. 38760 in routing and switching. 

 

Remember to use the rating system to let Vinay, Sudhir, and Raj know if you have received an adequate response.

 

Because of the volume expected during this event, our experts might not be able to answer every question. Remember that you can continue the conversation in the Service Providers community, subcommunity XR OS and Platforms shortly after the event. This event lasts through November 29, 2013. Visit this forum often to view responses to your questions and the questions of other Cisco Support Community members.

1 ACCEPTED SOLUTION

Accepted Solutions
New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hello gentlemen,

How many line card chassis can we connect with one fabric chassis?  Please advise.

Thank you.

Jackson

25 REPLIES
New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi Experts ,

I have couple of questions on CRS . first Can you please explain what is the difference between a CRS-3 and CRS-1 Router and what makes CRS different with other core routers availabl in market.

Cheers

Deepak

Cisco Employee

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi  Deepak ,

CRS-3 provides much more bandwidth than CRS-1. for an example  CRS-1, 16 SLOT chassis provides a Bandwithd of 1.12 Tbps but a CRS-3 Chassis  provides Bandwithd of 4.48 Tbps. From the Archicteure point of view bioth CRS-1  and CRS-3
are same the difference in the Line cards and the Fabric Cards  used in two routers. A CRS-1 router will
use 40G Line and 40 Gig Fabric card  on the other hand CRs-3 uses 140gig Line card and 140gig Fabric  Card.

Coming on to the Second part of your question, CRS routers can be  easliy scaled from a single chassis to Massive Multichassis routers. Now think  that
you need to increase the capacity in the core of your netwrok for which  you need to add more routers and this definately going to require lot of  rerouting , topology changes and wiring, however
In case of CRS you can just  add line card chassis if you already have multichassis running or covert from  Single chassis router to multichassis and in this case
topology changes ,  routing changes and cabling required will be much  less.

Thanks
Sudhir,Vinay,Raj.
New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi ,

Can we use both 40gig and 140 gig Line cards in same chassis.

Thanks

Deepak

Cisco Employee

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi  Deepak ,

Its  not recommanded to use mix of 40gig and 140 gig cards. CRS-MSc-B card is  compatiable with 140 G Fabric cards, However  CRS-MSC-140G card is only compatible with 140g Fabric cards and they can't be  used with 40 Gig cards. Mix of 40gig and 140 gig  cards can  be used temporarily during migration.

Thanks

Sudhir,Vinay,Raj.

New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi ,

Its good to see experts on CRS ..

Can you please help me to understand what exactly midplane design in CRS system ?

Charles

Bronze

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi Charles ,

Line cards ( CRS-MSC, CRS-FP etc ) have their associated PLIM ( Physical Layer Interface modules ) which provides the physical interfaces. Desgin of CRS router is such that PLIM's are inserted in the front of chassis and MSC's are inserted from rear. MSC's connects to the PLIM's over the midpane this is reason CRS is known to have Mid plane design.

This Mid plane is not a field replaceable unit and is also responsible for providing the control plane interconnections, distributing power and providing connectivity between Line cards and Switch fabric.

So logicall we have this type of connectivity.

PLIM----Midplane----LIne Card ( MSC )

Advatnage of this design is that if you have to replace the MSC card you do not need to unplug the cables from the PLIM.

Thanks

Vinay, Sudhir, Raj

New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hello Cisco Experts,

Can you please explain What is the difference between CRS MSC , MSC-B and FP Cards ?

Steve

Cisco Employee

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi Steve,

The MSC-B (Multi Service Card Rev B) is a cost reduced version of the existing CRS-MSC(=) linecard which provides L3 functions for the CRS-1router. 

CRS-MSC-B(=) will support ALL features that are supported on the existing CRS-MSC(=).  No new software features have been added.  There are NO new CLI, MIB or XML, all existing CLI, MIB and XML on MSC will continue to be supported on MSC-B. 

CRS-MSC-B(=) will NOT be supported with IOS XR release 3.5.x or earlier, but, it will be able to co-exist with CRS-MSC so long as IOS XR Software is R3.6 and above.  CRS-MSC-B(=) is supported with release 3.6.0 (and upwards).

Also please note CRS MSC is end of sale now.

I hope this helps.

Thanks

Sudhir,Vinay,Raj

Bronze

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi Steve ,

To add to the Sudhir's Explanation MSC cards provide better performance than FP cards. Also for some Features FP cards need licence however for MSC cards you dont need that.

Thanks

Vinay,Sudhir,Raj

New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hello Experts,

I have one question regd drops for unrecognized upper-level protocol which i see on one of the bundle ether interface on CRS. can you please tell me the theory behind this and the troubleshooting procedure for that?

RP/0/RP0/CPU0:CRS#sh int bundle-ether 111 | i drops

     4078622818 packets input, 3905568847386 bytes, 0 total input drops

     1232 drops for unrecognized upper-level protocol              ----------->>>

     3837543455 packets output, 798508449473 bytes, 0 total output drops

RP/0/RP0/CPU0:CRS#sh int bundle-ether 111 | i drops

     4079432040 packets input, 3906315130169 bytes, 0 total input drops

     1278 drops for unrecognized upper-level protocol   -------------->>>

     3838309170 packets output, 798664965405 bytes, 0 total output drops

Thanks

Jammel

Cisco Employee

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hello Jameel,

"Drops for unrecognized upper-level protocol" means that we've received packets of a type that you haven't configured and therefore don't have a handler for in the interface protocol handling chain.

That may be (and most likely is) expected and purely cosmetic.

Examples:

- other side (switch) has CDP configured but you don't have CDP configured on this end

- someone on the Ethernet is sending IS-IS hellos but you don't have IS-IS configured on this end

- someone on the Ethernet is sending IPv6 neigbor discovery packets but you don't have IPv6 configured on this end

It may be worth checking:

- do these packets increment periodically (i.e. one packet every 30 sec or so)?

- are there any obvious features (CDP is a good candidate) that you haven't configured but the far-end (switch, or if it's a crosslink, then

the connected peer) has?

Otherwise capture & decode the packets, and perhaps reviewing the config will already give the answer .

Thanks

Vinay,Sudhir,Raj

New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi All

I was upgrading my router and after reload My standby RP didnt come up in IOs-XR run state. When I consoled in the RP i observed that RP is reserting with the following errors.

Initializing DDR SDRAM...found 4096 MB

Initializing ECC on bank 0

Initializing ECC on bank 1

Initializing ECC on bank 2

Initializing ECC on bank 3

Turning off data cache, using DDR for first time

Initializing NVRAM...

Testing a portion of DDR SDRAM ...done

Reading ID EEPROMs ...

Initializing SQUID ...

Initializing PCI ...

PCI0 device[1]: Vendor ID 0x10ee

PCI0 device[1]: Device ID 0x300e

PCI1 device[1]: Device ID 0xac55

PCI1 device[1]: Vendor ID 0x104c

PCI1 device[2]: Device ID 0x680

PCI1 device[2]: Vendor ID 0x1095

PCI1 device[3]: Device ID 0x5618

PCI1 device[3]: Vendor ID 0x14e4

PCI1 device[4]: Device ID 0x5618

PCI1 device[4]: Vendor ID 0x14e4

Configuring MPPs ...

Configuring PCMCIA slots ...

System Bootstrap, Version 1.54(20091016:214209) [CRS-1 ROMMON],

Copyright (c) 1994-2009 by Cisco Systems, Inc.

Board type is 0x100006 (1048582)

Switch 0 initialized

Switch 1 initialized

Backplane FE port Up... Enabling

Enabling watchdog

G4(7457-SMP-MV64360 Rev 4) platform with 4096 MB of main memory

..

Initializing DDR SDRAM...found 4096 M

Thanks

Erick

Bronze

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi Eric ,

Please try doing the following. In case this doesnt resolve your issue I would recommend you to open a TAC case for further investigation as it may be a Hardware problem as well.

Connect to RP console.

- Enter rommon by hitting Ctrl+c until you get the rommon prompt.

- Enter these commands to disable the watchdog timeout and reboot:

WATCHDOG_MODE=1

sync

reset

- When the RP is running IOS XR, format the bootflash:

format bootflash:

- Reload the RP:

reload

- Hit Ctrl+c until you get the rommon prompt.

unset WATCHDOG_MODE

sync

reset

Thanks

Vinay, Raj , Sudhir

Cisco Employee

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Erick,

What version are you upgrading from and too ? Please ensure you follow the specific version upgrade process and have any required SMU's, etc. The CRS upgrade guides are located here:

http://www.cisco.com/web/Cisco_IOS_XR_Software/index.html#CRS-1

regards,

david

New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hello experts,

Is it mandatory to copy XR image on every RP in multi chassis setup ? Appreciate your help on this.

Thank you,

Lisa

Bronze

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi Lisa ,

You need to use the 'install add', 'install activate', and 'install commit'  so upgarde procedure remains the same.

Inastall add will add packages  to the disk of all RPs and shelf-controllers and install activate will  change the  code on RPs  and SCs and Finally Install Commit will check the consistency.

Thanks

Vinay, Sudhir,Raj

New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Thank you for the quick answer!  One more question please - what is the main difference between MSC and FP40 card? 

Lisa

Cisco Employee

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi Lisa,

I have already answered this question before in this event ,

let me explain again for you..

The MSC-B (Multi Service Card Rev B) is a cost reduced version of the  existing CRS-MSC(=) linecard which provides L3 functions for the  CRS-1router. 

CRS-MSC-B(=) will support ALL features that are  supported on the existing CRS-MSC(=).  No new software features have  been added.  There are NO new CLI, MIB or XML, all existing CLI, MIB and  XML on MSC will continue to be supported on MSC-B. 

CRS-MSC-B(=)  will NOT be supported with IOS XR release 3.5.x or earlier, but, it  will be able to co-exist with CRS-MSC so long as IOS XR Software is R3.6  and above.  CRS-MSC-B(=) is supported with release 3.6.0 (and upwards).

Also please note CRS MSC is end of sale now.

MSC cards provide better performance  than FP cards. Also for some Features FP cards need licence however for  MSC cards you dont need that.

Thanks

Sudhir,Vinay,Raj.

New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hello gentlemen,

How many line card chassis can we connect with one fabric chassis?  Please advise.

Thank you.

Jackson

Cisco Employee

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

hi Jackson,

MultiChassis capacity is gated by the OIM hardware
Up to  3 CRS-16 LCCs, in single topology mode where 8 OIM's/SFC's are required
Up to 9 CRS-16 LCCs, in multi-module topology mode where 24 OIM's/SFC's are required

Currently the CRS-3 MC System can support up to 9 LCC's with one FCC (9+1) when using PRP's.

regards,

david

Bronze

Re: Ask the Expert: Carrier Routing System (CRS) Hardware Archit

Thanks David for answering to Jackson's Question.

Here is some more information about the same. There are two ways to connect to the Fabric Chassis.

1. Horizontal Cabling or Single Topology

2. Vertical Cabling or Multimodule topology.

So If we use Horizontal cabling as David's Mentioned we would require 8 fabric cards in FCC and  One Fabric card in LCC will be connected to the 3 ports on Fabric card in FCC . Each S2 card in FCC has 9 ports and Fabric card in LCC has 3 ports. So With Each Fabric card in Fabric card chassis we can connect One Fabric card from 3 Line card Chassis. In this case One Card in FCC will make one Fabric Plane so Each Card will represent one Seprate Plane so with Horizontal cabling we can connect up to 3 CRS chassis with one Fabric card chassis.

On ther other hand if we use Vertical Cabling we put 3 Fabric card in FCC in one plane and One card in FCC will connect to these three cards in one plane so we can scale better, we get redudancy for fabric cards and this way we can connect 9 CRS LCC to one FCC.

For more details about this please refer to our presentation.

https://supportforums.cisco.com/docs/DOC-37821

and Blog

https://supportforums.cisco.com/community/netpro/service-providers/ios-xr/blog/2013/11/06/community-tech-talk-crs-multichassis

Thanks

Vinay,sudhir,Raj

Cisco Employee

Re: Ask the Expert: Carrier Routing System (CRS) Hardware Archit

hi Jackson,

I need to make a correction. While we have tested 9+1 MC internally the "official" supported number of LCC's stands at 8, at the moment. That would be an 8+1 MC, or 8 LCC's + 1 FCC. And we do have customers using the 8+1 MC system today.

regards,

david

New Member

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Appreciate your response David, Vinay, Sudhir and Raj.  One more thing.  I'm also curious as to how it will be decided which rack will become Rack 0 and Rack 1 in CRS multi chassis setup? 

Jackson

Cisco Employee

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi Jackson,

it will be done by configuration in admin mode based on the serial number of your line cards and fabric cards chassis:

dsc serial TBMwwwwwwww rack 0

dsc serial TBAxxxxxxxxx rack 1

dsc serial TBAyyyyyyyy rack 2

dsc serial TBAzzzzzzz rack 240

Cheers,

N.

Bronze

Ask the Expert: Carrier Routing System (CRS) Hardware Architectu

Hi Jackson ,

Nicols is right you need to define the serinal number of the chassis with the Rack number.

You can also refer to the following presentation.

https://supportforums.cisco.com/docs/DOC-37821

Thanks

Vinay, Sudhir,Raj

3079
Views
125
Helpful
25
Replies