So, last night I got called back in work at 12:00am, and didnt get home till 7am this morning, then my boss told me to come back in at 12 midday, I had 3 hours sleep. When I got work, I had to have a crisis meeting with my boss and had to explain to him for an hour about how and why the issue happened.
I work for a major food manufacturing company that is 24/7 and is a high output plant. I am the only network guy here, have about 150 or so switches, vpn asa firewalls, 100 or so access points and 400 or so voip phones. If any of this goes I am the only one to get it going again.
Last night was prob one of the worst nights I had. we had 2 x old Nortel 8610 passports that connect to all the nortel access switches, I implemented a new 6500 core x 4 last week and are rolling out 2960's to all offices over the next few months. we moved all the gateways to the new Cisco core last week, all was well. then last night the Nortel cpu card failed and failed back to master, this made the Nortel device revert to its old config with all ip settings etc, so we had duplicate gateways on the network, as well as spanning tree issues all over the place, blocking vlan 1 on the cisco switches that connnect to the Nortel core, saying spanning tree inconsistencies etc,due to the Nortel running 1 instance of spanning tree for all vlans. The sync between the cards had failed and so never saved the new config to the backup cpu.
I managed to get it all back working in the late hours. But trying to explain to my boss today was not nice, its almost like they dont believe what you say and its all your fault, almost like you sabotaged the network. I had lots of people standing behind me from the factory waiting for answers etc. Not a nice place to be considering my manager gets double my wage, yet just has to explain to others, where as I feel like me the network guy is the focal point of pressure!!
Sometimes I think is this all worth the stress. through no fault of my own all this happens, and then at the same time I feel like it makes me look like the bad guy. I feel like I get no support and have no backup on site for me, so basically I always have to be available 24/7 to respond. what if I was on hoilday?? and also having 3 hours sleep and having to go back to work, is this ethical guys??
I would like peoples thoughts on this, as Im sure alot of you are in my position.
What should I do ?