Edward,
The cards are in diff slots now. Disabling the XFP's didn't do anything. The temps came down as expected(swaping slots) but only on the RX 8. The cards on the RX16 wont come up yet! The cards on the RX-8 got moved from slot# 1 & 2 to slot# 3 & 4 respectively. The cards on the RX-16 moved from slot# 11 & 13 to slot# 12 & 14. The cards on slots 12 & 14 wont come up. I'll put them back to were they were and let you know if they come up.
I must also say that the temps on the management modules on the RX16 are consistently higer than in the RX8. See attached.
-Jorge.
--------------------------------------------------------------------------------
From: Jorge Mercado [mailto:mercado@telehouse.com]
Sent: Wednesday, November 22, 2006 12:51 PM
To: 'Edward Tan'
Subject: RE: Foundry TAC case # 155062
Hi Ed,
I dont have any extra 10G cards to try. In any event, the temp issue has happened over time. I dont yet know if the cards are deteriorating slowly or if it's a fan setting issue so..., I'll try points #1 & #3 as you suggest. I might need some direction in setting new fan thresholds but I'll read into it. In any event, my believe is that the issues are w/ the linecards themselves in both our RX8 & RX16. I've attached a couple of files for historical comparison on these boxes. Also, below is a summary of the current situation as I see it, then after that are the current fan settings:
NOTE: Once I pull the linecards and put them in another slot my guess is that the temps should come back down momentarily then come back up. So finding what may be happening will take time. Since these linecards are currently supporting some, non-production, traffic what I'll do for now is to shut down the interfaces on the trunks and see what contribution do the 10G XFP's may have to the temps.
*** BigIron RX-8 CHASSIS (SA12060232) ***
--- Good Temps ---
S1: RX-BI-4XG 4-port 10GbE Module CARD_STATE_UP 4 000c.dbdf.d800 (SA10060815)
LP1 Sensor1: 43.5C
LP1 Sensor2: 44.5C
--- Bad Temps ---
S2: RX-BI-4XG 4-port 10GbE Module CARD_STATE_UP 4 000c.dbdf.d800 (SA51050198)
LP2 Sensor1: 51.0C
LP2 Sensor2: 52.0C
--- FANS ---
Right fan tray (fan 1): Status = OK, Speed = MED (75%)
Right fan tray (fan 2): Status = OK, Speed = MED (75%)
Right fan tray (fan 3): Status = OK, Speed = MED (75%)
Right fan tray (fan 4): Status = OK, Speed = MED (75%)
-----------------------------------------------------------------------------------------------------------------
*** BigIron RX-16 CHASSIS (SA11061200) ***
--- Bad Temps ---
S11: RX-BI-4XG 4-port 10GbE Module CARD_STATE_UP 4 000c.dbe8.5400 (SA12060032)
S12:
S13: RX-BI-4XG 4-port 10GbE Module CARD_STATE_UP 4 000c.dbe8.5400 (SA11061952)
LP11 Sensor1: 59.0C
LP11 Sensor2: 57.5C
LP13 Sensor1: 53.5C
LP13 Sensor2: 50.0C
--- FANS ---
Bottom fan tray (fan 1): Status = OK, Speed = HI (100%)
Bottom fan tray (fan 2): Status = OK, Speed = HI (100%)
Bottom fan tray (fan 3): Status = OK, Speed = HI (100%)
Bottom fan tray (fan 4): Status = OK, Speed = HI (100%)
Bottom fan tray (fan 5): Status = OK, Speed = HI (100%)
Bottom fan tray (fan 6): Status = OK, Speed = HI (100%)
Back Fan A: Status = OK, Speed = HI (100%)
Back Fan B: Status = OK, Speed = HI (100%)
-----------------------------------------------------------------------------------------------------------------
#################################################################################################################
------------------- RX 16 Fan Settings --------------------------
telnet@nyiix4#sh fan-t
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_MP) ===
Fan Speed Low: -1 - 60
Fan Speed Med: 57 - 70
Fan Speed Med-Hi: 67 - 80
Fan Speed Hi: 77 - 85
state = 0 (FAN_STATE_LOW)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_SNM) ===
Fan Speed Low: -1 - 60
Fan Speed Med: 57 - 70
Fan Speed Med-Hi: 67 - 80
Fan Speed Hi: 72 - 85
state = 0 (FAN_STATE_LOW)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_LP) ===
Fan Speed Low: -1 - 50
Fan Speed Med: 46 - 55
Fan Speed Med-Hi: 51 - 60
Fan Speed Hi: 56 - 95
state = 3 (FAN_STATE_HI)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_STANDBY_MP) ===
Fan Speed Low: -1 - 60
Fan Speed Med: 57 - 70
Fan Speed Med-Hi: 67 - 80
Fan Speed Hi: 77 - 85
state = 0 (FAN_STATE_LOW)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_MP_CPU) ===
Fan Speed Low: -1 - 60
Fan Speed Med: 57 - 70
Fan Speed Med-Hi: 67 - 80
Fan Speed Hi: 77 - 85
state = 0 (FAN_STATE_LOW)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_STANDBY_MP_CPU) ===
Fan Speed Low: -1 - 60
Fan Speed Med: 57 - 70
Fan Speed Med-Hi: 67 - 80
Fan Speed Hi: 77 - 85
state = 1 (FAN_STATE_MED)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
telnet@nyiix4#
------------------------ RX 8 Fan Settings --------------------------
telnet@nyiix5#sh fan-t
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_MP) ===
Fan Speed Low: -1 - 60
Fan Speed Med: 57 - 70
Fan Speed Med-Hi: 67 - 80
Fan Speed Hi: 77 - 85
state = 0 (FAN_STATE_LOW)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_SNM) ===
Fan Speed Low: -1 - 60
Fan Speed Med: 57 - 70
Fan Speed Med-Hi: 67 - 80
Fan Speed Hi: 72 - 85
state = 0 (FAN_STATE_LOW)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_LP) ===
Fan Speed Low: -1 - 50
Fan Speed Med: 46 - 55
Fan Speed Med-Hi: 51 - 60
Fan Speed Hi: 56 - 95
state = 1 (FAN_STATE_MED)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_STANDBY_MP) ===
Fan Speed Low: -1 - 60
Fan Speed Med: 57 - 70
Fan Speed Med-Hi: 67 - 80
Fan Speed Hi: 77 - 85
state = 0 (FAN_STATE_LOW)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_MP_CPU) ===
Fan Speed Low: -1 - 60
Fan Speed Med: 57 - 70
Fan Speed Med-Hi: 67 - 80
Fan Speed Hi: 77 - 85
state = 0 (FAN_STATE_LOW)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
=== Thermal Sensor Control Block (THERMAL_SENSOR_TEST_RULE_STANDBY_MP_CPU) ===
Fan Speed Low: -1 - 60
Fan Speed Med: 57 - 70
Fan Speed Med-Hi: 67 - 80
Fan Speed Hi: 77 - 85
state = 0 (FAN_STATE_LOW)
max_ts_shut_off_count = 3
shut_off_count = 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
telnet@nyiix5#
--------------------------------------------------------------------------------
From: Edward Tan [mailto:etan@foundrynet.com]
Sent: Wednesday, November 22, 2006 12:15 PM
To: mercado@telehouse.com
Subject: Foundry TAC case # 155062
Hi Jorge,
Thank you for contacting Foundry Networks Technical Support, I will be working on your case and the ticket number is 155062, please references this number in any further correspondence.
Please send me the sh tech command output. Please try the following step for troubleshooting,
1) Do you have an empty slot which you can swap the module into it to see whats the temperature? Send me the sh chassis after you did this.
2) Do you have another same model of module, could you please try to swap them? Send me the sh chassis after you did this.
3) Please try to adjust the fan-threshold to see if the problem still exist. Sh fan-t will tell you the value.
Best regards,
Edward Tan
Technical Support Engineer
Foundry Networks, Inc.
408-207-1600
support@foundrynet.com