Stuff

cat /var/log/daemon.log

Feb  9 21:56:57 failover1 corosync[29125]:   [MAIN  ] Corosync Cluster Engine ('1.2.1'): started and ready to provide service.
Feb  9 21:56:57 failover1 corosync[29125]:   [MAIN  ] Corosync built-in features: nss
Feb  9 21:56:57 failover1 corosync[29125]:   [MAIN  ] Successfully read main configuration file '/etc/corosync/corosync.conf'.
Feb  9 21:56:57 failover1 corosync[29125]:   [TOTEM ] Initializing transport (UDP/IP).
Feb  9 21:56:57 failover1 corosync[29125]:   [TOTEM ] Initializing transmit/receive security: libtomcrypt SOBER128/SHA1HMAC (mode 0).
Feb  9 21:56:57 failover1 corosync[29125]:   [TOTEM ] The network interface [10.1.1.1] is now up.
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: process_ais_conf: Reading configure
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: config_find_init: Local handle: 2013064636357672962 for logging
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: config_find_next: Processing additional logging options...
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: get_config_opt: Found 'off' for option: debug
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: get_config_opt: Found 'no' for option: to_logfile
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: get_config_opt: Found 'yes' for option: to_syslog
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: get_config_opt: Found 'daemon' for option: syslog_facility
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: config_find_init: Local handle: 4730966301143465987 for service
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: config_find_next: Processing additional service options...
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: get_config_opt: Defaulting to 'pcmk' for option: clustername
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: get_config_opt: Defaulting to 'no' for option: use_logd
Feb  9 21:56:57 failover1 stonithd: [29137]: WARN: Core dumps could be lost if multiple dumps occur.
Feb  9 21:56:57 failover1 cib: [29138]: info: Invoked: /usr/lib/heartbeat/cib
Feb  9 21:56:57 failover1 lrmd: [29139]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb  9 21:56:57 failover1 attrd: [29140]: info: Invoked: /usr/lib/heartbeat/attrd
Feb  9 21:56:57 failover1 pengine: [29141]: info: Invoked: /usr/lib/heartbeat/pengine
Feb  9 21:56:57 failover1 crmd: [29142]: info: Invoked: /usr/lib/heartbeat/crmd
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: get_config_opt: Defaulting to 'no' for option: use_mgmtd
Feb  9 21:56:57 failover1 stonithd: [29137]: WARN: Consider setting non-default value in /proc/sys/kernel/core_pattern (or equivalent) for maximum supportability
Feb  9 21:56:57 failover1 cib: [29138]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb  9 21:56:57 failover1 lrmd: [29139]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb  9 21:56:57 failover1 attrd: [29140]: info: main: Starting up
Feb  9 21:56:57 failover1 pengine: [29141]: info: main: Starting pengine
Feb  9 21:56:57 failover1 crmd: [29142]: info: main: CRM Hg Version: 74392a28b7f31d7ddc86689598bd23114f58978b
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_startup: CRM: Initialized
Feb  9 21:56:57 failover1 stonithd: [29137]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Feb  9 21:56:57 failover1 cib: [29138]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb  9 21:56:57 failover1 lrmd: [29139]: info: enabling coredumps
Feb  9 21:56:57 failover1 attrd: [29140]: info: crm_cluster_connect: Connecting to OpenAIS
Feb  9 21:56:57 failover1 crmd: [29142]: info: crmd_init: Starting crmd
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] Logging: Initialized pcmk_startup
Feb  9 21:56:57 failover1 stonithd: [29137]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb  9 21:56:57 failover1 cib: [29138]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb  9 21:56:57 failover1 lrmd: [29139]: WARN: Core dumps could be lost if multiple dumps occur.
Feb  9 21:56:57 failover1 attrd: [29140]: info: init_ais_connection_once: Creating connection to our AIS plugin
Feb  9 21:56:57 failover1 crmd: [29142]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_startup: Maximum core file size is: 4294967295
Feb  9 21:56:57 failover1 stonithd: [29137]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb  9 21:56:57 failover1 cib: [29138]: info: startCib: CIB Initialization completed successfully
Feb  9 21:56:57 failover1 lrmd: [29139]: WARN: Consider setting non-default value in /proc/sys/kernel/core_pattern (or equivalent) for maximum supportability
Feb  9 21:56:57 failover1 attrd: [29140]: info: init_ais_connection_once: AIS connection established
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_startup: Service: 9
Feb  9 21:56:57 failover1 cib: [29138]: info: crm_cluster_connect: Connecting to OpenAIS
Feb  9 21:56:57 failover1 lrmd: [29139]: WARN: Consider setting /proc/sys/kernel/core_uses_pid (or equivalent) to 1 for maximum supportability
Feb  9 21:56:57 failover1 attrd: [29140]: info: get_ais_nodeid: Server details: id=16843018 uname=failover1 cname=pcmk
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_startup: Local hostname: failover1
Feb  9 21:56:57 failover1 cib: [29138]: info: init_ais_connection_once: Creating connection to our AIS plugin
Feb  9 21:56:57 failover1 lrmd: [29139]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb  9 21:56:57 failover1 attrd: [29140]: info: crm_new_peer: Node failover1 now has id: 16843018
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_update_nodeid: Local node id: 16843018
Feb  9 21:56:57 failover1 cib: [29138]: info: init_ais_connection_once: AIS connection established
Feb  9 21:56:57 failover1 lrmd: [29139]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb  9 21:56:57 failover1 attrd: [29140]: info: crm_new_peer: Node 16843018 is now known as failover1
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: Creating entry for node 16843018 born on 0
Feb  9 21:56:57 failover1 cib: [29138]: info: get_ais_nodeid: Server details: id=16843018 uname=failover1 cname=pcmk
Feb  9 21:56:57 failover1 lrmd: [29139]: info: Started.
Feb  9 21:56:57 failover1 attrd: [29140]: info: main: Cluster connection active
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: 0x9d3fc18 Node 16843018 now known as failover1 (was: (null))
Feb  9 21:56:57 failover1 cib: [29138]: info: crm_new_peer: Node failover1 now has id: 16843018
Feb  9 21:56:57 failover1 attrd: [29140]: info: main: Accepting attribute updates
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: Node failover1 now has 1 quorum votes (was 0)
Feb  9 21:56:57 failover1 cib: [29138]: info: crm_new_peer: Node 16843018 is now known as failover1
Feb  9 21:56:57 failover1 attrd: [29140]: info: main: Starting mainloop...
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: Node 16843018/failover1 is now: member
Feb  9 21:56:57 failover1 cib: [29138]: info: cib_init: Starting cib mainloop
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: spawn_child: Forked child 29137 for process stonithd
Feb  9 21:56:57 failover1 cib: [29138]: info: ais_dispatch: Membership 12: quorum still lost
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: spawn_child: Forked child 29138 for process cib
Feb  9 21:56:57 failover1 cib: [29138]: info: crm_update_peer: Node failover1: id=16843018 state=member (new) addr=r(0) ip(10.1.1.1)  (new) votes=1 (new) born=0 seen=12 proc=00000000000000000000000000013312 (new)
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: spawn_child: Forked child 29139 for process lrmd
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: spawn_child: Forked child 29140 for process attrd
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: spawn_child: Forked child 29141 for process pengine
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: spawn_child: Forked child 29142 for process crmd
Feb  9 21:56:57 failover1 corosync[29125]:   [SERV  ] Service engine loaded: Pacemaker Cluster Manager 1.0.9
Feb  9 21:56:57 failover1 corosync[29125]:   [SERV  ] Service engine loaded: corosync extended virtual synchrony service
Feb  9 21:56:57 failover1 corosync[29125]:   [SERV  ] Service engine loaded: corosync configuration service
Feb  9 21:56:57 failover1 corosync[29125]:   [SERV  ] Service engine loaded: corosync cluster closed process group service v1.01
Feb  9 21:56:57 failover1 corosync[29125]:   [SERV  ] Service engine loaded: corosync cluster config database access v1.01
Feb  9 21:56:57 failover1 corosync[29125]:   [SERV  ] Service engine loaded: corosync profile loading service
Feb  9 21:56:57 failover1 corosync[29125]:   [SERV  ] Service engine loaded: corosync cluster quorum service v0.1
Feb  9 21:56:57 failover1 corosync[29125]:   [MAIN  ] Compatibility mode set to whitetank.  Using V1 and V2 of the synchronization engine.
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 12: memb=0, new=0, lost=0
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 12: memb=1, new=1, lost=0
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_peer_update: NEW:  failover1 16843018
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_peer_update: MEMB: failover1 16843018
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: Node failover1 now has process list: 00000000000000000000000000013312 (78610)
Feb  9 21:56:57 failover1 corosync[29125]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
Feb  9 21:56:57 failover1 corosync[29125]:   [MAIN  ] Completed service synchronization, ready to provide service.
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_ipc: Recorded connection 0x9d469d0 for attrd/29140
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_ipc: Recorded connection 0x9d46f48 for cib/29138
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_ipc: Sending membership update 12 to cib
Feb  9 21:56:57 failover1 cib: [29145]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-16.raw
Feb  9 21:56:57 failover1 stonithd: [29137]: info: crm_cluster_connect: Connecting to OpenAIS
Feb  9 21:56:57 failover1 stonithd: [29137]: info: init_ais_connection_once: Creating connection to our AIS plugin
Feb  9 21:56:57 failover1 cib: [29145]: info: write_cib_contents: Wrote version 0.34.0 of the CIB to disk (digest: 6ff8c46f024b7861d74089ab33d1a2ef)
Feb  9 21:56:57 failover1 cib: [29145]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.0uAwqY (digest: /var/lib/heartbeat/crm/cib.p6uPq4)
Feb  9 21:56:57 failover1 stonithd: [29137]: info: init_ais_connection_once: AIS connection established
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_ipc: Recorded connection 0x9d48780 for stonithd/29137
Feb  9 21:56:57 failover1 stonithd: [29137]: info: get_ais_nodeid: Server details: id=16843018 uname=failover1 cname=pcmk
Feb  9 21:56:57 failover1 stonithd: [29137]: info: crm_new_peer: Node failover1 now has id: 16843018
Feb  9 21:56:57 failover1 stonithd: [29137]: info: crm_new_peer: Node 16843018 is now known as failover1
Feb  9 21:56:57 failover1 stonithd: [29137]: notice: /usr/lib/heartbeat/stonithd start up successfully.
Feb  9 21:56:57 failover1 stonithd: [29137]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] notice: pcmk_peer_update: Transitional membership event on ring 20: memb=1, new=0, lost=0
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_peer_update: memb: failover1 16843018
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] notice: pcmk_peer_update: Stable membership event on ring 20: memb=2, new=1, lost=0
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: Creating entry for node 33620234 born on 20
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: Node 33620234/unknown is now: member
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_peer_update: NEW:  .pending. 33620234
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_peer_update: MEMB: failover1 16843018
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: pcmk_peer_update: MEMB: .pending. 33620234
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: send_member_notification: Sending membership update 20 to 1 children
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: 0x9d3fc18 Node 16843018 ((null)) born on: 20
Feb  9 21:56:57 failover1 corosync[29125]:   [TOTEM ] A processor joined or left the membership and a new membership was formed.
Feb  9 21:56:57 failover1 cib: [29138]: info: ais_dispatch: Membership 20: quorum still lost
Feb  9 21:56:57 failover1 cib: [29138]: info: crm_new_peer: Node <null> now has id: 33620234
Feb  9 21:56:57 failover1 cib: [29138]: info: crm_update_peer: Node (null): id=33620234 state=member (new) addr=r(0) ip(10.1.1.2)  votes=0 born=0 seen=20 proc=00000000000000000000000000000000
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: 0x9d48db0 Node 33620234 (failover2) born on: 20
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: 0x9d48db0 Node 33620234 now known as failover2 (was: (null))
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: Node failover2 now has process list: 00000000000000000000000000013312 (78610)
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: update_member: Node failover2 now has 1 quorum votes (was 0)
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] info: send_member_notification: Sending membership update 20 to 1 children
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] WARN: route_ais_message: Sending message to local.crmd failed: unknown (rc=-2)
Feb  9 21:56:57 failover1 cib: [29138]: notice: ais_dispatch: Membership 20: quorum acquired
Feb  9 21:56:57 failover1 cib: [29138]: info: crm_get_peer: Node 33620234 is now known as failover2
Feb  9 21:56:57 failover1 cib: [29138]: info: crm_update_peer: Node failover2: id=33620234 state=member addr=r(0) ip(10.1.1.2)  votes=1 (new) born=20 seen=20 proc=00000000000000000000000000013312 (new)
Feb  9 21:56:57 failover1 corosync[29125]:   [pcmk  ] WARN: route_ais_message: Sending message to local.crmd failed: unknown (rc=-2)
Feb  9 21:56:57 failover1 corosync[29125]:   [MAIN  ] Completed service synchronization, ready to provide service.
Feb  9 21:56:58 failover1 crmd: [29142]: info: do_cib_control: CIB connection established
Feb  9 21:56:58 failover1 crmd: [29142]: info: crm_cluster_connect: Connecting to OpenAIS
Feb  9 21:56:58 failover1 crmd: [29142]: info: init_ais_connection_once: Creating connection to our AIS plugin
Feb  9 21:56:58 failover1 crmd: [29142]: info: init_ais_connection_once: AIS connection established
Feb  9 21:56:58 failover1 corosync[29125]:   [pcmk  ] info: pcmk_ipc: Recorded connection 0x9d48e20 for crmd/29142
Feb  9 21:56:58 failover1 corosync[29125]:   [pcmk  ] info: pcmk_ipc: Sending membership update 20 to crmd
Feb  9 21:56:58 failover1 crmd: [29142]: info: get_ais_nodeid: Server details: id=16843018 uname=failover1 cname=pcmk
Feb  9 21:56:58 failover1 crmd: [29142]: info: crm_new_peer: Node failover1 now has id: 16843018
Feb  9 21:56:58 failover1 crmd: [29142]: info: crm_new_peer: Node 16843018 is now known as failover1
Feb  9 21:56:58 failover1 crmd: [29142]: info: do_ha_control: Connected to the cluster
Feb  9 21:56:58 failover1 crmd: [29142]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Feb  9 21:56:58 failover1 crmd: [29142]: info: crmd_init: Starting crmd's mainloop
Feb  9 21:56:58 failover1 crmd: [29142]: notice: ais_dispatch: Membership 20: quorum acquired
Feb  9 21:56:58 failover1 crmd: [29142]: info: crm_update_peer: Node failover1: id=16843018 state=member (new) addr=r(0) ip(10.1.1.1)  (new) votes=1 (new) born=20 seen=20 proc=00000000000000000000000000013312 (new)
Feb  9 21:56:58 failover1 crmd: [29142]: info: crm_new_peer: Node failover2 now has id: 33620234
Feb  9 21:56:58 failover1 crmd: [29142]: info: crm_new_peer: Node 33620234 is now known as failover2
Feb  9 21:56:58 failover1 crmd: [29142]: info: crm_update_peer: Node failover2: id=33620234 state=member (new) addr=r(0) ip(10.1.1.2)  votes=1 born=20 seen=20 proc=00000000000000000000000000013312
Feb  9 21:56:58 failover1 crmd: [29142]: info: do_started: Delaying start, Config not read (0000000000000040)
Feb  9 21:56:58 failover1 crmd: [29142]: info: config_query_callback: Checking for expired actions every 900000ms
Feb  9 21:56:58 failover1 crmd: [29142]: info: config_query_callback: Sending expected-votes=2 to corosync
Feb  9 21:56:58 failover1 crmd: [29142]: info: do_started: The local CRM is operational
Feb  9 21:56:58 failover1 crmd: [29142]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ]
Feb  9 21:56:59 failover1 crmd: [29142]: info: ais_dispatch: Membership 20: quorum retained
Feb  9 21:57:02 failover1 attrd: [29140]: info: cib_connect: Connected to the CIB after 1 signon attempts
Feb  9 21:57:02 failover1 attrd: [29140]: info: cib_connect: Sending full refresh
Feb  9 21:57:43 failover1 crmd: [29142]: info: do_election_count_vote: Election 2 (owner: failover2) pass: vote from failover2 (Host name)
Feb  9 21:57:43 failover1 crmd: [29142]: info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_ELECTION cause=C_FSA_INTERNAL origin=do_election_count_vote ]
Feb  9 21:57:43 failover1 crmd: [29142]: info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ]
Feb  9 21:57:43 failover1 crmd: [29142]: info: do_te_control: Registering TE UUID: 4ae03e63-2073-465a-89be-fb3c8d51a7c7
Feb  9 21:57:43 failover1 crmd: [29142]: WARN: cib_client_add_notify_callback: Callback already present
Feb  9 21:57:43 failover1 crmd: [29142]: info: set_graph_functions: Setting custom graph functions
Feb  9 21:57:43 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses
Feb  9 21:57:43 failover1 crmd: [29142]: info: do_dc_takeover: Taking over DC status for this partition
Feb  9 21:57:43 failover1 cib: [29138]: info: cib_process_readwrite: We are now in R/W mode
Feb  9 21:57:43 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_master for section 'all' (origin=local/crmd/6, version=0.34.0): ok (rc=0)
Feb  9 21:57:43 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/7, version=0.34.0): ok (rc=0)
Feb  9 21:57:43 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/9, version=0.34.0): ok (rc=0)
Feb  9 21:57:43 failover1 crmd: [29142]: info: join_make_offer: Making join offers based on membership 20
Feb  9 21:57:43 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/11, version=0.34.0): ok (rc=0)
Feb  9 21:57:43 failover1 crmd: [29142]: info: do_dc_join_offer_all: join-1: Waiting on 2 outstanding join acks
Feb  9 21:57:43 failover1 crmd: [29142]: info: ais_dispatch: Membership 20: quorum retained
Feb  9 21:57:43 failover1 crmd: [29142]: info: crm_ais_dispatch: Setting expected votes to 2
Feb  9 21:57:43 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/14, version=0.34.0): ok (rc=0)
Feb  9 21:57:43 failover1 crmd: [29142]: info: config_query_callback: Checking for expired actions every 900000ms
Feb  9 21:57:43 failover1 crmd: [29142]: info: config_query_callback: Sending expected-votes=2 to corosync
Feb  9 21:57:43 failover1 crmd: [29142]: info: update_dc: Set DC to failover1 (3.0.1)
Feb  9 21:57:43 failover1 crmd: [29142]: info: ais_dispatch: Membership 20: quorum retained
Feb  9 21:57:43 failover1 crmd: [29142]: info: crm_ais_dispatch: Setting expected votes to 2
Feb  9 21:57:43 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_modify for section crm_config (origin=local/crmd/17, version=0.34.0): ok (rc=0)
Feb  9 21:57:43 failover1 crmd: [29142]: info: te_connect_stonith: Attempting connection to fencing daemon...
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_connect_stonith: Connected
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ]
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes responded to the join offer.
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_dc_join_finalize: join-1: Syncing the CIB from failover2 to the rest of the cluster
Feb  9 21:57:44 failover1 cib: [29138]: info: cib_replace_notify: Local-only Replace: -1.-1.-1 from failover2
Feb  9 21:57:44 failover1 cib: [29138]: info: log_data_element: cib:diff: - <cib epoch="34" have-quorum="1" />
Feb  9 21:57:44 failover1 cib: [29138]: info: log_data_element: cib:diff: + <cib have-quorum="0" epoch="35" />
Feb  9 21:57:44 failover1 attrd: [29140]: info: do_cib_replaced: Sending full refresh
Feb  9 21:57:44 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/19, version=0.35.0): ok (rc=0)
Feb  9 21:57:44 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/20, version=0.35.0): ok (rc=0)
Feb  9 21:57:44 failover1 cib: [29161]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-17.raw
Feb  9 21:57:44 failover1 crmd: [29142]: info: update_attrd: Connecting to attrd...
Feb  9 21:57:44 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='failover1']/transient_attributes (origin=local/crmd/21, version=0.35.0): ok (rc=0)
Feb  9 21:57:44 failover1 attrd: [29140]: info: find_hash_entry: Creating hash entry for terminate
Feb  9 21:57:44 failover1 attrd: [29140]: info: find_hash_entry: Creating hash entry for shutdown
Feb  9 21:57:44 failover1 cib: [29161]: info: write_cib_contents: Wrote version 0.35.0 of the CIB to disk (digest: 8e0f7b488be9023412773b4d050ff579)
Feb  9 21:57:44 failover1 crmd: [29142]: info: erase_xpath_callback: Deletion of "//node_state[@uname='failover1']/transient_attributes": ok (rc=0)
Feb  9 21:57:44 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='failover2']/transient_attributes (origin=failover2/crmd/8, version=0.35.0): ok (rc=0)
Feb  9 21:57:44 failover1 attrd: [29140]: info: crm_new_peer: Node failover2 now has id: 33620234
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_dc_join_ack: join-1: Updating node state to member for failover2
Feb  9 21:57:44 failover1 attrd: [29140]: info: crm_new_peer: Node 33620234 is now known as failover2
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_dc_join_ack: join-1: Updating node state to member for failover1
Feb  9 21:57:44 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='failover2']/lrm (origin=local/crmd/22, version=0.35.0): ok (rc=0)
Feb  9 21:57:44 failover1 cib: [29161]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.WebLg4 (digest: /var/lib/heartbeat/crm/cib.ZiOi7f)
Feb  9 21:57:44 failover1 crmd: [29142]: info: erase_xpath_callback: Deletion of "//node_state[@uname='failover2']/lrm": ok (rc=0)
Feb  9 21:57:44 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_delete for section //node_state[@uname='failover1']/lrm (origin=local/crmd/24, version=0.35.1): ok (rc=0)
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ]
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:44 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_modify for section nodes (origin=local/crmd/26, version=0.35.2): ok (rc=0)
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_dc_join_final: Ensuring DC, quorum and node attributes are up-to-date
Feb  9 21:57:44 failover1 crmd: [29142]: info: crm_update_quorum: Updating quorum status to true (call=28)
Feb  9 21:57:44 failover1 attrd: [29140]: info: attrd_local_callback: Sending full refresh (origin=crmd)
Feb  9 21:57:44 failover1 cib: [29138]: info: log_data_element: cib:diff: - <cib have-quorum="0" admin_epoch="0" epoch="35" num_updates="2" />
Feb  9 21:57:44 failover1 crmd: [29142]: info: abort_transition_graph: do_te_invoke:191 - Triggered transition abort (complete=1) : Peer Cancelled
Feb  9 21:57:44 failover1 attrd: [29140]: info: attrd_trigger_update: Sending flush op to all hosts for: shutdown (<null>)
Feb  9 21:57:44 failover1 cib: [29138]: info: log_data_element: cib:diff: + <cib have-quorum="1" dc-uuid="failover1" admin_epoch="0" epoch="36" num_updates="1" />
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_pe_invoke: Query 29: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:44 failover1 cib: [29138]: info: cib_process_request: Operation complete: op cib_modify for section cib (origin=local/crmd/28, version=0.36.1): ok (rc=0)
Feb  9 21:57:44 failover1 crmd: [29142]: info: erase_xpath_callback: Deletion of "//node_state[@uname='failover1']/lrm": ok (rc=0)
Feb  9 21:57:44 failover1 attrd: [29140]: info: attrd_trigger_update: Sending flush op to all hosts for: terminate (<null>)
Feb  9 21:57:44 failover1 crmd: [29142]: info: abort_transition_graph: need_abort:59 - Triggered transition abort (complete=1) : Non-status change
Feb  9 21:57:44 failover1 cib: [29162]: info: write_cib_contents: Archived previous version as /var/lib/heartbeat/crm/cib-18.raw
Feb  9 21:57:44 failover1 crmd: [29142]: info: need_abort: Aborting on change to have-quorum
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=29, ref=pe_calc-dc-1328842664-9, seq=20, quorate=1
Feb  9 21:57:44 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_pe_invoke: Query 30: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:44 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=30, ref=pe_calc-dc-1328842664-10, seq=20, quorate=1
Feb  9 21:57:44 failover1 cib: [29162]: info: write_cib_contents: Wrote version 0.36.0 of the CIB to disk (digest: d1baf4d06b14faf372a5bef9094cc059)
Feb  9 21:57:44 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:44 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Stopped
Feb  9 21:57:44 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 drbd:1 ]
Feb  9 21:57:44 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Stopped
Feb  9 21:57:44 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 0 instances of a possible 1 to master
Feb  9 21:57:44 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 0 instances of a possible 1 to master
Feb  9 21:57:44 failover1 pengine: [29141]: info: native_color: Resource drbd_fs cannot run anywhere
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (10s) for failover-ip on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Start failover-ip#011(failover1)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Start drbd:1#011(failover1)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Stopped)
Feb  9 21:57:44 failover1 crmd: [29142]: info: handle_response: pe_calc calculation pe_calc-dc-1328842664-9 is obsolete
Feb  9 21:57:44 failover1 pengine: [29141]: info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/pengine/pe-input-2759.bz2
Feb  9 21:57:44 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:44 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:44 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:44 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Stopped
Feb  9 21:57:44 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 drbd:1 ]
Feb  9 21:57:44 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Stopped
Feb  9 21:57:44 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 0 instances of a possible 1 to master
Feb  9 21:57:44 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 0 instances of a possible 1 to master
Feb  9 21:57:44 failover1 pengine: [29141]: info: native_color: Resource drbd_fs cannot run anywhere
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (10s) for failover-ip on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 cib: [29162]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.1WKBD4 (digest: /var/lib/heartbeat/crm/cib.thNZQg)
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Start failover-ip#011(failover1)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Start drbd:1#011(failover1)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Stopped)
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:44 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 1: 33 actions in 33 synapses
Feb  9 21:57:44 failover1 pengine: [29141]: info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/pengine/pe-input-2760.bz2
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 1 (ref=pe_calc-dc-1328842664-10) derived from /var/lib/pengine/pe-input-2760.bz2
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 4: monitor failover-ip_monitor_0 on failover1 (local)
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=4:1:7:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=failover-ip_monitor_0 )
Feb  9 21:57:44 failover1 lrmd: [29139]: info: rsc:failover-ip:2: probe
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 8: monitor failover-ip_monitor_0 on failover2
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: monitor drbd:0_monitor_0 on failover2
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 5: monitor drbd:1_monitor_0 on failover1 (local)
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=5:1:7:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_monitor_0 )
Feb  9 21:57:44 failover1 lrmd: [29139]: info: rsc:drbd:1:3: probe
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 29 fired and confirmed
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 30 fired and confirmed
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 6: monitor drbd_fs_monitor_0 on failover1 (local)
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=6:1:7:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd_fs_monitor_0 )
Feb  9 21:57:44 failover1 lrmd: [29139]: info: rsc:drbd_fs:4: probe
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd_fs_monitor_0 on failover2
Feb  9 21:57:44 failover1 crmd: [29142]: info: process_lrm_event: LRM operation failover-ip_monitor_0 (call=2, rc=7, cib-update=31, confirmed=true) not running
Feb  9 21:57:44 failover1 crmd: [29142]: info: match_graph_event: Action failover-ip_monitor_0 (4) confirmed on failover1 (rc=0)
Feb  9 21:57:44 failover1 crmd: [29142]: info: match_graph_event: Action failover-ip_monitor_0 (8) confirmed on failover2 (rc=0)
Feb  9 21:57:44 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd_fs_monitor_0 (call=4, rc=7, cib-update=32, confirmed=true) not running
Feb  9 21:57:44 failover1 crmd: [29142]: info: match_graph_event: Action drbd_fs_monitor_0 (6) confirmed on failover1 (rc=0)
Feb  9 21:57:44 failover1 crm_attribute: [29229]: info: Invoked: crm_attribute -N failover1 -n master-drbd:1 -l reboot -D
Feb  9 21:57:44 failover1 attrd: [29140]: info: find_hash_entry: Creating hash entry for master-drbd:1
Feb  9 21:57:44 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_monitor_0 (call=3, rc=7, cib-update=33, confirmed=true) not running
Feb  9 21:57:44 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_monitor_0 (5) confirmed on failover1 (rc=0)
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 3: probe_complete probe_complete on failover1 (local) - no waiting
Feb  9 21:57:44 failover1 attrd: [29140]: info: find_hash_entry: Creating hash entry for probe_complete
Feb  9 21:57:44 failover1 attrd: [29140]: info: attrd_trigger_update: Sending flush op to all hosts for: probe_complete (true)
Feb  9 21:57:44 failover1 attrd: [29140]: info: attrd_perform_update: Sent update 10: probe_complete=true
Feb  9 21:57:44 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover1, magic=NA, cib=0.36.6) : Transient attribute: update
Feb  9 21:57:44 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:44 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:44 failover1 crmd: [29142]: info: match_graph_event: Action drbd_fs_monitor_0 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:44 failover1 crmd: [29142]: WARN: status_from_rc: Action 9 (drbd:0_monitor_0) on failover2 failed (target: 7 vs. rc: 0): Error
Feb  9 21:57:44 failover1 crmd: [29142]: info: abort_transition_graph: match_graph_event:272 - Triggered transition abort (complete=0, tag=lrm_rsc_op, id=drbd:0_monitor_0, magic=0:0;9:1:7:4ae03e63-2073-465a-89be-fb3c8d51a7c7, cib=0.36.8) : Event failed
Feb  9 21:57:44 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_0 (9) confirmed on failover2 (rc=4)
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 7: probe_complete probe_complete on failover2 - no waiting
Feb  9 21:57:44 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:44 failover1 crmd: [29142]: notice: run_graph: Transition 1 (Complete=10, Pending=0, Fired=0, Skipped=15, Incomplete=8, Source=/var/lib/pengine/pe-input-2760.bz2): Stopped
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_graph_trigger: Transition 1 is now complete
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_pe_invoke: Query 34: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=34, ref=pe_calc-dc-1328842664-19, seq=20, quorate=1
Feb  9 21:57:44 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:44 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:44 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:44 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Stopped
Feb  9 21:57:44 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: short_print:      Slaves: [ failover2 ]
Feb  9 21:57:44 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:1 ]
Feb  9 21:57:44 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Stopped
Feb  9 21:57:44 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 0 instances of a possible 1 to master
Feb  9 21:57:44 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 0 instances of a possible 1 to master
Feb  9 21:57:44 failover1 pengine: [29141]: info: native_color: Resource drbd_fs cannot run anywhere
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (10s) for failover-ip on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Start failover-ip#011(failover1)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:0#011(Slave failover2)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Start drbd:1#011(failover1)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Stopped)
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:44 failover1 pengine: [29141]: info: process_pe_message: Transition 2: PEngine Input stored in: /var/lib/pengine/pe-input-2761.bz2
Feb  9 21:57:44 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 2: 27 actions in 27 synapses
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 2 (ref=pe_calc-dc-1328842664-19) derived from /var/lib/pengine/pe-input-2761.bz2
Feb  9 21:57:44 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.9) : Transient attribute: update
Feb  9 21:57:44 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:44 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 4: probe_complete probe_complete on failover2 - no waiting
Feb  9 21:57:44 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:44 failover1 crmd: [29142]: notice: run_graph: Transition 2 (Complete=1, Pending=0, Fired=0, Skipped=17, Incomplete=9, Source=/var/lib/pengine/pe-input-2761.bz2): Stopped
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_graph_trigger: Transition 2 is now complete
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_pe_invoke: Query 35: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=35, ref=pe_calc-dc-1328842664-21, seq=20, quorate=1
Feb  9 21:57:44 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:44 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:44 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:44 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Stopped
Feb  9 21:57:44 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: short_print:      Slaves: [ failover2 ]
Feb  9 21:57:44 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:1 ]
Feb  9 21:57:44 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Stopped
Feb  9 21:57:44 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 0 instances of a possible 1 to master
Feb  9 21:57:44 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 0 instances of a possible 1 to master
Feb  9 21:57:44 failover1 pengine: [29141]: info: native_color: Resource drbd_fs cannot run anywhere
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (10s) for failover-ip on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:1 on failover1
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Start failover-ip#011(failover1)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:0#011(Slave failover2)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Start drbd:1#011(failover1)
Feb  9 21:57:44 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Stopped)
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:44 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 3: 26 actions in 26 synapses
Feb  9 21:57:44 failover1 pengine: [29141]: info: process_pe_message: Transition 3: PEngine Input stored in: /var/lib/pengine/pe-input-2762.bz2
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 3 (ref=pe_calc-dc-1328842664-21) derived from /var/lib/pengine/pe-input-2762.bz2
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 5: start failover-ip_start_0 on failover1 (local)
Feb  9 21:57:44 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=5:3:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=failover-ip_start_0 )
Feb  9 21:57:44 failover1 lrmd: [29139]: info: rsc:failover-ip:5: start
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:44 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:0_pre_notify_stop_0 on failover2
Feb  9 21:57:44 failover1 IPaddr[29230]: INFO: Using calculated nic for 199.47.47.23: eth0
Feb  9 21:57:44 failover1 IPaddr[29230]: INFO: Using calculated netmask for 199.47.47.23: 255.255.255.0
Feb  9 21:57:44 failover1 IPaddr[29230]: INFO: eval ifconfig eth0:0 199.47.47.23 netmask 255.255.255.0 broadcast 199.47.47.255
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_pre_notify_stop_0 (52) confirmed on failover2 (rc=0)
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 53: notify drbd:0_post_notify_stop_0 on failover2
Feb  9 21:57:45 failover1 crmd: [29142]: info: process_lrm_event: LRM operation failover-ip_start_0 (call=5, rc=0, cib-update=36, confirmed=true) ok
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action failover-ip_start_0 (5) confirmed on failover1 (rc=0)
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 6: monitor failover-ip_monitor_10000 on failover1 (local)
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=6:3:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=failover-ip_monitor_10000 )
Feb  9 21:57:45 failover1 lrmd: [29139]: info: rsc:failover-ip:6: monitor
Feb  9 21:57:45 failover1 crmd: [29142]: info: process_lrm_event: LRM operation failover-ip_monitor_10000 (call=6, rc=0, cib-update=37, confirmed=false) ok
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action failover-ip_monitor_10000 (6) confirmed on failover1 (rc=0)
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_stop_0 (53) confirmed on failover2 (rc=0)
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:0_pre_notify_start_0 on failover2
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_pre_notify_start_0 (49) confirmed on failover2 (rc=0)
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 13: start drbd:1_start_0 on failover1 (local)
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=13:3:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_start_0 )
Feb  9 21:57:45 failover1 lrmd: [29139]: info: rsc:drbd:1:7: start
Feb  9 21:57:45 failover1 lrmd: [29139]: info: RA output: (drbd:1:start:stdout)
Feb  9 21:57:45 failover1 attrd: [29140]: info: attrd_trigger_update: Sending flush op to all hosts for: master-drbd:1 (10000)
Feb  9 21:57:45 failover1 attrd: [29140]: info: attrd_perform_update: Sent update 15: master-drbd:1=10000
Feb  9 21:57:45 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover1, magic=NA, cib=0.36.15) : Transient attribute: update
Feb  9 21:57:45 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:45 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:45 failover1 lrmd: [29139]: info: RA output: (drbd:1:start:stdout)
Feb  9 21:57:45 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_start_0 (call=7, rc=0, cib-update=38, confirmed=true) ok
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_start_0 (13) confirmed on failover1 (rc=0)
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:3:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:45 failover1 lrmd: [29139]: info: rsc:drbd:1:8: notify
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (50) confirmed on failover2 (rc=0)
Feb  9 21:57:45 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:45 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=8, rc=0, cib-update=39, confirmed=true) ok
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:45 failover1 crmd: [29142]: notice: run_graph: Transition 3 (Complete=20, Pending=0, Fired=0, Skipped=6, Incomplete=0, Source=/var/lib/pengine/pe-input-2762.bz2): Stopped
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_graph_trigger: Transition 3 is now complete
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_pe_invoke: Query 40: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=40, ref=pe_calc-dc-1328842665-30, seq=20, quorate=1
Feb  9 21:57:45 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:45 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:45 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:45 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:45 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:45 failover1 pengine: [29141]: notice: short_print:      Slaves: [ failover2 failover1 ]
Feb  9 21:57:45 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Stopped
Feb  9 21:57:45 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Slave failover1)
Feb  9 21:57:45 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:45 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Slave failover1)
Feb  9 21:57:45 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (59s) for drbd:1 on failover1
Feb  9 21:57:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (59s) for drbd:1 on failover1
Feb  9 21:57:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:45 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:45 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:0#011(Slave failover2)
Feb  9 21:57:45 failover1 pengine: [29141]: notice: LogActions: Promote drbd:1#011(Slave -> Master failover1)
Feb  9 21:57:45 failover1 pengine: [29141]: notice: LogActions: Start drbd_fs#011(failover1)
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:45 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 4: 36 actions in 36 synapses
Feb  9 21:57:45 failover1 pengine: [29141]: info: process_pe_message: Transition 4: PEngine Input stored in: /var/lib/pengine/pe-input-2763.bz2
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 4 (ref=pe_calc-dc-1328842665-30) derived from /var/lib/pengine/pe-input-2763.bz2
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:0_pre_notify_stop_0 on failover2
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 54: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=54:4:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:45 failover1 lrmd: [29139]: info: rsc:drbd:1:9: notify
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_pre_notify_stop_0 (52) confirmed on failover2 (rc=0)
Feb  9 21:57:45 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=9, rc=0, cib-update=41, confirmed=true) ok
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (54) confirmed on failover1 (rc=0)
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 29 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 53: notify drbd:0_post_notify_stop_0 on failover2
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 55: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=55:4:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:45 failover1 lrmd: [29139]: info: rsc:drbd:1:10: notify
Feb  9 21:57:45 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:45 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=10, rc=0, cib-update=42, confirmed=true) ok
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (55) confirmed on failover1 (rc=0)
Feb  9 21:57:45 failover1 attrd: [29140]: info: find_hash_entry: Creating hash entry for master-drbd:0
Feb  9 21:57:45 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.22) : Transient attribute: update
Feb  9 21:57:45 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:45 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_stop_0 (53) confirmed on failover2 (rc=0)
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 30 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:45 failover1 crmd: [29142]: notice: run_graph: Transition 4 (Complete=10, Pending=0, Fired=0, Skipped=16, Incomplete=10, Source=/var/lib/pengine/pe-input-2763.bz2): Stopped
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_graph_trigger: Transition 4 is now complete
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_pe_invoke: Query 43: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=43, ref=pe_calc-dc-1328842665-35, seq=20, quorate=1
Feb  9 21:57:45 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:45 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:45 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:45 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:45 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:45 failover1 pengine: [29141]: notice: short_print:      Slaves: [ failover2 failover1 ]
Feb  9 21:57:45 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Stopped
Feb  9 21:57:45 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Slave failover1)
Feb  9 21:57:45 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:45 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Slave failover1)
Feb  9 21:57:45 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (59s) for drbd:1 on failover1
Feb  9 21:57:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (59s) for drbd:1 on failover1
Feb  9 21:57:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:45 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:45 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:0#011(Slave failover2)
Feb  9 21:57:45 failover1 pengine: [29141]: notice: LogActions: Promote drbd:1#011(Slave -> Master failover1)
Feb  9 21:57:45 failover1 pengine: [29141]: notice: LogActions: Start drbd_fs#011(failover1)
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:45 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 5: 36 actions in 36 synapses
Feb  9 21:57:45 failover1 pengine: [29141]: info: process_pe_message: Transition 5: PEngine Input stored in: /var/lib/pengine/pe-input-2764.bz2
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 5 (ref=pe_calc-dc-1328842665-35) derived from /var/lib/pengine/pe-input-2764.bz2
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:0_pre_notify_stop_0 on failover2
Feb  9 21:57:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 54: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:45 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=54:5:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:45 failover1 lrmd: [29139]: info: rsc:drbd:1:11: notify
Feb  9 21:57:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=11, rc=0, cib-update=44, confirmed=true) ok
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (54) confirmed on failover1 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_pre_notify_stop_0 (52) confirmed on failover2 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 29 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 53: notify drbd:0_post_notify_stop_0 on failover2
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 55: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=55:5:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:46 failover1 lrmd: [29139]: info: rsc:drbd:1:12: notify
Feb  9 21:57:46 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=12, rc=0, cib-update=45, confirmed=true) ok
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (55) confirmed on failover1 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_stop_0 (53) confirmed on failover2 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 30 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_pre_notify_start_0 on failover2
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:5:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:46 failover1 lrmd: [29139]: info: rsc:drbd:1:13: notify
Feb  9 21:57:46 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=13, rc=0, cib-update=46, confirmed=true) ok
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_pre_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:5:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:46 failover1 lrmd: [29139]: info: rsc:drbd:1:14: notify
Feb  9 21:57:46 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=14, rc=0, cib-update=47, confirmed=true) ok
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (49) confirmed on failover2 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 33 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 56: notify drbd:0_pre_notify_promote_0 on failover2
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 58: notify drbd:1_pre_notify_promote_0 on failover1 (local)
Feb  9 21:57:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=58:5:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:46 failover1 lrmd: [29139]: info: rsc:drbd:1:15: notify
Feb  9 21:57:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=15, rc=0, cib-update=48, confirmed=true) ok
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_promote_0 (58) confirmed on failover1 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_pre_notify_promote_0 (56) confirmed on failover2 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 34 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 31 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 17: promote drbd:1_promote_0 on failover1 (local)
Feb  9 21:57:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=17:5:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_promote_0 )
Feb  9 21:57:46 failover1 lrmd: [29139]: info: rsc:drbd:1:16: promote
Feb  9 21:57:46 failover1 lrmd: [29139]: info: RA output: (drbd:1:promote:stdout)
Feb  9 21:57:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_promote_0 (call=16, rc=0, cib-update=49, confirmed=true) ok
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_promote_0 (17) confirmed on failover1 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 32 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 35 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 57: notify drbd:0_post_notify_promote_0 on failover2
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 59: notify drbd:1_post_notify_promote_0 on failover1 (local)
Feb  9 21:57:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=59:5:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:46 failover1 lrmd: [29139]: info: rsc:drbd:1:17: notify
Feb  9 21:57:46 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=17, rc=0, cib-update=50, confirmed=true) ok
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_promote_0 (59) confirmed on failover1 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_promote_0 (57) confirmed on failover2 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 36 fired and confirmed
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 43: start drbd_fs_start_0 on failover1 (local)
Feb  9 21:57:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=43:5:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd_fs_start_0 )
Feb  9 21:57:46 failover1 lrmd: [29139]: info: rsc:drbd_fs:18: start
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: start drbd:0_start_240000 on failover2
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 13: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 18: monitor drbd:1_monitor_59000 on failover1 (local)
Feb  9 21:57:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=18:5:8:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_monitor_59000 )
Feb  9 21:57:46 failover1 lrmd: [29139]: info: rsc:drbd:1:19: monitor
Feb  9 21:57:46 failover1 Filesystem[29653]: INFO: Running start for /dev/drbd1 on /drbd
Feb  9 21:57:46 failover1 lrmd: [29139]: info: RA output: (drbd_fs:start:stderr) FATAL: Module scsi_hostadapter not found.
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_monitor_59000 (call=19, rc=8, cib-update=51, confirmed=false) master
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_monitor_59000 (18) confirmed on failover1 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd_fs_start_0 (call=18, rc=0, cib-update=52, confirmed=true) ok
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd_fs_start_0 (43) confirmed on failover1 (rc=0)
Feb  9 21:57:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:47 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.41) : Transient attribute: update
Feb  9 21:57:47 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:47 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:47 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.42) : Transient attribute: removal
Feb  9 21:57:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (13) confirmed on failover2 (rc=0)
Feb  9 21:57:47 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:47 failover1 crmd: [29142]: notice: run_graph: Transition 5 (Complete=36, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2764.bz2): Complete
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_graph_trigger: Transition 5 is now complete
Feb  9 21:57:47 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:47 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:47 failover1 crmd: [29142]: info: do_pe_invoke: Query 53: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:47 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=53, ref=pe_calc-dc-1328842667-54, seq=20, quorate=1
Feb  9 21:57:47 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:47 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:47 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:47 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:47 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:47 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:47 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:47 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:47 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:47 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:47 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:47 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:47 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:47 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:47 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:47 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:47 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:47 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:47 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:47 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:47 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:47 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:47 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:47 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:47 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:47 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:47 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:47 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:47 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 6: 21 actions in 21 synapses
Feb  9 21:57:47 failover1 pengine: [29141]: info: process_pe_message: Transition 6: PEngine Input stored in: /var/lib/pengine/pe-input-2765.bz2
Feb  9 21:57:47 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 6 (ref=pe_calc-dc-1328842667-54) derived from /var/lib/pengine/pe-input-2765.bz2
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:47 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:6:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:47 failover1 lrmd: [29139]: info: rsc:drbd:1:20: notify
Feb  9 21:57:47 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=20, rc=0, cib-update=54, confirmed=true) ok
Feb  9 21:57:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:47 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:6:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:47 failover1 lrmd: [29139]: info: rsc:drbd:1:21: notify
Feb  9 21:57:47 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:47 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=21, rc=0, cib-update=55, confirmed=true) ok
Feb  9 21:57:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:47 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:6:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:47 failover1 lrmd: [29139]: info: rsc:drbd:1:22: notify
Feb  9 21:57:47 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:47 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=22, rc=0, cib-update=56, confirmed=true) ok
Feb  9 21:57:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:47 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:6:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:47 failover1 lrmd: [29139]: info: rsc:drbd:1:23: notify
Feb  9 21:57:47 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:47 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=23, rc=0, cib-update=57, confirmed=true) ok
Feb  9 21:57:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:47 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.50) : Transient attribute: update
Feb  9 21:57:47 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:47 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:48 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:48 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:48 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.53) : Transient attribute: update
Feb  9 21:57:48 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.54) : Transient attribute: removal
Feb  9 21:57:48 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:48 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:48 failover1 crmd: [29142]: notice: run_graph: Transition 6 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2765.bz2): Complete
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_graph_trigger: Transition 6 is now complete
Feb  9 21:57:48 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:48 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:48 failover1 crmd: [29142]: info: do_pe_invoke: Query 58: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:48 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=58, ref=pe_calc-dc-1328842668-64, seq=20, quorate=1
Feb  9 21:57:48 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:48 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:48 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:48 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:48 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:48 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:48 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:48 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:48 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:48 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:48 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:48 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:48 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:48 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:48 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:48 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:48 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:48 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:48 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:48 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:48 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:48 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:48 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:48 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:48 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:48 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:48 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:48 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:48 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 7: 21 actions in 21 synapses
Feb  9 21:57:48 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 7 (ref=pe_calc-dc-1328842668-64) derived from /var/lib/pengine/pe-input-2766.bz2
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:48 failover1 pengine: [29141]: info: process_pe_message: Transition 7: PEngine Input stored in: /var/lib/pengine/pe-input-2766.bz2
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:48 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:7:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:48 failover1 lrmd: [29139]: info: rsc:drbd:1:24: notify
Feb  9 21:57:48 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=24, rc=0, cib-update=59, confirmed=true) ok
Feb  9 21:57:48 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:48 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:7:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:48 failover1 lrmd: [29139]: info: rsc:drbd:1:25: notify
Feb  9 21:57:48 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:48 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=25, rc=0, cib-update=60, confirmed=true) ok
Feb  9 21:57:48 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:48 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:7:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:48 failover1 lrmd: [29139]: info: rsc:drbd:1:26: notify
Feb  9 21:57:48 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:48 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=26, rc=0, cib-update=61, confirmed=true) ok
Feb  9 21:57:48 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:48 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:48 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:7:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:48 failover1 lrmd: [29139]: info: rsc:drbd:1:27: notify
Feb  9 21:57:48 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:48 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=27, rc=0, cib-update=62, confirmed=true) ok
Feb  9 21:57:48 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:48 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:48 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:49 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.62) : Transient attribute: update
Feb  9 21:57:49 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:49 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:49 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:49 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:49 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.65) : Transient attribute: update
Feb  9 21:57:49 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.66) : Transient attribute: removal
Feb  9 21:57:49 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:49 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:49 failover1 crmd: [29142]: notice: run_graph: Transition 7 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2766.bz2): Complete
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_graph_trigger: Transition 7 is now complete
Feb  9 21:57:49 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:49 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:49 failover1 crmd: [29142]: info: do_pe_invoke: Query 63: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:49 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=63, ref=pe_calc-dc-1328842669-74, seq=20, quorate=1
Feb  9 21:57:49 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:49 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:49 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:49 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:49 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:49 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:49 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:49 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:49 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:49 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:49 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:49 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:49 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:49 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:49 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:49 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:49 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:49 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:49 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:49 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:49 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:49 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:49 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 8: 21 actions in 21 synapses
Feb  9 21:57:49 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 8 (ref=pe_calc-dc-1328842669-74) derived from /var/lib/pengine/pe-input-2767.bz2
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:49 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:8:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:49 failover1 lrmd: [29139]: info: rsc:drbd:1:28: notify
Feb  9 21:57:49 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=28, rc=0, cib-update=64, confirmed=true) ok
Feb  9 21:57:49 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:49 failover1 pengine: [29141]: info: process_pe_message: Transition 8: PEngine Input stored in: /var/lib/pengine/pe-input-2767.bz2
Feb  9 21:57:49 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:8:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:49 failover1 lrmd: [29139]: info: rsc:drbd:1:29: notify
Feb  9 21:57:49 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:49 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=29, rc=0, cib-update=65, confirmed=true) ok
Feb  9 21:57:49 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:49 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:8:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:49 failover1 lrmd: [29139]: info: rsc:drbd:1:30: notify
Feb  9 21:57:49 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:49 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=30, rc=0, cib-update=66, confirmed=true) ok
Feb  9 21:57:49 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:49 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:50 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:8:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:50 failover1 lrmd: [29139]: info: rsc:drbd:1:31: notify
Feb  9 21:57:50 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:50 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=31, rc=0, cib-update=67, confirmed=true) ok
Feb  9 21:57:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:50 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.74) : Transient attribute: update
Feb  9 21:57:50 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:50 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:50 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.77) : Transient attribute: update
Feb  9 21:57:50 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.78) : Transient attribute: removal
Feb  9 21:57:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:50 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:50 failover1 crmd: [29142]: notice: run_graph: Transition 8 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2767.bz2): Complete
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_graph_trigger: Transition 8 is now complete
Feb  9 21:57:50 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:50 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:50 failover1 crmd: [29142]: info: do_pe_invoke: Query 68: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:50 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=68, ref=pe_calc-dc-1328842670-84, seq=20, quorate=1
Feb  9 21:57:50 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:50 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:50 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:50 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:50 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:50 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:50 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:50 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:50 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:50 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:50 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:50 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:50 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:50 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:50 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:50 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:50 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:50 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:50 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:50 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:50 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:50 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:50 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 9: 21 actions in 21 synapses
Feb  9 21:57:50 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 9 (ref=pe_calc-dc-1328842670-84) derived from /var/lib/pengine/pe-input-2768.bz2
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:50 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:9:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:50 failover1 lrmd: [29139]: info: rsc:drbd:1:32: notify
Feb  9 21:57:50 failover1 pengine: [29141]: info: process_pe_message: Transition 9: PEngine Input stored in: /var/lib/pengine/pe-input-2768.bz2
Feb  9 21:57:50 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=32, rc=0, cib-update=69, confirmed=true) ok
Feb  9 21:57:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:50 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:9:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:50 failover1 lrmd: [29139]: info: rsc:drbd:1:33: notify
Feb  9 21:57:50 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:50 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=33, rc=0, cib-update=70, confirmed=true) ok
Feb  9 21:57:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:50 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:9:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:50 failover1 lrmd: [29139]: info: rsc:drbd:1:34: notify
Feb  9 21:57:50 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:50 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=34, rc=0, cib-update=71, confirmed=true) ok
Feb  9 21:57:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:51 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:9:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:51 failover1 lrmd: [29139]: info: rsc:drbd:1:35: notify
Feb  9 21:57:51 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:51 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=35, rc=0, cib-update=72, confirmed=true) ok
Feb  9 21:57:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:51 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.86) : Transient attribute: update
Feb  9 21:57:51 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:51 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:51 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.89) : Transient attribute: update
Feb  9 21:57:51 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.90) : Transient attribute: removal
Feb  9 21:57:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:51 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:51 failover1 crmd: [29142]: notice: run_graph: Transition 9 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2768.bz2): Complete
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_graph_trigger: Transition 9 is now complete
Feb  9 21:57:51 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:51 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:51 failover1 crmd: [29142]: info: do_pe_invoke: Query 73: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:51 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=73, ref=pe_calc-dc-1328842671-94, seq=20, quorate=1
Feb  9 21:57:51 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:51 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:51 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:51 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:51 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:51 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:51 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:51 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:51 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:51 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:51 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:51 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:51 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:51 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:51 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:51 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:51 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:51 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:51 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:51 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:51 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:51 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:51 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:51 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:51 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:51 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:51 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:51 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:51 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 10: 21 actions in 21 synapses
Feb  9 21:57:51 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 10 (ref=pe_calc-dc-1328842671-94) derived from /var/lib/pengine/pe-input-2769.bz2
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:51 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:10:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:51 failover1 lrmd: [29139]: info: rsc:drbd:1:36: notify
Feb  9 21:57:51 failover1 pengine: [29141]: info: process_pe_message: Transition 10: PEngine Input stored in: /var/lib/pengine/pe-input-2769.bz2
Feb  9 21:57:51 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=36, rc=0, cib-update=74, confirmed=true) ok
Feb  9 21:57:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:51 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:10:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:51 failover1 lrmd: [29139]: info: rsc:drbd:1:37: notify
Feb  9 21:57:52 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:52 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=37, rc=0, cib-update=75, confirmed=true) ok
Feb  9 21:57:52 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:52 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:10:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:52 failover1 lrmd: [29139]: info: rsc:drbd:1:38: notify
Feb  9 21:57:52 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:52 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=38, rc=0, cib-update=76, confirmed=true) ok
Feb  9 21:57:52 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:52 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:52 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:10:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:52 failover1 lrmd: [29139]: info: rsc:drbd:1:39: notify
Feb  9 21:57:52 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:52 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=39, rc=0, cib-update=77, confirmed=true) ok
Feb  9 21:57:52 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:52 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:52 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.98) : Transient attribute: update
Feb  9 21:57:52 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:52 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:52 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:52 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:52 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.101) : Transient attribute: update
Feb  9 21:57:52 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.102) : Transient attribute: removal
Feb  9 21:57:52 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:52 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:52 failover1 crmd: [29142]: notice: run_graph: Transition 10 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2769.bz2): Complete
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_graph_trigger: Transition 10 is now complete
Feb  9 21:57:52 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:52 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:52 failover1 crmd: [29142]: info: do_pe_invoke: Query 78: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:52 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=78, ref=pe_calc-dc-1328842672-104, seq=20, quorate=1
Feb  9 21:57:52 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:52 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:52 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:52 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:52 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:52 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:52 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:52 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:52 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:52 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:52 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:52 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:52 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:52 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:52 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:52 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:52 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:52 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:52 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:52 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:52 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:52 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:52 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:52 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:52 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:52 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:52 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:52 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:52 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 11: 21 actions in 21 synapses
Feb  9 21:57:52 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 11 (ref=pe_calc-dc-1328842672-104) derived from /var/lib/pengine/pe-input-2770.bz2
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:52 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:52 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:11:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:52 failover1 lrmd: [29139]: info: rsc:drbd:1:40: notify
Feb  9 21:57:53 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=40, rc=0, cib-update=79, confirmed=true) ok
Feb  9 21:57:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:53 failover1 pengine: [29141]: info: process_pe_message: Transition 11: PEngine Input stored in: /var/lib/pengine/pe-input-2770.bz2
Feb  9 21:57:53 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:11:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:53 failover1 lrmd: [29139]: info: rsc:drbd:1:41: notify
Feb  9 21:57:53 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:53 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=41, rc=0, cib-update=80, confirmed=true) ok
Feb  9 21:57:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:53 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:11:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:53 failover1 lrmd: [29139]: info: rsc:drbd:1:42: notify
Feb  9 21:57:53 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:53 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=42, rc=0, cib-update=81, confirmed=true) ok
Feb  9 21:57:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:53 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:11:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:53 failover1 lrmd: [29139]: info: rsc:drbd:1:43: notify
Feb  9 21:57:53 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:53 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=43, rc=0, cib-update=82, confirmed=true) ok
Feb  9 21:57:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:53 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.110) : Transient attribute: update
Feb  9 21:57:53 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:53 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:54 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.113) : Transient attribute: update
Feb  9 21:57:54 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.114) : Transient attribute: removal
Feb  9 21:57:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:54 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:54 failover1 crmd: [29142]: notice: run_graph: Transition 11 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2770.bz2): Complete
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_graph_trigger: Transition 11 is now complete
Feb  9 21:57:54 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:54 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:54 failover1 crmd: [29142]: info: do_pe_invoke: Query 83: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:54 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=83, ref=pe_calc-dc-1328842674-114, seq=20, quorate=1
Feb  9 21:57:54 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:54 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:54 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:54 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:54 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:54 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:54 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:54 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:54 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:54 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:54 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:54 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:54 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:54 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:54 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:54 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:54 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:54 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:54 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:54 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:54 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:54 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:54 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 12: 21 actions in 21 synapses
Feb  9 21:57:54 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 12 (ref=pe_calc-dc-1328842674-114) derived from /var/lib/pengine/pe-input-2771.bz2
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:54 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:12:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:54 failover1 lrmd: [29139]: info: rsc:drbd:1:44: notify
Feb  9 21:57:54 failover1 pengine: [29141]: info: process_pe_message: Transition 12: PEngine Input stored in: /var/lib/pengine/pe-input-2771.bz2
Feb  9 21:57:54 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=44, rc=0, cib-update=84, confirmed=true) ok
Feb  9 21:57:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:54 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:12:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:54 failover1 lrmd: [29139]: info: rsc:drbd:1:45: notify
Feb  9 21:57:54 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:54 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=45, rc=0, cib-update=85, confirmed=true) ok
Feb  9 21:57:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:54 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:12:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:54 failover1 lrmd: [29139]: info: rsc:drbd:1:46: notify
Feb  9 21:57:54 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:54 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=46, rc=0, cib-update=86, confirmed=true) ok
Feb  9 21:57:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:54 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:12:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:54 failover1 lrmd: [29139]: info: rsc:drbd:1:47: notify
Feb  9 21:57:54 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:54 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=47, rc=0, cib-update=87, confirmed=true) ok
Feb  9 21:57:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:54 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.122) : Transient attribute: update
Feb  9 21:57:54 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:54 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:55 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.125) : Transient attribute: update
Feb  9 21:57:55 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.126) : Transient attribute: removal
Feb  9 21:57:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:55 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:55 failover1 crmd: [29142]: notice: run_graph: Transition 12 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2771.bz2): Complete
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_graph_trigger: Transition 12 is now complete
Feb  9 21:57:55 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:55 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:55 failover1 crmd: [29142]: info: do_pe_invoke: Query 88: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:55 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=88, ref=pe_calc-dc-1328842675-124, seq=20, quorate=1
Feb  9 21:57:55 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:55 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:55 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:55 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:55 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:55 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:55 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:55 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:55 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:55 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:55 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:55 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:55 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:55 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:55 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:55 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:55 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:55 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:55 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:55 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:55 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:55 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:55 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 13: 21 actions in 21 synapses
Feb  9 21:57:55 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 13 (ref=pe_calc-dc-1328842675-124) derived from /var/lib/pengine/pe-input-2772.bz2
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:55 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:13:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:55 failover1 lrmd: [29139]: info: rsc:drbd:1:48: notify
Feb  9 21:57:55 failover1 pengine: [29141]: info: process_pe_message: Transition 13: PEngine Input stored in: /var/lib/pengine/pe-input-2772.bz2
Feb  9 21:57:55 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=48, rc=0, cib-update=89, confirmed=true) ok
Feb  9 21:57:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:55 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:13:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:55 failover1 lrmd: [29139]: info: rsc:drbd:1:49: notify
Feb  9 21:57:55 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:55 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=49, rc=0, cib-update=90, confirmed=true) ok
Feb  9 21:57:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:55 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:13:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:55 failover1 lrmd: [29139]: info: rsc:drbd:1:50: notify
Feb  9 21:57:55 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:55 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=50, rc=0, cib-update=91, confirmed=true) ok
Feb  9 21:57:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:55 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:13:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:55 failover1 lrmd: [29139]: info: rsc:drbd:1:51: notify
Feb  9 21:57:55 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:55 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=51, rc=0, cib-update=92, confirmed=true) ok
Feb  9 21:57:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:55 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.134) : Transient attribute: update
Feb  9 21:57:55 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:55 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:56 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.137) : Transient attribute: update
Feb  9 21:57:56 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.138) : Transient attribute: removal
Feb  9 21:57:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:56 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:56 failover1 crmd: [29142]: notice: run_graph: Transition 13 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2772.bz2): Complete
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_graph_trigger: Transition 13 is now complete
Feb  9 21:57:56 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:56 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:56 failover1 crmd: [29142]: info: do_pe_invoke: Query 93: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:56 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=93, ref=pe_calc-dc-1328842676-134, seq=20, quorate=1
Feb  9 21:57:56 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:56 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:56 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:56 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:56 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:56 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:56 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:56 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:56 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:56 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:56 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:56 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:56 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:56 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:56 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:56 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:56 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:56 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:56 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:56 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:56 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:56 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:56 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:56 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:56 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:56 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:56 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:56 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:56 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 14: 21 actions in 21 synapses
Feb  9 21:57:56 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 14 (ref=pe_calc-dc-1328842676-134) derived from /var/lib/pengine/pe-input-2773.bz2
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:56 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:14:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:56 failover1 lrmd: [29139]: info: rsc:drbd:1:52: notify
Feb  9 21:57:56 failover1 pengine: [29141]: info: process_pe_message: Transition 14: PEngine Input stored in: /var/lib/pengine/pe-input-2773.bz2
Feb  9 21:57:56 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=52, rc=0, cib-update=94, confirmed=true) ok
Feb  9 21:57:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:56 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:14:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:56 failover1 lrmd: [29139]: info: rsc:drbd:1:53: notify
Feb  9 21:57:56 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:56 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=53, rc=0, cib-update=95, confirmed=true) ok
Feb  9 21:57:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:56 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:14:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:56 failover1 lrmd: [29139]: info: rsc:drbd:1:54: notify
Feb  9 21:57:56 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:56 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=54, rc=0, cib-update=96, confirmed=true) ok
Feb  9 21:57:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:56 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:14:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:56 failover1 lrmd: [29139]: info: rsc:drbd:1:55: notify
Feb  9 21:57:57 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:57 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=55, rc=0, cib-update=97, confirmed=true) ok
Feb  9 21:57:57 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:57 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:57 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.146) : Transient attribute: update
Feb  9 21:57:57 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:57 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:57 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:57 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:57 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.149) : Transient attribute: update
Feb  9 21:57:57 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.150) : Transient attribute: removal
Feb  9 21:57:57 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:57 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:57 failover1 crmd: [29142]: notice: run_graph: Transition 14 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2773.bz2): Complete
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_graph_trigger: Transition 14 is now complete
Feb  9 21:57:57 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:57 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:57 failover1 crmd: [29142]: info: do_pe_invoke: Query 98: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:57 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=98, ref=pe_calc-dc-1328842677-144, seq=20, quorate=1
Feb  9 21:57:57 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:57 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:57 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:57 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:57 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:57 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:57 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:57 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:57 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:57 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:57 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:57 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:57 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:57 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:57 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:57 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:57 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:57 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:57 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:57 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:57 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:57 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:57 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:57 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:57 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:57 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:57 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:57 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:57 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 15: 21 actions in 21 synapses
Feb  9 21:57:57 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 15 (ref=pe_calc-dc-1328842677-144) derived from /var/lib/pengine/pe-input-2774.bz2
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:57 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:15:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:57 failover1 lrmd: [29139]: info: rsc:drbd:1:56: notify
Feb  9 21:57:57 failover1 pengine: [29141]: info: process_pe_message: Transition 15: PEngine Input stored in: /var/lib/pengine/pe-input-2774.bz2
Feb  9 21:57:57 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=56, rc=0, cib-update=99, confirmed=true) ok
Feb  9 21:57:57 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:57 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:15:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:57 failover1 lrmd: [29139]: info: rsc:drbd:1:57: notify
Feb  9 21:57:57 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:57 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=57, rc=0, cib-update=100, confirmed=true) ok
Feb  9 21:57:57 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:57 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:57 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:15:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:57 failover1 lrmd: [29139]: info: rsc:drbd:1:58: notify
Feb  9 21:57:58 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:58 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=58, rc=0, cib-update=101, confirmed=true) ok
Feb  9 21:57:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:58 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:15:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:58 failover1 lrmd: [29139]: info: rsc:drbd:1:59: notify
Feb  9 21:57:58 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:58 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=59, rc=0, cib-update=102, confirmed=true) ok
Feb  9 21:57:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:58 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.158) : Transient attribute: update
Feb  9 21:57:58 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:58 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:58 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.161) : Transient attribute: update
Feb  9 21:57:58 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.162) : Transient attribute: removal
Feb  9 21:57:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:58 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:58 failover1 crmd: [29142]: notice: run_graph: Transition 15 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2774.bz2): Complete
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_graph_trigger: Transition 15 is now complete
Feb  9 21:57:58 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:58 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:58 failover1 crmd: [29142]: info: do_pe_invoke: Query 103: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:58 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=103, ref=pe_calc-dc-1328842678-154, seq=20, quorate=1
Feb  9 21:57:58 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:58 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:58 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:58 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:58 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:58 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:58 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:58 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:58 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:58 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:58 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:58 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:58 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:58 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:58 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:58 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:58 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:58 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:58 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:58 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:58 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:58 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:58 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 16: 21 actions in 21 synapses
Feb  9 21:57:58 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 16 (ref=pe_calc-dc-1328842678-154) derived from /var/lib/pengine/pe-input-2775.bz2
Feb  9 21:57:58 failover1 pengine: [29141]: info: process_pe_message: Transition 16: PEngine Input stored in: /var/lib/pengine/pe-input-2775.bz2
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:58 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:16:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:58 failover1 lrmd: [29139]: info: rsc:drbd:1:60: notify
Feb  9 21:57:58 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=60, rc=0, cib-update=104, confirmed=true) ok
Feb  9 21:57:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:58 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:16:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:58 failover1 lrmd: [29139]: info: rsc:drbd:1:61: notify
Feb  9 21:57:59 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:57:59 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=61, rc=0, cib-update=105, confirmed=true) ok
Feb  9 21:57:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:57:59 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:16:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:59 failover1 lrmd: [29139]: info: rsc:drbd:1:62: notify
Feb  9 21:57:59 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:59 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=62, rc=0, cib-update=106, confirmed=true) ok
Feb  9 21:57:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:57:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:57:59 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:16:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:59 failover1 lrmd: [29139]: info: rsc:drbd:1:63: notify
Feb  9 21:57:59 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:57:59 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=63, rc=0, cib-update=107, confirmed=true) ok
Feb  9 21:57:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:57:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:57:59 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.170) : Transient attribute: update
Feb  9 21:57:59 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:57:59 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:57:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:57:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:57:59 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.173) : Transient attribute: update
Feb  9 21:57:59 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.174) : Transient attribute: removal
Feb  9 21:57:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:57:59 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:57:59 failover1 crmd: [29142]: notice: run_graph: Transition 16 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2775.bz2): Complete
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_graph_trigger: Transition 16 is now complete
Feb  9 21:57:59 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:57:59 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:57:59 failover1 crmd: [29142]: info: do_pe_invoke: Query 108: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:57:59 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=108, ref=pe_calc-dc-1328842679-164, seq=20, quorate=1
Feb  9 21:57:59 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:57:59 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:57:59 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:57:59 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:57:59 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:57:59 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:57:59 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:57:59 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:57:59 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:57:59 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:59 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:59 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:57:59 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:57:59 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:59 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:59 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:59 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:59 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:59 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:57:59 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:57:59 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:57:59 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:59 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:57:59 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:57:59 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:57:59 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:57:59 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:57:59 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:57:59 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 17: 21 actions in 21 synapses
Feb  9 21:57:59 failover1 pengine: [29141]: info: process_pe_message: Transition 17: PEngine Input stored in: /var/lib/pengine/pe-input-2776.bz2
Feb  9 21:57:59 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 17 (ref=pe_calc-dc-1328842679-164) derived from /var/lib/pengine/pe-input-2776.bz2
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:57:59 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:17:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:59 failover1 lrmd: [29139]: info: rsc:drbd:1:64: notify
Feb  9 21:57:59 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=64, rc=0, cib-update=109, confirmed=true) ok
Feb  9 21:57:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:57:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:57:59 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:17:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:57:59 failover1 lrmd: [29139]: info: rsc:drbd:1:65: notify
Feb  9 21:58:00 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:00 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=65, rc=0, cib-update=110, confirmed=true) ok
Feb  9 21:58:00 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:00 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:17:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:00 failover1 lrmd: [29139]: info: rsc:drbd:1:66: notify
Feb  9 21:58:00 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:00 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=66, rc=0, cib-update=111, confirmed=true) ok
Feb  9 21:58:00 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:00 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:00 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:17:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:00 failover1 lrmd: [29139]: info: rsc:drbd:1:67: notify
Feb  9 21:58:00 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:00 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=67, rc=0, cib-update=112, confirmed=true) ok
Feb  9 21:58:00 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:00 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:00 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.182) : Transient attribute: update
Feb  9 21:58:00 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:00 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:00 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:00 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:00 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.185) : Transient attribute: update
Feb  9 21:58:00 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.186) : Transient attribute: removal
Feb  9 21:58:00 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:00 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:00 failover1 crmd: [29142]: notice: run_graph: Transition 17 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2776.bz2): Complete
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_graph_trigger: Transition 17 is now complete
Feb  9 21:58:00 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:00 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:00 failover1 crmd: [29142]: info: do_pe_invoke: Query 113: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:00 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=113, ref=pe_calc-dc-1328842680-174, seq=20, quorate=1
Feb  9 21:58:00 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:00 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:00 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:00 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:00 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:00 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:00 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:00 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:00 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:00 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:00 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:00 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:00 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:00 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:00 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:00 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:00 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:00 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:00 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:00 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:00 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:00 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:00 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:00 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:00 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:00 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:00 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:00 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:00 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 18: 21 actions in 21 synapses
Feb  9 21:58:00 failover1 pengine: [29141]: info: process_pe_message: Transition 18: PEngine Input stored in: /var/lib/pengine/pe-input-2777.bz2
Feb  9 21:58:00 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 18 (ref=pe_calc-dc-1328842680-174) derived from /var/lib/pengine/pe-input-2777.bz2
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:00 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:00 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:18:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:00 failover1 lrmd: [29139]: info: rsc:drbd:1:68: notify
Feb  9 21:58:01 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=68, rc=0, cib-update=114, confirmed=true) ok
Feb  9 21:58:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:01 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:18:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:01 failover1 lrmd: [29139]: info: rsc:drbd:1:69: notify
Feb  9 21:58:01 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:01 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=69, rc=0, cib-update=115, confirmed=true) ok
Feb  9 21:58:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:01 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:18:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:01 failover1 lrmd: [29139]: info: rsc:drbd:1:70: notify
Feb  9 21:58:01 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:01 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=70, rc=0, cib-update=116, confirmed=true) ok
Feb  9 21:58:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:01 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:18:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:01 failover1 lrmd: [29139]: info: rsc:drbd:1:71: notify
Feb  9 21:58:01 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:01 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=71, rc=0, cib-update=117, confirmed=true) ok
Feb  9 21:58:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:01 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.194) : Transient attribute: update
Feb  9 21:58:01 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:01 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:01 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.197) : Transient attribute: update
Feb  9 21:58:02 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.198) : Transient attribute: removal
Feb  9 21:58:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:02 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:02 failover1 crmd: [29142]: notice: run_graph: Transition 18 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2777.bz2): Complete
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_graph_trigger: Transition 18 is now complete
Feb  9 21:58:02 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:02 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:02 failover1 crmd: [29142]: info: do_pe_invoke: Query 118: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:02 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=118, ref=pe_calc-dc-1328842682-184, seq=20, quorate=1
Feb  9 21:58:02 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:02 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:02 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:02 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:02 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:02 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:02 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:02 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:02 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:02 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:02 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:02 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:02 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:02 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:02 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:02 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:02 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:02 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:02 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:02 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:02 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:02 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:02 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 19: 21 actions in 21 synapses
Feb  9 21:58:02 failover1 pengine: [29141]: info: process_pe_message: Transition 19: PEngine Input stored in: /var/lib/pengine/pe-input-2778.bz2
Feb  9 21:58:02 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 19 (ref=pe_calc-dc-1328842682-184) derived from /var/lib/pengine/pe-input-2778.bz2
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:02 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:19:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:02 failover1 lrmd: [29139]: info: rsc:drbd:1:72: notify
Feb  9 21:58:02 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=72, rc=0, cib-update=119, confirmed=true) ok
Feb  9 21:58:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:02 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:19:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:02 failover1 lrmd: [29139]: info: rsc:drbd:1:73: notify
Feb  9 21:58:02 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:02 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=73, rc=0, cib-update=120, confirmed=true) ok
Feb  9 21:58:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:02 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:19:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:02 failover1 lrmd: [29139]: info: rsc:drbd:1:74: notify
Feb  9 21:58:02 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:02 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=74, rc=0, cib-update=121, confirmed=true) ok
Feb  9 21:58:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:02 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:19:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:02 failover1 lrmd: [29139]: info: rsc:drbd:1:75: notify
Feb  9 21:58:02 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:02 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=75, rc=0, cib-update=122, confirmed=true) ok
Feb  9 21:58:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:02 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.206) : Transient attribute: update
Feb  9 21:58:02 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:02 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:03 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.209) : Transient attribute: update
Feb  9 21:58:03 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.210) : Transient attribute: removal
Feb  9 21:58:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:03 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:03 failover1 crmd: [29142]: notice: run_graph: Transition 19 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2778.bz2): Complete
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_graph_trigger: Transition 19 is now complete
Feb  9 21:58:03 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:03 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:03 failover1 crmd: [29142]: info: do_pe_invoke: Query 123: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:03 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=123, ref=pe_calc-dc-1328842683-194, seq=20, quorate=1
Feb  9 21:58:03 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:03 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:03 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:03 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:03 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:03 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:03 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:03 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:03 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:03 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:03 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:03 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:03 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:03 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:03 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:03 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:03 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:03 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:03 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:03 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:03 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:03 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:03 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:03 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:03 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:03 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:03 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:03 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:03 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 20: 21 actions in 21 synapses
Feb  9 21:58:03 failover1 pengine: [29141]: info: process_pe_message: Transition 20: PEngine Input stored in: /var/lib/pengine/pe-input-2779.bz2
Feb  9 21:58:03 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 20 (ref=pe_calc-dc-1328842683-194) derived from /var/lib/pengine/pe-input-2779.bz2
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:03 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:20:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:03 failover1 lrmd: [29139]: info: rsc:drbd:1:76: notify
Feb  9 21:58:03 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=76, rc=0, cib-update=124, confirmed=true) ok
Feb  9 21:58:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:03 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:20:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:03 failover1 lrmd: [29139]: info: rsc:drbd:1:77: notify
Feb  9 21:58:03 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:03 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=77, rc=0, cib-update=125, confirmed=true) ok
Feb  9 21:58:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:03 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:20:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:03 failover1 lrmd: [29139]: info: rsc:drbd:1:78: notify
Feb  9 21:58:03 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:03 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=78, rc=0, cib-update=126, confirmed=true) ok
Feb  9 21:58:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:03 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:20:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:03 failover1 lrmd: [29139]: info: rsc:drbd:1:79: notify
Feb  9 21:58:03 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:03 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=79, rc=0, cib-update=127, confirmed=true) ok
Feb  9 21:58:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:03 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.218) : Transient attribute: update
Feb  9 21:58:03 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:03 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:04 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.221) : Transient attribute: update
Feb  9 21:58:04 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.222) : Transient attribute: removal
Feb  9 21:58:04 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:04 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:04 failover1 crmd: [29142]: notice: run_graph: Transition 20 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2779.bz2): Complete
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_graph_trigger: Transition 20 is now complete
Feb  9 21:58:04 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:04 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:04 failover1 crmd: [29142]: info: do_pe_invoke: Query 128: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:04 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=128, ref=pe_calc-dc-1328842684-204, seq=20, quorate=1
Feb  9 21:58:04 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:04 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:04 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:04 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:04 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:04 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:04 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:04 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:04 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:04 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:04 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:04 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:04 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:04 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:04 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:04 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:04 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:04 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:04 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:04 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:04 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:04 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:04 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:04 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:04 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:04 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:04 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:04 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:04 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 21: 21 actions in 21 synapses
Feb  9 21:58:04 failover1 pengine: [29141]: info: process_pe_message: Transition 21: PEngine Input stored in: /var/lib/pengine/pe-input-2780.bz2
Feb  9 21:58:04 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 21 (ref=pe_calc-dc-1328842684-204) derived from /var/lib/pengine/pe-input-2780.bz2
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:04 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:21:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:04 failover1 lrmd: [29139]: info: rsc:drbd:1:80: notify
Feb  9 21:58:04 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=80, rc=0, cib-update=129, confirmed=true) ok
Feb  9 21:58:04 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:04 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:21:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:04 failover1 lrmd: [29139]: info: rsc:drbd:1:81: notify
Feb  9 21:58:04 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:04 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=81, rc=0, cib-update=130, confirmed=true) ok
Feb  9 21:58:04 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:04 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:21:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:04 failover1 lrmd: [29139]: info: rsc:drbd:1:82: notify
Feb  9 21:58:04 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:04 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=82, rc=0, cib-update=131, confirmed=true) ok
Feb  9 21:58:04 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:04 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:04 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:21:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:04 failover1 lrmd: [29139]: info: rsc:drbd:1:83: notify
Feb  9 21:58:04 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:04 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=83, rc=0, cib-update=132, confirmed=true) ok
Feb  9 21:58:04 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:04 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:04 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:04 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.230) : Transient attribute: update
Feb  9 21:58:04 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:04 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:04 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:04 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:05 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.233) : Transient attribute: update
Feb  9 21:58:05 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.234) : Transient attribute: removal
Feb  9 21:58:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:05 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:05 failover1 crmd: [29142]: notice: run_graph: Transition 21 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2780.bz2): Complete
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_graph_trigger: Transition 21 is now complete
Feb  9 21:58:05 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:05 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:05 failover1 crmd: [29142]: info: do_pe_invoke: Query 133: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:05 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=133, ref=pe_calc-dc-1328842685-214, seq=20, quorate=1
Feb  9 21:58:05 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:05 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:05 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:05 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:05 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:05 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:05 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:05 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:05 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:05 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:05 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:05 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:05 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:05 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:05 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:05 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:05 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:05 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:05 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:05 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:05 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:05 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:05 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 22: 21 actions in 21 synapses
Feb  9 21:58:05 failover1 pengine: [29141]: info: process_pe_message: Transition 22: PEngine Input stored in: /var/lib/pengine/pe-input-2781.bz2
Feb  9 21:58:05 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 22 (ref=pe_calc-dc-1328842685-214) derived from /var/lib/pengine/pe-input-2781.bz2
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:05 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:22:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:05 failover1 lrmd: [29139]: info: rsc:drbd:1:84: notify
Feb  9 21:58:05 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=84, rc=0, cib-update=134, confirmed=true) ok
Feb  9 21:58:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:05 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:22:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:05 failover1 lrmd: [29139]: info: rsc:drbd:1:85: notify
Feb  9 21:58:05 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:05 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=85, rc=0, cib-update=135, confirmed=true) ok
Feb  9 21:58:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:05 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:22:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:05 failover1 lrmd: [29139]: info: rsc:drbd:1:86: notify
Feb  9 21:58:05 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:05 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=86, rc=0, cib-update=136, confirmed=true) ok
Feb  9 21:58:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:05 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:22:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:05 failover1 lrmd: [29139]: info: rsc:drbd:1:87: notify
Feb  9 21:58:05 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:05 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=87, rc=0, cib-update=137, confirmed=true) ok
Feb  9 21:58:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:05 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.242) : Transient attribute: update
Feb  9 21:58:05 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:05 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:06 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:08 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.245) : Transient attribute: update
Feb  9 21:58:08 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.246) : Transient attribute: removal
Feb  9 21:58:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:08 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:08 failover1 crmd: [29142]: notice: run_graph: Transition 22 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2781.bz2): Complete
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_graph_trigger: Transition 22 is now complete
Feb  9 21:58:08 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:08 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:08 failover1 crmd: [29142]: info: do_pe_invoke: Query 138: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:08 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=138, ref=pe_calc-dc-1328842688-224, seq=20, quorate=1
Feb  9 21:58:08 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:08 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:08 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:08 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:08 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:08 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:08 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:08 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:08 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:08 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:08 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:08 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:08 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:08 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:08 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:08 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:08 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:08 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:08 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:08 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:08 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:08 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:08 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 23: 21 actions in 21 synapses
Feb  9 21:58:08 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 23 (ref=pe_calc-dc-1328842688-224) derived from /var/lib/pengine/pe-input-2782.bz2
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:08 failover1 pengine: [29141]: info: process_pe_message: Transition 23: PEngine Input stored in: /var/lib/pengine/pe-input-2782.bz2
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:08 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:23:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:08 failover1 lrmd: [29139]: info: rsc:drbd:1:88: notify
Feb  9 21:58:08 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=88, rc=0, cib-update=139, confirmed=true) ok
Feb  9 21:58:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:08 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:23:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:08 failover1 lrmd: [29139]: info: rsc:drbd:1:89: notify
Feb  9 21:58:08 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:08 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=89, rc=0, cib-update=140, confirmed=true) ok
Feb  9 21:58:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:08 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:23:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:08 failover1 lrmd: [29139]: info: rsc:drbd:1:90: notify
Feb  9 21:58:08 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:08 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=90, rc=0, cib-update=141, confirmed=true) ok
Feb  9 21:58:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:08 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:23:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:08 failover1 lrmd: [29139]: info: rsc:drbd:1:91: notify
Feb  9 21:58:08 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:08 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=91, rc=0, cib-update=142, confirmed=true) ok
Feb  9 21:58:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:08 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.254) : Transient attribute: update
Feb  9 21:58:08 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:08 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:09 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.257) : Transient attribute: update
Feb  9 21:58:09 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.258) : Transient attribute: removal
Feb  9 21:58:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:09 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:09 failover1 crmd: [29142]: notice: run_graph: Transition 23 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2782.bz2): Complete
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_graph_trigger: Transition 23 is now complete
Feb  9 21:58:09 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:09 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:09 failover1 crmd: [29142]: info: do_pe_invoke: Query 143: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:09 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=143, ref=pe_calc-dc-1328842689-234, seq=20, quorate=1
Feb  9 21:58:09 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:09 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:09 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:09 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:09 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:09 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:09 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:09 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:09 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:09 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:09 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:09 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:09 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:09 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:09 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:09 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:09 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:09 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:09 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:09 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:09 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:09 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:09 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 24: 21 actions in 21 synapses
Feb  9 21:58:09 failover1 pengine: [29141]: info: process_pe_message: Transition 24: PEngine Input stored in: /var/lib/pengine/pe-input-2783.bz2
Feb  9 21:58:09 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 24 (ref=pe_calc-dc-1328842689-234) derived from /var/lib/pengine/pe-input-2783.bz2
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:09 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:24:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:09 failover1 lrmd: [29139]: info: rsc:drbd:1:92: notify
Feb  9 21:58:09 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=92, rc=0, cib-update=144, confirmed=true) ok
Feb  9 21:58:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:09 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:24:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:09 failover1 lrmd: [29139]: info: rsc:drbd:1:93: notify
Feb  9 21:58:09 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:09 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=93, rc=0, cib-update=145, confirmed=true) ok
Feb  9 21:58:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:09 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:24:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:09 failover1 lrmd: [29139]: info: rsc:drbd:1:94: notify
Feb  9 21:58:09 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:09 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=94, rc=0, cib-update=146, confirmed=true) ok
Feb  9 21:58:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:09 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:24:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:09 failover1 lrmd: [29139]: info: rsc:drbd:1:95: notify
Feb  9 21:58:09 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:09 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=95, rc=0, cib-update=147, confirmed=true) ok
Feb  9 21:58:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:09 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.266) : Transient attribute: update
Feb  9 21:58:09 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:09 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:10 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.269) : Transient attribute: update
Feb  9 21:58:10 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.270) : Transient attribute: removal
Feb  9 21:58:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:10 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:10 failover1 crmd: [29142]: notice: run_graph: Transition 24 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2783.bz2): Complete
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_graph_trigger: Transition 24 is now complete
Feb  9 21:58:10 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:10 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:10 failover1 crmd: [29142]: info: do_pe_invoke: Query 148: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:10 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=148, ref=pe_calc-dc-1328842690-244, seq=20, quorate=1
Feb  9 21:58:10 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:10 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:10 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:10 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:10 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:10 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:10 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:10 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:10 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:10 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:10 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:10 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:10 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:10 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:10 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:10 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:10 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:10 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:10 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:10 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:10 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:10 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:10 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 25: 21 actions in 21 synapses
Feb  9 21:58:10 failover1 pengine: [29141]: info: process_pe_message: Transition 25: PEngine Input stored in: /var/lib/pengine/pe-input-2784.bz2
Feb  9 21:58:10 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 25 (ref=pe_calc-dc-1328842690-244) derived from /var/lib/pengine/pe-input-2784.bz2
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:10 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:25:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:10 failover1 lrmd: [29139]: info: rsc:drbd:1:96: notify
Feb  9 21:58:10 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=96, rc=0, cib-update=149, confirmed=true) ok
Feb  9 21:58:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:10 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:25:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:10 failover1 lrmd: [29139]: info: rsc:drbd:1:97: notify
Feb  9 21:58:10 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:10 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=97, rc=0, cib-update=150, confirmed=true) ok
Feb  9 21:58:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:10 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:25:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:10 failover1 lrmd: [29139]: info: rsc:drbd:1:98: notify
Feb  9 21:58:10 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:10 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=98, rc=0, cib-update=151, confirmed=true) ok
Feb  9 21:58:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:10 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:25:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:10 failover1 lrmd: [29139]: info: rsc:drbd:1:99: notify
Feb  9 21:58:10 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:10 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=99, rc=0, cib-update=152, confirmed=true) ok
Feb  9 21:58:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:11 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.278) : Transient attribute: update
Feb  9 21:58:11 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:11 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:11 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.281) : Transient attribute: update
Feb  9 21:58:11 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.282) : Transient attribute: removal
Feb  9 21:58:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:11 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:11 failover1 crmd: [29142]: notice: run_graph: Transition 25 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2784.bz2): Complete
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_graph_trigger: Transition 25 is now complete
Feb  9 21:58:11 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:11 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:11 failover1 crmd: [29142]: info: do_pe_invoke: Query 153: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:11 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=153, ref=pe_calc-dc-1328842691-254, seq=20, quorate=1
Feb  9 21:58:11 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:11 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:11 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:11 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:11 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:11 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:11 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:11 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:11 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:11 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:11 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:11 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:11 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:11 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:11 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:11 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:11 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:11 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:11 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:11 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:11 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:11 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:11 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 26: 21 actions in 21 synapses
Feb  9 21:58:11 failover1 pengine: [29141]: info: process_pe_message: Transition 26: PEngine Input stored in: /var/lib/pengine/pe-input-2785.bz2
Feb  9 21:58:11 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 26 (ref=pe_calc-dc-1328842691-254) derived from /var/lib/pengine/pe-input-2785.bz2
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:11 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:26:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:11 failover1 lrmd: [29139]: info: rsc:drbd:1:100: notify
Feb  9 21:58:11 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=100, rc=0, cib-update=154, confirmed=true) ok
Feb  9 21:58:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:11 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:26:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:11 failover1 lrmd: [29139]: info: rsc:drbd:1:101: notify
Feb  9 21:58:11 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:11 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=101, rc=0, cib-update=155, confirmed=true) ok
Feb  9 21:58:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:11 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:26:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:11 failover1 lrmd: [29139]: info: rsc:drbd:1:102: notify
Feb  9 21:58:11 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:11 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=102, rc=0, cib-update=156, confirmed=true) ok
Feb  9 21:58:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:11 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:26:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:11 failover1 lrmd: [29139]: info: rsc:drbd:1:103: notify
Feb  9 21:58:11 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:11 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=103, rc=0, cib-update=157, confirmed=true) ok
Feb  9 21:58:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:12 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.290) : Transient attribute: update
Feb  9 21:58:12 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:12 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:12 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.293) : Transient attribute: update
Feb  9 21:58:12 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.294) : Transient attribute: removal
Feb  9 21:58:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:12 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:12 failover1 crmd: [29142]: notice: run_graph: Transition 26 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2785.bz2): Complete
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_graph_trigger: Transition 26 is now complete
Feb  9 21:58:12 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:12 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:12 failover1 crmd: [29142]: info: do_pe_invoke: Query 158: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:12 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=158, ref=pe_calc-dc-1328842692-264, seq=20, quorate=1
Feb  9 21:58:12 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:12 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:12 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:12 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:12 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:12 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:12 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:12 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:12 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:12 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:12 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:12 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:12 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:12 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:12 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:12 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:12 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:12 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:12 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:12 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:12 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:12 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:12 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 27: 21 actions in 21 synapses
Feb  9 21:58:12 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 27 (ref=pe_calc-dc-1328842692-264) derived from /var/lib/pengine/pe-input-2786.bz2
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:12 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:27:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:12 failover1 lrmd: [29139]: info: rsc:drbd:1:104: notify
Feb  9 21:58:12 failover1 pengine: [29141]: info: process_pe_message: Transition 27: PEngine Input stored in: /var/lib/pengine/pe-input-2786.bz2
Feb  9 21:58:12 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=104, rc=0, cib-update=159, confirmed=true) ok
Feb  9 21:58:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:12 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:27:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:12 failover1 lrmd: [29139]: info: rsc:drbd:1:105: notify
Feb  9 21:58:12 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:12 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=105, rc=0, cib-update=160, confirmed=true) ok
Feb  9 21:58:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:12 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:27:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:12 failover1 lrmd: [29139]: info: rsc:drbd:1:106: notify
Feb  9 21:58:12 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:12 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=106, rc=0, cib-update=161, confirmed=true) ok
Feb  9 21:58:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:12 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:27:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:12 failover1 lrmd: [29139]: info: rsc:drbd:1:107: notify
Feb  9 21:58:12 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:12 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=107, rc=0, cib-update=162, confirmed=true) ok
Feb  9 21:58:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:13 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.302) : Transient attribute: update
Feb  9 21:58:13 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:13 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:15 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.305) : Transient attribute: update
Feb  9 21:58:15 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.306) : Transient attribute: removal
Feb  9 21:58:15 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:15 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:15 failover1 crmd: [29142]: notice: run_graph: Transition 27 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2786.bz2): Complete
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_graph_trigger: Transition 27 is now complete
Feb  9 21:58:15 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:15 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:15 failover1 crmd: [29142]: info: do_pe_invoke: Query 163: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:15 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=163, ref=pe_calc-dc-1328842695-274, seq=20, quorate=1
Feb  9 21:58:15 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:15 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:15 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:15 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:15 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:15 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:15 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:15 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:15 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:15 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:15 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:15 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:15 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:15 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:15 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:15 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:15 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:15 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:15 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:15 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:15 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:15 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:15 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:15 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:15 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:15 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:15 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:15 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:15 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 28: 21 actions in 21 synapses
Feb  9 21:58:15 failover1 pengine: [29141]: info: process_pe_message: Transition 28: PEngine Input stored in: /var/lib/pengine/pe-input-2787.bz2
Feb  9 21:58:15 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 28 (ref=pe_calc-dc-1328842695-274) derived from /var/lib/pengine/pe-input-2787.bz2
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:15 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:28:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:15 failover1 lrmd: [29139]: info: rsc:drbd:1:108: notify
Feb  9 21:58:15 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=108, rc=0, cib-update=164, confirmed=true) ok
Feb  9 21:58:15 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:15 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:28:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:15 failover1 lrmd: [29139]: info: rsc:drbd:1:109: notify
Feb  9 21:58:15 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:15 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=109, rc=0, cib-update=165, confirmed=true) ok
Feb  9 21:58:15 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:15 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:28:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:15 failover1 lrmd: [29139]: info: rsc:drbd:1:110: notify
Feb  9 21:58:15 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:15 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=110, rc=0, cib-update=166, confirmed=true) ok
Feb  9 21:58:15 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:15 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:15 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:28:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:15 failover1 lrmd: [29139]: info: rsc:drbd:1:111: notify
Feb  9 21:58:15 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:15 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=111, rc=0, cib-update=167, confirmed=true) ok
Feb  9 21:58:15 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:15 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:15 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:16 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.314) : Transient attribute: update
Feb  9 21:58:16 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:16 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:16 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:16 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:16 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.317) : Transient attribute: update
Feb  9 21:58:16 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.318) : Transient attribute: removal
Feb  9 21:58:16 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:16 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:16 failover1 crmd: [29142]: notice: run_graph: Transition 28 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2787.bz2): Complete
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_graph_trigger: Transition 28 is now complete
Feb  9 21:58:16 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:16 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:16 failover1 crmd: [29142]: info: do_pe_invoke: Query 168: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:16 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=168, ref=pe_calc-dc-1328842696-284, seq=20, quorate=1
Feb  9 21:58:16 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:16 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:16 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:16 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:16 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:16 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:16 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:16 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:16 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:16 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:16 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:16 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:16 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:16 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:16 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:16 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:16 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:16 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:16 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:16 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:16 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:16 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:16 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 29: 21 actions in 21 synapses
Feb  9 21:58:16 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 29 (ref=pe_calc-dc-1328842696-284) derived from /var/lib/pengine/pe-input-2788.bz2
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:16 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:29:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:16 failover1 pengine: [29141]: info: process_pe_message: Transition 29: PEngine Input stored in: /var/lib/pengine/pe-input-2788.bz2
Feb  9 21:58:16 failover1 lrmd: [29139]: info: rsc:drbd:1:112: notify
Feb  9 21:58:16 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=112, rc=0, cib-update=169, confirmed=true) ok
Feb  9 21:58:16 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:16 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:29:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:16 failover1 lrmd: [29139]: info: rsc:drbd:1:113: notify
Feb  9 21:58:16 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:16 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=113, rc=0, cib-update=170, confirmed=true) ok
Feb  9 21:58:16 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:16 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:29:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:16 failover1 lrmd: [29139]: info: rsc:drbd:1:114: notify
Feb  9 21:58:16 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:16 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=114, rc=0, cib-update=171, confirmed=true) ok
Feb  9 21:58:16 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:16 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:16 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:16 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:29:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:16 failover1 lrmd: [29139]: info: rsc:drbd:1:115: notify
Feb  9 21:58:17 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:17 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=115, rc=0, cib-update=172, confirmed=true) ok
Feb  9 21:58:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:17 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.326) : Transient attribute: update
Feb  9 21:58:17 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:17 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:17 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.329) : Transient attribute: update
Feb  9 21:58:17 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.330) : Transient attribute: removal
Feb  9 21:58:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:17 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:17 failover1 crmd: [29142]: notice: run_graph: Transition 29 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2788.bz2): Complete
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_graph_trigger: Transition 29 is now complete
Feb  9 21:58:17 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:17 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:17 failover1 crmd: [29142]: info: do_pe_invoke: Query 173: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:17 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=173, ref=pe_calc-dc-1328842697-294, seq=20, quorate=1
Feb  9 21:58:17 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:17 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:17 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:17 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:17 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:17 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:17 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:17 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:17 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:17 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:17 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:17 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:17 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:17 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:17 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:17 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:17 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:17 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:17 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:17 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:17 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:17 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:17 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 30: 21 actions in 21 synapses
Feb  9 21:58:17 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 30 (ref=pe_calc-dc-1328842697-294) derived from /var/lib/pengine/pe-input-2789.bz2
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:17 failover1 pengine: [29141]: info: process_pe_message: Transition 30: PEngine Input stored in: /var/lib/pengine/pe-input-2789.bz2
Feb  9 21:58:17 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:30:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:17 failover1 lrmd: [29139]: info: rsc:drbd:1:116: notify
Feb  9 21:58:17 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=116, rc=0, cib-update=174, confirmed=true) ok
Feb  9 21:58:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:17 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:30:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:17 failover1 lrmd: [29139]: info: rsc:drbd:1:117: notify
Feb  9 21:58:17 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:17 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=117, rc=0, cib-update=175, confirmed=true) ok
Feb  9 21:58:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:17 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:30:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:17 failover1 lrmd: [29139]: info: rsc:drbd:1:118: notify
Feb  9 21:58:17 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:17 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=118, rc=0, cib-update=176, confirmed=true) ok
Feb  9 21:58:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:17 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:30:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:17 failover1 lrmd: [29139]: info: rsc:drbd:1:119: notify
Feb  9 21:58:17 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:17 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=119, rc=0, cib-update=177, confirmed=true) ok
Feb  9 21:58:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:18 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:18 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:18 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:18 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:18 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:18 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.338) : Transient attribute: update
Feb  9 21:58:18 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:18 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:18 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:18 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:20 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.341) : Transient attribute: update
Feb  9 21:58:20 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.342) : Transient attribute: removal
Feb  9 21:58:20 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:20 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:20 failover1 crmd: [29142]: notice: run_graph: Transition 30 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2789.bz2): Complete
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_graph_trigger: Transition 30 is now complete
Feb  9 21:58:20 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:20 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:20 failover1 crmd: [29142]: info: do_pe_invoke: Query 178: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:20 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=178, ref=pe_calc-dc-1328842700-304, seq=20, quorate=1
Feb  9 21:58:20 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:20 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:20 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:20 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:20 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:20 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:20 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:20 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:20 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:20 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:20 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:20 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:20 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:20 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:20 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:20 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:20 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:20 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:20 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:20 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:20 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:20 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:20 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 31: 21 actions in 21 synapses
Feb  9 21:58:20 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 31 (ref=pe_calc-dc-1328842700-304) derived from /var/lib/pengine/pe-input-2790.bz2
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:20 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:31:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:20 failover1 lrmd: [29139]: info: rsc:drbd:1:120: notify
Feb  9 21:58:20 failover1 pengine: [29141]: info: process_pe_message: Transition 31: PEngine Input stored in: /var/lib/pengine/pe-input-2790.bz2
Feb  9 21:58:20 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=120, rc=0, cib-update=179, confirmed=true) ok
Feb  9 21:58:20 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:20 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:31:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:20 failover1 lrmd: [29139]: info: rsc:drbd:1:121: notify
Feb  9 21:58:20 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:20 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=121, rc=0, cib-update=180, confirmed=true) ok
Feb  9 21:58:20 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:20 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:31:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:20 failover1 lrmd: [29139]: info: rsc:drbd:1:122: notify
Feb  9 21:58:20 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:20 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=122, rc=0, cib-update=181, confirmed=true) ok
Feb  9 21:58:20 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:20 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:20 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:20 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:31:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:20 failover1 lrmd: [29139]: info: rsc:drbd:1:123: notify
Feb  9 21:58:20 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:20 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=123, rc=0, cib-update=182, confirmed=true) ok
Feb  9 21:58:20 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:21 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.350) : Transient attribute: update
Feb  9 21:58:21 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:21 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:21 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.353) : Transient attribute: update
Feb  9 21:58:21 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.354) : Transient attribute: removal
Feb  9 21:58:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:21 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:21 failover1 crmd: [29142]: notice: run_graph: Transition 31 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2790.bz2): Complete
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_graph_trigger: Transition 31 is now complete
Feb  9 21:58:21 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:21 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:21 failover1 crmd: [29142]: info: do_pe_invoke: Query 183: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:21 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=183, ref=pe_calc-dc-1328842701-314, seq=20, quorate=1
Feb  9 21:58:21 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:21 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:21 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:21 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:21 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:21 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:21 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:21 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:21 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:21 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:21 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:21 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:21 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:21 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:21 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:21 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:21 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:21 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:21 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:21 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:21 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:21 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:21 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:21 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:21 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:21 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:21 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:21 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:21 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 32: 21 actions in 21 synapses
Feb  9 21:58:21 failover1 pengine: [29141]: info: process_pe_message: Transition 32: PEngine Input stored in: /var/lib/pengine/pe-input-2791.bz2
Feb  9 21:58:21 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 32 (ref=pe_calc-dc-1328842701-314) derived from /var/lib/pengine/pe-input-2791.bz2
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:21 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:32:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:21 failover1 lrmd: [29139]: info: rsc:drbd:1:124: notify
Feb  9 21:58:21 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=124, rc=0, cib-update=184, confirmed=true) ok
Feb  9 21:58:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:21 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:32:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:21 failover1 lrmd: [29139]: info: rsc:drbd:1:125: notify
Feb  9 21:58:21 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:21 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=125, rc=0, cib-update=185, confirmed=true) ok
Feb  9 21:58:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:21 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:32:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:21 failover1 lrmd: [29139]: info: rsc:drbd:1:126: notify
Feb  9 21:58:21 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:21 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=126, rc=0, cib-update=186, confirmed=true) ok
Feb  9 21:58:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:21 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:32:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:21 failover1 lrmd: [29139]: info: rsc:drbd:1:127: notify
Feb  9 21:58:21 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:21 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=127, rc=0, cib-update=187, confirmed=true) ok
Feb  9 21:58:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:22 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:22 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.362) : Transient attribute: update
Feb  9 21:58:22 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:22 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:22 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:22 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:22 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.365) : Transient attribute: update
Feb  9 21:58:22 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.366) : Transient attribute: removal
Feb  9 21:58:22 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:22 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:22 failover1 crmd: [29142]: notice: run_graph: Transition 32 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2791.bz2): Complete
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_graph_trigger: Transition 32 is now complete
Feb  9 21:58:22 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:22 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:22 failover1 crmd: [29142]: info: do_pe_invoke: Query 188: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:22 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=188, ref=pe_calc-dc-1328842702-324, seq=20, quorate=1
Feb  9 21:58:22 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:22 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:22 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:22 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:22 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:22 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:22 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:22 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:22 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:22 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:22 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:22 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:22 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:22 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:22 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:22 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:22 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:22 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:22 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:22 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:22 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:22 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:22 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:22 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:22 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:22 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:22 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:22 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:22 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 33: 21 actions in 21 synapses
Feb  9 21:58:22 failover1 pengine: [29141]: info: process_pe_message: Transition 33: PEngine Input stored in: /var/lib/pengine/pe-input-2792.bz2
Feb  9 21:58:22 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 33 (ref=pe_calc-dc-1328842702-324) derived from /var/lib/pengine/pe-input-2792.bz2
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:22 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:33:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:22 failover1 lrmd: [29139]: info: rsc:drbd:1:128: notify
Feb  9 21:58:22 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=128, rc=0, cib-update=189, confirmed=true) ok
Feb  9 21:58:22 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:22 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:33:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:22 failover1 lrmd: [29139]: info: rsc:drbd:1:129: notify
Feb  9 21:58:22 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:22 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=129, rc=0, cib-update=190, confirmed=true) ok
Feb  9 21:58:22 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:22 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:33:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:22 failover1 lrmd: [29139]: info: rsc:drbd:1:130: notify
Feb  9 21:58:22 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:22 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=130, rc=0, cib-update=191, confirmed=true) ok
Feb  9 21:58:22 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:22 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:22 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:22 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:33:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:22 failover1 lrmd: [29139]: info: rsc:drbd:1:131: notify
Feb  9 21:58:22 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:23 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=131, rc=0, cib-update=192, confirmed=true) ok
Feb  9 21:58:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:23 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.374) : Transient attribute: update
Feb  9 21:58:23 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:23 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:23 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.377) : Transient attribute: update
Feb  9 21:58:23 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.378) : Transient attribute: removal
Feb  9 21:58:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:23 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:23 failover1 crmd: [29142]: notice: run_graph: Transition 33 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2792.bz2): Complete
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_graph_trigger: Transition 33 is now complete
Feb  9 21:58:23 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:23 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:23 failover1 crmd: [29142]: info: do_pe_invoke: Query 193: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:23 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=193, ref=pe_calc-dc-1328842703-334, seq=20, quorate=1
Feb  9 21:58:23 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:23 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:23 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:23 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:23 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:23 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:23 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:23 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:23 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:23 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:23 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:23 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:23 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:23 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:23 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:23 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:23 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:23 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:23 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:23 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:23 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:23 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:23 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 34: 21 actions in 21 synapses
Feb  9 21:58:23 failover1 pengine: [29141]: info: process_pe_message: Transition 34: PEngine Input stored in: /var/lib/pengine/pe-input-2793.bz2
Feb  9 21:58:23 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 34 (ref=pe_calc-dc-1328842703-334) derived from /var/lib/pengine/pe-input-2793.bz2
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:23 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:34:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:23 failover1 lrmd: [29139]: info: rsc:drbd:1:132: notify
Feb  9 21:58:23 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=132, rc=0, cib-update=194, confirmed=true) ok
Feb  9 21:58:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:23 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:34:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:23 failover1 lrmd: [29139]: info: rsc:drbd:1:133: notify
Feb  9 21:58:23 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:23 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=133, rc=0, cib-update=195, confirmed=true) ok
Feb  9 21:58:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:23 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:34:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:23 failover1 lrmd: [29139]: info: rsc:drbd:1:134: notify
Feb  9 21:58:23 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:23 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=134, rc=0, cib-update=196, confirmed=true) ok
Feb  9 21:58:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:23 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:34:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:23 failover1 lrmd: [29139]: info: rsc:drbd:1:135: notify
Feb  9 21:58:24 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:24 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=135, rc=0, cib-update=197, confirmed=true) ok
Feb  9 21:58:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:24 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.386) : Transient attribute: update
Feb  9 21:58:24 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:24 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:24 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.389) : Transient attribute: update
Feb  9 21:58:24 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.390) : Transient attribute: removal
Feb  9 21:58:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:24 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:24 failover1 crmd: [29142]: notice: run_graph: Transition 34 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2793.bz2): Complete
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_graph_trigger: Transition 34 is now complete
Feb  9 21:58:24 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:24 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:24 failover1 crmd: [29142]: info: do_pe_invoke: Query 198: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:24 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=198, ref=pe_calc-dc-1328842704-344, seq=20, quorate=1
Feb  9 21:58:24 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:24 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:24 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:24 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:24 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:24 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:24 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:24 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:24 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:24 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:24 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:24 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:24 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:24 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:24 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:24 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:24 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:24 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:24 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:24 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:24 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:24 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:24 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:24 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:24 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:24 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:24 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:24 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:24 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 35: 21 actions in 21 synapses
Feb  9 21:58:24 failover1 pengine: [29141]: info: process_pe_message: Transition 35: PEngine Input stored in: /var/lib/pengine/pe-input-2794.bz2
Feb  9 21:58:24 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 35 (ref=pe_calc-dc-1328842704-344) derived from /var/lib/pengine/pe-input-2794.bz2
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:24 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:35:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:24 failover1 lrmd: [29139]: info: rsc:drbd:1:136: notify
Feb  9 21:58:24 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=136, rc=0, cib-update=199, confirmed=true) ok
Feb  9 21:58:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:24 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:35:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:24 failover1 lrmd: [29139]: info: rsc:drbd:1:137: notify
Feb  9 21:58:24 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:24 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=137, rc=0, cib-update=200, confirmed=true) ok
Feb  9 21:58:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:24 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:35:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:24 failover1 lrmd: [29139]: info: rsc:drbd:1:138: notify
Feb  9 21:58:24 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:24 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=138, rc=0, cib-update=201, confirmed=true) ok
Feb  9 21:58:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:24 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:35:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:24 failover1 lrmd: [29139]: info: rsc:drbd:1:139: notify
Feb  9 21:58:25 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:25 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=139, rc=0, cib-update=202, confirmed=true) ok
Feb  9 21:58:25 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:25 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:25 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.398) : Transient attribute: update
Feb  9 21:58:25 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:25 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:25 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:25 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:25 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.401) : Transient attribute: update
Feb  9 21:58:25 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.402) : Transient attribute: removal
Feb  9 21:58:25 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:25 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:25 failover1 crmd: [29142]: notice: run_graph: Transition 35 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2794.bz2): Complete
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_graph_trigger: Transition 35 is now complete
Feb  9 21:58:25 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:25 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:25 failover1 crmd: [29142]: info: do_pe_invoke: Query 203: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:25 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=203, ref=pe_calc-dc-1328842705-354, seq=20, quorate=1
Feb  9 21:58:25 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:25 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:25 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:25 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:25 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:25 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:25 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:25 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:25 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:25 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:25 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:25 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:25 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:25 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:25 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:25 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:25 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:25 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:25 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:25 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:25 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:25 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:25 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:25 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:25 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:25 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:25 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:25 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:25 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 36: 21 actions in 21 synapses
Feb  9 21:58:25 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 36 (ref=pe_calc-dc-1328842705-354) derived from /var/lib/pengine/pe-input-2795.bz2
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:25 failover1 pengine: [29141]: info: process_pe_message: Transition 36: PEngine Input stored in: /var/lib/pengine/pe-input-2795.bz2
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:25 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:36:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:25 failover1 lrmd: [29139]: info: rsc:drbd:1:140: notify
Feb  9 21:58:25 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=140, rc=0, cib-update=204, confirmed=true) ok
Feb  9 21:58:25 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:25 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:36:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:25 failover1 lrmd: [29139]: info: rsc:drbd:1:141: notify
Feb  9 21:58:25 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:25 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=141, rc=0, cib-update=205, confirmed=true) ok
Feb  9 21:58:25 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:25 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:36:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:25 failover1 lrmd: [29139]: info: rsc:drbd:1:142: notify
Feb  9 21:58:25 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:25 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=142, rc=0, cib-update=206, confirmed=true) ok
Feb  9 21:58:25 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:25 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:25 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:25 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:36:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:25 failover1 lrmd: [29139]: info: rsc:drbd:1:143: notify
Feb  9 21:58:26 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:26 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=143, rc=0, cib-update=207, confirmed=true) ok
Feb  9 21:58:26 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:26 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:26 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.410) : Transient attribute: update
Feb  9 21:58:26 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:26 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:26 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:26 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:26 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.413) : Transient attribute: update
Feb  9 21:58:26 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.414) : Transient attribute: removal
Feb  9 21:58:26 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:26 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:26 failover1 crmd: [29142]: notice: run_graph: Transition 36 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2795.bz2): Complete
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_graph_trigger: Transition 36 is now complete
Feb  9 21:58:26 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:26 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:26 failover1 crmd: [29142]: info: do_pe_invoke: Query 208: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:26 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=208, ref=pe_calc-dc-1328842706-364, seq=20, quorate=1
Feb  9 21:58:26 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:26 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:26 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:26 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:26 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:26 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:26 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:26 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:26 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:26 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:26 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:26 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:26 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:26 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:26 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:26 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:26 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:26 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:26 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:26 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:26 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:26 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:26 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:26 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:26 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:26 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:26 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:26 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:26 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 37: 21 actions in 21 synapses
Feb  9 21:58:26 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 37 (ref=pe_calc-dc-1328842706-364) derived from /var/lib/pengine/pe-input-2796.bz2
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:26 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:37:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:26 failover1 pengine: [29141]: info: process_pe_message: Transition 37: PEngine Input stored in: /var/lib/pengine/pe-input-2796.bz2
Feb  9 21:58:26 failover1 lrmd: [29139]: info: rsc:drbd:1:144: notify
Feb  9 21:58:26 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=144, rc=0, cib-update=209, confirmed=true) ok
Feb  9 21:58:26 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:26 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:37:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:26 failover1 lrmd: [29139]: info: rsc:drbd:1:145: notify
Feb  9 21:58:26 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:26 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=145, rc=0, cib-update=210, confirmed=true) ok
Feb  9 21:58:26 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:26 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:37:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:26 failover1 lrmd: [29139]: info: rsc:drbd:1:146: notify
Feb  9 21:58:26 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:26 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=146, rc=0, cib-update=211, confirmed=true) ok
Feb  9 21:58:26 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:26 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:27 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:27 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:37:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:27 failover1 lrmd: [29139]: info: rsc:drbd:1:147: notify
Feb  9 21:58:27 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:27 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=147, rc=0, cib-update=212, confirmed=true) ok
Feb  9 21:58:27 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:27 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:27 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.422) : Transient attribute: update
Feb  9 21:58:27 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:27 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:27 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:27 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:27 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.425) : Transient attribute: update
Feb  9 21:58:27 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.426) : Transient attribute: removal
Feb  9 21:58:27 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:27 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:27 failover1 crmd: [29142]: notice: run_graph: Transition 37 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2796.bz2): Complete
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_graph_trigger: Transition 37 is now complete
Feb  9 21:58:27 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:27 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:27 failover1 crmd: [29142]: info: do_pe_invoke: Query 213: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:27 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=213, ref=pe_calc-dc-1328842707-374, seq=20, quorate=1
Feb  9 21:58:27 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:27 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:27 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:27 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:27 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:27 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:27 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:27 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:27 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:27 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:27 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:27 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:27 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:27 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:27 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:27 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:27 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:27 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:27 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:27 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:27 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:27 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:27 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:27 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:27 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:27 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:27 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:27 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:27 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 38: 21 actions in 21 synapses
Feb  9 21:58:27 failover1 pengine: [29141]: info: process_pe_message: Transition 38: PEngine Input stored in: /var/lib/pengine/pe-input-2797.bz2
Feb  9 21:58:27 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 38 (ref=pe_calc-dc-1328842707-374) derived from /var/lib/pengine/pe-input-2797.bz2
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:27 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:38:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:27 failover1 lrmd: [29139]: info: rsc:drbd:1:148: notify
Feb  9 21:58:27 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=148, rc=0, cib-update=214, confirmed=true) ok
Feb  9 21:58:27 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:27 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:38:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:27 failover1 lrmd: [29139]: info: rsc:drbd:1:149: notify
Feb  9 21:58:27 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:27 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=149, rc=0, cib-update=215, confirmed=true) ok
Feb  9 21:58:27 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:27 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:38:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:27 failover1 lrmd: [29139]: info: rsc:drbd:1:150: notify
Feb  9 21:58:27 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:27 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=150, rc=0, cib-update=216, confirmed=true) ok
Feb  9 21:58:27 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:27 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:28 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:28 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:38:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:28 failover1 lrmd: [29139]: info: rsc:drbd:1:151: notify
Feb  9 21:58:28 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:28 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=151, rc=0, cib-update=217, confirmed=true) ok
Feb  9 21:58:28 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:28 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:28 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.434) : Transient attribute: update
Feb  9 21:58:28 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:28 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:28 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:28 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:28 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.437) : Transient attribute: update
Feb  9 21:58:28 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.438) : Transient attribute: removal
Feb  9 21:58:28 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:28 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:28 failover1 crmd: [29142]: notice: run_graph: Transition 38 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2797.bz2): Complete
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_graph_trigger: Transition 38 is now complete
Feb  9 21:58:28 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:28 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:28 failover1 crmd: [29142]: info: do_pe_invoke: Query 218: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:28 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=218, ref=pe_calc-dc-1328842708-384, seq=20, quorate=1
Feb  9 21:58:28 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:28 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:28 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:28 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:28 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:28 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:28 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:28 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:28 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:28 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:28 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:28 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:28 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:28 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:28 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:28 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:28 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:28 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:28 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:28 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:28 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:28 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:28 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:28 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:28 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:28 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:28 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:28 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:28 failover1 pengine: [29141]: info: process_pe_message: Transition 39: PEngine Input stored in: /var/lib/pengine/pe-input-2798.bz2
Feb  9 21:58:28 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 39: 21 actions in 21 synapses
Feb  9 21:58:28 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 39 (ref=pe_calc-dc-1328842708-384) derived from /var/lib/pengine/pe-input-2798.bz2
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:28 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:39:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:28 failover1 lrmd: [29139]: info: rsc:drbd:1:152: notify
Feb  9 21:58:28 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=152, rc=0, cib-update=219, confirmed=true) ok
Feb  9 21:58:28 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:28 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:39:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:28 failover1 lrmd: [29139]: info: rsc:drbd:1:153: notify
Feb  9 21:58:28 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:28 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=153, rc=0, cib-update=220, confirmed=true) ok
Feb  9 21:58:28 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:28 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:39:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:28 failover1 lrmd: [29139]: info: rsc:drbd:1:154: notify
Feb  9 21:58:28 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:28 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=154, rc=0, cib-update=221, confirmed=true) ok
Feb  9 21:58:28 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:28 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:29 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:29 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:39:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:29 failover1 lrmd: [29139]: info: rsc:drbd:1:155: notify
Feb  9 21:58:29 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:29 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=155, rc=0, cib-update=222, confirmed=true) ok
Feb  9 21:58:29 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:29 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:29 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.446) : Transient attribute: update
Feb  9 21:58:29 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:29 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:29 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:29 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:29 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.449) : Transient attribute: update
Feb  9 21:58:29 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.450) : Transient attribute: removal
Feb  9 21:58:29 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:29 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:29 failover1 crmd: [29142]: notice: run_graph: Transition 39 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2798.bz2): Complete
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_graph_trigger: Transition 39 is now complete
Feb  9 21:58:29 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:29 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:29 failover1 crmd: [29142]: info: do_pe_invoke: Query 223: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:29 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=223, ref=pe_calc-dc-1328842709-394, seq=20, quorate=1
Feb  9 21:58:29 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:29 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:29 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:29 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:29 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:29 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:29 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:29 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:29 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:29 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:29 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:29 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:29 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:29 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:29 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:29 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:29 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:29 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:29 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:29 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:29 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:29 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:29 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:29 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:29 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:29 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:29 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:29 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:29 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 40: 21 actions in 21 synapses
Feb  9 21:58:29 failover1 pengine: [29141]: info: process_pe_message: Transition 40: PEngine Input stored in: /var/lib/pengine/pe-input-2799.bz2
Feb  9 21:58:29 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 40 (ref=pe_calc-dc-1328842709-394) derived from /var/lib/pengine/pe-input-2799.bz2
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:29 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:40:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:29 failover1 lrmd: [29139]: info: rsc:drbd:1:156: notify
Feb  9 21:58:29 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=156, rc=0, cib-update=224, confirmed=true) ok
Feb  9 21:58:29 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:29 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:40:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:29 failover1 lrmd: [29139]: info: rsc:drbd:1:157: notify
Feb  9 21:58:29 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:29 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=157, rc=0, cib-update=225, confirmed=true) ok
Feb  9 21:58:29 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:29 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:40:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:29 failover1 lrmd: [29139]: info: rsc:drbd:1:158: notify
Feb  9 21:58:29 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:29 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=158, rc=0, cib-update=226, confirmed=true) ok
Feb  9 21:58:29 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:29 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:30 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:30 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:40:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:30 failover1 lrmd: [29139]: info: rsc:drbd:1:159: notify
Feb  9 21:58:30 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:30 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=159, rc=0, cib-update=227, confirmed=true) ok
Feb  9 21:58:30 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:30 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:30 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.458) : Transient attribute: update
Feb  9 21:58:30 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:30 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:30 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:30 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:30 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.461) : Transient attribute: update
Feb  9 21:58:30 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.462) : Transient attribute: removal
Feb  9 21:58:30 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:30 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:30 failover1 crmd: [29142]: notice: run_graph: Transition 40 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2799.bz2): Complete
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_graph_trigger: Transition 40 is now complete
Feb  9 21:58:30 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:30 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:30 failover1 crmd: [29142]: info: do_pe_invoke: Query 228: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:30 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=228, ref=pe_calc-dc-1328842710-404, seq=20, quorate=1
Feb  9 21:58:30 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:30 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:30 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:30 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:30 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:30 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:30 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:30 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:30 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:30 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:30 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:30 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:30 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:30 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:30 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:30 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:30 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:30 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:30 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:30 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:30 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:30 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:30 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:30 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:30 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:30 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:30 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:30 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:30 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 41: 21 actions in 21 synapses
Feb  9 21:58:30 failover1 pengine: [29141]: info: process_pe_message: Transition 41: PEngine Input stored in: /var/lib/pengine/pe-input-2800.bz2
Feb  9 21:58:30 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 41 (ref=pe_calc-dc-1328842710-404) derived from /var/lib/pengine/pe-input-2800.bz2
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:30 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:41:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:30 failover1 lrmd: [29139]: info: rsc:drbd:1:160: notify
Feb  9 21:58:30 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=160, rc=0, cib-update=229, confirmed=true) ok
Feb  9 21:58:30 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:30 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:41:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:30 failover1 lrmd: [29139]: info: rsc:drbd:1:161: notify
Feb  9 21:58:30 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:30 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=161, rc=0, cib-update=230, confirmed=true) ok
Feb  9 21:58:30 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:30 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:41:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:30 failover1 lrmd: [29139]: info: rsc:drbd:1:162: notify
Feb  9 21:58:30 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:30 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=162, rc=0, cib-update=231, confirmed=true) ok
Feb  9 21:58:30 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:30 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:31 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:31 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:31 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:31 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:31 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:31 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:41:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:31 failover1 lrmd: [29139]: info: rsc:drbd:1:163: notify
Feb  9 21:58:31 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:31 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=163, rc=0, cib-update=232, confirmed=true) ok
Feb  9 21:58:31 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:31 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:31 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:31 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:31 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:31 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:31 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.470) : Transient attribute: update
Feb  9 21:58:31 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:31 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:31 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:31 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:33 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.473) : Transient attribute: update
Feb  9 21:58:33 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.474) : Transient attribute: removal
Feb  9 21:58:33 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:33 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:33 failover1 crmd: [29142]: notice: run_graph: Transition 41 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2800.bz2): Complete
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_graph_trigger: Transition 41 is now complete
Feb  9 21:58:33 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:33 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:33 failover1 crmd: [29142]: info: do_pe_invoke: Query 233: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:33 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=233, ref=pe_calc-dc-1328842713-414, seq=20, quorate=1
Feb  9 21:58:33 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:33 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:33 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:33 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:33 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:33 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:33 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:33 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:33 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:33 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:33 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:33 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:33 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:33 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:33 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:33 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:33 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:33 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:33 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:33 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:33 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:33 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:33 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:33 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:33 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:33 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:33 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:33 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:33 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 42: 21 actions in 21 synapses
Feb  9 21:58:33 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 42 (ref=pe_calc-dc-1328842713-414) derived from /var/lib/pengine/pe-input-2801.bz2
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:33 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:42:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:33 failover1 lrmd: [29139]: info: rsc:drbd:1:164: notify
Feb  9 21:58:33 failover1 pengine: [29141]: info: process_pe_message: Transition 42: PEngine Input stored in: /var/lib/pengine/pe-input-2801.bz2
Feb  9 21:58:33 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=164, rc=0, cib-update=234, confirmed=true) ok
Feb  9 21:58:33 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:33 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:42:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:33 failover1 lrmd: [29139]: info: rsc:drbd:1:165: notify
Feb  9 21:58:33 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:33 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=165, rc=0, cib-update=235, confirmed=true) ok
Feb  9 21:58:33 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:33 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:42:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:33 failover1 lrmd: [29139]: info: rsc:drbd:1:166: notify
Feb  9 21:58:33 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:33 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=166, rc=0, cib-update=236, confirmed=true) ok
Feb  9 21:58:33 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:33 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:34 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:42:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:34 failover1 lrmd: [29139]: info: rsc:drbd:1:167: notify
Feb  9 21:58:34 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:34 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=167, rc=0, cib-update=237, confirmed=true) ok
Feb  9 21:58:34 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:34 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:34 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.482) : Transient attribute: update
Feb  9 21:58:34 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:34 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:34 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:34 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:34 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.485) : Transient attribute: update
Feb  9 21:58:34 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.486) : Transient attribute: removal
Feb  9 21:58:34 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:34 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:34 failover1 crmd: [29142]: notice: run_graph: Transition 42 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2801.bz2): Complete
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_graph_trigger: Transition 42 is now complete
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_pe_invoke: Query 238: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=238, ref=pe_calc-dc-1328842714-424, seq=20, quorate=1
Feb  9 21:58:34 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:34 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:34 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:34 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:34 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:34 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:34 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:34 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:34 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:34 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:34 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:34 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:34 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:34 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:34 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:34 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:34 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:34 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:34 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:34 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:34 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:34 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:34 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:34 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:34 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:34 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:34 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:34 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 43: 21 actions in 21 synapses
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 43 (ref=pe_calc-dc-1328842714-424) derived from /var/lib/pengine/pe-input-2802.bz2
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:34 failover1 pengine: [29141]: info: process_pe_message: Transition 43: PEngine Input stored in: /var/lib/pengine/pe-input-2802.bz2
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:43:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:34 failover1 lrmd: [29139]: info: rsc:drbd:1:168: notify
Feb  9 21:58:34 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=168, rc=0, cib-update=239, confirmed=true) ok
Feb  9 21:58:34 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:43:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:34 failover1 lrmd: [29139]: info: rsc:drbd:1:169: notify
Feb  9 21:58:34 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:34 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=169, rc=0, cib-update=240, confirmed=true) ok
Feb  9 21:58:34 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:43:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:34 failover1 lrmd: [29139]: info: rsc:drbd:1:170: notify
Feb  9 21:58:34 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:34 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=170, rc=0, cib-update=241, confirmed=true) ok
Feb  9 21:58:34 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:34 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:34 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:34 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:43:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:34 failover1 lrmd: [29139]: info: rsc:drbd:1:171: notify
Feb  9 21:58:35 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:35 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=171, rc=0, cib-update=242, confirmed=true) ok
Feb  9 21:58:35 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:35 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:35 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:35 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:35 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:35 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:35 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.494) : Transient attribute: update
Feb  9 21:58:35 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:35 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:35 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:35 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:37 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.497) : Transient attribute: update
Feb  9 21:58:37 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.498) : Transient attribute: removal
Feb  9 21:58:37 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:37 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:37 failover1 crmd: [29142]: notice: run_graph: Transition 43 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2802.bz2): Complete
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_graph_trigger: Transition 43 is now complete
Feb  9 21:58:37 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:37 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:37 failover1 crmd: [29142]: info: do_pe_invoke: Query 243: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:37 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=243, ref=pe_calc-dc-1328842717-434, seq=20, quorate=1
Feb  9 21:58:37 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:37 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:37 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:37 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:37 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:37 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:37 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:37 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:37 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:37 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:37 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:37 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:37 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:37 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:37 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:37 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:37 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:37 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:37 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:37 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:37 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:37 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:37 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:37 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:37 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:37 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:37 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:37 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:37 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 44: 21 actions in 21 synapses
Feb  9 21:58:37 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 44 (ref=pe_calc-dc-1328842717-434) derived from /var/lib/pengine/pe-input-2803.bz2
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:37 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:44:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:37 failover1 lrmd: [29139]: info: rsc:drbd:1:172: notify
Feb  9 21:58:37 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=172, rc=0, cib-update=244, confirmed=true) ok
Feb  9 21:58:37 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:37 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:44:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:37 failover1 lrmd: [29139]: info: rsc:drbd:1:173: notify
Feb  9 21:58:37 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:37 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=173, rc=0, cib-update=245, confirmed=true) ok
Feb  9 21:58:37 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:37 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:44:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:37 failover1 lrmd: [29139]: info: rsc:drbd:1:174: notify
Feb  9 21:58:37 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:37 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=174, rc=0, cib-update=246, confirmed=true) ok
Feb  9 21:58:37 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:37 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:38 failover1 pengine: [29141]: info: process_pe_message: Transition 44: PEngine Input stored in: /var/lib/pengine/pe-input-2803.bz2
Feb  9 21:58:38 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:38 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:44:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:38 failover1 lrmd: [29139]: info: rsc:drbd:1:175: notify
Feb  9 21:58:38 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:38 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:38 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=175, rc=0, cib-update=247, confirmed=true) ok
Feb  9 21:58:38 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:38 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.506) : Transient attribute: update
Feb  9 21:58:38 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:38 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:38 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:38 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:38 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.509) : Transient attribute: update
Feb  9 21:58:38 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.510) : Transient attribute: removal
Feb  9 21:58:38 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:38 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:38 failover1 crmd: [29142]: notice: run_graph: Transition 44 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2803.bz2): Complete
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_graph_trigger: Transition 44 is now complete
Feb  9 21:58:38 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:38 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:38 failover1 crmd: [29142]: info: do_pe_invoke: Query 248: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:38 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=248, ref=pe_calc-dc-1328842718-444, seq=20, quorate=1
Feb  9 21:58:38 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:38 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:38 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:38 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:38 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:38 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:38 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:38 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:38 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:38 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:38 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:38 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:38 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:38 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:38 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:38 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:38 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:38 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:38 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:38 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:38 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:38 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:38 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:38 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:38 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:38 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:38 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:38 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:38 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 45: 21 actions in 21 synapses
Feb  9 21:58:38 failover1 pengine: [29141]: info: process_pe_message: Transition 45: PEngine Input stored in: /var/lib/pengine/pe-input-2804.bz2
Feb  9 21:58:38 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 45 (ref=pe_calc-dc-1328842718-444) derived from /var/lib/pengine/pe-input-2804.bz2
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:38 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:45:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:38 failover1 lrmd: [29139]: info: rsc:drbd:1:176: notify
Feb  9 21:58:38 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=176, rc=0, cib-update=249, confirmed=true) ok
Feb  9 21:58:38 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:38 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:45:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:38 failover1 lrmd: [29139]: info: rsc:drbd:1:177: notify
Feb  9 21:58:38 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:38 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=177, rc=0, cib-update=250, confirmed=true) ok
Feb  9 21:58:38 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:38 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:38 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:45:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:38 failover1 lrmd: [29139]: info: rsc:drbd:1:178: notify
Feb  9 21:58:39 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:39 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=178, rc=0, cib-update=251, confirmed=true) ok
Feb  9 21:58:39 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:39 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:39 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:45:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:39 failover1 lrmd: [29139]: info: rsc:drbd:1:179: notify
Feb  9 21:58:39 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:39 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=179, rc=0, cib-update=252, confirmed=true) ok
Feb  9 21:58:39 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:39 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:39 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:39 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.518) : Transient attribute: update
Feb  9 21:58:39 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:39 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:39 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:39 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:41 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.521) : Transient attribute: update
Feb  9 21:58:41 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.522) : Transient attribute: removal
Feb  9 21:58:41 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:41 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:41 failover1 crmd: [29142]: notice: run_graph: Transition 45 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2804.bz2): Complete
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_graph_trigger: Transition 45 is now complete
Feb  9 21:58:41 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:41 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:41 failover1 crmd: [29142]: info: do_pe_invoke: Query 253: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:41 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=253, ref=pe_calc-dc-1328842721-454, seq=20, quorate=1
Feb  9 21:58:41 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:41 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:41 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:41 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:41 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:41 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:41 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:41 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:41 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:41 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:41 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:41 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:41 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:41 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:41 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:41 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:41 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:41 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:41 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:41 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:41 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:41 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:41 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:41 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:41 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:41 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:41 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:41 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:41 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 46: 21 actions in 21 synapses
Feb  9 21:58:41 failover1 pengine: [29141]: info: process_pe_message: Transition 46: PEngine Input stored in: /var/lib/pengine/pe-input-2805.bz2
Feb  9 21:58:41 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 46 (ref=pe_calc-dc-1328842721-454) derived from /var/lib/pengine/pe-input-2805.bz2
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:41 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:46:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:41 failover1 lrmd: [29139]: info: rsc:drbd:1:180: notify
Feb  9 21:58:41 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=180, rc=0, cib-update=254, confirmed=true) ok
Feb  9 21:58:41 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:41 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:46:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:41 failover1 lrmd: [29139]: info: rsc:drbd:1:181: notify
Feb  9 21:58:41 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:41 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=181, rc=0, cib-update=255, confirmed=true) ok
Feb  9 21:58:41 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:41 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:46:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:41 failover1 lrmd: [29139]: info: rsc:drbd:1:182: notify
Feb  9 21:58:41 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:41 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=182, rc=0, cib-update=256, confirmed=true) ok
Feb  9 21:58:41 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:41 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:42 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:42 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:46:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:42 failover1 lrmd: [29139]: info: rsc:drbd:1:183: notify
Feb  9 21:58:42 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:42 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=183, rc=0, cib-update=257, confirmed=true) ok
Feb  9 21:58:42 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:42 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:42 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.530) : Transient attribute: update
Feb  9 21:58:42 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:42 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:42 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:42 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:42 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.533) : Transient attribute: update
Feb  9 21:58:42 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.534) : Transient attribute: removal
Feb  9 21:58:42 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:42 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:42 failover1 crmd: [29142]: notice: run_graph: Transition 46 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2805.bz2): Complete
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_graph_trigger: Transition 46 is now complete
Feb  9 21:58:42 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:42 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:42 failover1 crmd: [29142]: info: do_pe_invoke: Query 258: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:42 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=258, ref=pe_calc-dc-1328842722-464, seq=20, quorate=1
Feb  9 21:58:42 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:42 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:42 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:42 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:42 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:42 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:42 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:42 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:42 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:42 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:42 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:42 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:42 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:42 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:42 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:42 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:42 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:42 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:42 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:42 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:42 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:42 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:42 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:42 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:42 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:42 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:42 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:42 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:42 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 47: 21 actions in 21 synapses
Feb  9 21:58:42 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 47 (ref=pe_calc-dc-1328842722-464) derived from /var/lib/pengine/pe-input-2806.bz2
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:42 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:47:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:42 failover1 lrmd: [29139]: info: rsc:drbd:1:184: notify
Feb  9 21:58:42 failover1 pengine: [29141]: info: process_pe_message: Transition 47: PEngine Input stored in: /var/lib/pengine/pe-input-2806.bz2
Feb  9 21:58:42 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=184, rc=0, cib-update=259, confirmed=true) ok
Feb  9 21:58:42 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:42 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:47:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:42 failover1 lrmd: [29139]: info: rsc:drbd:1:185: notify
Feb  9 21:58:42 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:42 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=185, rc=0, cib-update=260, confirmed=true) ok
Feb  9 21:58:42 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:42 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:47:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:42 failover1 lrmd: [29139]: info: rsc:drbd:1:186: notify
Feb  9 21:58:42 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:42 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=186, rc=0, cib-update=261, confirmed=true) ok
Feb  9 21:58:42 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:42 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:43 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:43 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:43 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:43 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:43 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:43 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:47:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:43 failover1 lrmd: [29139]: info: rsc:drbd:1:187: notify
Feb  9 21:58:43 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:43 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=187, rc=0, cib-update=262, confirmed=true) ok
Feb  9 21:58:43 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:43 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:43 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:43 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:43 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:43 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:43 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.542) : Transient attribute: update
Feb  9 21:58:43 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:43 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:43 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:43 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:45 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.545) : Transient attribute: update
Feb  9 21:58:45 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.546) : Transient attribute: removal
Feb  9 21:58:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:45 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:45 failover1 crmd: [29142]: notice: run_graph: Transition 47 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2806.bz2): Complete
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_graph_trigger: Transition 47 is now complete
Feb  9 21:58:45 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:45 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:45 failover1 crmd: [29142]: info: do_pe_invoke: Query 263: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:45 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=263, ref=pe_calc-dc-1328842725-474, seq=20, quorate=1
Feb  9 21:58:45 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:45 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:45 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:45 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:45 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:45 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:45 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:45 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:45 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:45 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:45 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:45 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:45 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:45 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:45 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:45 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:45 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:45 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:45 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:45 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:45 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 48: 21 actions in 21 synapses
Feb  9 21:58:45 failover1 pengine: [29141]: info: process_pe_message: Transition 48: PEngine Input stored in: /var/lib/pengine/pe-input-2807.bz2
Feb  9 21:58:45 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 48 (ref=pe_calc-dc-1328842725-474) derived from /var/lib/pengine/pe-input-2807.bz2
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:45 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:48:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:45 failover1 lrmd: [29139]: info: rsc:drbd:1:188: notify
Feb  9 21:58:45 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=188, rc=0, cib-update=264, confirmed=true) ok
Feb  9 21:58:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:45 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:48:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:45 failover1 lrmd: [29139]: info: rsc:drbd:1:189: notify
Feb  9 21:58:45 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:45 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=189, rc=0, cib-update=265, confirmed=true) ok
Feb  9 21:58:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:45 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:48:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:45 failover1 lrmd: [29139]: info: rsc:drbd:1:190: notify
Feb  9 21:58:45 failover1 lrmd: [29139]: info: perform_op:2906: operation notify[190] on ocf::drbd::drbd:1 for client 29142, its parameters: CRM_meta_clone=[1] CRM_meta_notify_slave_resource=[ ] CRM_meta_notify_active_resource=[ ] CRM_meta_notify_demote_resource=[ ] CRM_meta_notify_demote_uname=[ ] drbd_resource=[r0] CRM_meta_master_node_max=[1] CRM_meta_notify_stop_resource=[drbd:0 ] CRM_meta_notify_master_resource=[drbd:1 ] CRM_meta_clone_node_max=[1] CRM_meta_clone_max=[2] CRM_meta_notify=[true] CRM_meta_notify_start_resource=[drbd:0 ] CRM_meta_notify_stop_uname=[fa for rsc is already running.
Feb  9 21:58:45 failover1 lrmd: [29139]: info: perform_op:2916: postponing all ops on resource drbd:1 by 1000 ms
Feb  9 21:58:45 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:45 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=190, rc=0, cib-update=266, confirmed=true) ok
Feb  9 21:58:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:45 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:45 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:45 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:48:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:45 failover1 lrmd: [29139]: info: rsc:drbd:1:191: notify
Feb  9 21:58:46 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=191, rc=0, cib-update=267, confirmed=true) ok
Feb  9 21:58:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:46 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.554) : Transient attribute: update
Feb  9 21:58:46 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:46 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:46 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.557) : Transient attribute: update
Feb  9 21:58:46 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.558) : Transient attribute: removal
Feb  9 21:58:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:46 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:46 failover1 crmd: [29142]: notice: run_graph: Transition 48 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2807.bz2): Complete
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_graph_trigger: Transition 48 is now complete
Feb  9 21:58:46 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:46 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:46 failover1 crmd: [29142]: info: do_pe_invoke: Query 268: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:46 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=268, ref=pe_calc-dc-1328842726-484, seq=20, quorate=1
Feb  9 21:58:46 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:46 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:46 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:46 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:46 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:46 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:46 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:46 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:46 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:46 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:46 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:46 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:46 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:46 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:46 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:46 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:46 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:46 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:46 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:46 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:46 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:46 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:46 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:46 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:46 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:46 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:46 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:46 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:46 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 49: 21 actions in 21 synapses
Feb  9 21:58:46 failover1 pengine: [29141]: info: process_pe_message: Transition 49: PEngine Input stored in: /var/lib/pengine/pe-input-2808.bz2
Feb  9 21:58:46 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 49 (ref=pe_calc-dc-1328842726-484) derived from /var/lib/pengine/pe-input-2808.bz2
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:49:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:46 failover1 lrmd: [29139]: info: rsc:drbd:1:192: notify
Feb  9 21:58:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=192, rc=0, cib-update=269, confirmed=true) ok
Feb  9 21:58:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:49:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:46 failover1 lrmd: [29139]: info: rsc:drbd:1:193: notify
Feb  9 21:58:46 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=193, rc=0, cib-update=270, confirmed=true) ok
Feb  9 21:58:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:46 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:49:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:46 failover1 lrmd: [29139]: info: rsc:drbd:1:194: notify
Feb  9 21:58:46 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:46 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=194, rc=0, cib-update=271, confirmed=true) ok
Feb  9 21:58:46 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:46 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:47 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:49:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:47 failover1 lrmd: [29139]: info: rsc:drbd:1:195: notify
Feb  9 21:58:47 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:47 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=195, rc=0, cib-update=272, confirmed=true) ok
Feb  9 21:58:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:47 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:47 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:47 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.566) : Transient attribute: update
Feb  9 21:58:47 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:47 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:47 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:49 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.569) : Transient attribute: update
Feb  9 21:58:49 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.570) : Transient attribute: removal
Feb  9 21:58:49 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:49 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:49 failover1 crmd: [29142]: notice: run_graph: Transition 49 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2808.bz2): Complete
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_graph_trigger: Transition 49 is now complete
Feb  9 21:58:49 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:49 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:49 failover1 crmd: [29142]: info: do_pe_invoke: Query 273: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:49 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=273, ref=pe_calc-dc-1328842729-494, seq=20, quorate=1
Feb  9 21:58:49 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:49 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:49 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:49 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:49 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:49 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:49 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:49 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:49 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:49 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:49 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:49 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:49 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:49 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:49 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:49 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:49 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:49 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:49 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:49 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:49 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:49 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:49 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:49 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 50: 21 actions in 21 synapses
Feb  9 21:58:49 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 50 (ref=pe_calc-dc-1328842729-494) derived from /var/lib/pengine/pe-input-2809.bz2
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:49 failover1 pengine: [29141]: info: process_pe_message: Transition 50: PEngine Input stored in: /var/lib/pengine/pe-input-2809.bz2
Feb  9 21:58:49 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:50:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:49 failover1 lrmd: [29139]: info: rsc:drbd:1:196: notify
Feb  9 21:58:49 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=196, rc=0, cib-update=274, confirmed=true) ok
Feb  9 21:58:49 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:49 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:50:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:49 failover1 lrmd: [29139]: info: rsc:drbd:1:197: notify
Feb  9 21:58:49 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:49 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=197, rc=0, cib-update=275, confirmed=true) ok
Feb  9 21:58:49 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:49 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:50:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:49 failover1 lrmd: [29139]: info: rsc:drbd:1:198: notify
Feb  9 21:58:49 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:49 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=198, rc=0, cib-update=276, confirmed=true) ok
Feb  9 21:58:49 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:49 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:50 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:50:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:50 failover1 lrmd: [29139]: info: rsc:drbd:1:199: notify
Feb  9 21:58:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:50 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:50 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=199, rc=0, cib-update=277, confirmed=true) ok
Feb  9 21:58:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:50 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.578) : Transient attribute: update
Feb  9 21:58:50 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:50 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:50 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.581) : Transient attribute: update
Feb  9 21:58:50 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.582) : Transient attribute: removal
Feb  9 21:58:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:50 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:50 failover1 crmd: [29142]: notice: run_graph: Transition 50 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2809.bz2): Complete
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_graph_trigger: Transition 50 is now complete
Feb  9 21:58:50 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:50 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:50 failover1 crmd: [29142]: info: do_pe_invoke: Query 278: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:50 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=278, ref=pe_calc-dc-1328842730-504, seq=20, quorate=1
Feb  9 21:58:50 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:50 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:50 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:50 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:50 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:50 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:50 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:50 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:50 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:50 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:50 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:50 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:50 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:50 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:50 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:50 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:50 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:50 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:50 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:50 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:50 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:50 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:50 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:50 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 51: 21 actions in 21 synapses
Feb  9 21:58:50 failover1 pengine: [29141]: info: process_pe_message: Transition 51: PEngine Input stored in: /var/lib/pengine/pe-input-2810.bz2
Feb  9 21:58:50 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 51 (ref=pe_calc-dc-1328842730-504) derived from /var/lib/pengine/pe-input-2810.bz2
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:50 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:51:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:50 failover1 lrmd: [29139]: info: rsc:drbd:1:200: notify
Feb  9 21:58:50 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=200, rc=0, cib-update=279, confirmed=true) ok
Feb  9 21:58:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:50 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:51:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:50 failover1 lrmd: [29139]: info: rsc:drbd:1:201: notify
Feb  9 21:58:50 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:50 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=201, rc=0, cib-update=280, confirmed=true) ok
Feb  9 21:58:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:50 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:51:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:50 failover1 lrmd: [29139]: info: rsc:drbd:1:202: notify
Feb  9 21:58:50 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:50 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=202, rc=0, cib-update=281, confirmed=true) ok
Feb  9 21:58:50 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:50 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:51 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:51:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:51 failover1 lrmd: [29139]: info: rsc:drbd:1:203: notify
Feb  9 21:58:51 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:51 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=203, rc=0, cib-update=282, confirmed=true) ok
Feb  9 21:58:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:51 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:51 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:51 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.590) : Transient attribute: update
Feb  9 21:58:51 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:51 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:51 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:53 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.593) : Transient attribute: update
Feb  9 21:58:53 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.594) : Transient attribute: removal
Feb  9 21:58:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:53 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:53 failover1 crmd: [29142]: notice: run_graph: Transition 51 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2810.bz2): Complete
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_graph_trigger: Transition 51 is now complete
Feb  9 21:58:53 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:53 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:53 failover1 crmd: [29142]: info: do_pe_invoke: Query 283: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:53 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=283, ref=pe_calc-dc-1328842733-514, seq=20, quorate=1
Feb  9 21:58:53 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:53 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:53 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:53 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:53 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:53 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:53 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:53 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:53 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:53 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:53 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:53 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:53 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:53 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:53 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:53 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:53 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:53 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:53 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:53 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:53 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:53 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:53 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:53 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:53 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:53 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:53 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:53 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:53 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 52: 21 actions in 21 synapses
Feb  9 21:58:53 failover1 pengine: [29141]: info: process_pe_message: Transition 52: PEngine Input stored in: /var/lib/pengine/pe-input-2811.bz2
Feb  9 21:58:53 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 52 (ref=pe_calc-dc-1328842733-514) derived from /var/lib/pengine/pe-input-2811.bz2
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:53 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:52:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:53 failover1 lrmd: [29139]: info: rsc:drbd:1:204: notify
Feb  9 21:58:53 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=204, rc=0, cib-update=284, confirmed=true) ok
Feb  9 21:58:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:53 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:52:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:53 failover1 lrmd: [29139]: info: rsc:drbd:1:205: notify
Feb  9 21:58:53 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:53 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=205, rc=0, cib-update=285, confirmed=true) ok
Feb  9 21:58:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:53 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:52:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:53 failover1 lrmd: [29139]: info: rsc:drbd:1:206: notify
Feb  9 21:58:53 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:53 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=206, rc=0, cib-update=286, confirmed=true) ok
Feb  9 21:58:53 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:53 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:54 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:52:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:54 failover1 lrmd: [29139]: info: rsc:drbd:1:207: notify
Feb  9 21:58:54 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:54 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=207, rc=0, cib-update=287, confirmed=true) ok
Feb  9 21:58:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:54 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.602) : Transient attribute: update
Feb  9 21:58:54 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:54 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:54 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.605) : Transient attribute: update
Feb  9 21:58:54 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.606) : Transient attribute: removal
Feb  9 21:58:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:54 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:54 failover1 crmd: [29142]: notice: run_graph: Transition 52 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2811.bz2): Complete
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_graph_trigger: Transition 52 is now complete
Feb  9 21:58:54 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:54 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:54 failover1 crmd: [29142]: info: do_pe_invoke: Query 288: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:54 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=288, ref=pe_calc-dc-1328842734-524, seq=20, quorate=1
Feb  9 21:58:54 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:54 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:54 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:54 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:54 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:54 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:54 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:54 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:54 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:54 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:54 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:54 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:54 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:54 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:54 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:54 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:54 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:54 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:54 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:54 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:54 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:54 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:54 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:54 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 53: 21 actions in 21 synapses
Feb  9 21:58:54 failover1 pengine: [29141]: info: process_pe_message: Transition 53: PEngine Input stored in: /var/lib/pengine/pe-input-2812.bz2
Feb  9 21:58:54 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 53 (ref=pe_calc-dc-1328842734-524) derived from /var/lib/pengine/pe-input-2812.bz2
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:54 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:53:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:54 failover1 lrmd: [29139]: info: rsc:drbd:1:208: notify
Feb  9 21:58:54 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=208, rc=0, cib-update=289, confirmed=true) ok
Feb  9 21:58:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:54 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:53:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:54 failover1 lrmd: [29139]: info: rsc:drbd:1:209: notify
Feb  9 21:58:54 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:54 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=209, rc=0, cib-update=290, confirmed=true) ok
Feb  9 21:58:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:54 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:53:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:54 failover1 lrmd: [29139]: info: rsc:drbd:1:210: notify
Feb  9 21:58:54 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:54 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=210, rc=0, cib-update=291, confirmed=true) ok
Feb  9 21:58:54 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:54 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:55 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:53:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:55 failover1 lrmd: [29139]: info: rsc:drbd:1:211: notify
Feb  9 21:58:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:55 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:55 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=211, rc=0, cib-update=292, confirmed=true) ok
Feb  9 21:58:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:55 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.614) : Transient attribute: update
Feb  9 21:58:55 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:55 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:55 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.617) : Transient attribute: update
Feb  9 21:58:55 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.618) : Transient attribute: removal
Feb  9 21:58:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:55 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:55 failover1 crmd: [29142]: notice: run_graph: Transition 53 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2812.bz2): Complete
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_graph_trigger: Transition 53 is now complete
Feb  9 21:58:55 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:55 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:55 failover1 crmd: [29142]: info: do_pe_invoke: Query 293: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:55 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=293, ref=pe_calc-dc-1328842735-534, seq=20, quorate=1
Feb  9 21:58:55 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:55 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:55 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:55 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:55 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:55 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:55 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:55 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:55 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:55 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:55 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:55 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:55 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:55 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:55 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:55 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:55 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:55 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:55 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:55 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:55 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:55 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:55 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:55 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 54: 21 actions in 21 synapses
Feb  9 21:58:55 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 54 (ref=pe_calc-dc-1328842735-534) derived from /var/lib/pengine/pe-input-2813.bz2
Feb  9 21:58:55 failover1 pengine: [29141]: info: process_pe_message: Transition 54: PEngine Input stored in: /var/lib/pengine/pe-input-2813.bz2
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:55 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:54:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:55 failover1 lrmd: [29139]: info: rsc:drbd:1:212: notify
Feb  9 21:58:55 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=212, rc=0, cib-update=294, confirmed=true) ok
Feb  9 21:58:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:55 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:54:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:55 failover1 lrmd: [29139]: info: rsc:drbd:1:213: notify
Feb  9 21:58:55 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:55 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=213, rc=0, cib-update=295, confirmed=true) ok
Feb  9 21:58:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:55 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:54:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:55 failover1 lrmd: [29139]: info: rsc:drbd:1:214: notify
Feb  9 21:58:55 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:55 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=214, rc=0, cib-update=296, confirmed=true) ok
Feb  9 21:58:55 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:55 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:56 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:54:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:56 failover1 lrmd: [29139]: info: rsc:drbd:1:215: notify
Feb  9 21:58:56 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:56 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=215, rc=0, cib-update=297, confirmed=true) ok
Feb  9 21:58:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:56 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:56 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:56 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.626) : Transient attribute: update
Feb  9 21:58:56 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:56 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:56 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:58:58 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.629) : Transient attribute: update
Feb  9 21:58:58 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.630) : Transient attribute: removal
Feb  9 21:58:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:58:58 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:58:58 failover1 crmd: [29142]: notice: run_graph: Transition 54 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2813.bz2): Complete
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_graph_trigger: Transition 54 is now complete
Feb  9 21:58:58 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:58:58 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:58:58 failover1 crmd: [29142]: info: do_pe_invoke: Query 298: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:58:58 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=298, ref=pe_calc-dc-1328842738-544, seq=20, quorate=1
Feb  9 21:58:58 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:58:58 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:58:58 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:58:58 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:58:58 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:58:58 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:58:58 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:58:58 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:58:58 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:58:58 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:58 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:58 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:58:58 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:58:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:58 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:58 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:58:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:58:58 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:58:58 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:58 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:58:58 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:58:58 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:58:58 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:58:58 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:58:58 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:58:58 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 55: 21 actions in 21 synapses
Feb  9 21:58:58 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 55 (ref=pe_calc-dc-1328842738-544) derived from /var/lib/pengine/pe-input-2814.bz2
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:58:58 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:55:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:58 failover1 lrmd: [29139]: info: rsc:drbd:1:216: notify
Feb  9 21:58:58 failover1 pengine: [29141]: info: process_pe_message: Transition 55: PEngine Input stored in: /var/lib/pengine/pe-input-2814.bz2
Feb  9 21:58:58 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=216, rc=0, cib-update=299, confirmed=true) ok
Feb  9 21:58:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:58:58 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:55:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:58 failover1 lrmd: [29139]: info: rsc:drbd:1:217: notify
Feb  9 21:58:58 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:58:58 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=217, rc=0, cib-update=300, confirmed=true) ok
Feb  9 21:58:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:58:58 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:55:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:58 failover1 lrmd: [29139]: info: rsc:drbd:1:218: notify
Feb  9 21:58:58 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:58 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=218, rc=0, cib-update=301, confirmed=true) ok
Feb  9 21:58:58 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:58:58 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:58:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:58:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:58:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:58:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:58:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:58:59 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:55:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:58:59 failover1 lrmd: [29139]: info: rsc:drbd:1:219: notify
Feb  9 21:58:59 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:58:59 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=219, rc=0, cib-update=302, confirmed=true) ok
Feb  9 21:58:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:58:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:58:59 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:58:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:58:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:58:59 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:58:59 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.638) : Transient attribute: update
Feb  9 21:58:59 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:58:59 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:58:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:58:59 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:01 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.641) : Transient attribute: update
Feb  9 21:59:01 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.642) : Transient attribute: removal
Feb  9 21:59:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:01 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:01 failover1 crmd: [29142]: notice: run_graph: Transition 55 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2814.bz2): Complete
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_graph_trigger: Transition 55 is now complete
Feb  9 21:59:01 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:01 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:01 failover1 crmd: [29142]: info: do_pe_invoke: Query 303: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:01 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=303, ref=pe_calc-dc-1328842741-554, seq=20, quorate=1
Feb  9 21:59:01 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:01 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:01 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:01 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:01 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:01 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:01 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:01 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:01 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:01 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:01 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:01 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:01 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:01 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:01 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:01 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:01 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:01 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:01 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:01 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:01 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:01 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:01 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:01 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:01 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:01 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:01 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:01 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:01 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 56: 21 actions in 21 synapses
Feb  9 21:59:01 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 56 (ref=pe_calc-dc-1328842741-554) derived from /var/lib/pengine/pe-input-2815.bz2
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:01 failover1 pengine: [29141]: info: process_pe_message: Transition 56: PEngine Input stored in: /var/lib/pengine/pe-input-2815.bz2
Feb  9 21:59:01 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:56:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:01 failover1 lrmd: [29139]: info: rsc:drbd:1:220: notify
Feb  9 21:59:01 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=220, rc=0, cib-update=304, confirmed=true) ok
Feb  9 21:59:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:01 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:56:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:01 failover1 lrmd: [29139]: info: rsc:drbd:1:221: notify
Feb  9 21:59:01 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:01 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=221, rc=0, cib-update=305, confirmed=true) ok
Feb  9 21:59:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:01 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:56:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:01 failover1 lrmd: [29139]: info: rsc:drbd:1:222: notify
Feb  9 21:59:01 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:01 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=222, rc=0, cib-update=306, confirmed=true) ok
Feb  9 21:59:01 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:01 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:02 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:56:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:02 failover1 lrmd: [29139]: info: rsc:drbd:1:223: notify
Feb  9 21:59:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:02 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:02 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=223, rc=0, cib-update=307, confirmed=true) ok
Feb  9 21:59:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:02 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.650) : Transient attribute: update
Feb  9 21:59:02 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:02 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:02 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.653) : Transient attribute: update
Feb  9 21:59:02 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.654) : Transient attribute: removal
Feb  9 21:59:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:02 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:02 failover1 crmd: [29142]: notice: run_graph: Transition 56 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2815.bz2): Complete
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_graph_trigger: Transition 56 is now complete
Feb  9 21:59:02 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:02 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:02 failover1 crmd: [29142]: info: do_pe_invoke: Query 308: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:02 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=308, ref=pe_calc-dc-1328842742-564, seq=20, quorate=1
Feb  9 21:59:02 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:02 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:02 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:02 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:02 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:02 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:02 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:02 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:02 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:02 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:02 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:02 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:02 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:02 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:02 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:02 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:02 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:02 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:02 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:02 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:02 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:02 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:02 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:02 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 57: 21 actions in 21 synapses
Feb  9 21:59:02 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 57 (ref=pe_calc-dc-1328842742-564) derived from /var/lib/pengine/pe-input-2816.bz2
Feb  9 21:59:02 failover1 pengine: [29141]: info: process_pe_message: Transition 57: PEngine Input stored in: /var/lib/pengine/pe-input-2816.bz2
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:02 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:57:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:02 failover1 lrmd: [29139]: info: rsc:drbd:1:224: notify
Feb  9 21:59:02 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=224, rc=0, cib-update=309, confirmed=true) ok
Feb  9 21:59:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:02 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:57:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:02 failover1 lrmd: [29139]: info: rsc:drbd:1:225: notify
Feb  9 21:59:02 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:02 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=225, rc=0, cib-update=310, confirmed=true) ok
Feb  9 21:59:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:02 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:57:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:02 failover1 lrmd: [29139]: info: rsc:drbd:1:226: notify
Feb  9 21:59:02 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:02 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=226, rc=0, cib-update=311, confirmed=true) ok
Feb  9 21:59:02 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:02 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:03 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:57:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:03 failover1 lrmd: [29139]: info: rsc:drbd:1:227: notify
Feb  9 21:59:03 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:03 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=227, rc=0, cib-update=312, confirmed=true) ok
Feb  9 21:59:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:03 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:03 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:03 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.662) : Transient attribute: update
Feb  9 21:59:03 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:03 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:03 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:05 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.665) : Transient attribute: update
Feb  9 21:59:05 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.666) : Transient attribute: removal
Feb  9 21:59:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:05 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:05 failover1 crmd: [29142]: notice: run_graph: Transition 57 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2816.bz2): Complete
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_graph_trigger: Transition 57 is now complete
Feb  9 21:59:05 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:05 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:05 failover1 crmd: [29142]: info: do_pe_invoke: Query 313: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:05 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=313, ref=pe_calc-dc-1328842745-574, seq=20, quorate=1
Feb  9 21:59:05 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:05 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:05 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:05 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:05 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:05 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:05 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:05 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:05 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:05 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:05 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:05 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:05 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:05 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:05 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:05 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:05 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:05 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:05 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:05 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:05 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:05 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:05 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:05 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 58: 21 actions in 21 synapses
Feb  9 21:59:05 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 58 (ref=pe_calc-dc-1328842745-574) derived from /var/lib/pengine/pe-input-2817.bz2
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:05 failover1 pengine: [29141]: info: process_pe_message: Transition 58: PEngine Input stored in: /var/lib/pengine/pe-input-2817.bz2
Feb  9 21:59:05 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:58:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:05 failover1 lrmd: [29139]: info: rsc:drbd:1:228: notify
Feb  9 21:59:05 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=228, rc=0, cib-update=314, confirmed=true) ok
Feb  9 21:59:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:05 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:58:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:05 failover1 lrmd: [29139]: info: rsc:drbd:1:229: notify
Feb  9 21:59:05 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:05 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=229, rc=0, cib-update=315, confirmed=true) ok
Feb  9 21:59:05 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:05 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:05 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:58:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:05 failover1 lrmd: [29139]: info: rsc:drbd:1:230: notify
Feb  9 21:59:06 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:06 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=230, rc=0, cib-update=316, confirmed=true) ok
Feb  9 21:59:06 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:06 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:06 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:58:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:06 failover1 lrmd: [29139]: info: rsc:drbd:1:231: notify
Feb  9 21:59:06 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:06 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=231, rc=0, cib-update=317, confirmed=true) ok
Feb  9 21:59:06 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:06 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:06 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:06 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.674) : Transient attribute: update
Feb  9 21:59:06 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:06 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:06 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:06 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:08 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.677) : Transient attribute: update
Feb  9 21:59:08 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.678) : Transient attribute: removal
Feb  9 21:59:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:08 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:08 failover1 crmd: [29142]: notice: run_graph: Transition 58 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2817.bz2): Complete
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_graph_trigger: Transition 58 is now complete
Feb  9 21:59:08 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:08 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:08 failover1 crmd: [29142]: info: do_pe_invoke: Query 318: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:08 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=318, ref=pe_calc-dc-1328842748-584, seq=20, quorate=1
Feb  9 21:59:08 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:08 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:08 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:08 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:08 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:08 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:08 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:08 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:08 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:08 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:08 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:08 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:08 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:08 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:08 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:08 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:08 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:08 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:08 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:08 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:08 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:08 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:08 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:08 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 59: 21 actions in 21 synapses
Feb  9 21:59:08 failover1 pengine: [29141]: info: process_pe_message: Transition 59: PEngine Input stored in: /var/lib/pengine/pe-input-2818.bz2
Feb  9 21:59:08 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 59 (ref=pe_calc-dc-1328842748-584) derived from /var/lib/pengine/pe-input-2818.bz2
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:08 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:59:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:08 failover1 lrmd: [29139]: info: rsc:drbd:1:232: notify
Feb  9 21:59:08 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=232, rc=0, cib-update=319, confirmed=true) ok
Feb  9 21:59:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:08 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:59:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:08 failover1 lrmd: [29139]: info: rsc:drbd:1:233: notify
Feb  9 21:59:08 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:08 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=233, rc=0, cib-update=320, confirmed=true) ok
Feb  9 21:59:08 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:08 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:08 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:59:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:08 failover1 lrmd: [29139]: info: rsc:drbd:1:234: notify
Feb  9 21:59:09 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:09 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=234, rc=0, cib-update=321, confirmed=true) ok
Feb  9 21:59:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:09 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:59:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:09 failover1 lrmd: [29139]: info: rsc:drbd:1:235: notify
Feb  9 21:59:09 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:09 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=235, rc=0, cib-update=322, confirmed=true) ok
Feb  9 21:59:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:09 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.686) : Transient attribute: update
Feb  9 21:59:09 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:09 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:09 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.689) : Transient attribute: update
Feb  9 21:59:09 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.690) : Transient attribute: removal
Feb  9 21:59:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:09 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:09 failover1 crmd: [29142]: notice: run_graph: Transition 59 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2818.bz2): Complete
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_graph_trigger: Transition 59 is now complete
Feb  9 21:59:09 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:09 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:09 failover1 crmd: [29142]: info: do_pe_invoke: Query 323: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:09 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=323, ref=pe_calc-dc-1328842749-594, seq=20, quorate=1
Feb  9 21:59:09 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:09 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:09 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:09 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:09 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:09 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:09 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:09 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:09 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:09 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:09 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:09 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:09 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:09 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:09 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:09 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:09 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:09 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:09 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:09 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:09 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:09 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:09 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:09 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 60: 21 actions in 21 synapses
Feb  9 21:59:09 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 60 (ref=pe_calc-dc-1328842749-594) derived from /var/lib/pengine/pe-input-2819.bz2
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:09 failover1 pengine: [29141]: info: process_pe_message: Transition 60: PEngine Input stored in: /var/lib/pengine/pe-input-2819.bz2
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:09 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:60:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:09 failover1 lrmd: [29139]: info: rsc:drbd:1:236: notify
Feb  9 21:59:09 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=236, rc=0, cib-update=324, confirmed=true) ok
Feb  9 21:59:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:09 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:60:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:09 failover1 lrmd: [29139]: info: rsc:drbd:1:237: notify
Feb  9 21:59:09 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:09 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=237, rc=0, cib-update=325, confirmed=true) ok
Feb  9 21:59:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:09 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:60:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:09 failover1 lrmd: [29139]: info: rsc:drbd:1:238: notify
Feb  9 21:59:09 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:09 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=238, rc=0, cib-update=326, confirmed=true) ok
Feb  9 21:59:09 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:09 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:10 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:60:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:10 failover1 lrmd: [29139]: info: rsc:drbd:1:239: notify
Feb  9 21:59:10 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:10 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=239, rc=0, cib-update=327, confirmed=true) ok
Feb  9 21:59:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:10 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.698) : Transient attribute: update
Feb  9 21:59:10 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:10 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:10 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.701) : Transient attribute: update
Feb  9 21:59:10 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.702) : Transient attribute: removal
Feb  9 21:59:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:10 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:10 failover1 crmd: [29142]: notice: run_graph: Transition 60 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2819.bz2): Complete
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_graph_trigger: Transition 60 is now complete
Feb  9 21:59:10 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:10 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:10 failover1 crmd: [29142]: info: do_pe_invoke: Query 328: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:10 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=328, ref=pe_calc-dc-1328842750-604, seq=20, quorate=1
Feb  9 21:59:10 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:10 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:10 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:10 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:10 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:10 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:10 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:10 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:10 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:10 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:10 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:10 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:10 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:10 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:10 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:10 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:10 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:10 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:10 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:10 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:10 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:10 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:10 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:10 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 61: 21 actions in 21 synapses
Feb  9 21:59:10 failover1 pengine: [29141]: info: process_pe_message: Transition 61: PEngine Input stored in: /var/lib/pengine/pe-input-2820.bz2
Feb  9 21:59:10 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 61 (ref=pe_calc-dc-1328842750-604) derived from /var/lib/pengine/pe-input-2820.bz2
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:10 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:61:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:10 failover1 lrmd: [29139]: info: rsc:drbd:1:240: notify
Feb  9 21:59:10 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=240, rc=0, cib-update=329, confirmed=true) ok
Feb  9 21:59:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:10 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:61:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:10 failover1 lrmd: [29139]: info: rsc:drbd:1:241: notify
Feb  9 21:59:10 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:10 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=241, rc=0, cib-update=330, confirmed=true) ok
Feb  9 21:59:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:10 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:61:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:10 failover1 lrmd: [29139]: info: rsc:drbd:1:242: notify
Feb  9 21:59:10 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:10 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=242, rc=0, cib-update=331, confirmed=true) ok
Feb  9 21:59:10 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:10 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:11 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:61:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:11 failover1 lrmd: [29139]: info: rsc:drbd:1:243: notify
Feb  9 21:59:11 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:11 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=243, rc=0, cib-update=332, confirmed=true) ok
Feb  9 21:59:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:11 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.710) : Transient attribute: update
Feb  9 21:59:11 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:11 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:11 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.713) : Transient attribute: update
Feb  9 21:59:11 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.714) : Transient attribute: removal
Feb  9 21:59:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:11 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:11 failover1 crmd: [29142]: notice: run_graph: Transition 61 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2820.bz2): Complete
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_graph_trigger: Transition 61 is now complete
Feb  9 21:59:11 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:11 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:11 failover1 crmd: [29142]: info: do_pe_invoke: Query 333: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:11 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=333, ref=pe_calc-dc-1328842751-614, seq=20, quorate=1
Feb  9 21:59:11 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:11 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:11 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:11 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:11 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:11 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:11 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:11 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:11 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:11 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:11 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:11 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:11 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:11 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:11 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:11 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:11 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:11 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:11 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:11 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:11 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:11 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:11 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:11 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 62: 21 actions in 21 synapses
Feb  9 21:59:11 failover1 pengine: [29141]: info: process_pe_message: Transition 62: PEngine Input stored in: /var/lib/pengine/pe-input-2821.bz2
Feb  9 21:59:11 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 62 (ref=pe_calc-dc-1328842751-614) derived from /var/lib/pengine/pe-input-2821.bz2
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:11 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:62:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:11 failover1 lrmd: [29139]: info: rsc:drbd:1:244: notify
Feb  9 21:59:11 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=244, rc=0, cib-update=334, confirmed=true) ok
Feb  9 21:59:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:11 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:62:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:11 failover1 lrmd: [29139]: info: rsc:drbd:1:245: notify
Feb  9 21:59:11 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:11 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=245, rc=0, cib-update=335, confirmed=true) ok
Feb  9 21:59:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:11 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:62:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:11 failover1 lrmd: [29139]: info: rsc:drbd:1:246: notify
Feb  9 21:59:11 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:11 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=246, rc=0, cib-update=336, confirmed=true) ok
Feb  9 21:59:11 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:11 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:12 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:62:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:12 failover1 lrmd: [29139]: info: rsc:drbd:1:247: notify
Feb  9 21:59:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:12 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:12 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=247, rc=0, cib-update=337, confirmed=true) ok
Feb  9 21:59:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:12 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.722) : Transient attribute: update
Feb  9 21:59:12 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:12 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:12 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.725) : Transient attribute: update
Feb  9 21:59:12 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.726) : Transient attribute: removal
Feb  9 21:59:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:12 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:12 failover1 crmd: [29142]: notice: run_graph: Transition 62 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2821.bz2): Complete
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_graph_trigger: Transition 62 is now complete
Feb  9 21:59:12 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:12 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:12 failover1 crmd: [29142]: info: do_pe_invoke: Query 338: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:12 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=338, ref=pe_calc-dc-1328842752-624, seq=20, quorate=1
Feb  9 21:59:12 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:12 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:12 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:12 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:12 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:12 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:12 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:12 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:12 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:12 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:12 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:12 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:12 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:12 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:12 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:12 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:12 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:12 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:12 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:12 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:12 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:12 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:12 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:12 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 63: 21 actions in 21 synapses
Feb  9 21:59:12 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 63 (ref=pe_calc-dc-1328842752-624) derived from /var/lib/pengine/pe-input-2822.bz2
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:12 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:63:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:12 failover1 lrmd: [29139]: info: rsc:drbd:1:248: notify
Feb  9 21:59:12 failover1 pengine: [29141]: info: process_pe_message: Transition 63: PEngine Input stored in: /var/lib/pengine/pe-input-2822.bz2
Feb  9 21:59:12 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=248, rc=0, cib-update=339, confirmed=true) ok
Feb  9 21:59:12 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:12 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:12 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:63:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:12 failover1 lrmd: [29139]: info: rsc:drbd:1:249: notify
Feb  9 21:59:13 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:13 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=249, rc=0, cib-update=340, confirmed=true) ok
Feb  9 21:59:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:13 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:63:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:13 failover1 lrmd: [29139]: info: rsc:drbd:1:250: notify
Feb  9 21:59:13 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:13 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=250, rc=0, cib-update=341, confirmed=true) ok
Feb  9 21:59:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:13 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:63:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:13 failover1 lrmd: [29139]: info: rsc:drbd:1:251: notify
Feb  9 21:59:13 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:13 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=251, rc=0, cib-update=342, confirmed=true) ok
Feb  9 21:59:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:13 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.734) : Transient attribute: update
Feb  9 21:59:13 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:13 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:13 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.737) : Transient attribute: update
Feb  9 21:59:13 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.738) : Transient attribute: removal
Feb  9 21:59:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:13 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:13 failover1 crmd: [29142]: notice: run_graph: Transition 63 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2822.bz2): Complete
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_graph_trigger: Transition 63 is now complete
Feb  9 21:59:13 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:13 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:13 failover1 crmd: [29142]: info: do_pe_invoke: Query 343: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:13 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=343, ref=pe_calc-dc-1328842753-634, seq=20, quorate=1
Feb  9 21:59:13 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:13 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:13 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:13 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:13 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:13 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:13 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:13 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:13 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:13 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:13 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:13 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:13 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:13 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:13 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:13 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:13 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:13 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:13 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:13 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:13 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:13 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:13 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:13 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:13 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:13 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:13 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:13 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:13 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 64: 21 actions in 21 synapses
Feb  9 21:59:13 failover1 pengine: [29141]: info: process_pe_message: Transition 64: PEngine Input stored in: /var/lib/pengine/pe-input-2823.bz2
Feb  9 21:59:13 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 64 (ref=pe_calc-dc-1328842753-634) derived from /var/lib/pengine/pe-input-2823.bz2
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:13 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:64:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:13 failover1 lrmd: [29139]: info: rsc:drbd:1:252: notify
Feb  9 21:59:13 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=252, rc=0, cib-update=344, confirmed=true) ok
Feb  9 21:59:13 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:13 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:13 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:64:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:13 failover1 lrmd: [29139]: info: rsc:drbd:1:253: notify
Feb  9 21:59:14 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:14 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=253, rc=0, cib-update=345, confirmed=true) ok
Feb  9 21:59:14 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:14 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:64:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:14 failover1 lrmd: [29139]: info: rsc:drbd:1:254: notify
Feb  9 21:59:14 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:14 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=254, rc=0, cib-update=346, confirmed=true) ok
Feb  9 21:59:14 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:14 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:14 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:64:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:14 failover1 lrmd: [29139]: info: rsc:drbd:1:255: notify
Feb  9 21:59:14 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:14 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=255, rc=0, cib-update=347, confirmed=true) ok
Feb  9 21:59:14 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:14 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:14 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:14 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.746) : Transient attribute: update
Feb  9 21:59:14 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:14 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:14 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:14 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:16 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.749) : Transient attribute: update
Feb  9 21:59:16 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.750) : Transient attribute: removal
Feb  9 21:59:16 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:16 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:16 failover1 crmd: [29142]: notice: run_graph: Transition 64 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2823.bz2): Complete
Feb  9 21:59:16 failover1 crmd: [29142]: info: te_graph_trigger: Transition 64 is now complete
Feb  9 21:59:16 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:16 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:16 failover1 crmd: [29142]: info: do_pe_invoke: Query 348: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:16 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=348, ref=pe_calc-dc-1328842756-644, seq=20, quorate=1
Feb  9 21:59:16 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:16 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:16 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:16 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:16 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:16 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:16 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:16 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:16 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:16 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:16 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:16 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:16 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:16 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:16 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:16 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:16 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:16 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:16 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:16 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:16 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:16 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:16 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:16 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 65: 21 actions in 21 synapses
Feb  9 21:59:16 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 65 (ref=pe_calc-dc-1328842756-644) derived from /var/lib/pengine/pe-input-2824.bz2
Feb  9 21:59:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:16 failover1 pengine: [29141]: info: process_pe_message: Transition 65: PEngine Input stored in: /var/lib/pengine/pe-input-2824.bz2
Feb  9 21:59:16 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:16 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:65:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:16 failover1 lrmd: [29139]: info: rsc:drbd:1:256: notify
Feb  9 21:59:16 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=256, rc=0, cib-update=349, confirmed=true) ok
Feb  9 21:59:16 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:16 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:16 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:16 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:65:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:16 failover1 lrmd: [29139]: info: rsc:drbd:1:257: notify
Feb  9 21:59:17 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:17 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=257, rc=0, cib-update=350, confirmed=true) ok
Feb  9 21:59:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:17 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:65:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:17 failover1 lrmd: [29139]: info: rsc:drbd:1:258: notify
Feb  9 21:59:17 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:17 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=258, rc=0, cib-update=351, confirmed=true) ok
Feb  9 21:59:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:17 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:65:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:17 failover1 lrmd: [29139]: info: rsc:drbd:1:259: notify
Feb  9 21:59:17 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:17 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=259, rc=0, cib-update=352, confirmed=true) ok
Feb  9 21:59:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:17 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.758) : Transient attribute: update
Feb  9 21:59:17 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:17 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:17 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.761) : Transient attribute: update
Feb  9 21:59:17 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.762) : Transient attribute: removal
Feb  9 21:59:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:17 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:17 failover1 crmd: [29142]: notice: run_graph: Transition 65 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2824.bz2): Complete
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_graph_trigger: Transition 65 is now complete
Feb  9 21:59:17 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:17 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:17 failover1 crmd: [29142]: info: do_pe_invoke: Query 353: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:17 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=353, ref=pe_calc-dc-1328842757-654, seq=20, quorate=1
Feb  9 21:59:17 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:17 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:17 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:17 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:17 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:17 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:17 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:17 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:17 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:17 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:17 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:17 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:17 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:17 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:17 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:17 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:17 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:17 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:17 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:17 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:17 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:17 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:17 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:17 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 66: 21 actions in 21 synapses
Feb  9 21:59:17 failover1 pengine: [29141]: info: process_pe_message: Transition 66: PEngine Input stored in: /var/lib/pengine/pe-input-2825.bz2
Feb  9 21:59:17 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 66 (ref=pe_calc-dc-1328842757-654) derived from /var/lib/pengine/pe-input-2825.bz2
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:17 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:66:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:17 failover1 lrmd: [29139]: info: rsc:drbd:1:260: notify
Feb  9 21:59:17 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=260, rc=0, cib-update=354, confirmed=true) ok
Feb  9 21:59:17 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:17 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:17 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:66:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:17 failover1 lrmd: [29139]: info: rsc:drbd:1:261: notify
Feb  9 21:59:18 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:18 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=261, rc=0, cib-update=355, confirmed=true) ok
Feb  9 21:59:18 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:18 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:66:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:18 failover1 lrmd: [29139]: info: rsc:drbd:1:262: notify
Feb  9 21:59:18 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:18 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=262, rc=0, cib-update=356, confirmed=true) ok
Feb  9 21:59:18 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:18 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:18 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:66:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:18 failover1 lrmd: [29139]: info: rsc:drbd:1:263: notify
Feb  9 21:59:18 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:18 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=263, rc=0, cib-update=357, confirmed=true) ok
Feb  9 21:59:18 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:18 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:18 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:18 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.770) : Transient attribute: update
Feb  9 21:59:18 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:18 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:18 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:18 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:20 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.773) : Transient attribute: update
Feb  9 21:59:20 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.774) : Transient attribute: removal
Feb  9 21:59:20 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:20 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:20 failover1 crmd: [29142]: notice: run_graph: Transition 66 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2825.bz2): Complete
Feb  9 21:59:20 failover1 crmd: [29142]: info: te_graph_trigger: Transition 66 is now complete
Feb  9 21:59:20 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:20 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:20 failover1 crmd: [29142]: info: do_pe_invoke: Query 358: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:20 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=358, ref=pe_calc-dc-1328842760-664, seq=20, quorate=1
Feb  9 21:59:20 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:20 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:20 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:20 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:20 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:20 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:20 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:20 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:20 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:20 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:20 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:20 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:20 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:20 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:20 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:20 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:20 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:20 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:20 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:20 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:20 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:20 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:20 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:20 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 67: 21 actions in 21 synapses
Feb  9 21:59:20 failover1 pengine: [29141]: info: process_pe_message: Transition 67: PEngine Input stored in: /var/lib/pengine/pe-input-2826.bz2
Feb  9 21:59:20 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 67 (ref=pe_calc-dc-1328842760-664) derived from /var/lib/pengine/pe-input-2826.bz2
Feb  9 21:59:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:20 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:20 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:67:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:20 failover1 lrmd: [29139]: info: rsc:drbd:1:264: notify
Feb  9 21:59:20 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=264, rc=0, cib-update=359, confirmed=true) ok
Feb  9 21:59:20 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:20 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:20 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:20 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:67:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:20 failover1 lrmd: [29139]: info: rsc:drbd:1:265: notify
Feb  9 21:59:21 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:21 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=265, rc=0, cib-update=360, confirmed=true) ok
Feb  9 21:59:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:21 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:67:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:21 failover1 lrmd: [29139]: info: rsc:drbd:1:266: notify
Feb  9 21:59:21 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:21 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=266, rc=0, cib-update=361, confirmed=true) ok
Feb  9 21:59:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:21 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:67:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:21 failover1 lrmd: [29139]: info: rsc:drbd:1:267: notify
Feb  9 21:59:21 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:21 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=267, rc=0, cib-update=362, confirmed=true) ok
Feb  9 21:59:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:21 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:21 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.782) : Transient attribute: update
Feb  9 21:59:21 failover1 crmd: [29142]: info: update_abort_priority: Abort priority upgraded from 0 to 1000000
Feb  9 21:59:21 failover1 crmd: [29142]: info: update_abort_priority: Abort action done superceeded by restart
Feb  9 21:59:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_monitor_61000 (10) confirmed on failover2 (rc=0)
Feb  9 21:59:21 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (11) confirmed on failover2 (rc=0)
Feb  9 21:59:23 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.785) : Transient attribute: update
Feb  9 21:59:23 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:157 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.786) : Transient attribute: removal
Feb  9 21:59:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_stop_0 (12) confirmed on failover2 (rc=0)
Feb  9 21:59:23 failover1 crmd: [29142]: info: run_graph: ====================================================
Feb  9 21:59:23 failover1 crmd: [29142]: notice: run_graph: Transition 67 (Complete=21, Pending=0, Fired=0, Skipped=0, Incomplete=0, Source=/var/lib/pengine/pe-input-2826.bz2): Complete
Feb  9 21:59:23 failover1 crmd: [29142]: info: te_graph_trigger: Transition 67 is now complete
Feb  9 21:59:23 failover1 crmd: [29142]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_FSA_INTERNAL origin=notify_crmd ]
Feb  9 21:59:23 failover1 crmd: [29142]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb  9 21:59:23 failover1 crmd: [29142]: info: do_pe_invoke: Query 363: Requesting the current CIB: S_POLICY_ENGINE
Feb  9 21:59:23 failover1 crmd: [29142]: info: do_pe_invoke_callback: Invoking the PE: query=363, ref=pe_calc-dc-1328842763-674, seq=20, quorate=1
Feb  9 21:59:23 failover1 pengine: [29141]: info: unpack_config: Node scores: 'red' = -INFINITY, 'yellow' = 0, 'green' = 0
Feb  9 21:59:23 failover1 pengine: [29141]: info: determine_online_status: Node failover2 is online
Feb  9 21:59:23 failover1 pengine: [29141]: notice: unpack_rsc_op: Operation drbd:0_monitor_0 found resource drbd:0 active on failover2
Feb  9 21:59:23 failover1 pengine: [29141]: info: determine_online_status: Node failover1 is online
Feb  9 21:59:23 failover1 pengine: [29141]: notice: native_print: failover-ip#011(ocf::heartbeat:IPaddr):#011Started failover1
Feb  9 21:59:23 failover1 pengine: [29141]: notice: clone_print:  Master/Slave Set: ms_drbd
Feb  9 21:59:23 failover1 pengine: [29141]: notice: short_print:      Masters: [ failover1 ]
Feb  9 21:59:23 failover1 pengine: [29141]: notice: short_print:      Stopped: [ drbd:0 ]
Feb  9 21:59:23 failover1 pengine: [29141]: notice: native_print: drbd_fs#011(ocf::heartbeat:Filesystem):#011Started failover1
Feb  9 21:59:23 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:23 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:23 failover1 pengine: [29141]: info: master_color: Promoting drbd:1 (Master failover1)
Feb  9 21:59:23 failover1 pengine: [29141]: info: master_color: ms_drbd: Promoted 1 instances of a possible 1 to master
Feb  9 21:59:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:23 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:23 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring monitor (61s) for drbd:0 on failover2
Feb  9 21:59:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring start (240s) for drbd:0 on failover2
Feb  9 21:59:23 failover1 pengine: [29141]: notice: RecurringOp:  Start recurring stop (100s) for drbd:0 on failover2
Feb  9 21:59:23 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:23 failover1 pengine: [29141]: ERROR: create_notification_boundaries: Creating boundaries for ms_drbd
Feb  9 21:59:23 failover1 pengine: [29141]: notice: LogActions: Leave resource failover-ip#011(Started failover1)
Feb  9 21:59:23 failover1 pengine: [29141]: notice: LogActions: Start drbd:0#011(failover2)
Feb  9 21:59:23 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd:1#011(Master failover1)
Feb  9 21:59:23 failover1 pengine: [29141]: notice: LogActions: Leave resource drbd_fs#011(Started failover1)
Feb  9 21:59:23 failover1 crmd: [29142]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=handle_response ]
Feb  9 21:59:23 failover1 crmd: [29142]: info: unpack_graph: Unpacked transition 68: 21 actions in 21 synapses
Feb  9 21:59:23 failover1 pengine: [29141]: info: process_pe_message: Transition 68: PEngine Input stored in: /var/lib/pengine/pe-input-2827.bz2
Feb  9 21:59:23 failover1 crmd: [29142]: info: do_te_invoke: Processing graph 68 (ref=pe_calc-dc-1328842763-674) derived from /var/lib/pengine/pe-input-2827.bz2
Feb  9 21:59:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 25 fired and confirmed
Feb  9 21:59:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 51: notify drbd:1_pre_notify_stop_0 on failover1 (local)
Feb  9 21:59:23 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=51:68:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:23 failover1 lrmd: [29139]: info: rsc:drbd:1:268: notify
Feb  9 21:59:23 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=268, rc=0, cib-update=364, confirmed=true) ok
Feb  9 21:59:23 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_stop_0 (51) confirmed on failover1 (rc=0)
Feb  9 21:59:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 26 fired and confirmed
Feb  9 21:59:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 23 fired and confirmed
Feb  9 21:59:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 24 fired and confirmed
Feb  9 21:59:23 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 27 fired and confirmed
Feb  9 21:59:23 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 52: notify drbd:1_post_notify_stop_0 on failover1 (local)
Feb  9 21:59:23 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=52:68:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:23 failover1 lrmd: [29139]: info: rsc:drbd:1:269: notify
Feb  9 21:59:24 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout)
Feb  9 21:59:24 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=269, rc=0, cib-update=365, confirmed=true) ok
Feb  9 21:59:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_stop_0 (52) confirmed on failover1 (rc=0)
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 28 fired and confirmed
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 19 fired and confirmed
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 49: notify drbd:1_pre_notify_start_0 on failover1 (local)
Feb  9 21:59:24 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=49:68:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:24 failover1 lrmd: [29139]: info: rsc:drbd:1:270: notify
Feb  9 21:59:24 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:24 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=270, rc=0, cib-update=366, confirmed=true) ok
Feb  9 21:59:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_pre_notify_start_0 (49) confirmed on failover1 (rc=0)
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 20 fired and confirmed
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 17 fired and confirmed
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 9: start drbd:0_start_0 on failover2
Feb  9 21:59:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_start_0 (9) confirmed on failover2 (rc=0)
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 18 fired and confirmed
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 21 fired and confirmed
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 48: notify drbd:0_post_notify_start_0 on failover2
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 50: notify drbd:1_post_notify_start_0 on failover1 (local)
Feb  9 21:59:24 failover1 crmd: [29142]: info: do_lrm_rsc_op: Performing key=50:68:0:4ae03e63-2073-465a-89be-fb3c8d51a7c7 op=drbd:1_notify_0 )
Feb  9 21:59:24 failover1 lrmd: [29139]: info: rsc:drbd:1:271: notify
Feb  9 21:59:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:0_post_notify_start_0 (48) confirmed on failover2 (rc=0)
Feb  9 21:59:24 failover1 lrmd: [29139]: info: RA output: (drbd:1:notify:stdout) drbdsetup 1 syncer --set-defaults --create-device
Feb  9 21:59:24 failover1 crmd: [29142]: info: process_lrm_event: LRM operation drbd:1_notify_0 (call=271, rc=0, cib-update=367, confirmed=true) ok
Feb  9 21:59:24 failover1 crmd: [29142]: info: match_graph_event: Action drbd:1_post_notify_start_0 (50) confirmed on failover1 (rc=0)
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_pseudo_action: Pseudo action 22 fired and confirmed
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 10: monitor drbd:0_monitor_61000 on failover2
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 11: start drbd:0_start_240000 on failover2
Feb  9 21:59:24 failover1 crmd: [29142]: info: te_rsc_command: Initiating action 12: stop drbd:0_stop_100000 on failover2
Feb  9 21:59:24 failover1 crmd: [29142]: info: abort_transition_graph: te_update_diff:146 - Triggered transition abort (complete=0, tag=transient_attributes, id=failover2, magic=NA, cib=0.36.794) : Transient attribute: update
root@failover1:/var/log#