Stop doing action for handles and ignore responses after shutdown

Stop doing action for handles and ignore responses after shutdown #631