Clubs behind RLWC withdrawals, Graham says