Thus, for analyses such as Elo rating, where the order in which contests occurs matters, one must resort to creating a set of randomly shuffled contest sequences to be able to assess the effects of temporal order.