A batch axis is not a time axis

Shuffling axis 0 is harmless for a batch: examples are independent, and their order carries no information. It destroys a video, where order is the information.

The same operation, on the same shape, with a completely different meaning. Nothing in the array can tell you which case you are in — only the metadata can: acquisition records, timestamps, sample IDs.