Normal skin URLs expire at random once the user changes their skin. To mitigate that, the skin has to be saved in the replay.
This seems to be even worse with skulls because they appear to not always store the skin URL but sometimes only the player name and/or UUID.