My sister ran across this today.
Underneath that Two of Diamonds is a third Ace of Diamonds. When it dealt out the next two aces, she packed it in.
Back when I used Windows, I only saw Solitaire change the cards in the deck. But my sister gets these duplicates cards on a semi-regular basis.