Sounds like the wrong part to me...the seal should not be that loose...and should require some force upon installation, which is why the old one came out the way it did.
I don't believe there is a washer behind the yoke...if I remember correctly it's just the seal, then the yoke and nut.
Matt