Yes, all unsubscribed contacts are removed from your lists.
How do I do an email address search for an individual email?
How do I add new fields to a list in the Contact Manager?