While importing contacts to your subscribers, you can choose to put those contacts into a list that you've already created. You can select the list after you've opened the Add contacts window, and have input your contact details. For more information on these steps, see: Add contacts
You can use this method when re-segmenting, or doing any kind of maintenance on your lists. And you don't have to worry about creating any duplicate subscribers.