Monitoring Impromptu Conference Calls

We have several users that have impromptu conference calls. They are requesting the ability to see who is on the call and then have the ability to drop callers as their part of the call is over. Currently, to insure that a caller that should not be privy to additional details, they have to drop the entire call and then start a new conference call with the smaller group.