Option to disconnect one party in a conference call

We should have the option to disconnect the last call dialed or either number dialed in a conference call if we initiated the call our ourselves with both numbers.