While looping through the a players inventory contents by using inv.getContents(). When running inv.removeItem(item) on the offhand item. It will not remove any item from the inventory.

The work around for this is to use inv.setItemInOffhand(null). But this is undesirable as it required tracking the index of the current item.