Press and hold your item until two symbols appear. One of them is a minus. Tap on it and your item will be removed.
Furthermore, you can remove items from your overview. Thus, tap on the “plus icon" of your icon bar. After that, an overview of all your items which are currently in your dressing room is going to appear. You can remove those items by swiping left to right.