You may have to slide the armrest back to better access the retainers.
Using a flat-bladed plastic trim tool, release the retaining clips.