Can a person attuned to Living Gloves cast Remove Curse on themselves to remove them?

The living gloves (E:RftLW, pg. 278) have the feature Symbiotic Nature:

The gloves can’t be removed from you while you’re attuned to them, and you can’t voluntarily end your attunement to them. If you’re targeted by a spell that ends a curse, your attunement to the gloves ends, and they can be removed.

If I am attuned to the living gloves and know the spell remove curse, would casting remove curse on myself count as voluntarily ending my attunement to them?

This is a follow up to this question, wherein a process for achieving ready access to all artisan tool proficiencies is described using remove curse to unattune to the living gloves.