Definitely worth switching pills. Maybe try a higher or lower dose of the pill you’re currently on, as your skin is fine most of the time? Or ask what your doctor recommends.
Switching pills worked for me in the past when I was on a pill brand that was making me break out really badly. Bear in mind it might take a few weeks/months for your body to adjust to a new pill and your skin to settle down.