I don’t think it’s uncommon for people to get anxious about this, I have not experienced a pregnancy scare myself as I used condoms until I was educated on how the pill works which then helped trusting it.
It’s important to understand that birth control tricks your body into thinking it is already pregnant, that’s why so many of the side effects are similar.
If you remain anxious and/or paranoid you should keep using condoms as you might need more time to learn about your pill and trust it. There is no shame in that.