If you’re a perfect user of birth control, birth control is 99.7% effective at protecting pregnancy. There is always a risk, but shouldn’t be a concern for him to finish inside of you if you take it correctly. If you miss pills often or are not entirely confident in your usage, I wouldn’t go condomless all the time, but that’s just my opinion.