It should be fine to switch, but personally I would switch after all your active pills are done. It only takes 2 days (so 3 pills) for the mini pill to be working so you will be fine even with the 2 day break. Your mini pill would cover you by the time you would have normally ended your break week anyway.