No it’s not weird to go to your boyfriend’s family member’s funeral, you’re overthinking.
Or at least where I’m from it’s very common to go funerals of relatives of friends, coworkers and people you don’t know super well but see often or used to know better or are neighbours with. Especially if you live near where the funeral takes place.