Personally this is why I don't have sex with people in my friend group. You're not the asshole though, you sleeping with him doesn't like destroy your friend's chances of being with him if as you said he's not interested in relationship and she's trying to move on anyway. That said, it could get out and would probably hurt your friend's feelings, and since it's just casual sex and not serious, I'd probably stop.