Fabolous explains why he doesn't let "Love & Hip Hop" direct his personal life