I can't bother him with my little affairs.

我不能为这些小事去烦扰他。

《新英汉大辞典》

youdao

Oh, bother him! He's never around when you need him.

哎呀，他可真讨厌！需要他的时候从来都找不到他。

《牛津词典》

He refused to allow his knee to bother him as he ran beside the girl.

NEWYORKER: The Valetudinarian

James Hills discovered that a colleague is gay via Facebook, but he says that didn't bother him.

WSJ: How Facebook Can Ruin Your Friendships

But if someone else without an understandable motive did this, he admits that it would bother him.

FORBES: Confessions of an Online Stalker