Niggling is a word often used in my family.
gerund or present participle: niggling
cause slight but persistent annoyance, discomfort, or anxiety.
"a suspicion niggled at the back of her mind"
synonyms: irritate, annoy, bother, provoke, exasperate, upset, gall, irk, rankle with;More
informalrile, get to, bug
"his behavior does niggle me"
find fault with (someone) in a petty way.
"colleagues say he loved to niggle and criticize people"
synonyms: complain, quibble, nitpick, fuss, carp, cavil, grumble, gripe, grouse, moan
"he niggles about the prices"
BUG - there's your colloquialism!