What does following a jelly mean?

If Community Feed announces that you were followed, what does that mean? Should I be looking over my shoulder? Carrying a loud whistle? Or tear gas? Packing a gun? Pretend You don’t think I’m as ignorant as I feel.