Yes, a rubber glove will help. Most electric fences do not have a very high charge and they are most likely intermittent. I have held the wire and waited for the charge, most of the time it is a small jolt and not life threatening. I used to grab the wire and touch someone else, they usually jumped more than I did.
Not all electric fences are the same...I surveyed a goat farm a while back and got the p*ss knocked out of me when I grabbed the plastic handle where the fences connect...ain't supposed to do that.....I've touched a couple with the bipod setting on a point and guess what....zap a roonie....be careful...