edit: and by drove with them on I am referring to new rear brake pads.[/b]
See that's what happens when you don't read. Clearly you're talking about rear DISK brakes, because DISK brakes have PADS. We....are clearly talking about DRUM brakes, it even says that in the title..rear drum brakes.
Now, although 94clit has "said before" how to do it, you must know, that it will adjust in one direction quite easily. That will actually LOOSEN the adjuster. You will need to find the star wheel and figure out the "harder" direction in order to adjust it tighter. As was stated, you will start to feel drag on the tire as it spins, adjust it to where it spins about 3/4 rotation, pump the brake pedal several times and re-check the "spin". You might need to do it a few times until it is consistent, once it is, do the other side.