Hi,
I don't have canon brand lenses so I cant answer the difference in IS-USM and other stuff that Canon presents in those lenses. But I can tell you about f/4-5.6. THe f/ is used on all camera and lenses. It is called the aperture. The lower number means how wide the openning is and much light you are letting into the lenses. As you go higher the lens opening decreased, allowing fewer light in. A low aperture such as f/2.8 is an ideal setting for portrait and photographing in low light situations. You can increase the light and blur the background. A higher aperture like f/5.6 is an ideal for landscapes or outdoor shootings of various faraway subjects or if you want every subject in the photo to be in focus. A lens that is lets say 75-300mm zoom and f/4-5.6 means that the aperture is set at f/4 when you are at a 75 mm zoom. THe f/ increases as you zoom in eventually hitting f/5.6 when you reach 300mm.
More expensive lenses have a constant f/2.8 or lower. This is more capable because the aperture will stay at f/2.8 and will only increase if you tell it to by switching into manual or aperture priority.
As for EF, I believe it is the standard name for Canon EOS compatable lenses. Even aftermarket brands of lenses that are made for Canon EOSs have "EF" of the rear lens caps.
Here is the Canon homepage for the lenses they have to offer.
http://www.usa.canon.com/eflenses/
This is all I know for now. I hope it helps. Good luck! Any more questioins, leave a comment on my guestbook, send me an email or a private message.
Hugh