It's all easy to do with Excel, which you have, and Word.
In Excel create a top row of headers with Name, Address, City, State, Zip in the top 5 cells (A1, B1...).
Enter your addresses, or copy/import them (if you know how to do it) from your source material (if it's already been entered on your computer) in each column corresponding with your top row headers.
Save the Excel file.
Open Word. Go to menu Tools, and choose Letters and Mailings. Choose the Mail Merge Wizard. Follow the prompts, appearing--I believe--in a pane on the right side of your window.
Choose Labels. On the bottom of the pane, click Starting Document.
Change document layout: click Label Options. Select the label size/style parameters from the supplied list. On the bottom click Select Recipients.
With Use an existing list selected, click Browse.
Find and choose your saved Excel file as the data source.
Follow any other instructions/prompts (you should have the idea by now) and do the final mail merge.
Print the labels on plain white for a registration test (hold label stock and the printed paper up to the light to verify that each label will fit).
Insert your label stock into your printer (either in the manual tray, as is the default, or set up your print options to pull from Tray 1).
Incidentally you can also follow this procedure under Tools for printing envelopes. Just choose Envelopes instead of labels.