When you have no experience developing or conducting a usability test, sometimes the best thing you can do is walkthrough the website with co-workers from another department or family members, either giving very loose directions, ask them to do tasks or simply observing what they click on.

Do this a handful of times, and you'll start to get an idea of what the "issues" are and before you know it, you'll have a list of questions in front of you.