Basics of Satisfaction Survey Design – Part 4 of 4

Customer satisfaction evaluation

Avoid These Common Survey Question Design Pitfalls

Many times, survey questions are inherently designed to give unclear or less meaningful information. Familiarize yourself with these common mistakes BEFORE you design your questions:

Asking two questions at once (double-barreled questions)

Example:

How satisfied are you with the hours and location of our offices?

[ 1=very dissatisfied, 5=very satisfied]

You won’t be able to tell whether the participant is responding about the time, or the location, so you should ask this as two separate questions.

Leaving out a response choice

Example:

How many times in the past month have you visited our website?

[ 0 1-2 3-4 5 or more]

Always include an option for “not applicable” or “don’t know”, since some people will not know or remember, and if they guess, their answer will skew the results.

Leading questions

Based on their structure, certain survey questions can “lead” participants to a specific response:

Example:

This agency was recently ranked as number one in customer satisfaction in the federal government. How satisfied are you with your experience today?

[ 1=very dissatisfied, 5=very satisfied]

The first statement influences the response to the question by providing additional information that leads respondents to a positive response, so you should leave that text out.

Built-in assumptions

Survey questions that assume familiarity with a given topic:

Example:

This website is an improvement over our last website.

[ 1=strongly disagree, 5=strongly agree]

This question assumes that the survey participant has experience with the earlier version of the website.

After you design your questions, go back over this list and check yourself. Did you make any of these mistakes?

It’s worthwhile spending the time to edit now for more meaningful feedback.

(Many thanks to USA.gov for guidance on question design pitfalls.)

——————

For more resources, see our Library topics Marketing and Social Networking.

.. _____ ..

ABOUT Lisa M. Chapman:

Ms. Chapman’s new book has a name change! The Web Powered Entrepreneur – A Step-by-Step Guide will be available in April 2012. Lisa M. Chapman serves her clients as a business and marketing coach, business planning consultant and social media consultant. She helps clients to establish and enhance their online brand, attract their target market, engage them in meaningful social media conversations, and convert online traffic into revenues. Email: Lisa @ LisaChapman.com

F is for Focus

Young lady presenting while writing on the board

We continue with our alphabet of terms for great speaking.

Focus. When we speak in a focused way, all our energy works toward the same end–getting our message across. Our thoughts, our words, and our bodies all work together to send a unified, cohesive message. When we are in this particular state, words tend to come more easily, we gesture more dramatically, and it is almost as if we forget about ourselves. We speak fluently, with fewer fillers like “um” and much more dynamic expression. So how do you get to focus? Sometimes it is by directing our attention on the audience and what we bring to them. Sometimes it is being clear and passionate about our subject matter. Very rarely does it happen by thinking about our own selves or how well we are doing.

Friendly. Once again, when we focus on ourselves, or on the words themselves, we tend to get very serious. Our faces tense up, and often our bodies do too. We are there, but not there. We are all in our heads, not present in the moment. We often don’t even see the audience in front of us. Next time you speak, before you begin, make a conscious effort to connect with the audience. Look at the faces before you. Extend your gaze. Soften your eyes. Put on a welcoming smile. Breathe. Now you are ready to begin. Allow yourself to be present, to give of yourself to your audience. Don’t worry so much about what words you use, but about the thoughts and messages you wish to share.

Fresh. Are your ideas, your words, your very phrases stale and outdated? Or do you bring fresh perspective every time you speak? Sometimes we give the same presentations over and over until we get bored with them. We go on autopilot, mouthing the words without really connecting with them. Guess what? The audience can tell! If you have ever gone on autopilot, consider it an opportunity. Once you know the content well enough to go on autopilot, you have the opportunity to play with it. Change the sequence. Change the stories and illustrations you use. Instead of telling, use dialog to get everyone discussing the information. One well-known consultant in our area says he changes one third of his content every year, so he is constantly adding fresh content, and every three years it is completely revamped. This seems healthy to me. If your presentations seem stale, do something different each time you speak. Trust me, it will wake you up and keep you on your toes. It will make you a better speaker.

Are you a focused, friendly and fresh speaker? How did you get that way? How do you stay that way?

If you think of great words for upcoming letters, please add a comment.

Basics of Satisfaction Survey Design – Part 3 of 4

A feedback survey response on a desk

Common Survey Question Types and Examples

Multiple choice questions

Multiple choice questions have two or more answer options. Useful for all types of feedback, including collecting demographic information. Answers can be “yes/no” or a choice of multiple answers. Beware of leaving out an answer option, or using answer options that are not mutually exclusive.

Example 1: Are you a U.S. Citizen? Yes / No

Example 2: How many times have you called our agency about this issue in the past month?

□ Once

□ Twice

□ Three times

□ More than three times

□ Don’t know/not sure

Rank order scale questions

Questions that require the ranking of potential answer choices by a specific characteristic. These questions can provide insight into how important something is to a customer. Best in online or paper surveys, but doesn’t work too well in phone surveys.

Example: Please rank the following customer service factors, from most to least important to you, when interacting with us. (1=most important; 5=least important)

1st 2nd 3rd 4th 5th

□ □ □ □ □ Call wait time

□ □ □ □ □ Call hold time

□ □ □ □ □ Representative’s customer service skills

□ □ □ □ □ Representative’s knowledge skills

□ □ □ □ □ Resolution of issue

Rating scale questions

Rating scale questions that use a rating scale for responses. This type of question is useful for determining the prevalence of an attitude, opinion, knowledge or behavior.

There are two common types of scales:

1. Likert scale

Participants are typically asked whether they agree or disagree with a statement. Responses often range from “strongly disagree” to “strongly agree,” with five total answer options. (For additional answer options, see table below.)

Each option is ascribed a score or weight (1 = strong disagree to 5 = strongly agree), and these scores can be used in survey response analysis. For scaled questions, it is important to include a “neutral” category (“Neither Agree nor Disagree” below).

Example:The customer service representative was knowledgeable”

□ 1. Strongly Disagree

□ 2. Disagree

□ 3. Neither Agree nor Disagree

□ 4. Agree

□ 5. Strongly Agree

2. Semantic differential scale

In a question using a semantic differential scale, the ends of the scale are labeled with contrasting statements. The scales can vary, typically using either five or seven points.

Example:How would you describe your experience navigating our website?

□ 1. Very Hard to Navigate

□ 2. Somewhat Hard

□ 3. Neither Hard nor Easy

□ 4. Somewhat Easy

□ 5. Very Easy to Navigate

Open-ended questions

Open-ended questions have no specified answer choices. These are particularly helpful for collecting feedback from your participants about their attitudes or opinions. However, these questions may require extra time or can be challenging to answer, so participants may skip the questions or abandon the survey.

In addition, the analysis of open-ended questions can be difficult to automate, and may require extra time or resources to review. Consider providing extra motivation to elicit a response (e.g., “Your comments will help us improve our website”) and ensure there is enough space for a complete response.

Example: What are two ways we could have improved your experience with our agency today? We take your feedback very seriously and review comments daily.

Next time, we’ll discuss common mistakes and how to avoid them

(Many thanks to USA.gov for guidance on question design.)

——————

For more resources, see our Library topics Marketing and Social Networking.

.. _____ ..

ABOUT Lisa M. Chapman:

Ms. Chapman’s new book has a name change! The Net Powered Entrepreneur – A Step-by-Step Guide will be available in April 2012. Lisa M. Chapman serves her clients as a business and marketing coach, business planning consultant and social media consultant. She helps clients to establish and enhance their online brand, attract their target market, engage them in meaningful social media conversations, and convert online traffic into revenues. Email: Lisa @ LisaChapman.com

To Train Or Not To Train A Technical Writer

An instructor training a staff while pointing at the laptop screen

Lots of questions have been asked as to whether or not you need formal training to be a Technical Writer. Personally, I feel the answer is yes. You need to have some kind of training or degree, whether it is a degree in journalism or a certificate in Business Writing, or a degree in English or Communication. But it is even more than that. Today’s Technical Writer needs a technical degree or a technical background to get a foot in the door, such as a degree in the Sciences, i.e., Biology, Computer Science, Engineering, etc. Many companies have hired people who are not technical and are just writers and have been disappointed in the results. Reason being, their responsibilities included:

  • Gathering requirements from subject matter experts such as clients, developers, etc.
  • Translating complex technical information, development and relational database concepts into clear easy to understand language for developers and users as well as for training and marketing material
  • Understanding complex technical information and organizing it into logical sections that can be followed by the target audience
  • Creating a variety of documents that involve standard operating procedures, request for proposals as well as usability testing and regulatory compliance requirements
  • Having good communication skills and being able to stick to schedules
  • Developing project plans and being a knowledge liaison across departments.

Originally, people started off with a degree in writing (i.e., journalism, Business Writing, English) and worked in various companies or did freelance work. Sometimes this work took them into the technical writing arena. From there, they gained more and more experience within the technical field.

If you begin with a technical degree, you can end up writing for an infinite variety of industries from financial to education, to technical companies to publishing, to Civilian and Defense industries to government contracts, to any kind of global contract. If you begin with a degree in the sciences like Biology, you can possibly end up working in pharmaceutical companies or in a related field. Also, fields such as engineering, chemistry, physics, aerospace, manufacturing, computing, finance, consumer electronics, and biotechnology all need Technical Writers. The field is wide open to you.

So yes, you need some sort of training to be a Technical Writer, because a Technical Writer has to comprehend technology in a way that can be explained to a target audience. You have to be able to research and understand the technology you are working in. Think of the position as a Technical Communicator, because we are translators and professional editors. We are translators because we break down technical terminology into understandable everyday usage for our target audience. We are editors, because our documentation has to be error free in the usage of grammar, spelling, etc. This is especially important when producing writing matter such as marketing, training, or compliance material, which reflects upon a company’s image.

Do you agree?

Basics of Satisfaction Survey Design – Part 2 of 4

A lady with a survey form on her screen

Question Design

The way you design your questions will certainly affect the way the questions are answered. Or even IF they’re answered! We’ve all been caught on the phone with a surveyor who promised to take 3 minutes, then proceeded to ask 15 or more questions. Don’t ever be that person.

The Golden Rule “Do unto others…” certainly applies here.

Basics of Survey Questions

Keep questions short and easy to read. The longer and more complex the questions, the less accurate feedback you’ll get. This is particularly true of phone surveys.

Keep questions easy to answer, otherwise participants may abandon the survey, or provide incorrect information (e.g., giving the same answer/value for all questions, simply to get through the survey).

Keep “required” questions to a minimum. If a participant can’t or doesn’t want to answer a required question, they may abandon the survey.

Use a consistent rating scale (e.g., if 5=high and 1=low, keep this consistent throughout all survey questions). For rating scales, make sure your scale is balanced (e.g., provide an equal number of positive and negative response options).

Label each point in a response scale to ensure clarity and equal weight to each response option.

For closed-ended questions, include all possible answers, and make sure there is no overlap between answer options.

  • Use consistent word choices and definitions throughout the survey.
  • Avoid technical jargon and use language familiar to participants.
  • Be as precise as possible to avoid word choice confusion. Avoid words like “often” or “rarely”, which may mean different things to different people. Instead, use a precise phrase like “fewer than three times per week.”
  • Try to construct the questions as objectively as possible.

‘Skip Logic’ or ‘Conditional Branching’

When creating technology-based surveys, skip logic can be helpful. Skip logic enables you to guide participants to a specific follow-up question, based on a response to an earlier question. This technique can be used to minimize non-relevant questions for each participant, and for filtering out survey participants. For example, if you are looking for U.S. citizens only to fill out certain parts of your survey, anyone who answers “no” to the question “Are you a U. S. citizen?” can be skipped to the next relevant section.

Next time, we’ll discuss common survey question types and examples.

(Many thanks to USA.gov for guidance on question design.)

Do you have a favorite style for designing survey questions?

——————

For more resources, see our Library topics Marketing and Social Networking.

.. _____ ..

ABOUT Lisa M. Chapman:

Ms. Chapman’s new book has a name change! The Net-Powered Entrepreneur – A Step-by-Step Guide will be available in April 2012. Lisa M. Chapman serves her clients as a business and marketing coach, business planning consultant and social media consultant. She helps clients to establish and enhance their online brand, attract their target market, engage them in meaningful social media conversations, and convert online traffic into revenues. Email: Lisa @ LisaChapman.com

E is for Energy

Team rejoicing working together on a project in an office

If you follow this blog you know we are working our way through the alphabet, selecting words for each letter that embody different aspects of speaking and presenting. We have made our way to the letter “E.”

Energy. We all know how important energy is; too much and you feel like a nervous wreck, speaking too fast and bouncing off the walls like a toddler with too little sleep and too much sugar. Too little energy and you can come across as sleepy, slow, b o r i n g. Managing your energy so it is just right is a little tricky, but once you learn how to use it properly, you will be able to handle yourself under all kinds of pressure. As a result, your energy works with you and gives you power. (One little tip; stop thinking about nervousness, and think instead about using your energy rather than letting it act on you.)

Engaging. Usually the second thing my clients say makes a great speaker is being engaging. (The first one is confident!) A great speaker doesn’t just talk at or even to the audience, instead they engage them in dialog. You really can’t be boring if you are truly engaging. The best speakers use stories, examples, metaphors, visuals, discussions, or activities—whatever it takes to bring content to life and life to the audience. They ask questions, listen intently and care what the audience thinks. Great speakers encourage their audiences to ask meaningful questions, and they answer honestly. They foster give and take in every aspect of their presentations. They turn every talk into a conversation. And guess what? You can do these things as well.

Eye contact. This is such an important delivery skill, and one we sometimes overlook or underestimate it. Think about it; when you are face to face, eye contact is the single most important way to connect with your audience. Trouble is, when you are focusing on your thoughts, your words, or your slides, you might forget to look at your audience. Or it might be distracting, so you look away. Take time today to monitor your eye contact, and see if you can make a slow, steady connection with each person you are speaking with. Better yet, ask a trusted colleague to observe you and give you feedback on your eye contact. Ideally, it will be slower than sweeping the audience, but shorter than a staring contest. Two to four seconds per person is realistic but takes plenty of practice to master.

How have your embodied these attributes in your speaking? What results or outcomes have you enjoyed?

What other words come to mind for the letter E? And how about upcoming letters? Submit your ideas and get extra credit!

Basics of Satisfaction Survey Design – Part 1 of 4

Satisfied smiling man showing okay sign with his hand

Initial Design Considerations

Before you design your survey…

Clearly articulate the goals of your survey. Answer these questions before you even start. With this in mind, your survey has a 100% better chance of returning meaningful information.

  • Why are you running a survey?
  • What, specifically, will you do with the survey results?
  • How will the information help you improve your customer’s experience with you?

Make sure that each question will give you the right kind of feedback to achieve your survey goals. When in doubt, contact a statistician or survey expert for help with survey question design.

Survey design

The opening should introduce the survey, explain who is collecting the feedback and why. You should also include some reasons for participation, and share details about the confidentiality of the information you are collecting.

The introduction should set expectations about survey length and estimate the time it will take someone to complete. Opening survey questions should be easy to answer, to increase participant trust and encourage them to continue answering questions.

Ensure survey questions are relevant to participants, to reduce abandonment. To minimize confusion, questions should follow a logical flow, with similar questions grouped together.

Keep your survey short and to the point – fewer questions will deliver a higher survey response rate. If you have sensitive questions, or questions requesting personal information, include them towards the end of the survey, after trust has been built.

Test your survey with a small group before launch. Have participants share what they are thinking as they fill out each question, and make improvements where necessary.

Thank your participants after they’ve completed the survey.

Next time, we’ll discuss specific question styles that affect the quality of your answers.

(Many thanks to USA.gov for guidance on survey design.)

Do you have a favorite survey design that’s worked for you?

——————

For more resources, see our Library topics Marketing and Social Networking.

.. _____ ..

ABOUT Lisa M. Chapman:

Ms. Chapman’s new book has a name change! The Net-Powered Entrepreneur – A Step-by-Step Guide will be available in April 2012. Lisa M. Chapman serves her clients as a business and marketing coach, business planning consultant and social media consultant. She helps clients to establish and enhance their online brand, attract their target market, engage them in meaningful social media conversations, and convert online traffic into revenues. Email: Lisa @ LisaChapman.com

What is a Bug List?

Stressed young business man having headache because of a bug

When problems are encountered during the testing phase of a product or application, they have to be noted so that the problem can be corrected or prevented before the next testing phase. These problems have to be noted within a form known as a List of Errors form or a Problem and Resolution form or an Incident form. For us right now, we’ll simply call it a Bug List. Any irregularities or anomalies noted within the Bug List will be passed to the development group, who will resolve the problem.

The Bug List should contain at least 5 columns. The column headings should be listed accordingly: ‘Date Bug Found’, ‘Description of Bug, ‘Resolution’, ‘Date Bug Closed ‘, and ‘Comments’. The tester will describe in extreme detail the exact steps that led up to the occurrence within the ‘Description of Bug ‘column. This part of the form is crucial for replicating an error. Without it, the developer will not be able to duplicate the error and hence correct it.

For finding bugs (problems), every test plan has to be extremely detailed and every test scenario listed. Yes, there will be times when not every case/scenario is noted. If the tester does create a unique case, this case should be noted within the bug list. This way, when the application/product goes into the next testing phase, this new test case will be added to the test plan, as well as tested.

When testing is completed, the list will be directed to the appropriate developer and Project manager involved. Every bug found should be corrected, but then there are various grades of bugs. There are quick fixes, such as spelling errors, simple fixes which involve minor programming, i.e., a value was to be added and wasn’t, medium sized fixes which take a few hours when a functionally will not work under certain conditions, serious ones which require rework, and red flag ones where the applications/product seizes to work. Depending on time constraints, the more serious ones (red) will be corrected first. Then when time allows the minor ones will finally be corrected.

Once the problem is corrected by the developer and the fix is inserted into the ‘Resolution’ column, the tester will be informed. The tester will then perform regression testing where the tester tries to recreate the error. Once the tester is satisfied that the issue is resolved, a date for closing the bug can be inserted within the ‘Date bug closed’ column, and any pertinent comments needed can be added to the ‘Comments’ column.

For more complicated testing, there are now programs that will perform automatic testing when needed for direct testing and for regression testing. These new applications are really helpful especially when repeated tests need to be done. To help you keep track of all the bugs, there are also programs out there now that will assist you in keeping track of all bugs. These tracking programs are very useful, especially when a Quality Assurance Manager needs to be on top of all Red flagged issues.

This part of the Testing phase, where time is spent on creating the Bug list, has to be taken into consideration when scheduling time within the project plan. The same goes for adding in time for correcting problems and regression testing. Without the project plan, we would not be aware of our time line or different events that have to occur from a product or applications initiation or start to its completion. But to get back to the Bug list, without it, we would not be able to communicate and keep track of all these problematic issues that need to be resolved.

The Best Satisfaction Surveys

Survey satisfaction on customer service

Improve Your Business with Free Online Customer Surveys

Do you want to provide better service to your customers – service that beats your competition?

One very quick and easy way to tap into the core of what your customers really want is a free, automated online customer satisfaction survey tool. Many companies offer free versions of their survey tools. They do it for the publicity and the new prospect awareness they get. In return, you get an awesome tool. And if you really like it, you may upgrade to expand your reach. That’s a great deal!

When should you use an online satisfaction survey?

Email surveys are useful for collecting feedback after an online customer service interaction such as an email or chat; after a website visit; or for proactively reaching out for customer feedback. While email surveys are often used to collect feedback after an in-person or telephone interaction, it is a good idea to collect feedback through the same channel as the initial interaction.

Sample email customer satisfaction survey questions include:

  • Did we provide the information/answer you needed? [yes/no]
  • How easy was it for you to interact with us through email? [1 = not easy to 5 = very easy]
  • How satisfied are you with the service you received from us? [1= very dissatisfied to 5=very satisfied]

Pop-up and website customer surveys

Pop-up or website surveys are useful for collecting feedback after a customer has visited your website, or for collecting feedback from customers for whom you do not have contact information. Sample pop-up or website survey questions include:

  • Why did you come to our website today? [list answers]
  • Were you able to complete your task? [yes/no]
  • If you were not able to complete your task, why not? [open-ended]

Free Online Customer Survey Tools

Expect a few limitations with the free versions. They won’t affect the process, but they do usually impose some limitations, such as number of surveys or number of responses. The upgraded paid versions are usually quite affordable, and relatively not very expensive.

QuestionPro – The free version allows an unlimited number of responses, but you are limited by number of surveys (2) and questions per survey (10). Upgrade for $15.

Survey Gizmo – The restriction on the free version is the number of responses (250). But you can have unlimited surveys and questions. Upgrade options start at $19 a month.

Survey Monkey – The restriction on this free version is the number of responses – (100) and also the number of questions (10). Upgrades start at $19.95 a month.

A plan of action for following up on customer feedback is critical for your survey’s success.

When was the last time you used a customer satisfaction survey? What did you learn? What do you recommend to other companies?

——————

For more resources, see our Library topics Marketing and Social Networking.

.. _____ ..

ABOUT Lisa M. Chapman:

Ms. Chapman’s new book has a name change! The Net Powered Entrepreneur – A Step-by-Step Guide will be available in April 2012. Lisa M. Chapman serves her clients as a business and marketing coach, business planning consultant and social media consultant. She helps clients to establish and enhance their online brand, attract their target market, engage them in meaningful social media conversations, and convert online traffic into revenues. Email: Lisa @ LisaChapman.com

D is for Dynamic

A young lady smiling and moving her hands

We have been exploring the qualities of great presenters, starting with A and on our way to Z. Each week we list one or several attributes of great presenters and communicators, and suggest some ways you can build that characteristic in your own speaking.

If you want to play along, suggest your own great words starting with that letter of the week. Better yet, help me out by suggesting a word for the next letter of the alphabet! And let me know how you are using these ideas to build your own habits and characteristics for great speaking.

Dynamic: having life, energy, passion about your topic. Nothing can replace this! If you are worried about remembering your lines, this can rob all your energy and leave you flat. Audiences today have very little tolerance for a speaker just reading the slides. Break away. Tell a story. Talk about the problem, or your solution, or your audience. Breathe life into your presentation. Ahhhh! Much better!

Daring: if everyone else just reads through the boring bullets, are you really going to do the same thing? You could, of course. But why not be a little bit daring? Hide some of your slides. Edit out some of the detail. Add in a few great graphics. Photos of the team or the customer’s plant. Hit the “B” key while presenting a get a black screen, turning the attention off the slides and onto you. Now that’s daring.

Distinctive. What is your unique presentation strength? What makes you special? If it is your expressive voice, play that up. If it is your ability to tell stories, weave them in. If you are really good at humor—and you might want to ask someone to validate this—sprinkle some in. If you are great at facilitating a lively discussion, feature that in your presentations. No one can be you, so find what makes you distinctively different, and run with it.

How have your embodied these attributes in your speaking? What results or outcomes have you enjoyed? What cautionary tales would you add to those willing to be daring, distinctive and dynamic?

What other words come to mind for the letter D?