Project 18: Quantitative Evaluation of
Keyboards
Instructions to Subjects
A.1 Description of the Experiment
The following description should be read to each subject at the beginning
of the experiment. Italicized text are instructions to the experimenter.
Before you begin, you should have a worksheet available for the subject.
You should also have the interface up and running, with the Qwerty layout
selected. No other windows should be visible. Also, assign subjects a subject
number. Assume this one is Subject B02-13-3.
Introduce yourself. Give them the consent form to sign, on their worksheet.
If it is not signed, do not proceed.
- My name is _________, and I will be giving you instructions on what
to do and will answer your questions.
- You're helping us by trying out a new product in the early development
stages. We have several different versions of this product, and we're looking
to see which version is the easiest to use. If you have trouble with some
of the tasks, its the product's fault, not yours. Don't feel bad; that's
exactly what we are looking for. Remember, we are testing the product versions,
not you.
Tell the participant that it's OK to quit at any time.
- Although I don't know of any reason for this to happen, if you should
become uncomfortable or find this test objectionable in any way, you are
free to quit at any time.
Tell them about the experiment, and record the subject id.
- Our team is working on a computer that does not have a keyboard. Because
text entry may be occasionally required, we plan to put a simulated keyboard
on the screen, such as the one you see in front of you, through which people
can "mouse type". Show them the screen. The keyboard includes
only lower case letters and a space bar. There are no numbers or backspace
key. Anything you type appears on this one line entry.
- You "mouse-type" by selecting a key on the screen. For example,
I will type your subject identification, which is "subject b two thirteen
three". Notice that I have to press this button on the upper corner
before it will let me type.
Press the "Press here to begin" button and mouse-type "subject
three four".
- When I am done, I press this button to tell the system I have finished.
Press the "Press here when done" button.
Point to the screen
- The purpose of this experiment is to study people's ability to "mouse-type"
using a variety of different keyboard layouts. The keyboard layouts we
will use are as follows. This layout is called a Qwerty keyboard, and is
the same layout usually found on typewriters and computers.
Select the Phone Pad layout.
- This layout is called a phone pad keyboard. Notice that the letters
are arranged as they are on your telephone. I'll type the word 'test' on
it to show you how it works.
Start typing. You type a letter by pressing and cycling through
each letter on a key until the correct letter appears. To accept the next
character, you have to press the '>' key. To type a space, you have
to press the '>' twice.
Leave a space and show that the letters s an z require 4, not 3 button
presses. Also notice that the 'prs' button includes the letter 'q',
while the 'wxy' button includes the letter 'z'.
Select the Alphabetic layout.
- This layout is called an alphabetic keyboard. Notice that the letters
are arranged in alphabetic order. I'll type tye word test on it to show
you how it works.
Note: Don't tell subjects about the possible advantages or disadvantages
of each method!
Administer the pre-test questionairre on the worksheet. Write down the
answers as they are supplied!.
- Before we begin the typing task, I would like you to answer a few questions
found on this form.
A.2 Specific task instructions
Don't forget to record any comments on the workheet.
- For all typing tasks, I am going to ask you to type as fast as you
can. However, I want you to avoid typing errors. If you do make an occasional
mistake, just keep on going... there is no backspace key!. If you make
many errors, then you are probably trying too hard and you should slow
down a bit.
Task 1: Measure their touch typing ability. Set it up to the qwerty
keyboard
- We will begin by measuring your actual typing speed using the physical
keyboard.
Give them the paragraph.
- Please read the following paragraph aloud. When you are ready to begin,
I will press this button and tell you to begin typing. When you are done,
tell me and I will press the button again. Any questions?
Do it!
- Now lets do it again with the next paragraph. Ask them to read it
aloud, and repeat the previous step.
Task 2, 3 and 4: Measure their mouse typing ability with various keyboards.
Note that the order you run these experiments in will be assigned by your
TA! For illustration, assume the order is Phone and Alphabetic. Change the
layout to the Phone keyboard.
- Now we will see how fast you can mouse-type on the phone keyboard.
As before, you should type as fast as you can while still avoiding typing
errors. This time, you will be pressing the button at the beginning and
end. Read the first sentence aloud, and start whenever you are ready. This
sentence is for practice.
Note: Subjects may forget to press the button starting and ending
the experiment. Remind them!
Give them the 2nd sentence
- Now do the same with this sentence. We will be recording your typing
time and erros, so go as quickly as you can and try to keep your typing
errors down.
Read the sentence aloud and start whenever you are ready.
Give them the 3rd sentence
- Now here is the last sentence with this keyboard. Read it aloud and
start when ready.
Let them type it.
- Good. What do you think about mouse-typing with this layout?
Record their comments on the worksheet
Switch keyboards, and repeat the above procedure for the alphabetic
keyboard. Use the same sentences in the same order of presentation.
- I'll switch to the next keyboard.....
Adminster post-test questionairre on the worksheet
- Now that you have used all keyboards, can you rank order them from
best to worst? Do you have any other comments to make?
Record the results. You may want to ask other questions on oddities
that you may have observed.
At this point, the experiment is complete. You can answer any questions
that the subject may have. Thank them. Finally, record your own observations
of what you saw that were not captured by subject's comments.
Saul Greenberg
Contributors Page