Types of test techniques

 

Formal and informal testing:

 

Formal testing:

v     testees are told in advance what they need to know,

v     what the criteria are for success,

v     and so on.

 

Informal testing

v     a homework assignment

v     questions asked during the routine give-and-take of classroom interaction

v     textbook exercises.

 

 

Elicitation techniques

 

 

ELICITATION TECHNIQUES

1.       Questions and answers.

Simple questions, very often following reading, or as part of an interview; may require short or long answers:

What is the (family) relationship between David Copperfield and Mr Murdstone?

 

2.       True/false.

A statement is given which is to be marked true or false. This may also be given as a question, in which case the answer is yes or no.

Addis Ababa is the capital of Egypt. Is Addis Ababa the capital of Egypt?

 

3.       Multiple-choice.

The question consists of a stem and a number of options (usually four), from which the testee has to select the right one.

A person who writes books is called

a) a booker.        b) an editor.        c) an author.        d) a publisher.

 

4.       Gap-filling and completion.

The testee has to complete a sentence by filling a gap or adding something. A gap may or may not be signalled by a blank or dash; the word to be inserted may or may not be given or hinted at.

They (go) to Australia in 1980. Or

They ________ to Australia in 1980. (go) Or

A ________ is someone who writes books. Or

I've seen that film, (never)

 

5.       Matching.

The testee is faced with two groups of words, phrases or sentences;

each item in the first group has to be linked to a different item in the second.

large               small

unhappy          many

a lot                big

little                sad

 

6.       Dictation.

The tester dictates a passage or set of words; the testee writes them down.

 

7.       Cloze.

Words are omitted from a passage at regular intervals (for example, every seventh word). Usually the first two or three lines are given with no gaps.

The family are all fine, though Leo had a bad bout of flu last week. He spent most of it lying on the sofa watching ________ when he wasn't sleeping!

His exams ________ in two weeks, so he is ________ about missing school, but has managed to ________ quite a lot in spite ________ feeling ill.

 

8.       Transformation.

A sentence is given; the testee has to change it according to some given instruction.

Put into the past tense: I go to school by bus.

 

9.       Rewriting.

A sentence is given; the testee rewrites it, incorporating a given change of expression, but preserving the basic meaning.

He came to the meeting in spite of his illness. Although ....

 

10.   Translation.

The testee is asked to translate expressions, sentences or entire passages to or from the target language.

 

11.   Essay.

The testee is given a topic, such as 'Childhood memories', and asked to write an essay of a specific length.

 

12.   Monologue.

The testee is given a topic or question and asked to speak about it fora minute or two.

 

 

Which you will choose to use for a certain testing purpose will probably depend mainly on the following considerations:

1)     What will it tell me about the testee's knowledge? In other words, for what type of knowledge might it be a valid test?

2)     How easy is it to compose?

3)     How easy is it to administer?

4)     How easy is it to mark?

 

Task:

Try applying the above considerations to the set of elicitation techniques.

 

 Critical study of elicitation techniques

1. Questions and answers

These can be used to test almost anything. The more 'closed' the question is (that is, the fewer the possible options for correct answers), the easier the item will be to mark. It is fairly easy to compose and grade closed-ended questions; more open, thought-provoking ones are more difficult, but may actually test better.

 

2. True/false

This does not directly test writing or speaking abilities: only listening or reading. It may be used to test aspects of language such as vocabulary, grammar, content of a reading or listening passage. It is fairly easy to design; it is also easy to administer, whether orally or in writing, and to mark.

 

3. Multiple-choice

This may be used for the same testing purposes as true/false items; it does test rather more thoroughly since it offers more optional answers and is obviously very easy to mark. It is administered more conveniently through writing; but note that since the reading of the question-and-options is fairly time-consuming, the process of comprehension of the actual question items may take more time and effort than the point ostensibly tested, which raises problems of validity. Another important problem is that good multiple-choice questions are surprisingly difficult to design: they often come out ambiguous, or with no clear right answer, or with their solutions over-obvious. They are to be approached with caution!

 

4.Gap-filling and completion

"his usually tests grammar or vocabulary, as in the examples. It is tedious to compose, though not so difficult as multiple-choice; it is more easily administered in writing than in speech; the marking is usually simple. You may need to be aware that there is more than one possible right answer.

 

5. Matching

This usually tests vocabulary, and is rather awkward to administer orally: thus it is best presented written on the board or on paper, though responses may be either oral or in writing. Items can be time-consuming and difficult to compose, and again, there may be alternative 'right' answers to any particular item. Answers are fairly easily checked.

 

6. Dictation

This mainly tests spelling, perhaps punctuation, and, perhaps surprisingly on the face of it, listening comprehension: people can only usually write words down accurately from dictation if they understand them. It does not, however, test other writing skills or speech, and involves very little reading. It may supply some information on testees' passive knowledge of pronunciation, grammar and vocabulary. It is very easy to prepare and administer; it is relatively easy to mark, though there may be a problem deciding how much weight to attribute to different mistakes.

 

7. Cloze

This tests (intensive) reading, spelling, and to some extent knowledge of vocabulary and grammar. It can be adapted to 'target' specific language items, by, for example, omitting all the verbs (in which case it is not, strictly speaking, 'cloze', but rather 'gap-filling'). It is fairly easy to prepare and administer. Marking can be tricky: you may find it difficult sometimes to decide if a specific item is 'acceptable' or not.

 

8. Transformation

This item is relatively easy to design, administer and mark, but its validity may be suspect. It tests the ability of the testee to transform grammatical structures, which is not the same as testing grammar: a testee may perform well on transformation items without knowing the meaning of the target structure or how to use it in context. Marking is fairly straightforward.

 

9. Rewriting

This tests the same sort of thing as transformation, but is likely to reflect more thorough knowledge of the target items, since it involves paraphrasing the entire meaning of a sentence rather than transforming a particular item. It is, however, more difficult to compose, and the marking may be more subjective. It is, as its name suggests, usually done in writing.

 

10. Translation

A technique which,   at the time of writing, is for various reasons rather unpopular, but in my opinion undeservedly so. In a monolingual class whose teacher also speaks the learners' mother tongue, the translation of a 'bit' of language to or from the target language can give very quick and reliable information on what the testee does or does not know, particularly when it involves entire units of meaning (phrases, sentences) within a known context. Translation items are also relatively easy to compose - even improvise, in an informal test - and administer, in either speech or writing. Marking may sometimes be more difficult, but not prohibitively so.

 

11. Essay

This is a good test of general writing abilities. It is relatively easy to provide a topic and tell the class to write an essay about it but marking is extremely difficult and time-consuming. It must be clear in advance, both to you and to the students, how much emphasis you are going to lay on language forms, such as spelling, grammar, punctuation, and how much on aspects of content, such as interest and originality of ideas, effectiveness of expression, organization

 

12. Monologue

This tests oral fluency in 'long turns' - something not everyone can do in their mother tongue! It also tests overall knowledge of pronunciation, grammar and vocabulary. To choose a topic and allot it is not so difficult; to assess is very difficult indeed, demanding concentration and a very clear set of criteria and weighting system.