What is item construction in psychological test construction? What are the steps in doing it? (Lecture slides mostly in English)

1. PDU 303 PSIKOMETRIK
ITEM CONSTRUCTION
SEMESTER GASAL 2015/2016
FAKULTAS PSIKOLOGI UNIVERSITAS KATOLIK INDONESIA ATMA JAYA
KULIAH IV - 03 SEPTEMBER 2015

2. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST
REVISION
(ITEM) TEST
TRYOUT
(ITEM) TEST
CONCEPTUALIZATION
(ITEM) TEST DEVELOPMENT
2
(ITEM) TEST
CONSTRUCTION
(ITEM) TEST
ANALYSIS
ICON CREDITS: Idea by Lorenzo Alfano, Construction by Creative Stall,
Flask by Cornelius Danger, Calculator by Creative Stall,
Bandage by misirlou; from the Noun Project

3. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST
REVISION
(ITEM) TEST
TRYOUT
(ITEM) TEST
CONCEPTUALIZATION
(ITEM) TEST DEVELOPMENT
2
(ITEM) TEST
CONSTRUCTION
(ITEM) TEST
ANALYSIS
(Cohen & Swerdlik, 2009, p. 245-246)ICON CREDITS: Idea by Lorenzo Alfano, Construction by Creative Stall,
Flask by Cornelius Danger, Calculator by Creative Stall,
Bandage by misirlou; from the Noun Project

4. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST CONCEPTUALIZATION
There ought to be a test designed
to measure [fill in the blank]
in [such and such] way.
3
(Cohen & Swerdlik, 2009, p. 245-246)
ICON CREDIT: Idea by Lorenzo Alfano; from the Noun Project

5. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST CONCEPTUALIZATION
There ought to be a test designed
to measure [fill in the blank]
in [such and such] way.
3
PSYCHOLOGICAL
CONSTRUCT
TEST SPECIFICATION
(Cohen & Swerdlik, 2009, p. 245-246)
ICON CREDIT: Idea by Lorenzo Alfano; from the Noun Project

6. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
HOW?
WHY?WHAT?
WHEN & WHERE?
WHO?
Information about what the
test is going to measure;
Including the constuct and
its theoretical background.
Information about the
reason why the test is
needed.
Information about the test
taker, user, and publisher.
Information about the
context the text will be use.
Information about how the
test will be administered.
(ITEM) TEST CONCEPTUALIZATION
4
ICON CREDIT: Idea by Lorenzo Alfano from the Noun Project

7. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
HOW?
WHY?WHAT?
WHEN & WHERE?
WHO?
Information about what the
test is going to measure;
Including the constuct and
its theoretical background.
Information about the
reason why the test is
needed.
Information about the test
taker, user, and publisher.
Information about the
context the text will be use.
Information about how the
test will be administered.
(ITEM) TEST CONCEPTUALIZATION
4
TEST SPECIFICATION
(Cohen & Swerdlik, 2009, p. 246-247)
(GENERAL DESCRIPTION)ICON CREDIT: Idea by Lorenzo Alfano from the Noun Project

8. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
THESE ARE THE
THINGS SHOULD BE
CONSIDER BEFORE
WRITING THE ITEM.
ITEM FORMAT
NUMBER OF ITEMS
ITEM SCORING
(ITEM) TEST CONSTRUCTION
5
1
2
3
ICON CREDITS: Construction by Creative Stall

9. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST CONSTRUCTION
6
WRITING
ITEMS
NUMBER OF
ITEMS
RANGE OF
CONTENTS
(Cohen & Swerdlik, 2009, p. 256-265)
TYPES OF
ITEM FORMATS
DIMENSION
DIMENSION
INDICATOR
INDICATOR
INDICATOR
INDICATOR
INDICATOR
INDICATOR
ICON CREDIT: Construction by Creative Stall; from the Noun Project

10. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST CONSTRUCTION
7
WRITING
ITEMS
NUMBER OF
ITEMS
RANGE OF
CONTENTS
(Cohen & Swerdlik, 2009, p. 256-265)
TYPES OF
ITEM FORMATS
DIMENSION
DIMENSION
INDICATOR
INDICATOR
INDICATOR
INDICATOR
INDICATOR
INDICATOR
ITEM POOL
ICON CREDIT: Construction by Creative Stall; from the Noun Project

11. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST CONSTRUCTION
8
ITEM
FORMAT
SELECTED-
RESPONSE
CONSTRUCTED-
RESPONSEDICHOTOMOUS
POLYTOMOUS
ESSAY
SHORT
ANSWER
MULTIPLE
CHOICE
MATCHING
SCALE
(Cohen & Swerdlik, 2009, p. 256-265)
COMPLETION
ICON CREDIT: Construction by Creative Stall; from the Noun Project

12. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST CONSTRUCTION
9
ITEM
FORMAT
CONSTRUCTED-
RESPONSE
ESSAY
SHORT
ANSWER
(Cohen & Swerdlik, 2009, p. 259-260)
COMPLETION Requires the test taker to provide a word
or phrase that completes a sentence.
Requires the test taker to provide a word
or phrase to answer the question.
Requires the test taker to respond to a
question by writing a composition,
typically one that demonstrates recall of
facts, understanding, analysis, and/or
interpretation.
ICON CREDIT: Construction by Creative Stall; from the Noun Project

13. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST CONSTRUCTION
10
(Cohen & Swerdlik, 2009, p. 257-259)
ITEM
FORMAT
SELECTED-
RESPONSE
POLYTHOMOUS
DICHOTOMOUSRequire test takers to select a response
from two alternative responses.
Require test takers to select one or more
responses from a set of alternative
responses.
ICON CREDIT: Construction by Creative Stall; from the Noun Project

14. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST CONSTRUCTION
11
(Cohen & Swerdlik, 2009, p. 257-258)
ITEM
FORMAT
SELECTED-
RESPONSE
POLYTHOMOUS
DICHOTOMOUSMULTIPLE
CHOICE
MATCHING
SCALE
A CORRECT
ANSWER
A STEM
DISTRACTORS
PREMISES
RESPONSES
ICON CREDIT: Construction by Creative Stall; from the Noun Project

15. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST CONSTRUCTION
12
ITEM
SCORING
IPSATIVE
CUMULATIVE
(Cohen & Swerdlik, 2009, p. 265-266)
CLASS/
CATEGORY
ICON CREDIT: Construction by Creative Stall; from the Noun Project

16. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST CONSTRUCTION
13
ITEM
SCORING
IPSATIVE
CLASS/
CATEGORY
(Cohen & Swerdlik, 2009, p. 265-266)
CUMULATIVE Adding test taker responses in each item
cumulatively.
Test taker responses earn credit toward
placement in a particular class or
category.
Comparing a test taker’s score on one
scale within a test to another scale within
that same test.
ICON CREDIT: Construction by Creative Stall; from the Noun Project

17. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
(ITEM) TEST TRYOUT
The (pool item) test should be tried out
on people who are similar in critical respects
to the people for whom the test was designed.
The test tryout should be executed
under conditions as identical as possible
to the conditions under which the standardized test
will be administered;
all instructions, and everything from the time limits
allotted for completing the test to the atmosphere at the test site,
should be as similar as possible.
14
(Cohen & Swerdlik, 2009, p. 266)
ICON CREDIT: Flask by Cornelius Danger; from the Noun Project

18. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
ANALYSIS OF THE ITEM
SHOULD BE DONE
THROUGH THESE
METHODS.
(ITEM) TEST ANALYSIS
15
QUALITATIVE ANALYSIS
QUANTITATIVE ANALYSIS
ICON CREDITS: Calculator by Creative Stall, Conversations by Gregory Radek,
Abacus by Zlatko Najdenovski; from the Noun Project

19. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK 16
WANT TO KNOW MORE?
COHEN, R.J. & SWERDLIK, M.E. (2009). PSYCHOLOGICAL TESTING AND
ASSESSMENT: AN INTRODUCTION TO TESTS AND MEASUREMENT (7TH ED.).
BOSTON, MA: MCGRAW-HILL HIGHER EDUCATION.