Friday, May 02, 2014

The Importance of a test specification

This is a good solid reading for those who want to find out more about the power of a test specification !!!

http://pareonline.net/pdf/v18n3.pdf

Thursday, May 01, 2014

Elements of JSU (UiTM)



A JSU kursus should contain the following elements:

            1. each topic must be aligned to CO and PO

            2. the teaching time (including tutorial, lab, studio or any F2F activity)
               for each topic

3. marks allotted for each topic should also mirror the time spent
    teaching the topic

            4. type of item

            5. % distribution for each cognitive level that is aligned to JSU    
                fakulti/program

            6. cognitive level of difficulty ie easy, moderate and difficult



Test Spec - MUET exam

http://www.mpm.edu.my/documents/10156/c5c332ab-3d97-4959-83c0-09866eea0774

Sample test spec - Cambridge Exams (CEFR Level B2)

http://www.cambridgeenglish.org/images/139293-cambridge-english-first-fce-specs-and-samples-document.pdf

Elements of a test specification

Checklist after your test spec is done:

Make sure you have these............

  1. The purpose of the test
  2. The description of the test taker(s)
  3. The test level
  4. The construct of the test (something like the theoretical framework)
  5. The description of the textbook
  6. The number of sections or papers
  7. The time allocated for each section or paper
  8. The weightings for each section or paper
  9. The target language situation
  10. The text types for the test
  11. The length of the text used 
  12. The language skills to be tested (include macro and micro skills)
  13. The language elements to be tested
  14. The test tasks
  15. The test methods
  16. Rubrics or instructions of the test
  17. Criteria for marking
  18. The descriptions of the typical performance at each level
  19. The description of what candidates at each level can do out there
  20. Sample papers of previous similar test(s)
  21. Samples of students' performance on tasks

People who need the test specifications:

1. Test Constructors needs to know
  • who is sitting for the tests
  • what's the purpose of the tests
  • what contents to cover 
  • about the methods to use
  • how many parts/sections for the tests
  • the duration allocated for the tests

2. Test users need to know
  • the descriptions of the tests' contents
  • the scores allocated for each part/section
  • the criteria for marking

3. Teachers/Educators need to
  • decide what tests are suitable for their students
  • prepare their students for the respective tests
  • know how the marking criteria are
  • get some samples of previous test questions as guidance

4. Admissions officer need
  • the description of the tests to help them decide the validity for further action
  • to see if the tests measure up to academic-related requirements e.g. language level, serves admissions purposes


5. Publishers want to
  • produce textbooks/workbooks related to the requirements of the tests
  • ensure that the practice tests have suitable levels of difficulty with the right measure of contents, topics, tasks etc