Analyzing Assessment Items Using Test Specifications –Use APA 7
Description
Step 1. Investigate
Investigate an online database containing educational course standards, grade level(s), and course content. Select a subject (use math if you can) , grade level ( college if possible), and lesson standard(s), relevant to your teaching situation and which you have taught or will teach. Reflect on how you will measure student ability to demonstrate the learning objectives of the lesson related to the standards.
Step 2. Develop
Develop either a diagnostic or formative 10-item assessment. Research rules for creating an effective multiple-choice test. The assessment should have five select-response (multiple-choice) questions, four open-ended response (short-answer or verbal response), and one performance-assessment/performance-based (presentation, skit, class debate) item.
The assessment should have questions of varying difficulty: basic retrieval questions, intermediate, and higher-order questions. Research how to frame questions stems around Bloom’s Taxonomy. Include one Bloom’s Taxonomy verb per test item. For example: Identify the 13 original U.S. colonies (knowledge). Analyze how over-taxation on the 13 original U.S. colonies impacted colonial views of independence from Great Britain (analysis)?
Step 3. Formulate
Formulate a 3 page paper beginning with one or two introductory paragraphs describing the profile of your selected school setting. This description should include the school level, school size, type of school (e.g., urban, rural, virtual, etc.), target grade level for this assignment, sample size for this assignment, quantified demographics of diverse learners (e.g., bilingual, students of color, male, female, special ed., etc.), subject, lesson standard(s), and any other relevant information. Use appropriate APA citation.
Step 4. Complete
Access, complete, and insert the Table of Test Specifications into your paper after the introductory paragraph(s).
Step 5. Produce
Produce and include a correct answer key for each of the 10 items in the assessment. Provide a potential correct response for the open-ended question and performance-based item. Describe (and/or provide an image) of what should be done for the performance-based item and any materials that may be needed; provide the rubric used to assess the performance activity.
Step 6. Reflect
Reflect on each item below in a paragraph. Support the work with references in a references section according to appropriate APA 7 format.
Describe any trends and any correlations between test difficulty and percentage of students scoring correctly. Explain any demographic trends.
Compare the number of incorrect answers from the highest scorers on the test to the lowest scorers on the test. Elaborate on incorrect item responses.
Discuss what you learned and what to avoid when creating effective multiple-choice test questions. Evaluate the test for item difficulty and revision. Predict any lesson content revisions needed to increase assessment scores.
How does your assessment tool fit into a balanced assessment system?
