Tests and Measurement Rubric Comprehensive Exam Question Poor (1) Fair (2) Satisfactory

Tests and Measurement Rubric

Comprehensive Exam

Question

Poor (1)

Fair (2)

Satisfactory (3)

Mastery (4)

1a

Using this scale as an example, explain at least two different ways to assess reliability.  How much reliability would be considered acceptable and why?   

Only one method of assessing reliability is discussed.

Does not discuss reliability coefficients or levels of acceptability.

Two different ways of assessing reliability are discussed but not explained sufficiently to demonstrate understanding of concepts.

Two different ways of assessing reliability are discussed but are vague or not applied to example.

Discusses meaning of reliability coefficients and levels of acceptability but explanation is vague or not detailed.

Two different ways of assessing reliability are clearly defined and explained using scale as example.

Discusses meaning of reliability coefficients and levels of acceptability.

1b

For your dissertation, what concerns might you have regarding the reliability of your selected scale? Don’t just name your concerns, but also tell why they are concerns.  How could you deal with these in your study?

Concerns are missing, incorrect or extraneous to scale.

A description of concerns is listed but not explained or tied into ways of dealing with concerns.

Describes appropriate ways to deal with reliability concerns but they are too brief or simplistic.

Clearly and accurately describes concerns and highlights ways to deal with concerns.

2a

Explain at least two different ways to assess validity.

Only one method of assessing validity is discussed.

Two different ways of assessing validity are discussed but not explained sufficiently to demonstrate understanding of concepts.

Two different ways of assessing validity are discussed but are vague or not applied to example.

Two different ways of assessing validity are clearly defined and explained using scale as example.

2b

What concerns might you have regarding validity measures and why? For your dissertation, what concerns might you have regarding the validity of your selected scale? Don’t just name your concerns, but also tell why they are concerns. How could you deal with these in your study?

Concerns are missing, incorrect or extraneous to scale.

A description of concerns is listed but not explained or tied into ways of dealing with concerns.

Describes appropriate ways to deal with validity concerns but they are too brief or simplistic.

Clearly and accurately describes concerns and highlights ways to deal with concerns.

3

Discuss one potential cross-cultural challenge you would face in studying personality and how you would respond to this challenge as a researcher.

Concern is missing or not applied to scale.

Or

Response to challenge is missing or inaccurate.

Describes a potential cross cultural challenge but answer is too vague to support ways of responding to challenge.

Describes a potential cross cultural challenge but specific factors are not mentioned or not described in sufficient detail regarding responses to such challenges.

Clearly and specifically discusses a cross cultural challenge and gives examples of how they might respond to this challenge.

Column Totals:

Total Sum of All Column Totals:

Divided by (Five) 5 to Calculate Overall Score:

Student must earn an Overall Score of 3 or higher in order to pass this question.