際際滷

際際滷Share a Scribd company logo

Validity

Download as PPTX, PDF
Dr KHALID B.M
Dr KHALID B.M

The document discusses different types of validity for questionnaires and measures. It describes face validity as evaluating readability, clarity and layout. Content validity examines how comprehensively a measure represents the concept it aims to measure. Construct validity assesses how accurately a measure represents the theoretical construct it intends to measure in the real world. Criterion validity refers to how scores on a measure correlate with a gold standard. The document emphasizes that validity depends on the target population and purpose of the measure.

1 of 26
Download to read offline
VALIDITY QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 1
Indication Of How Sound Your Research Is ??? QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 2
The extent to which measures indicate what they are intended to measure ( It should be true solid) To match between the conceptual definition and the operational definition QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 3
FACE VALIDITY checking of tool for its validity on the face of it The face validity evaluates the following of the questionnaire 1. Readability 2. Clarity of wording 3. Layout and style 4. Feasibility QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 4
Face validity indicates the questionnaire appears to be appropriate to the study purpose and content area. It is the easiest validation process to undertake but it is the weakest form of the validity It evaluates the appearance of the questionnaire in terms of feasibility, readability, consistency of style and formatting and the clarity of the language QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 5
The questionnaire was given to 25 healthy individuals and face validity was assessed for clarity of words, layout and style and likelihood of target audience ability to understand the questionnaire. Respond: ALL PARTICIPANTS SHOULD BE SATISFACTORY Strategy 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 6
Does the content of the test appear to be suitable to its aim PUNCH LINE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 7
CONTENT VALIDITY Representativeness of content for construct. Content validity examines the extent to which concepts of interest are comprehensively represented by the items in the questionnaire. Covers all dimension of a concept QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 8
Example If we want to test knowledge on American geography it is not fair to have most question limited to the geography of new England A course exam has good content validity if it cover all the material that students are supposed to learn and poor content validity if it does not QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 9
CONTENT VALIDITY Two major standards for ensuring content validity 1. Representative collection of items 2. Sensible methods of test construction Sending experts: expert review creating index. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 10
1. MEASUREMENT AIM OF QUESTIONNAIRE It should be discriminate, evaluate or predictive Examples: A question on stiffness could be valid item of a discriminative questionnaire used to measure the impact of osteoartirrties on quality of life. But would be considered invalid for an evaluate questionnaire used as an outcome measure in a pain medication trial because it is unlikely to be changed by pain medication QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 11
2. TARGET POPULATION The population for which the questionnaire was developed, this is important to judge the relevance and comprehensiveness of the items. Example Questionnaire developed to measure functional status of patients with shoulder problems may be less valid to measure functional status of patients with wrist / hand problems because it may be less relevant for those patients. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 12
3. CONCEPTS The questionnaire is intended to measure 1. To judge the suitability of a questionnaire for a specific purpose 2. It is important that authors provide a clear framework of what the overall concepts are measured 3. Relevant concepts can be defined in terms of symptoms functioning QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 13
4. INTERPRETABILITY OF THE ITEMS The items should be short and simple and should not contain difficult words or jorgan items, Items should not contain difficult words QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 14
POSITIVE RATINGS FOR QUESTIONNAIRE CONTENT VALIDITY 1. Measurement aim 2. The target population 3. The concepts are being measured and the item selection If the clearly description is lacking content validity is rated as indeterminate Questionnaire should be given peers for review and response will be collected QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 15
Is the test fully representative of what it aims to measure PUNCH LINE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 16
CONSTRUCT VALIDITY Theoretical construct / Mini Theory / Real World Situation Defined the way they are measured Ex: Anxiety, intelligence, pain, Prakruti, Ama, Ojas QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 17
Theoretical construct of cause and effect accurately represents the real world situation A good experiment turns the theory into actual things QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 18
Construct validity accurately represent reality Convergent Validity: Simultaneously Measure Of Same Construct Correlate Discriminant Validity: Does Not Measure What It Should Not QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 19
Expert Team: Should Asses The Feasibility Factor analysis should be done STRATEGY 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 20
If construct is hard to conceptualize does not it make sense that it will be more difficult to operationalize and validate PUNCH LINE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 21
CRITERION VALIDITY Criterion validity refers to which scores a particular instrument relate to a gold standard. It is the extent to which people scores are correlated with other variable or criteria that reflects the same construct. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 22
Example 1. An IQ Test should correlate positively with school performance 2. An occupational aptitude test should correlate positively with work performance QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 23
PREDICTIVE VALIDITY A new measure of self esteem should correlate positively with an old establish measures QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 24
It would be fine to conclude that an English learnings achievement test is valid for children who are native English speakers but not for children who are still in the process of learning English PUNCH LINE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 25
Where there is Righteousness in heart There is beauty in the character.. TAKE HOME MESSAGE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 26

More Related Content

Validity

  • 1. VALIDITY QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 1
  • 2. Indication Of How Sound Your Research Is ??? QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 2
  • 3. The extent to which measures indicate what they are intended to measure ( It should be true solid) To match between the conceptual definition and the operational definition QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 3
  • 4. FACE VALIDITY checking of tool for its validity on the face of it The face validity evaluates the following of the questionnaire 1. Readability 2. Clarity of wording 3. Layout and style 4. Feasibility QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 4
  • 5. Face validity indicates the questionnaire appears to be appropriate to the study purpose and content area. It is the easiest validation process to undertake but it is the weakest form of the validity It evaluates the appearance of the questionnaire in terms of feasibility, readability, consistency of style and formatting and the clarity of the language QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 5
  • 6. The questionnaire was given to 25 healthy individuals and face validity was assessed for clarity of words, layout and style and likelihood of target audience ability to understand the questionnaire. Respond: ALL PARTICIPANTS SHOULD BE SATISFACTORY Strategy 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 6
  • 7. Does the content of the test appear to be suitable to its aim PUNCH LINE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 7
  • 8. CONTENT VALIDITY Representativeness of content for construct. Content validity examines the extent to which concepts of interest are comprehensively represented by the items in the questionnaire. Covers all dimension of a concept QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 8
  • 9. Example If we want to test knowledge on American geography it is not fair to have most question limited to the geography of new England A course exam has good content validity if it cover all the material that students are supposed to learn and poor content validity if it does not QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 9
  • 10. CONTENT VALIDITY Two major standards for ensuring content validity 1. Representative collection of items 2. Sensible methods of test construction Sending experts: expert review creating index. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 10
  • 11. 1. MEASUREMENT AIM OF QUESTIONNAIRE It should be discriminate, evaluate or predictive Examples: A question on stiffness could be valid item of a discriminative questionnaire used to measure the impact of osteoartirrties on quality of life. But would be considered invalid for an evaluate questionnaire used as an outcome measure in a pain medication trial because it is unlikely to be changed by pain medication QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 11
  • 12. 2. TARGET POPULATION The population for which the questionnaire was developed, this is important to judge the relevance and comprehensiveness of the items. Example Questionnaire developed to measure functional status of patients with shoulder problems may be less valid to measure functional status of patients with wrist / hand problems because it may be less relevant for those patients. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 12
  • 13. 3. CONCEPTS The questionnaire is intended to measure 1. To judge the suitability of a questionnaire for a specific purpose 2. It is important that authors provide a clear framework of what the overall concepts are measured 3. Relevant concepts can be defined in terms of symptoms functioning QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 13
  • 14. 4. INTERPRETABILITY OF THE ITEMS The items should be short and simple and should not contain difficult words or jorgan items, Items should not contain difficult words QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 14
  • 15. POSITIVE RATINGS FOR QUESTIONNAIRE CONTENT VALIDITY 1. Measurement aim 2. The target population 3. The concepts are being measured and the item selection If the clearly description is lacking content validity is rated as indeterminate Questionnaire should be given peers for review and response will be collected QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 15
  • 16. Is the test fully representative of what it aims to measure PUNCH LINE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 16
  • 17. CONSTRUCT VALIDITY Theoretical construct / Mini Theory / Real World Situation Defined the way they are measured Ex: Anxiety, intelligence, pain, Prakruti, Ama, Ojas QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 17
  • 18. Theoretical construct of cause and effect accurately represents the real world situation A good experiment turns the theory into actual things QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 18
  • 19. Construct validity accurately represent reality Convergent Validity: Simultaneously Measure Of Same Construct Correlate Discriminant Validity: Does Not Measure What It Should Not QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 19
  • 20. Expert Team: Should Asses The Feasibility Factor analysis should be done STRATEGY 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 20
  • 21. If construct is hard to conceptualize does not it make sense that it will be more difficult to operationalize and validate PUNCH LINE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 21
  • 22. CRITERION VALIDITY Criterion validity refers to which scores a particular instrument relate to a gold standard. It is the extent to which people scores are correlated with other variable or criteria that reflects the same construct. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 22
  • 23. Example 1. An IQ Test should correlate positively with school performance 2. An occupational aptitude test should correlate positively with work performance QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 23
  • 24. PREDICTIVE VALIDITY A new measure of self esteem should correlate positively with an old establish measures QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 24
  • 25. It would be fine to conclude that an English learnings achievement test is valid for children who are native English speakers but not for children who are still in the process of learning English PUNCH LINE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 25
  • 26. Where there is Righteousness in heart There is beauty in the character.. TAKE HOME MESSAGE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 26