際際滷

際際滷Share a Scribd company logo

Reliability

Download as PPTX, PDF
Dr KHALID B.M
Dr KHALID B.M

This document discusses the concept of reliability in assessment tools. It defines reliability as the degree to which an assessment tool produces stable and consistent results across different administrations of the test. There are three main types of reliability: internal consistency, which measures how correlated the items in a scale are; test-retest reliability, which involves administering the same test at different times; and inter-rater reliability, which examines consistency between raters. The document also discusses Cronbach's alpha as a measure of internal consistency and factor analysis as a statistical technique to evaluate construct validity and reduce a large set of data items into a smaller set of underlying factors.

1 of 20
Download to read offline
RELIABILITY 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 1
Is the DEGREE to which an assessment tool produce STABLE AND CONSISTENT RESULTS QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 2
Giving the same or compatible results in different experiments, situation is know as reliability How dependable, trust worthy or faithful the test is QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 3
RELIABILITY 1.Internal Consistency 2.Repeatability (Stability Or Test Retest Reliability) 3.Inter Rater Reliability QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 4
INTERNAL CONSISTENCY Internal consistency is a measure of the extent to which items in a questionnaire (sub) scale are correlated(homogeneous), thus measuring the same concept. How items are they are consistent or correlate each other Represents average of the co relation among all the item inter correlation of items and number of items in the scale. Internal Consistency 1. Cronbach's Alpha 2. Split Half Techniques 3. Kuder Richarsons 20 QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 5
CRONBACHS ALPHA Cronbachs alpha is considered an adequate measure of internal consistency . It is based on the average correlation of items within a scale, Cronbach's alpha tells us how much correlation we expect between the scale. A low Cronbach's alpha indicates a lack of correlation between the items in a scale, which makes summarizing the items unjustified A very high Cronbach's alpha indicates high correlation among the items in the scales Nunnally and Bernstein proposed a criterion of 0.70 0.90 as a measure of good internal consistency. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 6
HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 7
HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 8
HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 9
HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 10
REPEATABILITY (STABILITY OR TEST RETEST RELIABILITY Same test at different times Same questionnaire administering at two different times Example: If a patient balance has not changed between the Monday and Friday of same week the patient score on a balance score should be essentially same QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 11
REPEATABILITY (STABILITY OR TEST RETEST RELIABILITY) Stability of an instrument is the extent to which similar results are obtained on two separate administration. Test Retest Reliability Single observer, taken repeated measures at two difference time. Attributes are measured on same subject using the scale at two different time points and the correlation of score between two time points are checked to see the amount of consistency QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 12
REPRODUCTABILITY (INTER RATER RELIABILITY) Two observing assessing the two techniques. Ex : If you measure a patient shoulder abduction ROM is 140 degrees, you should be able to obtain that same score of 140 degree the second and third time QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 13
FACTOR ANALYSIS Large set of data reduce into smaller set Reduce the burden Factor analysis can be done to evaluate the CONSTRUCT VALIDITY of the tool. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 14
FACTOR ANALYSIS Factor analysis is a statistical technique used to identify a relatively small number of factors that can be used to represent relationship among sets of many interrelated variables. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 15
HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 16
HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 17
HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 18
KAISER MEYER OLKIN MEASURE OF SAMPLING ADEQUACY The measures varies between 0 to 1. A value of minimum 0.6 indicates a good sampling adequacy BARTLETT TEST OF SPHERICITY Correlation matrix to be an identify matrix P<0.05 Indicates that correlation matrix is a identity matrix QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 19
Reliability Is The Precondition For Trust TAKE HOME MESSAGE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 20

More Related Content

Reliability

  • 1. RELIABILITY 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 1
  • 2. Is the DEGREE to which an assessment tool produce STABLE AND CONSISTENT RESULTS QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 2
  • 3. Giving the same or compatible results in different experiments, situation is know as reliability How dependable, trust worthy or faithful the test is QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 3
  • 4. RELIABILITY 1.Internal Consistency 2.Repeatability (Stability Or Test Retest Reliability) 3.Inter Rater Reliability QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 4
  • 5. INTERNAL CONSISTENCY Internal consistency is a measure of the extent to which items in a questionnaire (sub) scale are correlated(homogeneous), thus measuring the same concept. How items are they are consistent or correlate each other Represents average of the co relation among all the item inter correlation of items and number of items in the scale. Internal Consistency 1. Cronbach's Alpha 2. Split Half Techniques 3. Kuder Richarsons 20 QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 5
  • 6. CRONBACHS ALPHA Cronbachs alpha is considered an adequate measure of internal consistency . It is based on the average correlation of items within a scale, Cronbach's alpha tells us how much correlation we expect between the scale. A low Cronbach's alpha indicates a lack of correlation between the items in a scale, which makes summarizing the items unjustified A very high Cronbach's alpha indicates high correlation among the items in the scales Nunnally and Bernstein proposed a criterion of 0.70 0.90 as a measure of good internal consistency. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 6
  • 7. HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 7
  • 8. HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 8
  • 9. HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 9
  • 10. HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 10
  • 11. REPEATABILITY (STABILITY OR TEST RETEST RELIABILITY Same test at different times Same questionnaire administering at two different times Example: If a patient balance has not changed between the Monday and Friday of same week the patient score on a balance score should be essentially same QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 11
  • 12. REPEATABILITY (STABILITY OR TEST RETEST RELIABILITY) Stability of an instrument is the extent to which similar results are obtained on two separate administration. Test Retest Reliability Single observer, taken repeated measures at two difference time. Attributes are measured on same subject using the scale at two different time points and the correlation of score between two time points are checked to see the amount of consistency QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 12
  • 13. REPRODUCTABILITY (INTER RATER RELIABILITY) Two observing assessing the two techniques. Ex : If you measure a patient shoulder abduction ROM is 140 degrees, you should be able to obtain that same score of 140 degree the second and third time QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 13
  • 14. FACTOR ANALYSIS Large set of data reduce into smaller set Reduce the burden Factor analysis can be done to evaluate the CONSTRUCT VALIDITY of the tool. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 14
  • 15. FACTOR ANALYSIS Factor analysis is a statistical technique used to identify a relatively small number of factors that can be used to represent relationship among sets of many interrelated variables. QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 15
  • 16. HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 16
  • 17. HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 17
  • 18. HOW TO CHECK IN SPSS 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 18
  • 19. KAISER MEYER OLKIN MEASURE OF SAMPLING ADEQUACY The measures varies between 0 to 1. A value of minimum 0.6 indicates a good sampling adequacy BARTLETT TEST OF SPHERICITY Correlation matrix to be an identify matrix P<0.05 Indicates that correlation matrix is a identity matrix QUICK SCAN 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 19
  • 20. Reliability Is The Precondition For Trust TAKE HOME MESSAGE 24-01-2023 Motivation For Life Academy by Dr Khalid B.M 20