Sign Up

Have an account? Sign In Now

Sign In

Forgot Password?

Don't have account, Sign Up Here

Forgot Password

Lost your password? Please enter your email address. You will receive a link and will create a new password via email.

Have an account? Sign In Now

Please type your username.

Please type your E-Mail.

Please choose the appropriate section so the question can be searched easily.

Please choose suitable Keywords Ex: question, poll.

Please choose an appropriate title for the question so it can be answered easily.

Sign InSign Up

IGNOU Answers

IGNOU Answers Logo IGNOU Answers Logo
Search
Ask A Question

Mobile menu

Close
Ask a Question
  • Home
  • Categories
    • All Questions
    • Commerce
    • Computer Science
    • Economics
    • English
    • General Queries
    • Political Science
    • Public Administration
    • Psychology
    • Sociology
    • Others
  • Tags
  • Users
  • Contact Us
Home/ Questions/Q 323
Next
Answered
Anonymous
  • 0
Anonymous
Asked: April 28, 20202020-04-28T05:44:58+05:30 2020-04-28T05:44:58+05:30In: Psychology

Explain the method of estimating reliability.

  • 0
Explain the method of estimating reliability.
  • 1 1 Answer
  • 0 Followers
  • 0
  • Share
    Share
    • Share on Facebook
    • Share on Twitter
    • Share on LinkedIn
    • Share on WhatsApp

1 Answer

  • Voted
  • Oldest
  • Recent
  1. Best Answer
    admin
    2020-04-28T10:18:15+05:30Added an answer on April 28, 2020 at 10:18 am

    Reliability is a measure of the consistency of a metric or a method. Every metric or method we use, including things like methods for uncovering usability problems in an interface and expert judgment, must be assessed for reliability.

    In fact, before you can establish validity, you need to establish reliability.
    Here are the four most common ways of measuring reliability for any empirical method or metric:

    • inter-rater reliability
    • test-retest reliability
    • parallel forms reliability
    • internal consistency reliability

    Because reliability comes from a history in educational measurement (think standardized tests), many of the terms we use to assess reliability come from the testing lexicon. But don’t let bad memories of testing allow you to dismiss their relevance to measuring the customer experience.

    These four methods are the most common ways of measuring reliability for any empirical method or metric.

    Inter-Rater Reliability: The extent to which raters or observers respond the same way to a given phenomenon is one measure of reliability. Where there’s judgment there’s disagreement.

    Even highly trained experts disagree among themselves when observing the same phenomenon. Kappa and the correlation coefficient are two common measures of inter-rater reliability. Some examples include:

    Evaluators identifying interface problems: Experts rating the severity of a problem For example, we found that the average inter-rater reliability[pdf] of usability experts rating the severity of usability problems was r = .52. You can also measure intra-rater reliability, whereby you correlate multiple scores from one observer. In that same study, we found that the average intra-rater reliability when judging problem severity was r = .58 (which is generally low reliability).

    Test-Retest Reliability: Do customers provide the same set of responses when nothing about their experience or their attitudes has changed? You don’t want your measurement system to fluctuate when all other things are static.

    Have a set of participants answer a set of questions (or perform a set of tasks). Later (by at least a few days, typically), have them answer the same questions again. When you correlate the two sets of measures, look for very high correlations (r > 0.7) to establish retest reliability.

    As you can see, there’s some effort and planning involved: you need for participants to agree to answer the same questions twice. Few questionnaires measure test-retest reliability (mostly because of the logistics), but with the proliferation of online research, we should encourage more of this type of measure.

    Parallel Forms Reliability: Getting the same or very similar results from slight variations on the question or evaluation method also establishes reliability. One way to achieve this is to have, say, 20 items that measure one construct (satisfaction, loyalty, usability) and to administer 10 of the items to one group and the other 10 to another group, and then correlate the results. You’re looking for high correlations and no systematic difference in scores between the groups.

    Internal Consistency Reliability: This is by far the most commonly used measure of reliability in applied settings. It’s popular because it’s the easiest to compute using software—it requires only one sample of data to estimate the internal consistency reliability. This measure of reliability is described most often using Cronbach’s alpha (sometimes called coefficient alpha).

    From MPC-005 Research Methods – IGNOU

    • 0
    • Reply
    • Share
      Share
      • Share on Facebook
      • Share on Twitter
      • Share on LinkedIn
      • Share on WhatsApp
Leave an answer

Leave an answer
Cancel reply

Browse

Sidebar

Ask A Question

Stats

  • Questions 339
  • Answers 340

Related Questions

  • Elucidate child helpline servises in india

  • Explain the method, steps relevance of grounded theory

  • Discuss the nature

  • Explain the different types of variables

  • How is psychodiagnostic assessment conducted of children?

  • Popular
  • Answers
  • Anonymous

    I need MCS-014 Assignment solution. ...

    • 14 Answers
  • himanshu

    i want answers of assignment ...

    • 11 Answers
  • Anonymous

    Can anyone provide answers of ...

    • 8 Answers
  • Anonymous

    What does the IGNOU BCA ...

    • 7 Answers
  • Vandana

    Calculate the physical address ...

    • 6 Answers
  • admin
    admin added an answer Evaluating a curriculum is an important process that helps determine the effectiveness of the curriculum and identify areas that need improvement. Here is a plan for how I would carry… January 27, 2023 at 2:41 pm
  • admin
    admin added an answer International Commission on Education for the Twenty-First Century Learning was headed by Jaques Delors, the former French Minister of Economy and Finance. The commission aimed at formulating suggestions and recommendations… January 27, 2023 at 2:29 pm
  • admin
    admin added an answer Education of an individual is defined as a process that results into total or overall development of an individual. Psychologists have identified three domains of a human being: Cognitive domain,… January 27, 2023 at 2:01 pm
  • admin
    admin added an answer Here is an example shell script that determines whether a given file exists in the home directory or not: #!/bin/bash # Check if the given file exists in the home… December 12, 2022 at 9:54 pm
  • admin
    admin added an answer There are many different search algorithms, and each one has its own complexities depending on the specific implementation and the type of data being searched. Here are some common search… December 12, 2022 at 9:47 pm

Top Members

admin

admin

  • 2 Questions
  • 1k Points
Pooja Sharma

Pooja Sharma

  • 7 Questions
  • 39 Points
Roushani Kumari

Roushani Kumari

  • 1 Question
  • 34 Points

Trending Tags

Free Assignments Free Solved Assignments IGNOU BCA Solved Assignments IGNOU BCOM Solved Assignments

Explore

  • Home
  • Categories
    • All Questions
    • Commerce
    • Computer Science
    • Economics
    • English
    • General Queries
    • Political Science
    • Public Administration
    • Psychology
    • Sociology
    • Others
  • Tags
  • Users
  • Contact Us

Footer

IGNOU Answers

About

IGNOU Answers is a social Questions & Answers platform which will help you to find answers to your questions..

Question Tags

BA Sociology ESO-11 Export Procedures and Documentation fst-01 International Business Finance ma english ma psychology mpc-004 question The Study of Society

Categories

  • Commerce
  • Computer Science
  • Economics
  • English
  • General Queries
  • Others
  • Political Science
  • Psychology
  • Public Administration
  • Science
  • Sociology

Useful Links

  • Home
  • Contact Us
  • Privacy Policy
  • Buy Assignments
  • IGNOU Updates

© 2021 IgnouAnswers.com. All Rights Reserved
Created With Love by KHOJINET.

Insert/edit link

Enter the destination URL

Or link to existing content

    No search term specified. Showing recent items. Search or use up and down arrow keys to select an item.