at Google ScholarTitle data
Küsshauer, Alexander ; Schüler, Jens ; Baum, Matthias:
Test-Retest Reliability in Metric Conjoint Experiments : Important Requirement or Overrated Nuisance?
2020
Event: 24. Interdisziplinäre Jahreskonferenz zu Entrepreneurship, Innovation und Mittelstand (G-Forum)
, 28.09. - 02.10.2020
, online.
(Conference item: Conference
,
Paper
)
Abstract in another language
Within-subject experiments such as metric conjoint approaches are popular to study individual decision-making in the entrepreneurship literature. Taking a methodological perspective, the testretest reliability is usually treated as a key aspect that makes or breaks a study because low reliabilities may embody severe validity concerns. Traditional research suggested a threshold for internal consistency measures of r = 0.70, which have been adopted for test-retest reliabilities in within-subject designs. However, such a threshold might be inappropriate because conjoint
studies rely on several data points and thus maximize the reliability of results (Monsen, Patzelt, & Saxton, 2010). To address this critical puzzle, we first conduct a systematic literature review to evaluate how the current “rules of thumbs” may affect test-retest reliabilities. Second, we use primary data from a conjoint study on former entrepreneurs’ employability and simulate several data sets varying in sample sizes and test-retest reliabilities to analyze how regression estimates and model fits vary. Our results demonstrate that more nuanced perspectives toward test-retest reliabilities in within-subject designs are needed and best practice recommendations are offered.
Further data
| Item Type: | Conference item (Paper) |
|---|---|
| Refereed: | Yes |
| Keywords: | Within-subject designs; Metric conjoint analysis; Test-retest reliability threshold |
| Institutions of the University: | Faculties > Faculty of Law, Business and Economics > Department of Business Administration > Chair Business Administration XVI > Chair Business Administration XVI - Univ.-Prof. Dr. Matthias Baum Faculties Faculties > Faculty of Law, Business and Economics Faculties > Faculty of Law, Business and Economics > Department of Business Administration Faculties > Faculty of Law, Business and Economics > Department of Business Administration > Chair Business Administration XVI |
| Result of work at the UBT: | No |
| DDC Subjects: | 300 Social sciences > 330 Economics |
| Date Deposited: | 29 Jan 2021 10:09 |
| Last Modified: | 29 Jan 2021 10:09 |
| URI: | https://eref.uni-bayreuth.de/id/eprint/62587 |