337: Methodological Pluralism in the Study of Rankings: RD, Experiments, Simulations, Qualitative Methods (16351)

Third-party evaluations -- such as rankings, awards, and aggregated consumer reviews -- have grown in influence over the last decades. Understanding these sources of environmental influence is not only practically important for managers but also crucial for scholars in areas such as stakeholder theory and the social evaluations literature. This workshop responds to the increasing interest in ranking studies and contributes to future research by exploring diverse methodological approaches. Recent explorations have drawn from a wide range of methods, providing valuable empirical and theoretical insights. Quantitative research has employed experimental and quasi-experimental designs to separate the effects of third-party evaluation systems from unobservable factors, while qualitative studies have revealed a nuanced processual understanding of responses from ranked entities. The workshop features a panel of five scholars sharing their experiences in conducting cutting-edge empirical research in third-party evaluation systems. These scholars will discuss the application of regression discontinuity designs, field experimental approaches, online and lab experiments, simulation methods, and qualitative approaches. They will also offer guidance on effectively positioning research for reviewers and publication. Through these discussions, the workshop aims to enhance participants' understanding of these empirical approaches and their optimal application in producing high-quality research on third-party evaluations.