Skip to main content
SpringerLink
Log in

Randomized, Multicenter, Parallel-Arm (RMPA) research trial design: a potential solution to survey length, response rate and data quality in social science research

  • Original Article
  • Published:
Journal of Marketing Analytics Aims and scope Submit manuscript

Abstract

Previous research has shown that long surveys negatively impact response rate and can negatively impact the quality of the data collected through respondent fatigue. Several solutions have been tried including survey design, incentivizing respondents, esthetically enhancing surveys, infusing secondary data and shortening the scales; however, these actions create their own problems that further impact the quality of data. The purpose of this paper is to illustrate the use of a modified version of a commonly used method in medical research, Randomized, Multicenter, Parallel-Arm Research Design. This methodology is proposed as a solution to lengthy surveys in social science research for specific types of applications. Using a typology research example, a survey with 1020+ items was divided (into three parallel arms) using this methodology, given to different respondents (randomly across multiple centers), later recombined and analyzed. Exploratory results demonstrate the potential of the methodology for use in social science research. The most critical element to ensure successful use of this methodology is the creation of relevant inclusion criteria for the samples of interest.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Acuna, E., and C. Rodriguez. 2004. The treatment of missing values and its effect on classifier accuracy. In Classification, clustering, and data mining applications, 639–647. Berlin: Springer.

  • Andridge, R., and R. Little. 2010. A review of Hot Deck Imputation for survey non-response. International Statistics Review 78 (1): 40–64. https://doi.org/10.1111/j.1751-5823.2010.00103.x.

    Article  Google Scholar 

  • Angoff, W.H. 1987. Technical and practical issues in equating: A discussion of four papers. Applied Psychological Measurement 11: 291–300.

    Article  Google Scholar 

  • Angoff, W.H. 1996. Equating. In Educational measurement: Origins, theories, and explications, Theories and applications, vol. 2, ed. A.W. Ward and H.W. Stoker, 259–331. Lanham: University Press of America.

    Google Scholar 

  • Appel, L.J. 2006. A primer on the design, conduct, and interpretation of clinical trials. Clinical Journal of the American Society of Nephrology 1 (6): 1360–1367.

    Article  Google Scholar 

  • Axenfeld, J., A. Blom, C. Bruch, and C. Wolf. 2022. Split questionnaire designs for online surveys: The impact of module construction on imputation quality. Journal of Survey Statistics and Methodology 10 (5): 1236–1262. https://doi.org/10.1093/jssam/smab055.

    Article  Google Scholar 

  • Berdie, D.R. 1973. Questionnaire length and response rate. Journal of Applied Psychology 58 (2): 278–280.

    Article  Google Scholar 

  • Biner, P.M., and D.L. Barton. 1990. Justifying the enclosure of monetary incentives in mail survey cover letters. Psychology and Marketing 7 (3): 153–162.

    Article  Google Scholar 

  • Biner, P.M., and H.J. Kidd. 1994. The interactive effects of monetary incentive justification and questionnaire length on mail survey response rates. Psychology and Marketing 11 (5): 483–492.

    Article  Google Scholar 

  • Boyle, G.J. 1991. Does item homogeneity indicate internal consistency or item redundancy in psychometric scales? Personality and Individual Differences 12: 291–294.

    Article  Google Scholar 

  • Cattell, R.B. 1973. Personality and mood by questionnaire. San Francisco: Jossey-Bass.

    Google Scholar 

  • Cattell, R.B. 1978. Scientific use of factor analysis in behavioral and life sciences. New York: Plenum Press.

    Book  Google Scholar 

  • Childers, T.L., and O.C. Ferrell. 1979. Response rates and perceived questionnaire length in mail surveys. Journal of Marketing Research 16 (3): 429–431.

    Article  Google Scholar 

  • Childers, T.L., and S.J. Skinner. 1996. Toward a conceptualization of mail survey response behavior. Psychology and Marketing 12 (2): 185–209.

    Article  Google Scholar 

  • Chipperfield, J.O., and D.G. Steel. 2009. Design and estimation for split questionnaire surveys. Journal of Official Statistics 25 (2): 227–244.

    Google Scholar 

  • Chipperfield, J.O., and D.G. Steel. 2011. Efficiency of split questionnaire surveys. Journal of Statistical Planning and Inference 141 (5): 1925–1932. https://doi.org/10.1016/j.jspi.2010.12.003.

    Article  Google Scholar 

  • Durrant, G.B. 2009. Imputation methods for handling item-nonresponse in practice: Methodological issues and recent debates. International Journal of Social Research Methodology 12 (4): 293–304.

    Article  Google Scholar 

  • Galesic, M., and M. Bosnjak. 2009. Effects of questionnaire length on participation and indicators of response quality in a web survey. Public Opinion Quarterly 73 (2): 349–360.

    Article  Google Scholar 

  • Ganju, J., and D.V. Mehrotra. 2003. Stratified experiments reexamined with emphasis on multicenter trials. Controlled Clinical Trials 24 (2): 167–181.

    Article  Google Scholar 

  • Goritz, A.S., and S.C. Luthe. 2013. Lotteries and study results in market research online panels. International Journal of Market Research 55 (5): 611–626.

    Article  Google Scholar 

  • Hagen, N.A., P.D. Biondo, P. Brasher, and C.R. Stiles. 2011. Formal feasibility studies in palliative care: Why they are important and how to conduct them. Journal of Pain and Symptom Management 42 (2): 278–289.

    Article  Google Scholar 

  • Helgeson, J.G., K.E. Voss, and W.D. Terpening. 2002. Determinants of mail-survey design factors and respondent factors. Psychology and Marketing 19 (3): 303–328.

    Article  Google Scholar 

  • Hui, M., A. Joy, C. Kim, and M. Laroche. 1993. Equivalence of lifestyle dimensions across four major subcultures in Canada. Journal of International Consumer Marketing 10 (1): 15–35.

    Article  Google Scholar 

  • Iannarino, N., and A. Palmer-Wackerly. 2022. Fertility preservation decision-making communication between young adult cancer patients and their romantic partners: An application of the DECIDE typology. Health Communication 37 (6): 778–789. https://doi.org/10.1080/10410236.2020.1868065.

    Article  Google Scholar 

  • Johnson, E.P., L. Siluk, and S. Tarraf. 2014. Techniques for fusing survey modules: Respondent matching and data imputation. International Journal of Market Research 56 (4): 425–442.

    Article  Google Scholar 

  • Kereakoglow, S., R. Gelman, and A.H. Partridge. 2013. Evaluating the effects of esthetically enhanced materials compared to standard materials on clinician response rates to a mailed survey. International Journal of Social Research Methodology 16 (4): 301–306.

    Article  Google Scholar 

  • Kline, P. 1986. A handbook of test construction: Introduction to psychometric design. New York: Methuen.

    Google Scholar 

  • Little, R.J.A., and D.B. Rubin. 1989. The analysis of social science data with missing values. Sociological Methods and Research 18 (2–3): 292–326.

    Article  Google Scholar 

  • Localio, A.R., J.A. Berlin, T.R. Ten Have, and S.E. Kimmel. 2001. Adjustments for center in multicenter studies: An overview. Annals of Internal Medicine 135 (2): 112.

    Article  Google Scholar 

  • Maloney, P., M.J. Grawitch, and L.K. Barber. 2011. Strategic item selection to reduce survey length: Reduction in validity? Consulting Psychology Journal: Practice and Research 63 (3): 162–175.

    Article  Google Scholar 

  • Petrescu, M., and A.S. Krishen. 2019. Strength in diversity: Methods and analytics. Journal of Marketing Analytics 7 (4): 203–204.

    Article  Google Scholar 

  • Pfender, E.J., E. Wittenberg, A. Kerr, and J. Goldsmith. 2022. Family communication in Autism Spectrum Disorder: Applying the family caregiver communication typology to parent caregivers, health communication. Health Communication. https://doi.org/10.1080/10410236.2022.2128232.

    Article  Google Scholar 

  • Porter, S., and M. Whitcomb. 2003. The impact of lottery incentive on student survey response rates. Research in Higher Education 44 (4): 389–407.

    Article  Google Scholar 

  • Reblin, A., M. Clayton, Kevin John, and L. Ellington. 2016. Addressing methodological challenges in large communication data sets: Collecting and coding longitudinal interactions in home hospice cancer care. Health Communication 31 (7): 789–797. https://doi.org/10.1080/10410236.2014.1000480.

    Article  Google Scholar 

  • Reynolds, F.D., and M. Crask. 1977. The modern feminine lifestyle. Journal of Marketing 41 (3): 38–45.

    Article  Google Scholar 

  • Riggs, J.F., S. Widmier, and R.E. Plank. 2016. The impact of pharmaceutical industry salesperson regulations, guidance statements, and laws on their sales behaviours: A taxonomy with managerial insights. International Journal of Pharmaceutical and Healthcare Marketing 10 (2): 161–191. https://doi.org/10.1108/IJPHM-05-2015-0019.

    Article  Google Scholar 

  • Roszkowski, M.J., and A.G. Bean. 1990. Believe it or not! Longer questionnaires have lower response rates. Journal of Business and Psychology 4 (4): 495–509.

    Article  Google Scholar 

  • Sarstedt, M., and N.P. Danks. 2021. Prediction in HRM research—A gap between rhetoric and reality. Human Resource Management Journal. https://doi.org/10.1111/1748-8583.12400.

    Article  Google Scholar 

  • Simon, A. 2014. Using administrative data for constructing sampling frames and replacing data collected through surveys. International Journal of Social Research Methodology 17 (3): 185–196.

    Article  Google Scholar 

  • Tambor, E.S., G.A. Chase, R.R. Faden, G. Geller, K.J. Hofman, and N.A. Holtzman. 1993. Improving response rates through incentive and follow-up: The effect on a survey of physicians’ knowledge of genetics. American Journal of Public Health 83 (11): 1599–1603.

    Article  Google Scholar 

  • Van Kenhove, P., K. Wijnen, and K. DeWulf. 2002. The influence of topic involvement on mail-survey response behavior. Psychology and Marketing 19 (3): 293–301.

    Article  Google Scholar 

  • Wells, W.D., and D. Tigert. 1971. Activities, interests, and opinions. Journal of Advertising Research 11 (4): 27–35.

    Google Scholar 

  • Winters, L.C. 1992. International psychographics. Marketing Research 4 (3): 48–49.

    Google Scholar 

  • Young, R.B., and R.G. Javalgi. 2007. International market research: A global project management perspective. Business Horizons 50: 113–122.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Centurion Sales Program at Stetson University, DeLand, FL, USA

    John F. Riggs & Dena Hale

  2. Kennesaw State University, Kennesaw, GA, USA

    Scott Widmier

  3. ArkVisum LLC, Ormond Beach, FL, USA

    Sonya Tidwell-Riggs

Authors
  1. John F. Riggs
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dena Hale
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Scott Widmier
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sonya Tidwell-Riggs
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dena Hale.

Ethics declarations

Conflict of interest

The authors have no conflicts of interest to declare. All co-authors have seen and agree with the contents of the manuscript and there is no financial interest to report. We certify that the submission is original work and is not under review at any other publication.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Riggs, J.F., Hale, D., Widmier, S. et al. Randomized, Multicenter, Parallel-Arm (RMPA) research trial design: a potential solution to survey length, response rate and data quality in social science research. J Market Anal 11, 577–586 (2023). https://doi.org/10.1057/s41270-023-00233-7

Download citation

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1057/s41270-023-00233-7

Keywords

Search

Navigation