The Transparency and Openness Promotion (TOP) Guidelines describe modular standards that journals can adopt to promote open science. The TOP Factor is a metric to describe the extent to which journals have adopted the TOP Guidelines in their policies. Systematic methods and rating instruments are needed to calculate the TOP Factor. Moreover, implementation of these open science policies depends on journal procedures and practices, for which TOP provides no standards or rating instruments. We describe a process for assessing journal policies, procedures, and practices according to the TOP Guidelines. We developed this process as part of the Transparency of Research Underpinning Social Intervention Tiers (TRUST) Initiative to advance open science in the social intervention research ecosystem. We also provide new instruments for rating journal instructions to authors (policies), manuscript submission systems (procedures), and published articles (practices) according to standards in the TOP Guidelines. In addition, we describe how to determine the TOP Factor score for a journal, calculate reliability of journal ratings, and assess coherence among a journal’s policies, procedures, and practices. As a demonstration of this process, we describe a protocol for studying approximately 345 influential journals that have published research used to inform evidence-based policy. The TRUST Process includes systematic methods and rating instruments for assessing and facilitating implementation of the TOP Guidelines by journals across disciplines. Our study of journals publishing influential social intervention research will provide a comprehensive account of whether these journals have policies, procedures, and practices that are consistent with standards for open science and thereby facilitate the publication of trustworthy findings to inform evidence-based policy. Through this demonstration, we expect to identify ways to refine the TOP Guidelines and the TOP Factor. Refinements could include: improving templates for adoption in journal instructions to authors, manuscript submission systems, and published articles; revising explanatory guidance intended to enhance the use, understanding, and dissemination of the TOP Guidelines; and clarifying the distinctions among different levels of implementation. Research materials are available on the Open Science Framework: https://osf.io/txyr3/ .

中文翻译：

---

评估透明度和开放性促进 (TOP) 指南的实施：评估期刊政策、程序和实践的信任过程

透明度和开放性促进 (TOP) 指南描述了期刊可以采用的模块化标准来促进开放科学。TOP Factor 是描述期刊在其政策中采用 TOP 指南的程度的指标。需要系统的方法和评级工具来计算 TOP Factor。此外，这些开放科学政策的实施取决于期刊程序和实践，TOP 没有为此提供标准或评级工具。我们描述了根据 TOP 指南评估期刊政策、程序和实践的过程。我们开发了这个过程，作为支持社会干预层级的研究透明度 (TRUST) 计划的一部分，以推进社会干预研究生态系统中的开放科学。我们还提供了新的工具，用于根据 TOP 指南中的标准对作者（政策）、手稿提交系统（程序）和已发表文章（实践）的期刊说明进行评级。此外，我们还介绍了如何确定期刊的 TOP Factor 分数、计算期刊评级的可靠性以及评估期刊政策、程序和实践之间的一致性。作为这一过程的演示，我们描述了一个协议，用于研究大约 345 种有影响力的期刊，这些期刊发表了用于为循证政策提供信息的研究。TRUST 流程包括系统的方法和评级工具，用于评估和促进跨学科期刊对 TOP 指南的实施。我们对发表有影响力的社会干预研究的期刊的研究将全面说明这些期刊是否具有与开放科学标准一致的政策、程序和实践，从而促进可信赖的发现的发表，为循证政策提供信息。通过此演示，我们希望确定改进 TOP 指南和 TOP 因素的方法。改进可能包括：改进在期刊对作者、手稿提交系统和已发表文章的指导中采用的模板；修订旨在加强对 TOP 指南的使用、理解和传播的解释性指南；明确不同实施层次的区别。研究材料可在开放科学框架上获得：https://osf.io/txyr3/。