To accelerate translational research and enhance collaboration and opportunities for discovery through interoperable data.
The goal of this Informatics Common Metric is to enhance collaboration and opportunities for discovery through interoperable data. Informatics provides critical tools, methods and resources to accelerate translational research. The forthcoming Informatics Common Metric aims to improve discovery opportunities within and among CTSA Program hubs through metrics that encourage data repository quality and harmonization across hubs.
A team of informatics and evaluation experts developed the metric definition and Operational Guidelines. The Common Metrics Implementation team at the Center for Leading Innovation and Collaboration (CLIC) began the pilot activities in August 2017 through March 2018. Sixteen hubs participated in the pilot, representing diversity such as: hub size, single vs. multi-institution, and data model (i2b2/ACT, i2b2/TriNetX, OMOP, PCORnet).
Based on post-pilot assessment including hub interviews, a number of key findings were identified to inform the recommendations for Consortium-wide implementation. These included: (1) Providing scripts to the hubs was a critical addition to the metric that was viewed positively by the hubs, as it reduced duplicative efforts. (2) The amount of script editing required varied by data model and hub. (3) Informatics Metric was seen as valuable to all although new to some hubs. (4) Not all hubs had data for all required domains, (e.g. observations) although all the domains were seen as valuable. (5) Age of the data was a significant concern to the hubs – the value of including data older than
10 years was questioned. (6) For some hubs influence on improving their data warehouse was limited as not all hubs view themselves as able to influence the management and/or collection of the clinical data. (7) RBA process was viewed as valuable to strategic management although there were challenges with the Clear Impact Scorecard. (8) Hubs indicated it would be helpful to have guidance on metric team formation and engagement.
Prior to Consortium scale-up, CLIC suggests the following recommendations: (1) Modify the Operational Guidelines to refine data collection and clarify scope of data. (2) Expand CLIC technical support to the hubs including facilitating access to script subject matter expert. (3) Develop Implementation Guide specific to the metric. (4) Market the
Informatics metric to demonstrate value and future potential. (5) Revise the structure of the Scorecard to reduce redundancies.
Communication of the pilot findings and network scale-up plans will be presented to key Consortium stakeholder groups over the next couple of months. Scale-up
implementation to the Consortium will start upon approval from the NCATS leadership.
Please log in to access this content