Multi-Year Common Metrics Hub Report: 2015-2019 Survey

Purpose

To gather feedback regarding the 2015-2019 Common Metrics Hub Report

Executive Summary

The Common Metrics Initiative (CMI) Multi-Year Data Report: 2015-2019 was released by the Center for Leading Innovation and Collaboration (CLIC) to hub-specific web pages on the CLIC website on February 11, 2021. Hubs were required to use a federated log in to access their individual reports.

The CMI Multi-Year Report included visualizations for aggregated data for each of the common metrics (Informatics and Careers in Clinical and Translational Research – both TL1 and KL2), and Year-to-Year Comparison data 2018-2019. It also included aggregated metric results for individual hubs, and across the consortium. PowerPoint slides for each of the metric visualizations were provided to the hubs.

The Multi-Year Common Metrics Feedback Survey was sent on March 29, 2021 via email, to the principal investigators, evaluators and administrators at each hub throughout the consortium. Those receiving the survey were instructed that there was no limit to the number of surveys that their hubs could submit. The survey was closed on April 12, 2020.

A total of 54 surveys were received from 43 unique hubs. This report includes the quantitative and qualitative results in their entirety.

Key Considerations:
Based on the survey responses in these feedback areas, there is agreement to continue to reflect the following areas in future reports and planned activities:
• Report aggregated data
• Report year-to-year comparison data
• Informatics metric data
• Conduct webinar(s) that explain how reports are generated
• Provide PowerPoint slides for each of the visualizations
Hubs responded that the data stratifications were useful; but that they hope that the data are stratified differently in future reports, particularly regarding hub comparisons.

Almost all survey respondents (N=49, 90.8%) indicated that they either had or were planning to discuss the report with their hub metric teams. In addition, 77.6% (N=38) of the respondents indicated that they had or were planning to discuss their report with their NCATS Program Officer.

Distributed Date
Files

Please log in to access this content

Instrument Fields
Order Instrument Field
1

Please identify your hub
2

Please specify "Other" hub
3

Please identify your role
4

Please specify "Other" role
5

Based on the Multi-Year Common Metric Hub Report, please indicate how useful the Informatics Common Metric visualization was
6

Based on the Multi-Year Common Metric Hub Report, please indicate how useful the Careers in Clinical and Translational Research Metric (CCTR) - TL1 visualization was
7

Based on the Multi-Year Common Metric Hub Report, please indicate how useful the Careers in Clinical and Translational Research Metric (CCTR) - KL2 visualization was
8

Please provide your overall comments regarding the Aggregated Metric Results
9

Overall, please indicate how useful the inter-hub comparisons of your hub to other hubs were for the Informatics Metric Results by Data Domain
10

Overall, please indicate how useful the inter-hub comparisons of your hub to other hubs were for the CCTR - Total TL1 Graduates Currently Engaged
11

Overall, please indicate how useful the inter-hub comparisons of your hub to other hubs were for the CCTR - Percent TL1 Graduates Currently Engaged (URP and Women)
12

Overall, please indicate how useful the inter-hub comparisons of your hub to other hubs were for the CCTR - Total KL2 Graduates Currently Engaged
13

Overall, please indicate how useful the inter-hub comparisons of your hub to other hubs were for the CCTR - Total KL2 Graduates Currently Engaged (URP and Women)
14

Please provide your overall comments regarding the Year-to-Year Comparison data
15

Please provide your overall comments regarding the 2019 Informatics Common Metric Themes
16

What additional Informatics topics/themes would you like to have addressed in the Insights to Inspire 2021 program?
17

Has your hub discussed the report and PowerPoint slides with your hub metric team(s)?
18

Please provide any additional comments regarding discussions about the report and slides with your hub metric team(s)
19

Has your hub discussed the report and PowerPoint slides with your NCATS Program Officer?
20

If no, please explain why you do not plan on discussing the report with your Program Officer
Submitted by Laura Hassinger on Fri, 06/04/2021 - 10:23