The METRIQ Research Agenda
The MedEd LIFE Research Collaborative has been hard at work on a research agenda evaluating blogs and podcasts for the past three years. We have attempted to quantify their growth and development (studies 1-3), quantify the impact (study 4), outline ways to improve them (studies 6-7), and develop tools to evaluate their quality (studies 8-13). The METRIQ study will bring all of this work together in an effort to validate the quality evaluation tools that have been developed.
We understand that free access to research is important - particularly so when it is on the topic of Free Open Access Medical education (FOAM). For that reason we have done everything in our power to make the publications that led to and result from the METRIQ Study accessible. This page links to our formal journal publications as well as freely archived PDF versions of the articles in our research agenda. When free access to the published PDF is not available through a recognized repository and publication rules allow, we will self-archive a post-refereed version of our manuscripts. If you ever have difficulty accessing literature that has been published by our group, please CONTACT US so that we can personally share a copy with you. We are readily available via email and on Twitter.
1 This study quantified the number of emergency medicine and critical care blogs and podcasts.
2 This survey study evaluated the use of various open educational resources by emergency medicine residents and program directors.
4 This study derived and provided validity evidence for the use of an impact factor for blogs and podcasts: the Social Media Index.
5 Building on historical paradigms, this innovation report explored how ALiEM incorporated expert peer review could be into a medical education blog.
6Building on 5, this innovation report explored how a new model of "Coached Peer Review" was implemented at CanadiEM to foster junior authors and editors.
7 This study shifted the focus to defining quality. A systematic review and quality analysis were conducted to develop quality indicators for blogs and podcasts.
8 This Delphi study built consensus among a group of emergency medicine physicians on which quality indicators were the most important.
10 This paper translated the information in studies 8 and 9 by developing user-friendly checklists for blogs and podcasts.
11 This study evaluated the ALiEM AIR Score for validity and reliability as a measure of assessment for blog posts.
13 This study combined the data from studies 8 and 9 along with new information to derive two quality "decision rules", METRIQ-5 and METRIQ-8.
16 This study compares the reliability of the METRIQ-8 and ALiEM AIR Score to the community standard of average gestalt quality assessment.
14 This paper describes how the METRIQ Study recruited 309 participants from a virtual community of practice to complete a 90-120 minute survey.
17 This study compares average gestalt, METRIQ-8, and ALiEM AIR to the Social Media Index to investigate the latter's relationship with quality.
15 The first results from the METRIQ Study reveal that gestalt quality evaluation of blog posts quality is inadequate. We need to do better!
18 This study assessed the editorial processes and affiliations of the top 100 emergency medicine blogs.