In order for the videos to be useful to clinicians, medical students, families, pharmaceutical developers, and other stakeholders, each video must be labeled with appropriate metadata and validated by experts where needed. The Clinical Picture Maker provides a structure for the videos and related metadata, and streamlines the process of reviewing videos and adding data. This results in a video dataset that can be searched, sorted, and utilized in a variety of ways.
Video Metadata
Once a video is uploaded to the Clinical Picture Maker Platform, CPM staff review the video and add relevant metadata. When adding metadata, CPM staff will use the content of the video as a guide, as well as user-provided data such as the title and description of the video, and the self-reported symptoms and keywords.
Metadata for each video includes:
- Participant data (diagnoses of the participant in the video, age of the participant at the time of filming)
- Title and description
- Symptoms visible in the video
- Topics related to the content of the video
Expert Review
When a video labeled as showing specific symptoms, it is important for that video to be reviewed by clinicians with expertise in that domain. The Clinical Picture Maker has a team of expert clinicians with advanced knowledge in many different areas of medicine. Videos are assigned to specific experts for review depending on the symptoms in question.
When the expert reviewers log onto the Clinical Picture Maker platform, they can view their Review Dashboard, which shows the videos assigned to them, as well as a list of previously reviewed videos. The reviewers respond to a form that requests input on different elements of the video, and requires them to rate their level of confidence that each symptom is present in the video.
Once the reviews are submitted, Clinical Picture Maker staff view all the responses, make any needed changes, and either submit the video for further review, or publish the video to the See System Rare Disease Video Database.
Here are some examples of how experts analyze video as they’re reviewing it on the Clinical Picture Maker platform.
Dr. Keith Coffman Reviewing a Video
Loading video…
Expert Agreement
Occasionally, experts may disagree on what symptoms are visible in a video, or they may be unable to draw a confident conclusion. For this reason, the video page in the See System Rare Disease Video Database displays the average level of confidence for each symptom, and also the number of reviewers for each rating.
