Skip to content

Commit

Permalink
deleted goT warnings
Browse files Browse the repository at this point in the history
  • Loading branch information
elizaan committed Aug 14, 2024
1 parent 3f84bf8 commit 36a1757
Show file tree
Hide file tree
Showing 6 changed files with 15 additions and 618 deletions.
Binary file modified public/Upset-Alttext-User-Survey/assets/T1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
4 changes: 2 additions & 2 deletions public/Upset-Alttext-User-Survey/assets/consent.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,10 @@
Before we begin, please read the following consent form carefully and thereafter complete the section below.

## Purpose of the Study
Taking valuable feedback and assessment from sighted community is crucial as a forst evaluation step for our generated text descriptions. The sole purpose of the study is to evaluate our text description for UpSet plots.
Taking valuable feedback and assessment from the sighted community is crucial as a first evaluation step for our generated text descriptions. The sole purpose of the study is to evaluate our text description for UpSet plots.

## Tasks
The study contains three visualization contents: Visualization only (a UpSet plot), Text only (text description of a UpSet plot), Visualization and Text (a UpSet plot and text description of that plot). For each visualization content, we ask you 12 questions regarding understanding the content. The questions contain various types such as single-choice, checkbox, long text, likert scale, etc. After answering the questions for each content, the participant will take part in a post study survey. Each participant should take approximately 20-25 minutes to complete the questionnaire.
The study contains three visualization contents: Visualization only (an UpSet plot), Text only (text description of an UpSet plot), Visualization and Text (an UpSet plot and text description of that plot). For each visualization content, we ask you 12 questions regarding understanding the content. The questions contain various types such as single-choice, checkbox, long text, likert scale, etc. After answering the questions for each content, the participant will take part in a post-study survey. Each participant should take approximately 20-25 minutes to complete the questionnaire.

Each participant in this study is assigned a random ID for analyses. As such, your participation will remain anonymous, and your responses will not be used to identify you.

Expand Down
8 changes: 5 additions & 3 deletions public/Upset-Alttext-User-Survey/assets/introduction.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,14 @@

Welcome to our study!

In this study, you will encounter questions about **data visualizations and equivalent text describing the content** of data visualizations. We will use UpSet plots, a set visualization technique similar to Venn diagrams as an example.
In this study, you will encounter questions about **data visualizations and equivalent text describing the content** of data visualizations. We will use UpSet plots, a set visualization technique similar to Venn diagrams, as an example.



Our research aims to **make data visualizations more accessible to people with visual impairments** such as low vision, residual vision, or no vision. We want to understand whether text can convey equal amounts of informations as a chart.
Our research aims to **make data visualizations more accessible to people with visual impairments** such as low vision, residual vision, or no vision. We want to understand whether text can convey equal amounts of information as a chart.

We first will introduce what an UpSet plot is, why is it used, how you can interpret an UpSet plot.

To ensure you are comfortable with the actual question-answer session, there will be a training section where you will have up to **three attempts** to answer the questions correctly. If you do no pass the training on your third try, **you can not proceed to the study** and **your answer will not be accepted**. In that case, **we will not be able to pay you** and **you will be automatically redirected to the finish page**.
>
**<span style="color:red;">⚠️ WARNING:</span>**
<span style="color:red;">To ensure you have engaged with the tutorial, there will be a training section where you will have up to **three attempts** to answer the questions correctly. If you do not pass the training on your third try, **you will not be able to proceed to the study** and **your answers will not be accepted**. In that case, **we will not be able to pay you**.</span>
2 changes: 1 addition & 1 deletion public/Upset-Alttext-User-Survey/assets/training1.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ Here you see an example for "Visualization Only". In the sidebar, you can see so
This UpSet plot shows movies and their genres. A movie can have multiple genres. The sets are movie genres. The items are movies. The intersections show how many movies have exactly the same genres.

<div class="image-container">
<img src="./assets/T1.png" alt="Movie Genres" width="600" height="940"/>
<img src="./assets/T1.png" alt="Movie Genres" width="610" height="940"/>
</div>

</body>
Expand Down
14 changes: 7 additions & 7 deletions public/Upset-Alttext-User-Survey/assets/upset.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

# What Is UpSet?

UpSet visualizes set data, as it would be usually displayed in a Venn diagram. However, unlike Venn diagrams, UpSet works for more than three sets.
UpSet visualizes set data, as it would usually be displayed in a Venn diagram. However, unlike Venn diagrams, UpSet works for more than three sets.


## UpSet Explained
Expand All @@ -13,7 +13,7 @@ UpSet plots the intersections of a set as a matrix, as shown in the following fi

<br>

Below you can see examples of how these intersections correspond to the segments in a Venn diagram. The first row in the figure is completely empty – it corresponds to all the elements that are in none of the sets. The green (third) row corresponds to the elements that are only in set B, (not in A or C). The orange (fifth) row represents elements that are shared by sets A and B, but not with C. Finally, the last (violet) row represents the elements shared between all sets.
Below, you can see examples of how these intersections correspond to the segments in a Venn diagram. The first row in the figure is completely empty – it corresponds to all the elements that are in none of the sets. The green (third) row corresponds to the elements that are only in set B, (not in A or C). The orange (fifth) row represents elements that are shared by sets A and B, but not with C. Finally, the last (violet) row represents the elements shared between all sets.

<img style="height: 400px; width: 490.5px" class="centered-image" src="./assets/concept_2_intersections.svg" alt="Explaining the intersections in UpSet">

Expand All @@ -31,7 +31,7 @@ The matrix is also very useful because it can be sorted in various ways. A commo
<img style="height: 400px; width: 298.4px" class="centered-image" src="./assets/concept_4_sorting.svg" alt="Sorting by cardinality in UpSet">


These are the basiscs of UpSet! Next, we'll look at an example like you will see in the study.
These are the basics of UpSet! Next, we'll look at an example like the ones you will see in the study.

## Interpreting UpSet Plots

Expand All @@ -41,20 +41,20 @@ The following UpSet plot shows movie genres as intersecting sets.
<br>

### Sets and Set Sizes:
In this UpSet plot the genres Drama, Comedy, Thrillar, Crime, and Fantasy are the sets. The bars on top indicate that Drama is a large set, but Fantasy is small.
In this UpSet plot, the genres Drama, Comedy, Thriller, Crime, and Fantasy are the sets. The bars on top indicate that Drama is a large set, but Fantasy is small.

In the study, **you will be asked to classify this distribution** using your judgement. Are they:
In the study, **you will be asked to classify this distribution** using your judgment. Are they:
* Roughly equal,
* Diverging a bit, or
* Diverging a lot.

For this example the correct answer is "Diverging a lot".
For this example, the correct answer is "Diverging a lot".


### Intersection and Intersection Sizes:
In this UpSet plot, there are 20 intersections that are made up of different sets.

You will be asked about the make-up of these intersection. The categories are
You will be asked about the make-up of these intersections. The categories are
* an intersection is made up of **no set**; as shown in the third row with size 854 here (movies that don't have any of the genres shown).
* an intersection can only contain a **single set**, like the largest one (Drama, with 1198 movies)
* an intersection can contain **2-3 sets**, like the "Drama-Comedy" intersection with size 212.
Expand Down
Loading

0 comments on commit 36a1757

Please sign in to comment.