... | @@ -9,36 +9,36 @@ When it comes to planning a user study various steps need to be executed, summar |
... | @@ -9,36 +9,36 @@ When it comes to planning a user study various steps need to be executed, summar |
|
- Is a familiarization phase required to get used to the hardware, the scene, the controls, and the task? (Highly recommended!)
|
|
- Is a familiarization phase required to get used to the hardware, the scene, the controls, and the task? (Highly recommended!)
|
|
- Which data needs to be logged by the study framework? (Advice: Log as much as possible; it is better not to use data in the end instead of missing data.)
|
|
- Which data needs to be logged by the study framework? (Advice: Log as much as possible; it is better not to use data in the end instead of missing data.)
|
|
- Which questions need to be asked to gain meaningful insight?
|
|
- Which questions need to be asked to gain meaningful insight?
|
|
- Which tool to use for the questionnaires? We recommend [SoSciSurvey](https://www.soscisurvey.de/) as an online platform. See [some documentation here](https://help.itc.rwth-aachen.de/en/service/u7okrwv9h0s2/article/6e30ff0575d84d09b6e5db792cae60ba/). However, it is sometimes useful to do the questionnaires directly in VR - to do so, have a look [here at out LikertScale Plugin](https://git-ce.rwth-aachen.de/vr-vis/VR-Group/unreal-development/plugins/likert-scale-plugin)
|
|
- Which tool to use for the questionnaires? We recommend [SoSciSurvey](https://www.soscisurvey.de/) as an online platform. See [some documentation here](https://help.itc.rwth-aachen.de/en/service/u7okrwv9h0s2/article/c6819bc1c79e4e3ca0264b0d440770ae/). However, it is sometimes useful to do the questionnaires directly in VR - to do so, have a look [here at our LikertScale Plugin](https://git-ce.rwth-aachen.de/vr-vis/VR-Group/unreal-development/plugins/likert-scale-plugin)
|
|
- How many participants do you need? Do they need to be experts in a certain field or do they need to be novice users?
|
|
- How many participants do you need? Do they need to be experts in a certain field, or do they need to be novice users?
|
|
- When do you want to conduct your study?
|
|
- When do you want to conduct your study?
|
|
- How is the concrete study procedure?
|
|
- How is the concrete study procedure?
|
|
- Do we have funding to pay participants? In this case contact finanzen@itc.rwth-aachen.de to setup the "Werksvertrag", you get the money transferred and also a specific Quittungsliste which every participant has to sign (twice).
|
|
- Do we have funding to pay participants? In this case, contact finanzen@itc.rwth-aachen.de to set up the "Werksvertrag", you get the money transferred and also a specific Quittungsliste which every participant has to sign (twice).
|
|
|
|
|
|
**Study Procedure**
|
|
**Study Procedure**
|
|
|
|
|
|
After you designed your study it is time to set it up. The following section will thereby focus on the supporting material, aka questionnaires, instruction texts, etc.
|
|
After you have designed your study, it is time to set it up. The following section will thereby focus on the supporting material, aka questionnaires, instruction texts, etc.
|
|
|
|
|
|
1. Scheduling
|
|
1. Scheduling
|
|
- [Block the equipment](https://rwth-aachen.sciebo.de/f/4542196192) in the lab for the course of your study.
|
|
- [Block the equipment](https://rwth-aachen.sciebo.de/f/4542196192) in the lab for the course of your study.
|
|
- We have a booking tool which you could use: https://git-ce.rwth-aachen.de/vr-vis/group-wiki/-/wikis/Students/Appointment-Scheduling-Tool. (You have to ask your supervisor to initially set up the experiment and create an account for you: https://git-ce.rwth-aachen.de/vr-vis/staff-wiki/-/wikis/Manuals/Appointment-Scheduling-Tool)
|
|
- We have a booking tool which you could use: https://git-ce.rwth-aachen.de/vr-vis/group-wiki/-/wikis/Students/Appointment-Scheduling-Tool. (You have to ask your supervisor to initially set up the experiment and create an account for you: https://git-ce.rwth-aachen.de/vr-vis/staff-wiki/-/wikis/Manuals/Appointment-Scheduling-Tool)
|
|
- Otherwise you can also set up up a [Foodle](https://terminplaner6.dfn.de/en) or [Doodle](https://doodle.com/en/) or something similar to schedule appointments with your participants.
|
|
- Otherwise, you can also set up a [Foodle](https://terminplaner6.dfn.de/en) or [Doodle](https://doodle.com/en/) or something similar to schedule appointments with your participants.
|
|
- Send an [invitation mail](StudyProcedure/Invitation Mail) to potential participants, share it on social media, and via posters.
|
|
- Send an [invitation mail](StudyProcedure/Invitation Mail) to potential participants, share it on social media, and via posters.
|
|
2. Introductory Text
|
|
2. Introductory Text
|
|
- Write a [text](StudyProcedure/Explaining Texts) informing participants about the general procedure of the study. Do not give away details that might bias the outcome. It is also totally fine if users do not know what to pay attention to.
|
|
- Write a [text](StudyProcedure/Explaining Texts) informing participants about the general procedure of the study. Do not give away details that might bias the outcome. It is also totally fine if users do not know what to pay attention to.
|
|
3. Informed Consent
|
|
3. Informed Consent
|
|
- Prepare the [informed consent](https://git-ce.rwth-aachen.de/vr-vis/VR-Group/unreal-development/plugins/unreal-study-framework/-/wikis/StudyProcedure/Informed%20Consent) which participants need to sign up front after reading the general introductory text. Keep all the signed copies of it for 10 years!
|
|
- Prepare the [informed consent](https://git-ce.rwth-aachen.de/vr-vis/VR-Group/unreal-development/plugins/unreal-study-framework/-/wikis/StudyProcedure/Informed%20Consent), which participants need to sign up front after reading the general introductory text. Keep all the signed copies of it for 10 years!
|
|
4. Demographics
|
|
4. Demographics
|
|
- Prepare a demographics [questionnaire](StudyProcedure/Questionnaires) as the first questionnaire to be filled out prior to the actual study.
|
|
- Prepare a demographics [questionnaire](StudyProcedure/Questionnaires) as the first questionnaire to be filled out before the actual study.
|
|
5. Task Description
|
|
5. Task Description
|
|
- If not mixed with the introductory text, [prepare a task description](StudyProcedure/Explaining Texts) explaining the interaction and navigation controls in detail as well as the actual user task. Use figures to underline your descriptions.
|
|
- If not mixed with the introductory text, [prepare a task description](StudyProcedure/Explaining Texts) explaining the interaction and navigation controls in detail, as well as the actual user task. Use figures to underline your descriptions.
|
|
6. Questionnaires
|
|
6. Questionnaires
|
|
- Prepare [questionnaire](StudyProcedure/Questionnaires) to be asked before, between, and after the various conditions, you test.
|
|
- Prepare [questionnaire](StudyProcedure/Questionnaires) to be asked before, between, and after the various conditions you test.
|
|
- Whenever possible use standardized questionnaires cited in the literature.
|
|
- Whenever possible, use standardized questionnaires cited in the literature.
|
|
- Add your own precise questions focusing on your very technique/investigation object.
|
|
- Add your own precise questions focusing on your very technique/investigation object.
|
|
- Add free text fields to ask for reasons for a special vote as well as additional thoughts, recommendations, and ideas.
|
|
- Add free text fields to ask for reasons for a special vote as well as additional thoughts, recommendations, and ideas.
|
|
7. Interview
|
|
7. Interview
|
|
- Decide whether you need a structured or semi-structured interview (probably in the end) to gain more insight or if the questionnaires are sufficient.
|
|
- Decide whether you need a structured or semi-structured interview (probably in the end) to gain more insight, or if the questionnaires are sufficient.
|
|
8. Debriefing
|
|
8. Debriefing
|
|
- After finishing the study, you can and should tell participants what the focus of your study was. However, make sure that they are aware that this information should not be disclosed to people who might still want to participate in the study, to avoid any bias.
|
|
- After finishing the study, you can and should tell participants what the focus of your study was. However, make sure that they are aware that this information should not be disclosed to people who might still want to participate in the study, to avoid any bias.
|
|
|
|
|
... | | ... | |