Last week during our weekly voice meeting I talked about improving the questionnaire and I'm not sure if everyone understood what I meant. Because of this I've decided to create this contribution, with an example of how the new questionnaire would work.
If I recall correctly other people had some improvements planned for the questionnaire, but I think they were more related to the wording of the questions and answers (and maybe number of answers), while this is purely focussed on the technical side of the questionnaire.
Why?
First of all I'd like to explain my reasoning for updating the questionnaire. Currently there are only 4 answers per question, which is far too little. Sometimes when reviewing a contribution I think the answer lies somewhere between two answers, and I'm sure others sometimes feel the same. So what are we supposed to do then? I'm sure if you ask different people they will have different answers for this as well... What I personally do is the following: for example, if I think the answer is exactly in between two other answers, then I sum the score of both answers and simply take the average. Pretty logical, right?
The problem is for the contributor who, when checking out what I answered, sees the answer I selected (which is either lower or higher than the actual score), and not what I actually determined the answer (or more accurately: score) to be. Is this fair? I don't know, but it's definitely pretty confusing.
Instead of having a dropdown with answers, I propose using a slider with tick marks that indicate the score of the 4 answers, and let the reviewer pick whatever score they want. Using my proposed way of showing which answer was selected should alleviate some of the aforementioned confusion, and with that give a more clear view of what the answer actually is. It also gives the reviewer more flexibility when reviewing contributions, and will give them even more room to distinguish between the quality of contributions. Of course another option is to simply add more answers, but I prefer this approach.
An example
I've recorded a GIF showing how the new questionnaire works below:
I've also created a pen with a working example.
Of course the above example is just to show you how it works. The most important aspect is the ability to pick a score in between two answers if necessary, while also leaving the possibility for reviewers to see and select the pre-determined answers originally available in the questionnaire.
I am very curious to hear what you guys (contributors and reviewers) think about this proposal!