Show Advanced KnowledgeHide Advanced Knowledge

Extend Lock Answers for Key-Feature

1 Initial Problem

It is not possible to realize the behaviour of key feature sequences in ILIAS right now.

Key feature test scenarios have a special set of requirements:

• a question can / may include the best solution to a previous question, that means that question build up on each other
• students have to answer one question after another, they cannot fast-foreward or leaf through the test first
• answers need to be locked on navigating to the next question in line (students can go back to have a look at previous answers, but they must not change them anymore)
• students may get feedback or even the best possible solution when answering a question (then all necessary info will be included in the case vignette of the next question)

The current functionality for feedback loops and the answer locking behaviour does not allow this kind scenario.

2 Conceptual Summary

In order to make key feature testing possible, we propose to restructure the test settings for instant feedback and the locking of participants answers. An additional option for locking of answers when a following question is presented allows to configure a key feature scenario even without using the feedback loops.

2.1 Settings for Question Feedback and Answer Locking Behaviour

Setting: Instant Feedback

• A single checkbox is added for enabling the feedback feature in general
• When enabled, the known checkbox group for enabling the different feedback options comes up as a required subsetting
• An additional subsetting also set as required is added as radio group having two options to configure the event that triggers the feedback loop
  • Participants can Trigger the Feedback Manually
  • The Feedback is Triggered by Answering Questions

Setting: Participant Answers

• Do not Lock Participants Answers during Test Passes
• Lock Answers with the Presentation of Feedback
• Lock Answers with the Presentation of Follow-Up Questions
• Lock Answers with the Presentation of Feedback or Follow-Up Questions

2.2 Conflicts with other Test Settings

When participants answers gets locked on navigating to the next question in line the following settings needs to be set implicitly. If the settings are adjusted on saving the form, an info message is shown to the test autor.

Shuffle Questions

• This feature is implicitly deactivated

Unanswered Questions

• This setting is implicitly set to Unanswered Questions Stay in Position

2.3 Test Player Navigation Behaviour

When the setting 'Participants Answers' includes the behaviour of participant answer locking due to showing the follow-up question the behaviour of the navigation workflow within the test run will be changed for the following situations. 

Navigation prior to Editing a Question

When the participant navigates to the next question without having answered the current one, a new modal dialog will tell the participant that an empty solution will be stored that cannot be changed afterwards. This navigation try can be confirmed or canceled.

Navigation after Editing a Question

When the participant navigates to the next question having the current one answered, a new modal dialog will ask the participant for confirmation due to the fact that the currently entered answer cannot be changed any longer.

Navigation by Using the Question List

The question list does only provide links for the allready answered as well as the current question. Navigating to follow-up question is not possible. The navigation to previous questions behaves in the same way like before.

3 User Interface Modifications

3.1 List of Affected Views

Test > Settings > General Settings
Test > Start Test > Test Player

3.2 User Interface Details

3.3 New User Interface Concepts

None.

4 Technical Information

No technical issues relevant.

5 Contact

• Author of the Request: Glaubitz, Marko [mglaubitz], Universität Freiburg
• Maintainer: Heyser, Björn [bheyser]
• Implementation of the feature is done by:  Heyser, Björn [bheyser]

6 Funding

If you are interest in funding this feature, please add your name and institution to this list.

• Universität Freiburg, Projekt kosmic

7 Discussion

JourFixe, ILIAS [jourfixe], 04 JUN 2018 : We highly appreciate this feature request and schedule it for 5.4 under the following conditions:

• The modal for the navigation to the next question must have a checkbox "Don't show again..." like known from usual tests. Otherwise users will be annoyed when always having to make two submits (Next + Save and Proceed).
• The modal for the navigation to the next question must always be presented when a user does not give any answer (no matter if checkbox is toggled or not).
• In case of contradictory settings (Locking answers + shuffle, locking answers + postpone) a failure message should be presented and indicate which settings cannot be used together. For each conflict settings, a warning message should be presented under the setting stating that there is a settings conflict. Explanation of conflict should only be made in failure message.

8 Implementation

{The maintainer has to give a description of the final implementation and add screenshots if possible.}

Test Cases

Test cases completed at 7. August 2018 by Heyser, Björn [bheyser]

• C208 : Direkte Rückmeldungen
• C209 : Antworten nach Rückmeldung festschreiben
• C24627 : Antworten festschreiben mit Anzeige der Folge Frage
• C24628 : Beantworten einer Frage und Springen zur nächsten
• C24629 : Beantworten einer Frage und Springen zur einer vorherigen
• C24630 : Nicht beantworten einer Frage und Springen zu einer vorherigen
• C24631 : Nicht beantworten einer Frage und springen zur nächsten
• C24632 : Navigation über Fragenliste und Bearbeitungsstand 

Approval

Approved at 2018-10-26 by Glaubitz, Marko [mglaubitz].