Show Advanced KnowledgeHide Advanced Knowledge

Exercise: Comparing Submissions of Type Text

1 Initial Problem

In ILIAS 5.3 all submissions are listed (assignment type: Text) or offered for download (assignment type: portfolio).

Tutors would like to compare selected submissions and view them next to each other. 

For Text Assigments handed in solutions can already be listed however in a rather difficult format.

2 Conceptual Summary

Assigment Type: Text 

1. Users can select users in Submissions and Grade tab using the existing checkboxes.
2. In the multi-actions the action Compare Submissions is selected  and Execute is clicked.
3.  Two different options

• Option 1: ILIAS shows the selected submissions in Reporting Panels underneath each other for immediate comparison in an underworld. 
• Option 2: ILIAS shows the first two selected submissions in Reporting Panels next to each other. The selected users can be flipped through in a first-in-first-out fashion. On top Users can be selected for one of the two slots.

3 User Interface Modifications

3.1 List of Affected Views

• NEW Underworld "LCompare Selected Submissions" of Assignment Type "Text"

3.2 User Interface Details

3.3 New User Interface Concepts

Re-Use of the Reporting Panel

4 Technical Information

{The maintainer has to provide necessary technical information, e.g. dependencies on other ILIAS components, necessary modifications in general services/architecture, potential security or performance issues.}

5 Contact

• Author of the Request: Tödt, Alexandra [atoedt]
• Maintainer: Killing, Alexander [alex]
• Implementation of the feature is done by: {The maintainer must add the name of the implementing developer.}

6 Funding

If you are interest in funding this feature, please add your name and institution to this list.

• …

7 Discussion

23. November 2017 Amstutz, Timon [amstutz]: I do not see benefit of such a new User Interface implementation in this context, but several issues:

1. How would this work mobile?
2. How could this work with many items selected?
3. How would a responsive view for this look like?

Most importantly, I do not see the benefit of this feature compared to just opening a second tab in the browser and comparing like that.

Killing, Alexander [alex], 5 Dec 2017: @Timon: You refer to Option 2 or to both? I think Option 1 gives some advantages and is also easier to implement. It's more a "Detailed Report" than a comparison feature for me. But I can imagine that tutors would select a number of participants and list the details in this way to get an overview or maybe to print them. I currently prefer Option 1 over Option 2.

Kunkel, Matthias [mkunkel], 12 DEC 2017: I see the need for a better presentations of submissions for evaluating and grading them. But I have a couple of questions regarding this feature request and the two shown options:

1. Concerning option 1: I have the impression that the screenshot for option 1 is not really showing what is meant because it shows just one submission. As this feature is called "... Comparing Submissions", I assume that all selected submissions are presented on one screen, right? Please give a statement. And how are the different submissions separated in option 1. It is important to distinguish them clearly.
2. Concerning option 2: does the dropdown above the submissions offer just the selected users for comparison or all users that made submissions? And what happens when flipping through pairs by clicking on the arrow at the right side: does submission A|B is replaced by B|C or by C|D? Isn't it a more realistic workflow to compare submission A with B, then with C, then with D a.s.o.? In this case the left arrow is currently at the wrong place because you only change the right pair and always compare it to the left one (which stays static).
3. Concerning both options: Does the feedback always need to be shown - or would it be better for the user to have an option to focus on the submissions only? A filter that shows/hides feedbacks would be helpful. Making a sound evaluation of an amount of submissions requires focusing on the submission itself. All "additional" information might be helpful in special cases but can become information clutter when not needed but displayed.

AT, 2017-12-18 @Timon:

1. Option 2 will not work on small screens. 
2. Just two submissions will be shown at the same time, however users could leave trough the pairs. 
3. This is unfortunately unresponsive. 

AT 2017-12-18 @Matthias: 

1. Option 1 lists the submissions that were selected for comparison underneath each other. I amended the mockup to clarify. 
2. The dropdown hold the names of those users previously selected for comparing. A|B ist replaced by B|C. 
3. The feedback could be shown or hidden. I agree with your point about informational clutter.

JourFixe, ILIAS [jourfixe], 2017-12-18: We reject option 2 for presenting and comparing multiple assignments on one page and prefer a solution where assignments are presented one under the other. Please have a look at the UI element 'Presentation Table' (https://github.com/ILIAS-eLearning/ILIAS/pull/602) to check if this does not solve the requirement for comparing multiple assignments better than a report panel.

Tödt, Alexandra [atoedt] 2017-02-05: I did look at the Pull Request and talked the issue over with the client for the project detailed on this page. 

• They refuse to scroll down long lists and open individual ones. The want to single out their specific participants and have their data opened in all cases. They find the approach does not work fo the long lists they are looking at working with. 
• They were miffed their project was put on halt for an element does not exist in the kitchensink, yet. They are perfectly happy with the element that is available today.  

JourFixe, ILIAS [jourfixe], 05 FEB 2018 : We discussed the suggested UI element 'Presentation Table' and how it can be used in this scenario. We prefer to use the 'Report Panel' for comparing submissions as originally suggested by Alexandra. Reports shall be presented underneath each other (as shown in option 1 above) but with clearly separated backgrounds to distinguish each report better. Feature request is scheduled for 5.4.

JourFixe, ILIAS [jourfixe], 19 NOV 2018 : We re-schedule this feature for 6.0 with the requirements stated in the last JF decision.

8 Implementation

{The maintainer has to give a description of the final implementation and add screenshots if possible.}

Test Cases

Test cases completed at 2019-05-29 by Tödt, Alexandra [atoedt]

• 31716 : Abgaben zu einer Text Übungseinheit vergleichen

Approval

Approved at 2019-03-11 by Claudia Frie and Maximilian Tietz, Uni Hannover