Extended Rating in Wiki

1 Requirements

1.1 Feature Request Ver. 1

1.2 Feature Request Ver. 2

(Damanakis, Alexander (11.10.11)
 
Description:
Wiki admins can add a new component „improved rating“ to their wikis. The component is configured on the Wiki-Level. (configuration options below.) Data are recorded on the page level.
 
The component contains two parts:
items and ratings
 
An item is a question, an expression or any string that is to be rated.
The rating is a five-star scale that records users rating of the item.  Each rating calculates its own statistics (at least number of ratings, mean and median).
 
All ratings of all items can be summarized into a global item by adding up all ratings of item X [1-N ]/ number of ratings item X [1-N]  and dividing the result by number of items (arithmetic mean).
 
Configurational options for wiki admin:
-        Number of Items configurable from 1 to n < 20
-        String describing item (max 256 chars)
-        Statistics to be reported for each item
-        Summary statistics on/off
 
 
Data recording:
Data are recorded on the page level – that is, although all pages of the wiki allow ratings off the same items 1-N, item 1 for page one keeps its data separate of item 1 on page two. Statistics are calculated per item per page.
 
Data retrival:
Wiki Admins can retrieve/download all ratings from their wiki in the following format:
Columns: pageid, itemid, date_time, rating
lines: one rating per line
 
Example Wiki 1:
Item:                                        rating:
Like this page?                          1-2-3-4-5 (five-star rating)
Value for money?                        1-2-3-4-5 (five-star rating)
Another configurable Item            1-2-3-4-5 (five-star rating)
----------------
Summary                                   arithmetic mean of the above
 
 
Example Wiki 2:
Item:                                        rating:
Like this page?                          1-2-3-4-5 (five-star rating)
Value for money?                        1-2-3-4-5 (five-star rating)
Another configurable Item            1-2-3-4-5 (five-star rating)
yet another Item                        1-2-3-4-5 (five-star rating)
And yet another                         1-2-3-4-5 (five-star rating)
[Summary turned off]

2 Status

3 Additional Information

4 Discussion

Alex 15 Mar 2011: I do not fully understand the flexibility that is needed her. Could you please give some concrete examples of options presented to the learners and how it should look like?

JF 28 Mar 2011: Some things are not very clear. Is it correct that the subjects are configured on the wiki level (valid for all pages within one wiki)? Should the five-start rating be used within the subjects or are there any additional requirements wrt the flexibility? Please provide additional examples and put this on the agenda again.

JF 7 Nov 2011: Thanks for the additional explanations. We now understand how the feature should work. We think that "Extended Rating" would be a better name than "Improved Rating".
 
One open issue is: Since we want to make the rating feature a general feature in the future, we placed it at the header actions menu level. This position should be used consistently for the whole system. This means the different levels could only be displayed as an "overlay" window, like the feature now. Only the aggregated rating could be shown on the header action menu level (see wikis in current ILIAS 4.2 installations) and no rating block would be added to wikis. This also leads to the question how to handle the presentation of the rating element, when [Summary turned off] is selected? We cannot show any stars for this case. Is it very imporant that an aggregated rating can be deactivated?

HJ 19.3.2012:
"Since we want to make the rating feature a general feature in the future"
» Good idea.
One of our institution does use an own php-Application with this feature: users can rate documents (see picture below).

JF 19 Mar 2012: We discussed the relation of this rating feature and the requirements to offer polls in ILIAS (and the existing feedback feature in courses). We concluded, that we should not try to use the same base implementation for polls and ratings. The feature should extend the existing rating feature.
 
We also discussed the question of the presentation. We concentrate on the ratings presentation as outlined in the description of this feature request (not the screenshot provided in the last comment. We also must decide whether the presentation of these multi-category ratings within an overlay is ok or not, e.g. if the multi-category ratings must be presented in a side-block.
 
However we schedule this for 4.3 and try to settle the open conceptual points during the development of this feature.

MK, AK, 7 May 2012: We discussed the wiki rating side block again, today. There are some pros&cons of the different solutions, but we think this extra side block could be valuable for other installations, too. So we would like to make it an option of the wiki settings to show this rating block, even if this means that the functionality is available twice (in the block and in the overlay). This way it is possible to put an extra emphasis on ratings, if this is important for the didactical scenario.

Matthias Kunkel, 21 Aug 2012: The current implementation of this feature could still be improved. Why do we have a column for the "Overall Rating" and one for "Your Rating". Couldn't we integrate both into one star bar like it is done for the general rating bar. The current presentation needs too much space for the presentation of stars. And I think the stars could even be smaller than now. If we have gained some more space in a line, presenting a value (4,1) would be also helpful to see how each point is rated. It is not so easy to identify the parts of a illuminated star...

 
JL 31 Aug 2012: Matthias, please do not confuse the presentation mode (overall rating is presented as yellow/grey stars, own rating as blue dot) with the rating "editor" (own rating as yellow/grey stars). Without rating categories the user clicks on the presentation mode and decides on his rating in the "editor" layer. With categories he basically does the same but as the information what the overall rating for each category is is not available elsewhere we are displaying it in the "editor" overlay, too. So if you present each category condensed (yellow/grey stars, blue dot), how is the user going the edit his personal rating - in a 2nd overlay?

actual implementation

mockup, suggestions of Matthias

JF 17 Sep 2012: The number of votes should be displayed at the bottom of the block (similar to polls). We will try to implement the "Matthias mockup". If users move with the mouse over a rating star line, they will turn to blue/grey. If (s)he clicks a star the blue star presentation will stay until submit is clicked. After submitting the yellow/blue satellite presentation will be shown.

5 Implementation

JL 18 Sep 2012: The layout of the extended rating has been adapted to the simplified version above. To distinguish user and overall rating "blue stars" were introduced.