Surveys as Test Parts

This is a sub-entry of the feature request Competence-driven Question Groups and Test Parts

1 Initial Problem

This feature requires the implementation of Introduction of Test Parts

Furthermore, in order to assess competences properly, self-evaluations (in contrast to giving answers to test questions) are a crucial tool that is missing entirely in the testing procedures that ILIAS offers right now. It is not possible to alternate blocks of self-evaluation (e.g. a short competence-base survey) with questions (or groups of questions or test parts) that try to assess student perfomance in this ara of competences / this field.
If ILIAS were able to combine the feedback on how well a student did in a test part with the data of how they evaluated themselves (with reagrd to these competences or learning outcomes), it would be possible to achieve a much more effective impact on the students learning process by showing them really relevant learning suggestions and "learning progress" feedback.

2 Conceptual Summary

support tightly interwoven combinations of testing and self-evaluation ("some might call this self-assessment). Learners should be presented with alternating sets of small surveys and test parts. By the ILIAS will provied intricate data for contrastive analyses methods that need both aspects, the performance measurement from the test and the (previous / post hoc) self-refexion data form the surveys.

• acts as a special test part
• two possible ways:
  • competence-focused: a single page with offers / demands giving a self-evaluation to a preset set of competences
    • re-use the self-evaluation functionality / features / screens of the competence management service
  • survey-focused: integration of a prepared survey which must be completed before st student can move on to the next test part
    • more felxibility and usable for universities taht do not have the competence management activated
    • basically only a playback issue:
      • user is directed into the survey issue
      • if a user leaves the test and resumes it, they jump back into the survey

3 User Interface Modifications

3.1 List of Affected Views

{Please list all views (screens) of ILIAS that should be modified, newly introduced or removed.}

3.2 User Interface Details

{For each of these views please list all user interface elements that should be modified, added or removed. Please provide the textual appearance of the UI elements and their interactive behaviour.}

3.3 New User Interface Concepts

{If the proposal introduces any completely new user interface elements, please provide a link to separate feature wiki entries for each of them according to the kitchen sink template.}

4 Technical Information

{The maintainer has to provide necessary technical information, e.g. dependencies on other ILIAS components, necessary modifications in general services/architecture, potential security or performance issues.}

5 Contact

• Author of the Request: Glaubitz, Marko [mglaubitz], Universität Freiburg
  
• Maintainer: {Please add your name before applying for an initial workshop or a Jour Fixe meeting.}
• Implementation of the feature is done by: {The maintainer must add the name of the implementing developer.}

6 Funding

If you are interest in funding this feature, please add your name and institution to this list.

• we might need some help here, but the project "kosmic - KompetenzOrientierte Selbstlernangebote für Mathematik, Interkulturalität und Chemie" Universität Freiburg is interested in funding parts of this

7 Discussion

Samoila, Oliver [oliver.samoila], 2017-03-08: 
Hallo Marko, 
vielen Dank für die vielen Ideen.

Da ich für mich noch in Frage stelle, dass sich die Daten aus Selbeinschätzungen mit denen aus Tests verrechnen lassen bzw. verrechnet werden dürften, wüsste ich gern warum ihr für die Sequenzierung von Tests und Umfragen keine Vorbedingungen nutzt?
Mir geht es aber vorrangig nicht um diese Kombination, sondern darum, was dabei mit den erhobenen Kompetenzdaten passieren soll.

Bereits für die überarbeiteten Visualisierungen in "Meine Kompetenzen", in Objekten und im Entwurf für die Aggregation von Komepetenzdatensätzen haben wir einer Vermischung von Messungen, Selbsteinschätzungen und Fremdeinschätzungen strikt vermieden. Meines Erachtens kann eine Aggregation diseser Erhebungstypen nur dann vollzogen werden, wenn es eine allgemiengültige Regelformulierung dafür gibt - dies kann ich mir wiederum nicht vorstellen.

8 Implementation

{The maintainer has to give a description of the final implementation and add screenshots if possible.}

Test Cases

Test cases completed at {date} by {user}

• {Test case number linked to Testrail} : {test case title}

Approval

Approved at {date} by {user}.