Competence Service for Question Pool

1 Requirements

With the feature Competence Service for Test the test gets able to trigger competence level achievements. Therefore a configuration with question/competence assignments and a corresponding set of competence level thresholds is neccessary.
 
A weakness of the concept behind the feature Competence Service for Test is the fact, that the configuration for compentence level triggering is to be done on each test again.

A solution to the problem as well as further improvements can be found in the following concept.
(Chapter 2.5 ( Competence statistics) is not to be considered , as this is not sufficiently specified and there is no funding.)

2 Additional Information

• Idea / concept: kkoch [at] hsu-hh [dot] de , oliver.samoila [at] hsu-hh [dot] de
• Funding: Funded by optes
• Maintainer: Björn Heyser
• Implementation of the feature is done by: Björn Heyser, Databay AG AG
• Tested by / status: (name, e-mail), (status information set after implementation)

3 Discussion

BH 12 May 2014: The maintainers highly appriciate this feature in addition to the feature Competence Service for Test.

JF 12 May 2014: We appreciate this feature and schedule it for 4.5. The competence assignment and the "competence points" should be regarded as "properties" of the question and be copied into tests, when pool questions are used. The general activation of the competence service and the threshold definitions are parts of the test definition.

Matthias Kunkel, 28 Feb 2015: This  feature was already scheduled for a previous ILIAS version but not implemented due to missing funding or time. We re-schedule it automatically for 5.1 to save time for discussion new feature requests.

4 Implementation

Heyser, Björn [bheyser] 10. July 2015: Feature has been implemented according to the specification document referenced in the requirements section.

4.1 Competence Assignment in Pool

When the competence management was activated in the ILIAS Administration the Test Question Pool offers a setting to enable use of competences for questions within the Test Question Pool. When this setting is enabled an additional tab "Competences" comes available.

This competence tab shows two subtabs, the first one shows a list of all questions in the pool and it offers possibilities to assign one or more competences to the questions. For assignments with the evaluation mode "result comparison" it is also possible to adjust the granted competence points within this screen.

For assigning competences the link "Manage Competence Assignments" is to be used that is available for each questtion. It leads to the following screen, where you can select/deselect one or competences from the competence tree.

With the link "Manage Assignment Properties" it is possible to adjust the criteria of how competence points are granted for which kind of answer given by the learner.
There are two types of evaluation the given answer of the participant. The first mode simply defines a competence point value that is scored relatively to the effective question result of the learner. When the learner answers the question with an result of 75%, than exactly 75% of the defined competence points value is granted to the learner.

The alternative mode uses a logical expression syntax to compare against the exact submitted solution in detail. It is possibe for example to match certain selected checkboxes for multiple choice questions or a concrete order sequence for ordering questions. Multiple expressions can be defined with different amounts of competence points. The expressions are evaluated in the given order until all are checked or one was evaluated with true. A positive evaluation leads to granting the defined competence points.

The other subtab that is available in the Test Question Pool's competences tab shows aggregated statistical information about assignments for each competence that gets addressed.

For questions within Test Objects this competence assignment service exists as well, like in the Test Question Pool the use of competences is to be enabled.

For questions imported from Test Question Pools the competence assignments made in the pool are imported to the test as well. Additionally questions created in the test itself, or for questions without competence assignments, competence assignments can be managed as well of course. This configuration steps work exactly like within the Test Question Pool.

The Test Object's competence tab offers a second subtab as well, here this tab is used to define neccessary threshold values that are used as scale when calculating the reached competence level based on the Test Object's internal competence point handling.

When the Test was taken by a learner, the info screen as well as the test results screen offers a link to open a screen, showing the reached competence records.

The competence results screen presents the stored competence records in the same way like the personal desktop. When the competence managemant offers competence profles for users, this screen also shows the a gap analysis using spiderweb diagrams. 

Test Cases

Test cases completed at {date} by {user}

• Testsuite 1 : Test & Assessment
• TestCases
  • C5449-C5463
  • C5466-C5500
  • C5474-C5475
  • C5816-C5844

Approval

Koch, Karola [kkoch] 10. July 2015: The solution for assigning competencies in Tests, QuestionPools, FormATests and QuestionSet Pools meets our expectations (tested in optes 4.4 by Karola Koch - 10.07.2015).