WP2 - User requirements and evaluation

Back to Project objectives

Objectives

The objectives of this workpackage are:

• to capture the requirements of the end-users (mobile learners) of the system;
• to survey the latest research in mobile learning area; and
• to define evaluation criteria and to evaluate the project results, even from a pedagogical perspective, with respect to the previously captured requirements and also to the objectives of the project.

Description of work

Requirements workshops and pair-wise partner meetings will be held to extract the requirements of the system, for the three task areas to be used in the trials. This will involve meetings with end-users within the partner sites (i.e. researchers, students, education departments etc) as well as with the content-provider departments. A literature search will be conducted to identify suitable metrics for assessing cognitive load, with a view to setting a general requirement to minimise that load. This may involve looking at the methods, algorithms and practices people use to perform their tasks, and the resources associated with cognitive scaffolding available in the environment. This work will feed into WP 4 and WP 11.
A survey of the latest research in this area will be made and published as an interim report. EU Mobile Newsletter will be used in as a source for getting updated state of the art.
Evaluation criteria, methodologies and templates will be made covering system usability, functionality and performance. These will enable a comprehensive evaluation to be performed by all partners, according to ISO 13407 (Human-Centred Design Processes for Interactive Systems), and by real users in WP11. Usability will be measured as part of a usability test, inspired by European Usability Support Centres [EUSC]. Robust metrics for measuring the effectiveness, efficiency and satisfaction have been developed by the ESPRIT MUSiC project [MUSIC]. Satisfaction will be measured by a questionnaire such as SUMI. The Common Industry Format [CIF] for usability test reports can be used to report usability metrics. Partner 6 leads this WP.

Deliverables

• PM4: D2.1 Initial user requirements
• PM4: D2.2 Evaluation methodology and criteria
• PM10: D2.3 Evaluation of Pre-prototype
• PM16: D2.4 Evaluation of first prototype
• PM22: D2.5 Final user requirements
• PM22: D2.6 Evaluation of second prototype

Milestones and expected result

The expected results from this work package are:

• a clear, defined set of user requirements to use a basis to design and evaluate the solution developed in the project; and
• comprehensive evaluation criteria that will be used in WP8 to influence prototypes.

BSCW link: http://bscw.uni-koblenz.de/bscw/bscw.cgi/0/82382

Back to Project objectives