The goal of this evaluation study is to compare existing classic search interfaces against graphical user-interface toward publication search and trend analysis. On the basis of a within-subject evaluation design, each participant has perform a couple of tasks for both conditions.
Condition one is the raw web-interface of DBLP with only basic search options. The second condition is the Scitics Trend Analysis interface on the exact same DBLP database.
The whole evaluation will takes approx. 15 minutes. Because of time measurement in the background at the practical tasks, please perform these evaluation parts without breaks or delays.
Overall the evaluation covers the following steps:
- First, you will be asked to provide some personal information.
- Second, you will be asked to provide some information about your skills and expertise in using computer systems.
- Third, you should perform and solve some tasks with the first system, followed by a questionnaire about your subjective use experience.
- Fourth and finally, you should perform and solve some tasks with the second system, followed by a questionnaire about your subjective use experience.