Relevance assessment of query document pairs is expensive and boring? It does not have to be. We are currently developing a playful means of determining relevance. We select keywords from the pages and ask judges to associate them to topics in a game.
Please follow the link to the current version of the GeAnn annotation game.