We presented a short paper at the 6th CLEF 2015 Conference and Labs of the Evaluation Forum in Toulouse on the deliberations from a workshop on Evaluating Learning Language Models we held last Fall with generous support from ELIAS. The presentation raised a fair bit of interest and several requests for a continuation workshop, and we are now motivated to continue by actually implementing the evaluation metrics suggested from the workshop.
