Automated Essay Scoring

Preface.- Building an Automated Essay Scoring System.- From Lessons to Guidelines.- Models.- Generic Features.- Genre- and Task-Specific Features.- Automated Scoring Systems: From Prototype to Production.- Evaluating for Real-World Use.- Automated Feedback.- Automated Scoring of Content.- Automated Scoring of Speech.- Fooling the System: Gaming Strategies.- Looking Back, Looking Ahead.- Definitions-in-Context.- Index.- References.- Authors' Biographies.

Beata Beigman Klebanov is a Senior Research Scientist at Educational Testing Service, Princeton, NJ. She specializes in development of language technology for education in the subfields of reading and writing. She has led projects on developing automated methods for assessing quality of arguments, topic development, use of figurative language, as well as worked on methods for estimating text complexity and predicting the rate of oral reading of a given text. She has also worked on the effect of noise in language data on the performance of statistical models, as well as on characteristics of class vs test performance. She is the principal investigator behind Relay ReaderTM-innovative technology to support development of reading fluency. Dr. Beigman Klebanov's research appeared in leading journals, such as Computational Linguistics, Transactions of the ACL, ACM Transactions on Speech and Language Processing, Journal of AI in Education, Language Testing, Journal of Educational Psychology,as well as in proceedings of top-tier conferences such as Association for Computational Linguistics' annual meetings (ACL), Learning Analytics and Knowledge conferences (LAK), and the annual meetings of the National Council on Measurement in Education (NCME). She has co-organized a series of ACL workshops and shared tasks on processing of metaphor and other types of figurative language. Beata is currently serving as an action editor for the Transactions of the ACL journal and has served as an area chair or senior area chair for the NAACL/ACL conferences in 2019-2022.Nitin Madnani is a Distinguished Research Engineer in the AI Research Labs at the Educational Testing Service (ETS) in Princeton. His NLP adventures began with an elective course on computational linguistics he took while studying computer architecture at the University of Maryland, College Park. As a Ph.D. student at the Institute of Advanced Computer Studies (UMIACS), he worked on automated document summarization,