Criteria for Evaluation
I have recently added the first criterion referring to harmful consequences. As discussed in my narrative, I have found educational technologies that may harm students, including Automated Essay Scoring (AES) systems that measure only quantifiable aspects of writing and are used as gatekeeping devices. The veil of objectivity can facilitate using standardized tests for unfair high-stakes decisions. So, the primary question to consider is if using the technology will have harmful consequences.
The flowchart allows for weighting questions. Technologies that limit harmful consequences and align with learning outcomes will likely be recommended for use. Technologies designed only for improving efficiency have to pass several other questions before recommendation. Thus I am attempting to offer a more balanced view of the potential advantages and challenges for using learning technology.