In the Margins Main Menu Welcome The In the Margins home page Lexomics The starting point for the Lexomics path Manual Start page for the Lexos Manual Topics Explore this path to learn about the Lexomic methods Glossary Glossary of terms used in Lexos and In the Margins Bibliography Beginning of bibliography path Lexos Install Guide Install Guide

The Scrub Tool

5371
The Scrub Tool
The Scrubbing tool allows you to make document-wide edits, such as the removal of punctuation, digits, and capital letters. Additionally, it also allows you to input a list of Stopwords, Lemmas, Consolidations, and Special Characters. The overall goal of this scrubbing is to normalize texts, removing every possible difference except the actual words used, thereby permitting the application of advanced statistical analysis. Without scrubbing, said statistical analysis may well register false variation between texts.

Tutorial:
The first part of the scrubbing process involves several simple
options which effect the entire document. In almost all cases, their
names provide ample evidence of their functionality, so the important
thing to remember is that they will take effect throughout
your selections. If you select 'Remove All Punctuation', every
period, comma, colon, and quotation mark will be removed.