Text segmentation

<p>Text segmentation is the process of dividing written text into meaningful units, such as words, <a href="/facts/Sentence_(linguistics)/GhKKkcm2">sentences</a>, or <a href="/facts/Topic_(linguistics)/vow08bl6">topics</a>.  The term applies both to <a href="/facts/Mental_process/ga0tSBul">mental processes</a> used by humans when reading text, and to artificial processes implemented in computers, which are the subject of <a href="/facts/Natural_language_processing/1hjMKsSN">natural language processing</a>. The problem is non-trivial, because while some written languages have explicit word boundary markers, such as the word spaces of written English and the distinctive initial, medial and final letter shapes of <a href="/facts/Arabic_language/A1e66hVV">Arabic</a>, such signals are sometimes ambiguous and not present in all written languages.
</p><p>Compare <a href="/facts/Speech_segmentation/UCoL3rfQ">speech segmentation</a>, the process of dividing speech into linguistically meaningful portions.
</p>

Text segmentation open-in-new

Text segmentation