https://www.linguisticsweb.org/ 2026-04-18T19:20:44+00:00 https://www.linguisticsweb.org/ https://www.linguisticsweb.org/lib/tpl/starter/images/favicon.ico text/html 2021-10-02T13:35:09+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:advancedshellsettings&rev=1633174509&do=diff Advanced shell settings IMPORTANT CAUTIONARY NOTE: Some of the settings described here are advanced settings that are only necessary under very specific circumstances. If you do not know what any of this entails then it is likely you will not need it. Do not needlessly fiddle with these settings, esp. not with the Code Page settings described further down unless you know what you are doing and what the potential consequences are. I take no responsibility for any damage you do to your system by … text/html 2020-10-01T12:23:28+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:characterencoding&rev=1601547808&do=diff Character encoding The concept of character encoding refers to the way operating systems encode the individual characters of an alphabet, numerical symbols, or indeed, any other type of grapheme-like symbol (punctuation marks, mathematical operators etc.). Character encoding is a notorious issue in natural language processing on computational systems, because the choice of encoding system determines - among other things - how natural language data is represented in the memory of a computational… text/html 2020-10-01T12:23:28+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:eclipse_for_text_processing&rev=1601547808&do=diff Eclipse for basic text processing Eclipse is a powerful integrated development environment (IDE) for programmers and other people working with code. Eclipse is especially geared towards the Java developer, but also offers a development environment for working with other programming languages. It has optional editors and parsers and support for many programming languages such as text/html 2020-10-01T12:23:28+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:fonts&rev=1601547808&do=diff Fonts In linguistics, we often need more symbols than are represented in ordinary fonts such as Times New Roman, Calibri etc. In order to represent older stages of the language that have additional characters such as Old English thorn or phonetic symbols to represent the International Phonetic Alphabet (IPA), we need special fonts. You can use the font Junicode which is available for free on Source Forge: text/html 2022-09-07T12:59:43+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:generictools&rev=1662548383&do=diff Generic tools Apart from the large number of natural language processing tools and techniques that support different analysis, annotation and query tasks, some more generic tools are useful to support text processing and manipulation tasks. Among these, text editors and programming editors are the most important ones. A variety of such tools that are found useful and are widely used by many linguists, computational linguists and computer scientists working with natural language processing are i… text/html 2021-05-23T18:03:17+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:java&rev=1621785797&do=diff Java JDK set-up These days, the code that drives a vast number of applications ranging from software on our laptops to apps on our smartphones is written in the programming language Java. A basic installation of Java, the so-called Java Runtime Environment (JRE) will be preinstalled on any appliances that need it to run. Consequently, most people never have to actually think about whether they text/html 2020-10-01T12:23:29+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:perl&rev=1601547809&do=diff Perl Perl is a popular programming language that has over the years proven itself as an extremely useful tool for scripting for example for administration and text analysis and cleaning tasks. Perl was first developed by Larry Wall. One of its greatest strengths is its powerful implementation of regular expressions that is a quasi standard. text/html 2021-07-09T18:11:07+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:python&rev=1625847067&do=diff [Python3] Python, developed by Guido van Rossum, has become one of the post popular programming languages in recent years. To learn more about the Python eco-system and to download Python, visit: <https://www.python.org/> Python3 installation Download a version of the Python3 installation file that is appropriate for your operating system. Click on text/html 2020-10-01T12:23:29+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:regex&rev=1601547809&do=diff Regular expressions Regular expressions (short: regex) are a powerful tool for text manipulation and search over electronic data. They are implemented in many programming languages and count as the major strength of scripting languages such as Perl or Python as well as the UNIX based operating systems. They allow for search operations as well as text manipulation in the form of search and replace tasks. Most people will be familiar with regular expressions without knowing it from the search fac… text/html 2020-10-01T12:23:29+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:systemrequirements&rev=1601547809&do=diff System Requirements This page lists software and tools that are not restricted to corpus and computational linguistics in terms of their functionality, but that are a prerequisite for many applications that will be encountered in this field. Examples are programming languages such as Java, Perl, Python and R as well as extensions to your operating system required by some software applications such as Tcl/Tk, GraphViz and others. text/html 2021-04-18T15:24:46+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:textputzing&rev=1618752286&do=diff Cleaning corpus data: cleaning and preprocessing STATUS: under construction In many cases, the first step in corpus building entails cleaning up and normalizing texts which come in unsuitable formats or in formats that do not fit the processing pipeline we have in mind. This may be due to the fact that texts are gathered from diverse sources or in diverse formats, or that texts come in formats such as html, pdf, rtf, docx or any other of the multitude of file types and formats available on mod… text/html 2023-04-30T00:19:02+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:visual_studio_code_for_python_programming&rev=1682806742&do=diff Visual Studio Code for Python programming [UNDER CONSTRUCTION: 2023-04-29] Visual Studio Code is a powerful, highly configurable open source code editor that is excellently suited for Python development as well as a large number of other processing tasks. text/html 2021-10-02T13:27:36+00:00 Anonymous (anonymous@undisclosed.example.com) https://www.linguisticsweb.org/doku.php?id=linguisticsweb:tutorials:basics:windowsshell&rev=1633174056&do=diff The Shell (aka the Command Prompt, command line, Terminal) author: Sabine Bartsch | version: 2021-10-02 The Shell, also known as the Command Prompt in Windows (German: Eingabeaufforderung) or Terminal in MacOS and Linux, provides access to commands and tools that are not accessible via the graphical user interface, but have to be called by means of command line parameters. Many professional tools in linguistics have to be called from the command line. It is thus very important for students of …