Text Pre Processing Techniques

Setup.: Python 3.10

• Whindows (CMD on project root folder)

$python -m venv venv

$venv\Scripts\activate

$pip install -r requirements.txt

• Linux (terminal on project root folder)

$python3 -m venv venv

$source bin\activate

$pip3 install -r requirements.txt

• Install pytorch

Some results preview

Run

• Fallow the steps to retrieve the dataset in each dataset folder, which you want to run

• Run :
  main.ipynb

  or

  $main.py dataset-name

Tests

Run all tests
$python -m unittest discover

Run only one test class
$python -m unittest package.file.ClassName

$python -m unittest package.file.ClassName.test_method