talon/requirements.txt

chardet>=1.0.1
cchardet>=0.3.5
cssselect
html5lib
joblib
lxml>=2.3.3
numpy
regex>=1
scikit-learn==0.24.1 # pickled versions of classifier, else rebuild
scipy
six>=1.10.0
Drops Python 2 support REP-1030 In addition to some python 2 => 3 fixes, this change bumps the scikit-learn version to latest. The previously pinned version of scikit-learn failed trying to compile all necessary C modules under python 3.7+ due to included header files that weren't compatible with C the API implemented in python 3.7+. Simultaneously, with the restrictive compatibility supported by scikit-learn, it seemed prudent to drop python 2 support altogether. Otherwise, we'd be stuck with python 3.4 as the newest possible version we could support. With this change, tests are currently passing under 3.9.2. Lastly, imports the original training data. At some point, a new version of the training data was committed to the repo but no classifier was trained from it. Using a classifier trained from this new data resulted in most of the tests failing. 2021-04-27 09:27:24 -05:00			`chardet>=1.0.1`
			`cchardet>=0.3.5`
			`cssselect`
			`html5lib`
			`joblib`
			`lxml>=2.3.3`
			`numpy`
			`regex>=1`
			`scikit-learn==0.24.1 # pickled versions of classifier, else rebuild`
			`scipy`
			`six>=1.10.0`