forked from Ponysearch/Ponysearch
ed901ab18e
- Add documentation to the plugin
- Harmonize FastText language model with SearXNG's language model
Reosurces::
import fasttext # --> +10 MB
fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB
Suggested-by: @dalf
- To speed up and simplify the deployment use fasttext-wheel instead of fasttext
- Building numpy on the Alpine Linux of docker-images takes ages --> install
py3-numpy from Alpines package manager (apk)
- Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu
libc) --> patch Dockerfile and build from fastetxt:
sed -i s/fasttext-wheel/fasttext/ requirements.txt
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
19 lines
341 B
Text
19 lines
341 B
Text
certifi==2022.12.7
|
|
babel==2.11.0
|
|
flask-babel==2.0.0
|
|
flask==2.2.2
|
|
jinja2==3.1.2
|
|
lxml==4.9.1
|
|
pygments==2.13.0
|
|
python-dateutil==2.8.2
|
|
pyyaml==6.0
|
|
httpx[http2]==0.21.2
|
|
Brotli==1.0.9
|
|
uvloop==0.17.0
|
|
httpx-socks[asyncio]==0.7.2
|
|
langdetect==1.0.9
|
|
setproctitle==1.3.2
|
|
redis==4.4.0
|
|
markdown-it-py==2.1.0
|
|
typing_extensions==4.4.0
|
|
fasttext-wheel==0.9.2
|