OwlBurst/Ponysearch
1
0
Fork 0
forked from Ponysearch/Ponysearch
Code Pull requests Activity
7860 commits 4 branches 17 tags 96 MiB
Commit graph

392 commits

Author SHA1 Message Date
Markus Heiser
e9afc4f8ce [mod] Startpage: reversed engineered & upgrade to data_type: traits_v1 
One reason for the often seen CAPTCHA of the Startpage requests are the
incomplete requests SearXNG sends to startpage.com: this patch is a complete new
implementation of the ``request()`` function, reversed engineered from the
Startpage's search form.  The new implementation:

- use traits of data_type: traits_v1 and drop deprecated data_type: supported_languages
- adds time-range support
- adds save-search support
- fix searxng/searxng/issues 1884
- fix searxng/searxng/issues 1081 --> improvements to avoid CAPTCHA

In preparation for more categories (News, Images, Videos ..) from Startpage, the
variable ``startpage_categ`` was set up.  The default value is ``web`` and other
categories from Startpage are not yet implemented.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
858aa3e604 [mod] wikipedia & wikidata: upgrade to data_type: traits_v1 
BTW this fix an issue in wikipedia: SearXNG's locales zh-TW and zh-HK are now
using language `zh-classical` from wikipedia (and not `zh`).

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
d0f465e6fa [mod] bing: add time_range support & upgrade to data_type: traits_v1 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
7daf4f95ef [mod] Wikipedia: fetch engine traits (data_type: supported_languages) 
Implements a fetch_traits function for the Wikipedia engines.

.. note::

   Does not include migration of the request methode from 'supported_languages'
   to 'traits' (EngineTraits) object!

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
f78f908383 [mod] Google: fetch engine traits (data_type: supported_languages) 
Implements a fetch_traits function for the Google engines.

.. note::

   Does not include migration of the request methode from 'supported_languages'
   to 'traits' (EngineTraits) object!

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
dba8977b09 [mod] DuckDuckGo: fetch engine traits (data_type: supported_languages) 
Implements a fetch_traits function for the DuckDuckGo engines.

.. note::

   Does not include migration of the request methode from 'supported_languages'
   to 'traits' (EngineTraits) object!

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
ef143729a0 [mod] yahoo: fetch engine traits (data_type: traits_v1) 
Implements a fetch_traits function for the Yahoo engine.

.. note::

   Includes migration of the request methode from 'supported_languages' to
   'traits' (EngineTraits) object!

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
c1ae2ef57c [mod] qwant: fetch engine traits (data_type: traits_v1) 
Implements a fetch_traits function for the Qwant engines.

.. note::

   Includes migration of the request methode from 'supported_languages' to
   'traits' (EngineTraits) object!

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
fc0c775030 [mod] Dailymotion: fetch engine traits (data_type: supported_languages) 
Implements a fetch_traits function for the Dailymotion engine.

.. note::

   Does not include migration of the request methode from 'supported_languages'
   to 'traits' (EngineTraits) object!

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
61383edb27 [mod] Startpage: fetch engine traits (data_type: supported_languages) 
Implements a fetch_traits function for the Startpage engine.

.. note::

   Does not include migration of the request methode from 'supported_languages'
   to 'traits' (EngineTraits) object!

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
d3aa690a7a [mod] bing: fetch engine traits (data_type: supported_languages) 
Implements a fetch_traits function for the Bing engines.

.. note::

   Does not include migration of the request methode from 'supported_languages'
   to 'traits' (EngineTraits) object!

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
a7fe22770a [mod] Peertube: re-engineered & upgrade to data_type: traits_v1 
- fetch_traits(): Fetch languages from peertube's search-index source code.

  [mod] Include migration of the request methode from 'supported_languages'
        to 'traits' (EngineTraits) object.
  [fix] old supported_languages_url is no longer valid since the sources
        has been moved to a different path.

- fixed code to pass pylint
- request(): complete re-implementation based on the API docs [1]
- response(): complete re-implementation, adds serveral fields missed before
- add source code documentation

[1] https://docs.joinpeertube.org/api-rest-reference.html#tag/Search/operation/searchVideos

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
6e5f22e558 [mod] replace engines_languages.json by engines_traits.json 
Implementations of the *traits* of the engines.

Engine's traits are fetched from the origin engine and stored in a JSON file in
the *data folder*.  Most often traits are languages and region codes and their
mapping from SearXNG's representation to the representation in the origin search
engine.

To load traits from the persistence::

    searx.enginelib.traits.EngineTraitsMap.from_data()

For new traits new properties can be added to the class::

    searx.enginelib.traits.EngineTraits

.. hint::

   Implementation is downward compatible to the deprecated *supported_languages
   method* from the vintage implementation.

   The vintage code is tagged as *deprecated* an can be removed when all engines
   has been ported to the *traits method*.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
097d092a7f
Merge pull request #2224 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2023-03-15 18:36:29 +01:00
Markus Heiser
85ef1af343
Merge pull request #2222 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2023-03-15 18:35:36 +01:00
Alexandre Flament
1632f18631
Merge pull request #2227 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2023-03-01 17:52:57 +01:00
Alexandre Flament
5bbbb14b62
Merge pull request #2226 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2023-03-01 17:52:02 +01:00
dalf
5042d94dea Update searx.data - update_engine_descriptions.py 2023-03-01 01:48:22 +00:00
dalf
e30a45812f Update searx.data - update_ahmia_blacklist.py 2023-03-01 01:38:07 +00:00
dalf
935415bfcf Update searx.data - update_currencies.py 2023-03-01 01:37:46 +00:00
dalf
ccd00518fd Update searx.data - update_firefox_version.py 2023-03-01 01:37:42 +00:00
dalf
d7f10909fa Update searx.data - update_wikidata_units.py 2023-03-01 01:37:25 +00:00
Markus Heiser
d989c9429f
Merge pull request #2134 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2023-01-29 17:59:40 +01:00
Markus Heiser
5c2667b956
Merge pull request #2135 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2023-01-29 17:59:03 +01:00
Markus Heiser
e6a17f2fae
Merge pull request #2136 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2023-01-29 17:58:22 +01:00
Markus Heiser
c4cbf8829a
Merge pull request #2137 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2023-01-29 17:57:56 +01:00
dalf
f900e33092 Update searx.data - update_engine_descriptions.py 2023-01-29 01:33:29 +00:00
dalf
dafe026815 Update searx.data - update_currencies.py 2023-01-29 01:24:14 +00:00
dalf
47435be70b Update searx.data - update_firefox_version.py 2023-01-29 01:23:43 +00:00
dalf
53a4a90d0c Update searx.data - update_wikidata_units.py 2023-01-29 01:23:42 +00:00
dalf
9dd95457a9 Update searx.data - update_ahmia_blacklist.py 2023-01-29 01:23:42 +00:00
dalf
0639769274 Update searx.data - update_firefox_version.py 2022-12-29 09:17:56 +01:00
Markus Heiser
174e6851b3
Merge pull request #2054 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-12-29 08:35:51 +01:00
Markus Heiser
d531f89316
Merge pull request #2057 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2022-12-29 08:31:19 +01:00
Markus Heiser
76cd808a49
Merge pull request #2053 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-12-29 08:28:19 +01:00
dalf
000734cb93 Update searx.data - update_engine_descriptions.py 2022-12-29 01:25:31 +00:00
dalf
36eea5b7cc Update searx.data - update_currencies.py 2022-12-29 01:16:59 +00:00
dalf
66780efda7 Update searx.data - update_wikidata_units.py 2022-12-29 01:16:59 +00:00
dalf
de793fb71e Update searx.data - update_ahmia_blacklist.py 2022-12-29 01:16:52 +00:00
ArtikusHG
9925a20950 [mod] new plugin: Autodetect search language 2022-12-10 13:11:47 +01:00
Markus Heiser
a8359dd4d3
Merge pull request #1981 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-11-29 07:48:26 +01:00
Markus Heiser
1b2f1c17f6
Merge pull request #1982 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-11-29 07:47:52 +01:00
Markus Heiser
3579a38a2d
Merge pull request #1983 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-11-29 07:46:49 +01:00
Markus Heiser
82af2f4460
Merge pull request #1984 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-11-29 07:45:51 +01:00
dalf
a508cdbd4b Update searx.data - update_engine_descriptions.py 2022-11-29 01:34:42 +00:00
dalf
c4512cf64d Update searx.data - update_ahmia_blacklist.py 2022-11-29 01:24:48 +00:00
dalf
b0b45fd2d0 Update searx.data - update_currencies.py 2022-11-29 01:24:39 +00:00
dalf
a9be73b4da Update searx.data - update_wikidata_units.py 2022-11-29 01:24:38 +00:00
dalf
9fc72419e1 Update searx.data - update_firefox_version.py 2022-11-29 01:24:35 +00:00
Alexandre Flament
e473addaff User agent: don't include the patch number in the Firefox version 
The Firefox version in the user agent doesn't include the patch version: 106.0 not 106.0.2

Close #1914
 2022-11-05 22:04:37 +01:00
Markus Heiser
fc9986de0a
Merge pull request #1905 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-10-29 08:22:43 +02:00
Markus Heiser
3f1d594c23
Merge pull request #1906 from searxng/update_data_update_external_bangs.py 
Update searx.data - update_external_bangs.py
 2022-10-29 08:21:33 +02:00
Markus Heiser
a9deead102
Merge pull request #1907 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-10-29 08:20:53 +02:00
Markus Heiser
d49ccb54ea
Merge pull request #1908 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-10-29 08:20:27 +02:00
Markus Heiser
fa59ff9b78
Merge pull request #1909 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-10-29 08:19:56 +02:00
dalf
e70589c598 Update searx.data - update_engine_descriptions.py 2022-10-29 01:56:57 +00:00
dalf
985a2a87a6 Update searx.data - update_currencies.py 2022-10-29 01:46:40 +00:00
dalf
c0ecc2f865 Update searx.data - update_wikidata_units.py 2022-10-29 01:46:38 +00:00
dalf
c24abc2f8c Update searx.data - update_firefox_version.py 2022-10-29 01:46:34 +00:00
dalf
f0c7898445 Update searx.data - update_external_bangs.py 2022-10-29 01:46:27 +00:00
dalf
799c5270ae Update searx.data - update_ahmia_blacklist.py 2022-10-29 01:46:24 +00:00
Markus Heiser
23d797ee6f Update searx.data - update_osm_keys_tags.py 
Patch was generated by::

  ./manage pyenv.cmd searxng_extra/update/update_osm_keys_tags.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-10-11 11:49:06 +02:00
Alexandre Flament
a7d693231c
Merge pull request #1819 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-09-29 16:03:34 +02:00
Alexandre Flament
f3d25f9cef
Merge pull request #1821 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2022-09-29 16:02:57 +02:00
Alexandre Flament
5060732486
Merge pull request #1818 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-09-29 16:02:02 +02:00
Alexandre Flament
520a873ab4
Merge pull request #1820 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-09-29 16:01:31 +02:00
dalf
9cb792c0d6 Update searx.data - update_engine_descriptions.py 2022-09-29 02:22:00 +00:00
dalf
2d429ebd75 Update searx.data - update_wikidata_units.py 2022-09-29 02:13:02 +00:00
dalf
8fc3940448 Update searx.data - update_currencies.py 2022-09-29 02:12:54 +00:00
dalf
b7f4a3a207 Update searx.data - update_ahmia_blacklist.py 2022-09-29 02:12:48 +00:00
dalf
3153f0a795 Update searx.data - update_firefox_version.py 2022-09-29 02:12:48 +00:00
Markus Heiser
13ef9cc125
Merge pull request #1720 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-08-29 07:09:04 +02:00
Markus Heiser
e9b564d066
Merge pull request #1722 from searxng/update_data_update_languages.py 
Update searx.data - update_languages.py
 2022-08-29 07:08:26 +02:00
Markus Heiser
2b65502388
Merge pull request #1723 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-08-29 07:07:54 +02:00
Markus Heiser
55d04a089d
Merge pull request #1724 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2022-08-29 07:07:14 +02:00
Markus Heiser
4a96480bd5
Merge pull request #1721 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-08-29 07:06:39 +02:00
dalf
c2400a8677 Update searx.data - update_engine_descriptions.py 2022-08-29 02:17:55 +00:00
dalf
e8bf907eef Update searx.data - update_firefox_version.py 2022-08-29 02:09:34 +00:00
dalf
915c0a2bc6 Update searx.data - update_languages.py 2022-08-29 02:09:27 +00:00
dalf
b1ccecbeb3 Update searx.data - update_wikidata_units.py 2022-08-29 02:09:17 +00:00
dalf
2e6d41fa24 Update searx.data - update_ahmia_blacklist.py 2022-08-29 02:09:09 +00:00
dalf
83fbc16908 Update searx.data - update_currencies.py 2022-08-29 02:09:09 +00:00
Markus Heiser
6579d6d558 [fix] qwant - API error::locale must be one .. 
The request function should not request a language (aka locale) that is not
supported by qwant. Select a locale like zh-TW ends in qwant's API error:

  ERROR searx.engines.qwant news: exception : \
  API error::locale must be one of the following values: \
    en_gb, en_ie, en_us, en_ca, en_my, en_au, en_nz, de_de, de_ch, de_at, fr_fr, \
    fr_be, fr_ch, fr_ca, fr_ad, fc_ca, co_fr, es_es, es_ar, es_cl, es_co, es_mx, \
    es_pe, es_ad, ca_es, ca_ad, ca_fr, eu_es, eu_fr, it_it, it_ch, pt_pt, pt_ad, \
    nl_be, nl_nl

The existing searx.utils.match_language function is unsuitable for this purpose,
it is replaced by function searx.locales.get_engine_locale that is based on the
methods from the babel package.

The quant's _fetch_supported_languages function has been revised to filter out
languages 8aka locales) not supported by qwant.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-08-14 10:36:14 +02:00
Markus Heiser
73ffa0c070 Update searx.data - update_engine_descriptions.py 
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-08-10 21:48:34 +02:00
Markus Heiser
14085cc0a7
Merge pull request #1580 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2022-07-29 07:23:02 +02:00
Markus Heiser
7602c23d71
Merge pull request #1579 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-07-29 07:22:12 +02:00
Markus Heiser
0bad4fb931
Merge pull request #1578 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-07-29 07:21:06 +02:00
Markus Heiser
7dd75ae080
Merge pull request #1576 from searxng/update_data_update_languages.py 
Update searx.data - update_languages.py
 2022-07-29 07:20:28 +02:00
dalf
2bdb367e8c Update searx.data - update_engine_descriptions.py 2022-07-29 02:13:07 +00:00
dalf
fc019fb296 Update searx.data - update_currencies.py 2022-07-29 02:01:30 +00:00
dalf
c2662ec3c8 Update searx.data - update_firefox_version.py 2022-07-29 02:01:08 +00:00
dalf
385542e6c5 Update searx.data - update_ahmia_blacklist.py 2022-07-29 02:01:04 +00:00
dalf
90068b3d0b Update searx.data - update_languages.py 2022-07-29 02:00:53 +00:00
Markus Heiser
445cba7c02 Update searx.data - update_engine_descriptions.py 
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-07-15 09:26:44 +02:00
Markus Heiser
81e8c7370f Update searx.data - update_engine_descriptions.py 
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-07-07 17:16:41 +02:00
Markus Heiser
1416559f22 Update searx.data - update_engine_descriptions.py 
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-07-02 12:16:00 +02:00
Markus Heiser
2bf800a4b1 Update searx.data - update_currencies.py 
./manage pyenv.cmd python ./searxng_extra/update/update_currencies.py

Closes: https://github.com/searxng/searxng/pull/1375
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-07-02 12:16:00 +02:00
Markus Heiser
eb3123e164
Merge pull request #1379 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-06-29 15:40:51 +02:00
dalf
a89fca9d08 Update searx.data - update_ahmia_blacklist.py 2022-06-29 07:21:09 +00:00
Markus Heiser
3a75d3c1cc
Merge pull request #1376 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-06-29 08:45:29 +02:00
dalf
11def5155e Update searx.data - update_wikidata_units.py 2022-06-29 01:52:03 +00:00
dalf
21ab024469 Update searx.data - update_firefox_version.py 2022-06-29 01:51:46 +00:00
Markus Heiser
e568da2314
Merge pull request #1266 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-06-01 13:49:48 +02:00
Markus Heiser
84a5e48a90
Merge pull request #1265 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-06-01 11:29:41 +02:00
Markus Heiser
78968843a8
Merge pull request #1267 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-06-01 11:24:35 +02:00
Markus Heiser
a9251cfeb4
Merge pull request #1268 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2022-06-01 11:24:00 +02:00
Markus Heiser
61ee915064
Merge pull request #1264 from searxng/update_data_update_languages.py 
Update searx.data - update_languages.py
 2022-06-01 10:34:19 +02:00
dalf
fda176144e Update searx.data - update_engine_descriptions.py 2022-06-01 06:40:37 +00:00
dalf
f37b9978cb Update searx.data - update_currencies.py 2022-06-01 06:32:10 +00:00
dalf
a93170725f Update searx.data - update_firefox_version.py 2022-06-01 06:31:57 +00:00
dalf
8d6d32bf6e Update searx.data - update_ahmia_blacklist.py 2022-06-01 06:31:54 +00:00
dalf
012d7fcaa0 Update searx.data - update_languages.py 2022-06-01 06:31:54 +00:00
dalf
ab9616c2cc Update searx.data - update_wikidata_units.py 2022-06-01 06:31:52 +00:00
Markus Heiser
8a79eb4d7b
Merge pull request #1158 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-05-01 09:51:56 +02:00
Markus Heiser
6bd6e09e14
Merge pull request #1159 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2022-05-01 09:51:21 +02:00
Markus Heiser
9c7e9bf1d9
Merge pull request #1157 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-05-01 09:50:28 +02:00
Markus Heiser
9e6000407a
Merge pull request #1156 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-05-01 09:49:55 +02:00
dalf
6f0a717dce Update searx.data - update_engine_descriptions.py 2022-05-01 06:33:42 +00:00
dalf
bdfbc0ec02 Update searx.data - update_currencies.py 2022-05-01 06:26:53 +00:00
dalf
6cb08a568a Update searx.data - update_wikidata_units.py 2022-05-01 06:26:44 +00:00
dalf
10023344a5 Update searx.data - update_ahmia_blacklist.py 2022-05-01 06:26:33 +00:00
dalf
e36d7067a9 Update searx.data - update_firefox_version.py 2022-05-01 06:26:31 +00:00
Markus Heiser
62982c8812 [fix] add back missing languages & regions (followup of PR #1071) 
In PR #1071 the language catalog of dailymotion has been cleaned up, before
there had been over 7000 "languages" in the catalog.

As a side effect of this clean-up the language & region catalog in SearXNG has
been reduced [1].

This patch reduce the ``min_engines_per_lang`` from 13 to 12 to get the missed
languages back in language & region catalog of SearXNG.

[1] 3bb62823ec (diff-f3f00db0f87f95b882624a192e0aac21525638af0b18c9514e765fcf1991678d)

Requested-by: @tiekoetter in a Matrix chat
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-04-22 12:09:42 +02:00
Alexandre Flament
7bf9e12db9 Update searx.data - update_engine_descriptions.py 2022-04-16 13:17:39 +02:00
Markus Heiser
3bb62823ec [fix] dailymotion engine: filter by language & country 
- fix the issue of fetching more the 7000 *languages*
- improve the request function and filter by language & country
- implement time_range_support & safesearch
- add more fields to the response from dailymotion (allow_embed, length)
- better clean up of HTML tags in the 'content' field.

This is more or less a complete rework based on the '/videos' API from [1].
This patch cleans up the language list in SearXNG that has been polluted by the
ISO-639-3 2 and 3 letter codes from dailymotion languages which have never been
used.

[1] https://developers.dailymotion.com/tools/

Closes: https://github.com/searxng/searxng/issues/1065
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-04-16 09:27:34 +02:00
Alexandre Flament
765504ceca
Merge pull request #1031 from dalf/fix-bing-_fetch_supported_languages 
Fix bing  fetch supported languages
 2022-04-02 08:23:58 +02:00
Markus Heiser
099840f4d6
Merge pull request #1035 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-04-01 09:02:19 +02:00
Markus Heiser
b853ab717e
Merge pull request #1034 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-04-01 09:01:48 +02:00
Markus Heiser
c2de356497
Merge pull request #1033 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-04-01 09:00:51 +02:00
dalf
086517d269 Update searx.data - update_wikidata_units.py 2022-04-01 06:27:23 +00:00
dalf
d245ca97ca Update searx.data - update_ahmia_blacklist.py 2022-04-01 06:27:22 +00:00
dalf
084d9ab4e4 Update searx.data - update_currencies.py 2022-04-01 06:27:18 +00:00
dalf
4d55523247 Update searx.data - update_firefox_version.py 2022-04-01 06:27:13 +00:00
Alexandre FLAMENT
7d31b2c0af Update languages 2022-03-31 20:04:46 +00:00
Markus Heiser
0ddcc12474
Merge pull request #934 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-03-01 07:54:58 +01:00
Markus Heiser
69f84d941f
Merge pull request #935 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-03-01 07:53:33 +01:00
Markus Heiser
5508155252
Merge pull request #936 from searxng/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2022-03-01 07:52:54 +01:00
dalf
f4c6eba227 Update searx.data - update_currencies.py 2022-03-01 06:25:18 +00:00
dalf
6946c4566f Update searx.data - update_wikidata_units.py 2022-03-01 06:24:57 +00:00
dalf
49bc3971ae Update searx.data - update_firefox_version.py 2022-03-01 06:24:55 +00:00
dalf
6add9dd6d3 Update searx.data - update_ahmia_blacklist.py 2022-03-01 06:24:53 +00:00
Markus Heiser
314ea2dc61
Merge pull request #852 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2022-02-01 06:52:57 +00:00
Markus Heiser
4d0bd47ff0
Merge pull request #853 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2022-02-01 06:52:19 +00:00
Markus Heiser
20cbabff96
Merge pull request #851 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2022-02-01 06:48:54 +00:00
dalf
f4f90aa3a4 Update searx.data - update_firefox_version.py 2022-02-01 06:23:16 +00:00
dalf
7b402e1aa0 Update searx.data - update_ahmia_blacklist.py 2022-02-01 06:23:01 +00:00
dalf
1c47f4b6e0 Update searx.data - update_currencies.py 2022-02-01 06:23:00 +00:00
dalf
e78dc45d1e Update searx.data - update_wikidata_units.py 2022-02-01 06:22:58 +00:00
Alexandre Flament
f3f61df6a0 [mod] remove deprecate code 
remove code to support Python 3.5 and Python 3.6
 2022-01-29 08:54:12 +01:00
Markus Heiser
a7c3c352d8 [upd] searx/data/external_bangs.json 
Updated external bangs by::

    ./manage pyenv.cmd ./searxng_extra/update/update_external_bangs.py

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2022-01-12 19:37:13 +01:00