Markus Heiser
e9afc4f8ce
[mod] Startpage: reversed engineered & upgrade to data_type: traits_v1
...
One reason for the often seen CAPTCHA of the Startpage requests are the
incomplete requests SearXNG sends to startpage.com: this patch is a complete new
implementation of the ``request()`` function, reversed engineered from the
Startpage's search form. The new implementation:
- use traits of data_type: traits_v1 and drop deprecated data_type: supported_languages
- adds time-range support
- adds save-search support
- fix searxng/searxng/issues 1884
- fix searxng/searxng/issues 1081 --> improvements to avoid CAPTCHA
In preparation for more categories (News, Images, Videos ..) from Startpage, the
variable ``startpage_categ`` was set up. The default value is ``web`` and other
categories from Startpage are not yet implemented.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
858aa3e604
[mod] wikipedia & wikidata: upgrade to data_type: traits_v1
...
BTW this fix an issue in wikipedia: SearXNG's locales zh-TW and zh-HK are now
using language `zh-classical` from wikipedia (and not `zh`).
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
e0a6ca96cc
[doc] add a description of bing engines (web, news, video, images)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
15eaf0f15f
[mod] bing_news: use async API & upgrade to data_type: traits_v1
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
ff80e7637e
[mod] bing_images: use async API & upgrade to data_type: traits_v1
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
bc21d28298
[mod] bing_videos: use async API & upgrade to data_type: traits_v1
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
d0f465e6fa
[mod] bing: add time_range support & upgrade to data_type: traits_v1
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
c9cd376186
[mod] replace searx.languages by searx.sxng_locales
...
With the language and region tags from the EngineTraitsMap the handling of
SearXNG's tags of languages and regions has been normalized and is no longer
a *mystery*. The "languages" became "locales" that are supported by babel and
by this, the update_engine_traits.py can be simplified a lot.
Other code places can be simplified as well, but these simplifications
should (respectively can) only be done when none of the engines work with the
deprecated EngineTraits.supported_languages interface anymore.
This commit replaces searx.languages by searx.sxng_locales and fix the naming of
some names from "language" to "locale" (e.g. language_codes --> sxng_locales).
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
7daf4f95ef
[mod] Wikipedia: fetch engine traits (data_type: supported_languages)
...
Implements a fetch_traits function for the Wikipedia engines.
.. note::
Does not include migration of the request methode from 'supported_languages'
to 'traits' (EngineTraits) object!
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
f78f908383
[mod] Google: fetch engine traits (data_type: supported_languages)
...
Implements a fetch_traits function for the Google engines.
.. note::
Does not include migration of the request methode from 'supported_languages'
to 'traits' (EngineTraits) object!
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
dba8977b09
[mod] DuckDuckGo: fetch engine traits (data_type: supported_languages)
...
Implements a fetch_traits function for the DuckDuckGo engines.
.. note::
Does not include migration of the request methode from 'supported_languages'
to 'traits' (EngineTraits) object!
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
ef143729a0
[mod] yahoo: fetch engine traits (data_type: traits_v1)
...
Implements a fetch_traits function for the Yahoo engine.
.. note::
Includes migration of the request methode from 'supported_languages' to
'traits' (EngineTraits) object!
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
c1ae2ef57c
[mod] qwant: fetch engine traits (data_type: traits_v1)
...
Implements a fetch_traits function for the Qwant engines.
.. note::
Includes migration of the request methode from 'supported_languages' to
'traits' (EngineTraits) object!
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
fc0c775030
[mod] Dailymotion: fetch engine traits (data_type: supported_languages)
...
Implements a fetch_traits function for the Dailymotion engine.
.. note::
Does not include migration of the request methode from 'supported_languages'
to 'traits' (EngineTraits) object!
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
61383edb27
[mod] Startpage: fetch engine traits (data_type: supported_languages)
...
Implements a fetch_traits function for the Startpage engine.
.. note::
Does not include migration of the request methode from 'supported_languages'
to 'traits' (EngineTraits) object!
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
d3aa690a7a
[mod] bing: fetch engine traits (data_type: supported_languages)
...
Implements a fetch_traits function for the Bing engines.
.. note::
Does not include migration of the request methode from 'supported_languages'
to 'traits' (EngineTraits) object!
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
a7fe22770a
[mod] Peertube: re-engineered & upgrade to data_type: traits_v1
...
- fetch_traits(): Fetch languages from peertube's search-index source code.
[mod] Include migration of the request methode from 'supported_languages'
to 'traits' (EngineTraits) object.
[fix] old supported_languages_url is no longer valid since the sources
has been moved to a different path.
- fixed code to pass pylint
- request(): complete re-implementation based on the API docs [1]
- response(): complete re-implementation, adds serveral fields missed before
- add source code documentation
[1] https://docs.joinpeertube.org/api-rest-reference.html#tag/Search/operation/searchVideos
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
Markus Heiser
6e5f22e558
[mod] replace engines_languages.json by engines_traits.json
...
Implementations of the *traits* of the engines.
Engine's traits are fetched from the origin engine and stored in a JSON file in
the *data folder*. Most often traits are languages and region codes and their
mapping from SearXNG's representation to the representation in the origin search
engine.
To load traits from the persistence::
searx.enginelib.traits.EngineTraitsMap.from_data()
For new traits new properties can be added to the class::
searx.enginelib.traits.EngineTraits
.. hint::
Implementation is downward compatible to the deprecated *supported_languages
method* from the vintage implementation.
The vintage code is tagged as *deprecated* an can be removed when all engines
has been ported to the *traits method*.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-24 10:37:42 +01:00
dependabot[bot]
912f877dec
Bump ionicons from 6.1.3 to 7.1.0 in /searx/static/themes/simple
...
Bumps [ionicons](https://github.com/ionic-team/ionicons ) from 6.1.3 to 7.1.0.
- [Release notes](https://github.com/ionic-team/ionicons/releases )
- [Changelog](https://github.com/ionic-team/ionicons/blob/main/CHANGELOG.md )
- [Commits](https://github.com/ionic-team/ionicons/compare/v6.1.3...v7.1.0 )
---
updated-dependencies:
- dependency-name: ionicons
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-03-24 07:57:14 +00:00
searxng-bot
9f3a57c901
[translations] update from Weblate
...
abfec8f4f02ea21c3fc6c653342bbf46
2023-03-24 07:07:52 +00:00
Solirs
ac169a0f75
Pass black formatting test
2023-03-21 00:41:36 +01:00
Solirs
e26bce33d4
WIKIDATA: Add description for results
2023-03-21 00:14:54 +01:00
Markus Heiser
b61b845951
Merge pull request #2266 from return42/shuffle-cipher
...
[mod] Shuffle httpx's default ciphers of a SSL context randomly.
2023-03-20 12:28:05 +01:00
Markus Heiser
94430e104c
Merge pull request #2238 from return42/fix-2027
...
[fix] fix threshold in replace_auto_language
2023-03-19 15:30:37 +01:00
Markus Heiser
f2962a2f4a
Merge pull request #2239 from return42/fix-eslintrc
...
[fix] remove duplicate key in simple theme ESLint configuration
2023-03-19 15:30:12 +01:00
Markus Heiser
8fa54ffddf
[mod] Shuffle httpx's default ciphers of a SSL context randomly.
...
From the analyse of @9Ninety [1] we know that DDG (and may be other engines / I
have startpage in mind) does some kind of TLS fingerprint to block bots.
This patch shuffles the default ciphers from httpx to avoid a cipher profile
that is known to httpx (and blocked by DDG).
[1] https://github.com/searxng/searxng/issues/2246#issuecomment-1467895556
----
From `What Is TLS Fingerprint and How to Bypass It`_
> When implementing TLS fingerprinting, servers can't operate based on a
> locked-in whitelist database of fingerprints. New fingerprints appear
> when web clients or TLS libraries release new versions. So, they have to
> live off a blocklist database instead.
> ...
> It's safe to leave the first three as is but shuffle the remaining ciphers
> and you can bypass the TLS fingerprint check.
.. _What Is TLS Fingerprint and How to Bypass It:
https://www.zenrows.com/blog/what-is-tls-fingerprint#how-to-bypass-tls-fingerprinting
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
Closes: https://github.com/searxng/searxng/issues/2246
2023-03-19 13:40:31 +01:00
Markus Heiser
677903c355
Merge pull request #2257 from Solirs/fix_bad_escape
...
re.escape() the query in highlight_content to prevent a server side error.
2023-03-17 08:54:54 +01:00
Solirs
fbb0e9d275
[fix] server side error: escape backslashes in the query highlight_content
...
Any backslash escapes in the replacement are processed [1], backslashes should
be escaped [2].
[1] https://docs.python.org/3/library/re.html#re.sub
[2] https://docs.python.org/3/library/re.html#re.escape
closes:
- https://github.com/searxng/searxng/issues/2256
- https://github.com/searxng/searxng/issues/2250
2023-03-17 08:46:00 +01:00
searxng-bot
86c3757872
[translations] update from Weblate
...
32926a197aabc876c0ed00f56cf287f68c4c5f83dffe61fac7736cace831b8e3ef3c60afc046a677142041d6119b51df
2023-03-17 07:07:53 +00:00
Alexandre Flament
3e9cddc606
rollback test
2023-03-15 19:55:20 +01:00
Alexandre Flament
41ed0ef0c7
test
2023-03-15 19:53:53 +01:00
Markus Heiser
097d092a7f
Merge pull request #2224 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2023-03-15 18:36:29 +01:00
Markus Heiser
85ef1af343
Merge pull request #2222 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2023-03-15 18:35:36 +01:00
Markus Heiser
a7f1649190
[fix] remove duplicate key in simple theme ESLint configuration
...
Partial merge of [PR-1736]
[PR-1736] https://github.com/searxng/searxng/pull/1736
Suggested-by: @FunctionalHacker in [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-05 09:12:13 +01:00
Markus Heiser
150a90c84e
[fix] fix threshold in replace_auto_language
...
[1] https://github.com/searxng/searxng/pull/2027#pullrequestreview-1322157677
[2] https://github.com/searxng/searxng/pull/1969#issuecomment-1345354529
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-03-05 08:29:58 +01:00
searxng-bot
1f36fc3a45
[translations] update from Weblate
...
0d8ebfe11358dd6d4d8c13db1ae581b60003698f31c796179015ec7303619a68fa90585bc902c5e5
2023-03-03 07:08:08 +00:00
Alexandre Flament
714e83d5ea
Merge pull request #2220 from Solirs/gentoo_engine_timeout
...
Increase timeout for gentoo wiki engine
2023-03-01 17:57:21 +01:00
Alexandre Flament
1632f18631
Merge pull request #2227 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2023-03-01 17:52:57 +01:00
Alexandre Flament
5bbbb14b62
Merge pull request #2226 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2023-03-01 17:52:02 +01:00
dalf
5042d94dea
Update searx.data - update_engine_descriptions.py
2023-03-01 01:48:22 +00:00
dalf
e30a45812f
Update searx.data - update_ahmia_blacklist.py
2023-03-01 01:38:07 +00:00
dalf
935415bfcf
Update searx.data - update_currencies.py
2023-03-01 01:37:46 +00:00
dalf
ccd00518fd
Update searx.data - update_firefox_version.py
2023-03-01 01:37:42 +00:00
dalf
d7f10909fa
Update searx.data - update_wikidata_units.py
2023-03-01 01:37:25 +00:00
Solirs
35fbb3578b
Increase timeout for gentoo wiki engine
2023-02-28 13:54:44 +01:00
Alexandre Flament
d669da81fb
Merge pull request #2027 from dalf/fix_2018
...
Add "auto" as a language.
2023-02-20 12:17:38 +01:00
searxng-bot
297e463e49
[translations] update from Weblate
...
8ff0fa33
2023-02-19 11:46:59 +00:00
Markus Heiser
0b1444b61e
[doc] improved docs of implementations for automatic speech recognition
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-19 10:09:52 +00:00
Markus Heiser
363203c579
Merge pull request #2201 from return42/fix-2190
...
[doc] slight improvements to the doc of the settings (base_url)
2023-02-18 18:21:14 +01:00
Alexandre Flament
6748e8e2d5
Add "Auto-detected" as a language.
...
When the user choose "Auto-detected", the choice remains on the following queries.
The detected language is displayed.
For example "Auto-detected (en)":
* the next query language is going to be auto detected
* for the current query, the detected language is English.
This replace the autodetect_search_language plugin.
2023-02-17 15:17:36 +00:00
Markus Heiser
bb83036f48
[fix] typo in searx/plugins/tor_check.py
...
Related: https://github.com/searxng/searxng/pull/2189
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-17 13:09:14 +01:00
Markus Heiser
5820dc78ce
[doc] slight improvements to the doc of the settings (base_url)
...
Closes: https://github.com/searxng/searxng/issues/2190
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-17 12:08:58 +01:00
Markus Heiser
52f6bc745b
Merge pull request #2188 from ahmad-alkadri/fix/petalsearch
...
Fix the petalsearch engine
2023-02-15 13:57:28 +01:00
Markus Heiser
ba5b6c382f
Merge pull request #2192 from return42/fix-tineye
...
[mod] disbale engine tineye by default
2023-02-15 06:43:41 +01:00
Ahmad Alkadri
f6af59899b
Fix petalsearch and remove petalsearch news
2023-02-14 18:43:55 +01:00
Allan Nordhøy
2be373a18f
[fix] spelling: Tor, SearXNG
2023-02-14 17:13:53 +01:00
Markus Heiser
7d446dfdb2
[mod] disbale engine tineye by default
...
Tineye becomes active as soon as a https:// signature is found in the search
term, but most of the time a reverse image search is not requested when a URL is
specified, often the URL is just from a C&P.
The frequent requests to tineye lead in the end to the SearXNG instance being
blocked by tineye and the user seeing unexpected error messages.
BTW: many maintainers have disabled this engine in their local SearXNG settings.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-14 08:27:19 +01:00
Markus Heiser
3abff182ea
[fix] remove engine neeva from settings.yml
...
Engine is broken and can't by used any longer as a simple XPath engine.
@allendema tested a engines/neeva.py version using json from the dom, but
without luck: There was some kind of captcha for pagination.
[1] https://github.com/searxng/searxng/issues/2007#issuecomment-1426061698
Closes: https://github.com/searxng/searxng/issues/2007
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-10 18:46:37 +01:00
Lea
a530ac4099
fix: typo in suggestions
2023-02-10 15:33:25 +01:00
Markus Heiser
415f6398d6
[fix] time_range in HTML form should not be a string 'None'
...
Before this patch SearXNG returns 'time_range': 'None'::
<form method="GET" action="/searx/search">
...
<input type="hidden" name="time_range" value="None">
...
</form>
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-10 15:32:21 +01:00
wibyweb
6707354bc8
[mod] engine wiby: add pagination
...
Suggested by: @wibyweb in searx https://github.com/searx/searx/pull/3465
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-10 15:31:24 +01:00
Markus Heiser
4c06837a50
[mod] make python code pylint 2.16.1 compliant
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-10 13:59:21 +01:00
Markus Heiser
7320b0c796
Merge pull request #2130 from searxng/translations_update
...
Update translations
2023-02-04 17:53:20 +01:00
dependabot[bot]
a5a73d77b3
Bump grunt from 1.5.3 to 1.6.1 in /searx/static/themes/simple
...
Bumps [grunt](https://github.com/gruntjs/grunt ) from 1.5.3 to 1.6.1.
- [Release notes](https://github.com/gruntjs/grunt/releases )
- [Changelog](https://github.com/gruntjs/grunt/blob/main/CHANGELOG )
- [Commits](https://github.com/gruntjs/grunt/compare/v1.5.3...v1.6.1 )
---
updated-dependencies:
- dependency-name: grunt
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-02-04 08:10:18 +00:00
Markus Heiser
257dc7d6c4
[fix-2146] set different HTTP Referer header to DuckDuckGo requests
...
For what ever reasons, ddg-lite don't like the Referer
https://lite.duckduckgo.com/
In an interactive session in the WEB browser the the Reverer has exactly this
value, but ddg-lite don't like this value when the request is build up by
SearXNG. The new value is:
https://google.com/
What fakes a user comes from a google link.
Related: https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2146
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-02-03 08:45:51 +01:00
searxng-bot
8db35f8e9c
[translations] update from Weblate
...
009d48c2a5353bad1617f45879bc60f4
2023-02-03 07:15:25 +00:00
Alexandre Flament
9d102fb08f
Merge pull request #2132 from dalf/update_pr_1967
...
search.suspended_time settings: bug fixes
2023-01-29 20:48:43 +01:00
Markus Heiser
feccee01c0
[doc] Add doc-strings to searx.exceptions
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-01-29 19:06:19 +01:00
Markus Heiser
4f808088f1
Merge pull request #2139 from dalf/fix_update_languages
...
Fix update languages
2023-01-29 17:59:59 +01:00
Markus Heiser
d989c9429f
Merge pull request #2134 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2023-01-29 17:59:40 +01:00
Markus Heiser
5c2667b956
Merge pull request #2135 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2023-01-29 17:59:03 +01:00
Markus Heiser
e6a17f2fae
Merge pull request #2136 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2023-01-29 17:58:22 +01:00
Markus Heiser
c4cbf8829a
Merge pull request #2137 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2023-01-29 17:57:56 +01:00
Alexandre Flament
bfca63c536
wikipedia engine: update _fetch_supported_languages
...
the layout https://meta.wikimedia.org/wiki/List_of_Wikipedias has changed
2023-01-29 10:01:58 +00:00
Alexandre Flament
8256de2fe8
peertube engine: update _fetch_supported_languages
...
There is now an API to get the list of supported languages
https://docs.joinpeertube.org/api-rest-reference.html#tag/Video/operation/getLanguages
2023-01-29 10:01:54 +00:00
dalf
f900e33092
Update searx.data - update_engine_descriptions.py
2023-01-29 01:33:29 +00:00
dalf
dafe026815
Update searx.data - update_currencies.py
2023-01-29 01:24:14 +00:00
dalf
47435be70b
Update searx.data - update_firefox_version.py
2023-01-29 01:23:43 +00:00
dalf
53a4a90d0c
Update searx.data - update_wikidata_units.py
2023-01-29 01:23:42 +00:00
dalf
9dd95457a9
Update searx.data - update_ahmia_blacklist.py
2023-01-29 01:23:42 +00:00
Alexandre Flament
37addec69e
search.suspended_time settings: bug fixes
...
* fix type in settings.yml: replace suspend_times by suspended_times
* always use delay defined in settings.yml:
* HTTP status 402 and 403: read the value from settings.yml instead of using the hardcoded value of 1 day.
* startpage engine: CAPTCHA suspend the engine for one day instead of one week
2023-01-28 10:24:14 +00:00
Alexandre Flament
28356f4284
Merge pull request #2115 from searxng/dependabot/pip/master/flask-babel-3.0.0
...
Bump flask-babel from 2.0.0 to 3.0.0
2023-01-27 10:43:17 +01:00
mrpaulblack
b3883dc395
[build] /static
2023-01-23 23:00:38 +01:00
mrpaulblack
8ead23347f
[fix] use input elements for pagination requests
...
* use html input elements instead of buttons for the pagination forms at the bottom of the result page
* move the less section that hides the pagination number widget on mobile to the mobile section
* clean up the less code for styling the numbers of the pagination widget
* fix: add the margin for box results (like in news category) to the bottom of the result to have a margin between pagination widget and article result
2023-01-23 22:56:55 +01:00
llmII
d2b2300ee1
Feature: Pagination Widget with list of numbers.
...
Adds to the navigation widget, preserving forward/backward nav, and
inserting a list of clickable page numbers between them.
Phone sized devices continue without this widget as deterministic
display under small screen sizes has not been solved.
The widget is agnostic to the actual amount of pages there are that one
can navigate to and as such shows all plausible, albeit not necessarilly
valid, possibilities.
This widget does not interfere with infinite scroll in any fashion.
2023-01-23 21:22:06 +01:00
Alexandre Flament
06b5068a2e
SearXNG version: YYYY.MM.DD without leading zero
2023-01-22 10:45:00 +00:00
Alexandre Flament
a9d6f7532a
weblate: migration to https://translate.codeberg.org/
2023-01-21 15:45:12 +00:00
searxng-bot
6e4c8b3516
[translations] update from Weblate
2023-01-20 11:32:23 +00:00
Alexandre Flament
f759a84af4
SearXNG version: fix make docker
...
continuation of #2117
related to #2111
This commit:
* fixes the Docker tag using an additional variable DOCKER_TAG, see searx/version.py
* fixes the Docker labels org.label-schema.vcs-ref and org.opencontainers.image.revision
* adds searx/version_frozen to .gitignore
2023-01-20 10:46:00 +00:00
dependabot[bot]
70fff2ebf1
Bump flask-babel from 2.0.0 to 3.0.0
...
Bumps [flask-babel](https://github.com/python-babel/flask-babel ) from 2.0.0 to 3.0.0.
- [Release notes](https://github.com/python-babel/flask-babel/releases )
- [Changelog](https://github.com/python-babel/flask-babel/blob/master/CHANGELOG )
- [Commits](https://github.com/python-babel/flask-babel/compare/v2.0.0...v3.0.0 )
---
updated-dependencies:
- dependency-name: flask-babel
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-01-20 09:38:30 +00:00
Alexandre Flament
0515f2974b
Version number follows PEP440 : replace - by +
...
Close #2111
2023-01-20 09:05:44 +00:00
Alexandre Flament
6d72ef3cbe
Merge pull request #2109 from ahmad-alkadri/fix/highlight-full-word
...
Standalone words highlighting for query result in non-CJK characters
2023-01-17 23:24:04 +01:00
Alexandre Flament
13b0c251c4
Merge pull request #2100 from nexryai/master
...
Add goo engine
2023-01-15 23:08:28 +01:00
ahmad-alkadri
99b5272d9a
A little fix and modified the testing for content highlight
2023-01-15 16:51:31 +01:00
Léon Tiekötter
0cedb1c6d8
Add search.suspended_times settings
...
Make suspended_time changeable in settings.yml
Allow different values to be set for different exceptions.
Co-authored-by: Alexandre Flament <alex@al-f.net>
2023-01-15 09:00:32 +00:00
ahmad-alkadri
6c421110b5
Perso branch - added cjk check and enclosement
2023-01-14 23:00:08 +00:00
searxng-bot
3e5ea08504
[translations] update from Weblate
...
6a57ee0bb180a8108710174a529a2591a254bd01860c3fcec140fb52
2023-01-13 07:14:55 +00:00
nexryai
4e7bb1bf9a
Add goo engine
2023-01-12 16:28:09 +09:00
Ahmad Alkadri
7fc8d72889
[fix] bing: parsing result; check to see if the element contains links
...
This patch is to hardening the parsing of the bing response:
1. To fix [2087] check if the selected result item contains a link, otherwise
skip result item and continue in the result loop. Increment the result
pointer when a result has been added / the enumerate that counts for skipped
items is no longer valid when result items are skipped.
To test the bugfix use: ``!bi :all cerbot``
2. Limit the XPath selection of result items to direct children nodes (list
items ``li``) of the ordered list (``ol``).
To test the selector use: ``!bi :en pontiac aztek wiki``
.. in the result list you should find the wikipedia entry on top,
compare [2068]
[2087] https://github.com/searxng/searxng/issues/2087
[2068] https://github.com/searxng/searxng/issues/2068
2023-01-09 15:08:24 +01:00
Milad-Laly
cf4db4be37
[fix] Mojeek Xpath showing suggestions and searches + add lang support
2023-01-09 09:33:47 +01:00
Markus Heiser
54e63839db
Merge pull request #2088 from llmII/fix-suggestions
...
Fix #2083
2023-01-08 18:53:32 +01:00
Markus Heiser
9d6b048fba
[build] /static
2023-01-08 18:39:37 +01:00
llmII
33d97fd01a
Fix #2083
...
This changes the Suggestions to be a single column, not a wrapping row,
changing the input to be incapable of overflowing into visually adjacent
elements.
2023-01-08 10:44:58 -06:00
allixx
1407a055b2
[simple theme] set tab index for search page input field #1891
...
Previously it took five tab keypresses to reach search input field
on search results page. Now one tab press is enough.
2023-01-08 13:41:48 +03:00
ahmad-alkadri
9ee99423fe
[fix] Bing-Web engine: XPath to get the wikipedia result
...
Modify the XPath selector to get the wikipedia result plus small fixes.
About result content: especially with the Wikipedia result, we'd get several
paragraph elements, only the first paragraph would be taken and displayed on the
search result
2023-01-08 09:11:16 +01:00
Markus Heiser
4e355564d2
Merge pull request #1903 from LalleSX/patch-1
...
Added info about adding the enginge to the brownser
2023-01-07 15:03:12 +01:00
PrivateLalle
212acf7f7b
[mod] about page: add information about adding enginge to the brownser
2023-01-07 14:48:06 +01:00
Markus Heiser
4cd3be8964
[fix] indentation and line size of the the markdown files
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-01-07 14:46:31 +01:00
Markus Heiser
b2a80347e3
[build] /static
2023-01-07 11:53:51 +01:00
ahmad-alkadri
db70c262c3
Add flex-wrap to the list of engines
2023-01-07 11:53:05 +01:00
Rudis Muiznieks
128b8c7f0a
Add HTTP Referer header to DuckDuckGo requests
...
closes #2080
2023-01-06 16:07:37 -06:00
Markus Heiser
b241015e93
Merge pull request #2078 from searxng/dependabot/pip/master/pygments-2.14.0
...
Bump pygments from 2.13.0 to 2.14.0
2023-01-06 08:40:46 +01:00
Markus Heiser
e9a7a6aea6
[build] /static
2023-01-06 08:35:52 +01:00
searxng-bot
2420ab6fc3
[translations] update from Weblate
...
b1c60c5b891335484398061a9857916a0ba500780189e64824ded833
2023-01-06 07:14:08 +00:00
searxng-bot
38c22c8c31
[translations] update from Weblate
...
ea56f7b60dbbb03181f33cb75ff824600ea6d8c3b19bb597904fa9abe7c7d624
2022-12-30 07:14:21 +00:00
dalf
0639769274
Update searx.data - update_firefox_version.py
2022-12-29 09:17:56 +01:00
Markus Heiser
174e6851b3
Merge pull request #2054 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-12-29 08:35:51 +01:00
Markus Heiser
d531f89316
Merge pull request #2057 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-12-29 08:31:19 +01:00
Markus Heiser
76cd808a49
Merge pull request #2053 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-12-29 08:28:19 +01:00
dalf
000734cb93
Update searx.data - update_engine_descriptions.py
2022-12-29 01:25:31 +00:00
dalf
36eea5b7cc
Update searx.data - update_currencies.py
2022-12-29 01:16:59 +00:00
dalf
66780efda7
Update searx.data - update_wikidata_units.py
2022-12-29 01:16:59 +00:00
dalf
de793fb71e
Update searx.data - update_ahmia_blacklist.py
2022-12-29 01:16:52 +00:00
Alexandre Flament
0d4896170f
Merge pull request #2047 from dalf/fasttext-predict
...
Use fasttext-predict instead of fasttext(-wheel)
2022-12-26 20:50:09 +01:00
Alexandre Flament
f3515041af
Lazy load fasttext-predict
2022-12-26 18:44:23 +00:00
searxng-bot
dd125321e4
[translations] update from Weblate
...
7f3e72fd5d48e55656e67eb028e1abe1b19d55f7274f7ee9ab00649b
2022-12-23 07:14:39 +00:00
Rudis Muiznieks
6804ff048d
Fix: add trailing slash to duckduckgo url
...
Close #1854
2022-12-22 07:49:58 -06:00
ArtikusHG
735e388cec
Merge branch 'master' into fasttext
2022-12-16 19:43:10 +00:00
ArtikusHG
1f8f8c1e91
Replace langdetect with fasttext
2022-12-16 21:07:39 +02:00
Alexandre Flament
2a51c85672
Merge pull request #1974 from fehho/query-string-deserial
...
[fix] Deserialize preferences which are explicitly blank strings
2022-12-16 18:56:30 +01:00
searxng-bot
03ce848e04
[translations] update from Weblate
...
4cf39daef67457cfdee211c29eeb4290
2022-12-16 07:15:19 +00:00
Alexandre Flament
9e9f57e48b
Merge pull request #1954 from dalf/fix.redis.init.2
...
[fix] follow up of PR-1856
2022-12-14 07:08:19 +01:00
Markus Heiser
ed901ab18e
[mod] improve 'Autodetect search language' plugin
...
- Add documentation to the plugin
- Harmonize FastText language model with SearXNG's language model
Reosurces::
import fasttext # --> +10 MB
fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB
Suggested-by: @dalf
- To speed up and simplify the deployment use fasttext-wheel instead of fasttext
- Building numpy on the Alpine Linux of docker-images takes ages --> install
py3-numpy from Alpines package manager (apk)
- Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu
libc) --> patch Dockerfile and build from fastetxt:
sed -i s/fasttext-wheel/fasttext/ requirements.txt
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-12-11 11:26:07 +01:00
ArtikusHG
9925a20950
[mod] new plugin: Autodetect search language
2022-12-10 13:11:47 +01:00
Alexandre Flament
b971167ced
move searx.shared.redisdb to searx.redisdb
2022-12-10 09:26:38 +01:00
Alexandre Flament
34e260f88f
[fix] follow up of PR-1856
...
- the environment variable SEARXNG_REDIS_URL overrides the setting value redis.url
- ./manage sets SEARXNG_REDIS_URL to unix:///usr/local/searxng-redis/run/redis.sock if:
- the socket exists
- SEARXNG_REDIS_URL is not already defined
Update of PR #1856
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2022-12-10 09:26:38 +01:00
searxng-bot
759d53c892
[translations] update from Weblate
...
1b4600d0e3b49827975217cf
2022-12-09 07:15:14 +00:00
Alexandre Flament
269326063a
Fix: don't crash when engine or name is missing in settings.yml
...
SearXNG crashes if the engine or name fields are missing.
With this commit, the app displays an error in the log and keeps loading.
Close #1951
2022-12-04 23:43:59 +01:00
searxng-bot
f40d1c0004
[translations] update from Weblate
...
cc5cf5d897776fbfc3c9f988a1cf339e4429167c
2022-12-02 07:15:43 +00:00
Ryan Kaskel
e19218c6a9
Copy client connection kwargs before mutating
2022-11-29 12:15:18 +00:00
Markus Heiser
a8359dd4d3
Merge pull request #1981 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-11-29 07:48:26 +01:00
Markus Heiser
1b2f1c17f6
Merge pull request #1982 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-11-29 07:47:52 +01:00
Markus Heiser
3579a38a2d
Merge pull request #1983 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-11-29 07:46:49 +01:00
Markus Heiser
82af2f4460
Merge pull request #1984 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-11-29 07:45:51 +01:00
dalf
a508cdbd4b
Update searx.data - update_engine_descriptions.py
2022-11-29 01:34:42 +00:00
dalf
c4512cf64d
Update searx.data - update_ahmia_blacklist.py
2022-11-29 01:24:48 +00:00
dalf
b0b45fd2d0
Update searx.data - update_currencies.py
2022-11-29 01:24:39 +00:00
dalf
a9be73b4da
Update searx.data - update_wikidata_units.py
2022-11-29 01:24:38 +00:00
dalf
9fc72419e1
Update searx.data - update_firefox_version.py
2022-11-29 01:24:35 +00:00
searxng-bot
981a2c9626
[translations] update from Weblate
...
c13727fc21f638f6b8ed9e1c
2022-11-25 07:16:11 +00:00
fehho
7cab51f98f
Deserialize explicitly blank strings
...
Default behavior of urllib.parse_qs is to discard blank values, causing a preference of none to be deserialized as undefined, using the instance default rather than the selected preference.
2022-11-24 13:14:12 -06:00
searxng-bot
9d06115d07
[translations] update from Weblate
...
7569f2666418da9aacc0dc1a6c2beba6b49457e3
2022-11-19 16:21:15 +00:00
searxng-bot
7a39952558
[translations] update from Weblate
...
f123be21fa2cfa8f
2022-11-18 07:17:51 +00:00
Émilien Devos
46ad32343a
Switch back to protobuf for raw HTML
2022-11-11 07:39:48 +00:00
ngosang
78be4b4c70
Fix Google search engine.
...
- Fix broken links. Resolves #1794
- Fix missing results. Resolves #1829
2022-11-11 07:34:19 +01:00
Ryan Draga
408200c87e
[fix] disabling zlibrary due to z-lib.org domain seizure
2022-11-10 21:18:21 +01:00
Markus Heiser
ee4475ff4b
Merge pull request #1934 from dalf/fix_user_agent
...
User agent: don't include the patch number in the Firefox version
2022-11-09 06:50:33 +01:00
Alexandre FLAMENT
73b5a58d9e
[FIX] Redis initialization
...
redis.Redis.from_url(url) doesn't check if the url is valid
Before this commit: actual error are detected later when the client is actually used.
With this commit, client() makes sure to return a valid Redis client or None.
Also, the code makes sure not to log the password of the Redis URL
2022-11-07 22:08:32 +00:00
Alexandre Flament
8f19bdaf17
Merge pull request #1882 from fehho/metacpan
...
Add MetaCPAN engine
2022-11-07 21:54:11 +01:00
fehho
fe351c2802
Add MetaCPAN engine
2022-11-07 08:07:06 -06:00
Evhorizon
1517724615
Update network.py
2022-11-06 20:35:30 +01:00
Alexandre Flament
2dc5c0e1d6
Merge pull request #1928 from searxng/translations_update
...
Update translations
2022-11-06 11:29:28 +01:00
Alexandre Flament
4fe5463671
Merge pull request #1869 from vgerak/1836-ddg-weather
...
Fix floating point format in DDG weather humidity
2022-11-05 22:46:50 +01:00
Alexandre FLAMENT
d8dee21277
searx.locale: add Dhivehi language
2022-11-05 21:26:15 +00:00
Alexandre FLAMENT
20d951fc5c
searx.locales: improve support for languages not supported by babel
...
* refactor get_translations() to rely on ADDITIONAL_TRANSLATIONS and LOCALE_BEST_MATCH
* update RTL_LOCALES for languages in ADDITIONAL_TRANSLATIONS
2022-11-05 21:26:07 +00:00
Alexandre Flament
e473addaff
User agent: don't include the patch number in the Firefox version
...
The Firefox version in the user agent doesn't include the patch version: 106.0 not 106.0.2
Close #1914
2022-11-05 22:04:37 +01:00
Alexandre FLAMENT
e92755d358
Initialize Redis in searx/webapp.py
...
settings.yml:
* The default URL was unix:///usr/local/searxng-redis/run/redis.sock?db=0
* The default URL is now "false"
The default URL makes the log difficult to deal with:
if the admin didn't install a Redis instance, the logs record a false error.
It worked before because SearXNG initialized the Redis connection when the limiter started.
In this commit, SearXNG initializes Redis in searx/webapp.py
so various components can use Redis without taking care of the initialization step.
2022-11-05 17:45:52 +01:00
Alexandre Flament
fe419e355b
The checker requires Redis
...
Remove the abstraction in searx.shared.SharedDict.
Implement a basic and dedicated scheduler for the checker using a Redis script.
2022-11-05 12:04:50 +01:00
searxng-bot
7438e48d13
[translations] update from Weblate
...
41ebf8e71de65e6afff11c22f677049febf69b4aa21b6221ac384800c4736fd41b967129
2022-11-04 07:18:35 +00:00
Markus Heiser
fc9986de0a
Merge pull request #1905 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-10-29 08:22:43 +02:00
Markus Heiser
3f1d594c23
Merge pull request #1906 from searxng/update_data_update_external_bangs.py
...
Update searx.data - update_external_bangs.py
2022-10-29 08:21:33 +02:00
Markus Heiser
a9deead102
Merge pull request #1907 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-10-29 08:20:53 +02:00
Markus Heiser
d49ccb54ea
Merge pull request #1908 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-10-29 08:20:27 +02:00
Markus Heiser
fa59ff9b78
Merge pull request #1909 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-10-29 08:19:56 +02:00
dalf
e70589c598
Update searx.data - update_engine_descriptions.py
2022-10-29 01:56:57 +00:00
dalf
985a2a87a6
Update searx.data - update_currencies.py
2022-10-29 01:46:40 +00:00
dalf
c0ecc2f865
Update searx.data - update_wikidata_units.py
2022-10-29 01:46:38 +00:00
dalf
c24abc2f8c
Update searx.data - update_firefox_version.py
2022-10-29 01:46:34 +00:00
dalf
f0c7898445
Update searx.data - update_external_bangs.py
2022-10-29 01:46:27 +00:00
dalf
799c5270ae
Update searx.data - update_ahmia_blacklist.py
2022-10-29 01:46:24 +00:00
Markus Heiser
5a181ea1f5
Merge pull request #1901 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/svgo-3.0.0
...
Bump svgo from 2.8.0 to 3.0.0 in /searx/static/themes/simple
2022-10-28 10:22:56 +02:00
Markus Heiser
d913f0d8aa
[build] /static
2022-10-28 10:17:56 +02:00
searxng-bot
bc3db6fd16
[translations] update from Weblate
...
bf52cdbcfbb36c7618cc8a367314d2b6b25147b9d39ade65cb835cdc563f4e0ba698a2e9df5ce28155b369a33eddf243edd3871d5aab9f7b0b2cfe68732b7865d652c20f0bcaaa8d6fd87821618f213c30d38ee9a934ce3bb696c22e6ee1efe2
2022-10-28 07:18:50 +00:00
dependabot[bot]
3cade9a7eb
Bump svgo from 2.8.0 to 3.0.0 in /searx/static/themes/simple
...
Bumps [svgo](https://github.com/svg/svgo ) from 2.8.0 to 3.0.0.
- [Release notes](https://github.com/svg/svgo/releases )
- [Changelog](https://github.com/svg/svgo/blob/main/CHANGELOG-old.md )
- [Commits](https://github.com/svg/svgo/compare/v2.8.0...v3.0.0 )
---
updated-dependencies:
- dependency-name: svgo
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-10-28 07:13:58 +00:00
searxng-bot
18ba8628dd
[translations] update from Weblate
...
c7fddee3f559a626fe7af6628a7c3da9a84dad5c9ee1ac8bb91bedc4dff99ef4cd639f6c49507a60ad30558219e9707597581f70fcd52cea
2022-10-21 07:32:09 +00:00
Vasilis Gerakaris
947b62c9d5
Fix floating point format in DDG weather humidity
...
Fixes #1836
2022-10-20 11:44:17 +03:00
Alexandre FLAMENT
035bc507ec
[fix] startpage engine
2022-10-14 18:27:53 +00:00
Alexandre Flament
32e8c2cf09
searx.network: add "verify" option to the networks
...
Each network can define a verify option:
* false to disable certificate verification
* a path to existing certificate.
SearXNG uses SSL_CERT_FILE and SSL_CERT_DIR when they are defined
see https://www.python-httpx.org/environment_variables/#ssl_cert_file
2022-10-14 13:59:22 +00:00
searxng-bot
6e86f33342
[translations] update from Weblate
...
eee3d5e2c4eb981827423f5b9e8b7f861203aa6a22c78af56a4776f8c00bdc7de5a39537e3fad460da5f0bc35704a98bf3ef3ebb620636c1767b3bb260d38c87
2022-10-14 07:38:20 +00:00
Markus Heiser
23d797ee6f
Update searx.data - update_osm_keys_tags.py
...
Patch was generated by::
./manage pyenv.cmd searxng_extra/update/update_osm_keys_tags.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-10-11 11:49:06 +02:00
searxng-bot
325eadfd04
[translations] update from Weblate
...
70909b19acf1f0aa94ce447f59959050e27a5c792c05470f53644516
2022-10-07 07:30:33 +00:00
Mohamed Elashri
8d5653e60d
Merge branch 'searxng:master' into master
2022-09-30 23:06:54 +00:00
searxng-bot
4fea4acea1
[translations] update from Weblate
...
fbac3535cf5d71b76dc351bd42daf1f8f5fb629f4e5f2c795131835f02055902716bd1d7768c8e43e8ad24c1a88c5f91fc70c33a
2022-09-30 07:43:45 +00:00
Alexandre Flament
a7d693231c
Merge pull request #1819 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-09-29 16:03:34 +02:00
Alexandre Flament
f3d25f9cef
Merge pull request #1821 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-09-29 16:02:57 +02:00
Alexandre Flament
5060732486
Merge pull request #1818 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-09-29 16:02:02 +02:00
Alexandre Flament
520a873ab4
Merge pull request #1820 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-09-29 16:01:31 +02:00
dalf
9cb792c0d6
Update searx.data - update_engine_descriptions.py
2022-09-29 02:22:00 +00:00
dalf
2d429ebd75
Update searx.data - update_wikidata_units.py
2022-09-29 02:13:02 +00:00
dalf
8fc3940448
Update searx.data - update_currencies.py
2022-09-29 02:12:54 +00:00
dalf
b7f4a3a207
Update searx.data - update_ahmia_blacklist.py
2022-09-29 02:12:48 +00:00
dalf
3153f0a795
Update searx.data - update_firefox_version.py
2022-09-29 02:12:48 +00:00
Alexandre Flament
a3148e5115
Merge pull request #1814 from return42/fix-typos
...
[fix] typos / reported by @kianmeng in searx PR-3366
2022-09-28 09:22:02 +02:00
Alexandre Flament
0e00af9c26
Merge pull request #1810 from return42/fix-1809
...
[fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str'
2022-09-28 09:20:03 +02:00
Markus Heiser
ba8959ad7c
[fix] typos / reported by @kianmeng in searx PR-3366
...
[PR-3366] https://github.com/searx/searx/pull/3366
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-27 18:32:14 +02:00
Mohamed Elashri
212c98c9f5
Merge branch 'searxng:master' into master
2022-09-27 14:03:12 +00:00
Markus Heiser
52023e3d6e
[fix] doc of the paper.html template (isbn, issn)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-25 15:46:29 +02:00
Markus Heiser
0052887929
[fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str'
...
- fix issue reported #1809
- filter out `None` value from issn and isbn list
- add comments (from publicationName)
- add publisher
Closes: https://github.com/searxng/searxng/issues/1809
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-25 15:25:55 +02:00
Mohamed Elashri
5832c70680
correct sci-hub links/ add .ru and remove other 3rd party domains.
2022-09-24 11:03:57 -04:00
Markus Heiser
e36b023508
[mod] core.ac.uk: add cetgory 'scientific publications'
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 16:16:22 +02:00
Markus Heiser
b424ee255e
[mod] paper.html: simplify template by using result_link macro
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 16:13:36 +02:00
Alexandre Flament
bfd6f61849
Merge pull request #1804 from return42/fix-core.ac.uk
...
core.ac.uk: use paper.html template
2022-09-24 15:12:05 +02:00
Alexandre Flament
16443d4f4a
[mod] core.ac.uk: try multiple ways to get url
...
If the url is not found, using:
* the DOI
* the downloadUrl
* the ARK id
2022-09-24 15:02:39 +02:00
Markus Heiser
3198c906af
[mod] paper.html: add links to doi resolver
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 14:19:51 +02:00
Markus Heiser
c76830d8a8
[mod] core.ac.uk: use paper.html template
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 13:19:33 +02:00
Markus Heiser
3ff2ad939d
[fix] ERROR searx.engines.core.ac.uk: list index out of range
...
Some result items from core.ac.uk do not have an URL::
Traceback (most recent call last):
File "searx/search/processors/online.py", line 154, in search
search_results = self._search_basic(query, params)
File "searx/search/processors/online.py", line 142, in _search_basic
return self.engine.response(response)
File "SearXNG/searx/engines/core.py", line 73, in response
'url': source['urls'][0].replace('http://', 'https://', 1),
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 13:19:33 +02:00
Markus Heiser
caebafdd06
[fix] typo in crossref settings: disable --> disabled
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-24 08:12:36 +02:00
Alexandre Flament
d6446be38f
[mod] science category: various update of about PR 1705
2022-09-23 20:52:55 +02:00
Alexandre FLAMENT
fe43b6e821
[build] /static
2022-09-23 20:45:58 +02:00
Alexandre FLAMENT
e36f85b836
Science category: update the engines
...
* use the paper.html template
* fetch more data from the engines
* add crossref.py
2022-09-23 20:45:58 +02:00
Alexandre FLAMENT
593026ad9c
oa_doi_rewrite: add the doi to the result when it is found.
...
Currentty, when oa_doi_rewrite find a DOI in the result URL, it replace the URL.
In this commit, the plugin adds the key "doi" to the result,
so the paper.html can show it.
2022-09-23 20:45:58 +02:00
Alexandre FLAMENT
5ba831d6a8
Add paper.html result template
2022-09-23 20:45:58 +02:00
Alexandre FLAMENT
a96f503d7b
Add searx.webutils.searxng_format_date
...
* Move the datetime to str code from searx.webapp.search to searx.webutils.searxng_format_date
* When the month, day, hour, day and second are zero, the function returns only the year.
2022-09-23 20:45:58 +02:00
Alexandre Flament
bef3984d03
Merge pull request #1728 from liimee/eng-ddw
...
add duckduckgo weather engine
2022-09-23 18:14:09 +02:00
Alexandre Flament
d3fec1388c
Merge pull request #1624 from liimee/eng-wttr
...
Add wttr.in engine
2022-09-23 18:13:37 +02:00
searxng-bot
ab6e1542ff
[translations] update from Weblate
...
55133802b9309bdf6da8db13c1edbd899795e5fe
2022-09-23 07:38:23 +00:00
Alexandre Flament
1a7b6872b5
Merge pull request #1792 from unixfox/google-images-internal-api
...
use the internal API for google images
2022-09-21 19:50:38 +02:00
Markus Heiser
cf7ee67f71
[mod] google-images: slightly improvements of the engine
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-21 18:59:55 +02:00
Markus Heiser
8b40e68c56
[fix] wording: SearXNG is 'open' and not 'hackable'
...
The word "hackable" may arouse interest in programmers to participate in the
development, but it scares the ordinary user.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-21 17:10:35 +02:00
Emilien Devos
df5f8d0e8e
use the internal API for google images
2022-09-20 22:52:38 +02:00
Markus Heiser
dcf1d408a5
[fix] google-news: origin result does not have a content area
...
The google news are in a rework, the content area of a news item has been
removed.
Closes: https://github.com/searxng/searxng/issues/1790
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-20 20:18:43 +02:00
Alexandre FLAMENT
33b43763b9
Brave engine: fix BrotliDecoderDecompressStream error
2022-09-18 22:08:38 +00:00
Markus Heiser
fbf07237ff
[fix] and improve docs generated from source code.
...
Fix::
searx/locales.py:docstring of searx.locales.get_engine_locale:17: \
WARNING: Definition list ends without a blank line; unexpected unindent.
Improvement: don't show default values in the generated documentation whe it is
more a mess than a usefull information (`:meta hide-value:`).
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-18 12:44:12 +02:00
Alexandre Flament
b3708e4137
Merge pull request #1757 from LencoDigitexer/master
...
add yandex autocomplete
2022-09-17 13:17:00 +02:00
LencoDigitexer
bc28091557
remove the print statement
2022-09-17 11:25:14 +03:00
searxng-bot
2ee8e5eff2
[translations] update from Weblate
...
570c4f7d0ef09ea103f97e22caddaedcaddfb0c22872e3a6d2835b09
2022-09-16 07:30:31 +00:00
LencoDigitexer
3f72a79088
add yandex to autocomplete backends settings
2022-09-09 23:50:58 +03:00
LencoDigitexer
7b8d6015e3
add yandex autocompleter
2022-09-09 23:42:44 +03:00
Alexandre Flament
eb3d185e66
Merge pull request #1755 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/sharp-0.31.0
...
Bump sharp from 0.30.7 to 0.31.0 in /searx/static/themes/simple
2022-09-09 10:40:38 +02:00
searxng-bot
bf8ea2020f
[translations] update from Weblate
2022-09-09 07:26:09 +00:00
dependabot[bot]
cbf65e8292
Bump sharp from 0.30.7 to 0.31.0 in /searx/static/themes/simple
...
Bumps [sharp](https://github.com/lovell/sharp ) from 0.30.7 to 0.31.0.
- [Release notes](https://github.com/lovell/sharp/releases )
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md )
- [Commits](https://github.com/lovell/sharp/compare/v0.30.7...v0.31.0 )
---
updated-dependencies:
- dependency-name: sharp
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-09-09 07:11:11 +00:00
Alexandre Flament
691c0ed6b9
Merge pull request #1743 from dalf/update_about_metrics
...
Update about the metrics
2022-09-04 11:29:28 +02:00
Markus Heiser
ad8ffd222c
[mod] option 'ui: cache_url:' to configure internet cache or archive
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-04 09:42:20 +02:00
Alexandre FLAMENT
dd0887be18
xpath engine: change raise_for_httperror to no_result_for_http_status
...
no_result_for_http_status contains a list of HTTP status.
These HTTP status are seen an empty result list.
In other cases an exception is thrown as usual.
Previously raise_for_httperror were ignoring all HTTP error,
which make defective engines invisible in the stats.
2022-09-04 09:07:28 +02:00
Markus Heiser
a15dfa5ee1
[fix] engine woxikon.de - don't raise exception on empty result list
...
Woxikon expects a word in German, so with query "foo" the site finds nothing and
respons a 404:
httpx.HTTPStatusError: Client error '404 Not Found' \
for url 'https://synonyme.woxikon.de/synonyme/foo.php '
[1] https://github.com/searxng/searxng/issues/1543#issuecomment-1193317054
Closes: https://github.com/searxng/searxng/issues/1543
Suggested-by: @allendema [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-09-04 09:07:28 +02:00
Markus Heiser
8e9fb0b435
Merge pull request #1647 from return42/deepl-engine
...
[mod] add deepl translation engine
2022-09-02 14:09:22 +02:00
Alexandre FLAMENT
66f72a006f
template: when enable_metrics are disabled, hide the empty stats
...
when metrics are disabled:
* hide the link to /stats at the bottom of the pages
* in /preferences, hide the columns "Response time" and "Reliability"
2022-09-02 08:52:23 +00:00
Alexandre FLAMENT
94a28ebe53
Stats: display only the score per result, no anymore the score
2022-09-02 08:30:38 +00:00
searxng-bot
9e84cf31a4
[translations] update from Weblate
...
9b3635db875cbf387b3b12a0e60b4544dc9c17a47307cf31ae642e6f8db6b9c9d74ef6923ddf8997303d0890
2022-09-02 07:25:26 +00:00
Émilien Devos
fcccf39030
Disable brave by default
...
Brave is too unstable and will often not work by default. As seen in many issues: https://github.com/searxng/searxng/issues?q=is%3Aissue++sort%3Aupdated-desc+brave+label%3Abug+
2022-08-31 15:47:56 +02:00
ta
85b5293e40
simplify infobox result
2022-08-31 18:29:50 +07:00
ta
12f7d4a46b
add duckduckgo weather engine
2022-08-31 17:29:32 +07:00
Alexandre Flament
242db53118
Merge pull request #1708 from dalf/result_proxy_default_settings
...
settings.yml: set default values for result_proxy
2022-08-29 19:42:04 +02:00
Alexandre Flament
a7bd2b47c2
Merge pull request #1712 from dalf/remove_searx_env_var
...
Remove usage of SEARX environment variables
2022-08-29 19:41:39 +02:00
Markus Heiser
13ef9cc125
Merge pull request #1720 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-08-29 07:09:04 +02:00
Markus Heiser
e9b564d066
Merge pull request #1722 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
2022-08-29 07:08:26 +02:00
Markus Heiser
2b65502388
Merge pull request #1723 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-08-29 07:07:54 +02:00
Markus Heiser
55d04a089d
Merge pull request #1724 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-08-29 07:07:14 +02:00
Markus Heiser
4a96480bd5
Merge pull request #1721 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-08-29 07:06:39 +02:00
dalf
c2400a8677
Update searx.data - update_engine_descriptions.py
2022-08-29 02:17:55 +00:00
dalf
e8bf907eef
Update searx.data - update_firefox_version.py
2022-08-29 02:09:34 +00:00
dalf
915c0a2bc6
Update searx.data - update_languages.py
2022-08-29 02:09:27 +00:00
dalf
b1ccecbeb3
Update searx.data - update_wikidata_units.py
2022-08-29 02:09:17 +00:00
dalf
2e6d41fa24
Update searx.data - update_ahmia_blacklist.py
2022-08-29 02:09:09 +00:00
dalf
83fbc16908
Update searx.data - update_currencies.py
2022-08-29 02:09:09 +00:00
Alexandre FLAMENT
4adc9920e9
Remove usage of SEARX environment variables
2022-08-28 17:12:57 +00:00
Alexandre FLAMENT
341ad46303
settings.yml: set default values for result_proxy
...
* initialize result_proxy with searx/settings_defaults.py
* allow result_proxy.key to be a string
this commit supersedes #1522
2022-08-28 09:27:53 +00:00
Markus Heiser
8bdc6986a1
Merge pull request #1706 from dalf/fix-autocomplete-post
...
Fix: autocomplete with the POST method: url encode the user query
2022-08-28 09:14:47 +02:00
Markus Heiser
3be847149e
Merge pull request #1707 from dalf/fix-external-bang
...
External bang: bug fix: URL encode the query so "!!g 1+1" works as intended
2022-08-28 09:07:24 +02:00
Alexandre FLAMENT
2af1a6f547
External bang: bug fix: URL encode the query so "!!g 1+1" works as intended
2022-08-27 07:10:26 +00:00
Alexandre FLAMENT
268fa7e036
[build] /static
2022-08-27 06:52:20 +00:00
Alexandre FLAMENT
4a72a6b9fc
Theme: fix autocompletion with the POST method
...
With the POST method, autocomplete.js does not URL encode the values.
For example "1+1" is sent as "1+1" which is read as "1 1" since space are URL encoded with a plus.
There is no clean way to fix the bug since autocomplete.js seems abandoned.
The commit monkey patches the ajax function of autocomplete.js
Related to #1695
2022-08-27 06:48:30 +00:00
Alexandre Flament
56000d5162
Merge pull request #1699 from liimee/eng-app-store
...
add apple app store engine
2022-08-27 07:43:23 +02:00
Alexandre Flament
44bc94c36e
Merge pull request #1700 from liimee/eng-ddm
...
add apple maps engine
2022-08-27 07:36:16 +02:00
ta
5057007270
remove thumbnail from results
2022-08-27 06:23:30 +07:00
ta
525946d7dd
add poi's website and phone number, doesn't crash when there is no displayMapRegion, query the token on the first request
2022-08-27 06:17:58 +07:00
Alexandre Flament
5284de9137
Merge pull request #1702 from tiekoetter/limiter-accept-encoding-handling
...
[mod] limiter plugin: Accept-Encoding handling
2022-08-26 11:54:12 +02:00
searxng-bot
e5a25e51bf
[translations] update from Weblate
...
3e03429446a4dfd3d41463fd338b67160c9d7756b422a48044c9caa0a774721fd8a322d6
2022-08-26 07:24:01 +00:00
Léon Tiekötter
221740f76e
[mod] limiter plugin: Accept-Encoding handling
...
Only raise "suspicious Accept-Encoding" when both "gzip" and "deflate" are missing from Accept-Encoding.
Prevent Browsers which only implement one compression solution from being blocked by the limiter plugin.
Example Browser which is currently blocked: Lynx Browser (https://lynx.invisible-island.net )
2022-08-25 23:21:30 +02:00
ta
5dce299b22
add apple maps engine
2022-08-25 17:05:40 +07:00
Alexandre Flament
5a241e545e
Merge pull request #1688 from liimee/eng-9gag
...
Add 9gag engine
2022-08-25 09:32:52 +02:00
ta
cef7bbab22
get the not cropped version of the thumbnail when the image height is not too important
2022-08-24 18:33:11 +07:00
ta
78bff4618c
add safesearch support
2022-08-24 18:31:04 +07:00
ta
bcae7ae4e3
add developer info as author
2022-08-24 17:50:38 +07:00
ta
e5c1b64b1d
add the apple app store engine
...
The Apple App Store is the digital app distribution platform for iOS & iPadOS.
2022-08-24 17:27:36 +07:00
ta
040e24f9ad
support playing videos directly
2022-08-24 16:48:31 +07:00
Markus Heiser
c2db7b2a66
[fix] Internal server error after changing UI language to BG
...
A placeholder has been translated to BG, issue was added 8 month ago, when BG
translation was added [1]
msgid "Compute {functions} of the arguments"
msgstr "Изчислете {функции} на аргументите"
The incorrect translation has been corrected here in the message files and on
weblate.
[1] https://weblate.bubu1.eu/translate/searxng/searxng/bg/?&offset=49#history
Closes: https://github.com/searxng/searxng/issues/1692
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-23 08:11:16 +02:00
ta
79d06509c1
add tags as suggestions
2022-08-23 05:18:35 +07:00
ta
d22f469010
use invalid-name instead of C0103 for pylint
2022-08-22 18:27:35 +07:00
ta
dd9127492f
add 9gag engine
...
9GAG is a social media website where users upload and share user-generated images and videos
2022-08-22 17:35:07 +07:00
ta
e64cca8c3f
don't raise error when nothing was found
2022-08-22 17:04:29 +07:00
M Asenov
faa32d5773
fixed xpath selector for appropriate results
2022-08-21 20:08:00 +01:00
Alexandre Flament
5ed40af3ba
Merge pull request #1661 from liimee/eng-tw
...
Add twitter engine
2022-08-21 15:21:18 +02:00
Markus Heiser
ee3c5e7752
Merge pull request #1666 from return42/harden-get_engine_locales
...
[fix] typo in get_engine_locale
2022-08-21 08:22:29 +02:00
Markus Heiser
77a0f33819
[fix] engine duden - don't raise exception on empty result list
...
Duden expects a word in German, so with query "amazing" the site finds nothing
and respons a 404:
httpx.HTTPStatusError: Client error '404 Not Found' for url\
'https://www.duden.de/suchen/dudenonline/amazing '
[1] https://github.com/searxng/searxng/issues/1543#issuecomment-1193317054
Suggested-by: @allendema [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-20 08:41:03 +02:00
Markus Heiser
6f28a69f12
Merge pull request #1677 from searxng/dependabot/pip/master/pygments-2.13.0
...
Bump pygments from 2.12.0 to 2.13.0
2022-08-19 10:21:22 +02:00
Markus Heiser
299635fb8b
[build] /static
2022-08-19 10:01:25 +02:00
Markus Heiser
b08a779f2e
make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-19 10:00:50 +02:00
searxng-bot
3478c0bc8b
[translations] update from Weblate
...
2b94abf3249c92f8a331870c5aca8ddc6e7d76a02a49e5f02d2cafa6adcf97ed
2022-08-19 07:18:58 +00:00
ta
05851978cf
add explanation of token
2022-08-17 19:45:42 +07:00
ta
c8acd4a3b6
add profile image to user results
2022-08-17 14:30:59 +07:00
ta
b6fd7cd571
add thumbnail to results if available
2022-08-17 14:25:22 +07:00
Markus Heiser
de1e7d12f7
[fix] get_engine_locale: better approximation of 'en' is 'en-US'
...
Compared to `en-EN` the better approximation of 'en' is 'en-US'.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 15:45:07 +02:00
Markus Heiser
ac7776663b
[fix] typo in get_engine_locale
...
Due to a typo in get_engine_locale, a language selection like `!qw :de siemens`
did not work.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 14:35:09 +02:00
Markus Heiser
ef81d14ccf
[fix] harden get_engine_locale: handle UnknownLocaleError exceptions
...
When a user selects an unknown or invalid locale by using the search syntax:
!qw siemens :de-TW
Before this patch a UnknownLocaleError exception will be rasied:
```
Traceback (most recent call last):
File "SearXNG/searx/search/processors/online.py", line 154, in search
search_results = self._search_basic(query, params)
File "SearXNG/searx/search/processors/online.py", line 128, in _search_basic
self.engine.request(query, params)
File "SearXNG/searx/engines/qwant.py", line 98, in request
q_locale = get_engine_locale(params['language'], supported_languages, default='en_US')
File "SearXNG/searx/locales.py", line 216, in get_engine_locale
locale = babel.Locale.parse(searxng_locale, sep='-')
File "SearXNG/local/py3/lib/python3.8/site-packages/babel/core.py", line 330, in parse
raise UnknownLocaleError(input_id)
```
This patch implements a simple exception handling, since e.g. `de-TW` does not
exists `de` will be used to get engines locale. On invalid terms like `xy-XY`
the default will be returned.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 13:55:42 +02:00
Markus Heiser
27385e7898
[mod] qwant - add safesearch option
...
Closes: https://github.com/searxng/searxng/issues/1640
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:36:14 +02:00
Markus Heiser
6579d6d558
[fix] qwant - API error::locale must be one ..
...
The request function should not request a language (aka locale) that is not
supported by qwant. Select a locale like zh-TW ends in qwant's API error:
ERROR searx.engines.qwant news: exception : \
API error::locale must be one of the following values: \
en_gb, en_ie, en_us, en_ca, en_my, en_au, en_nz, de_de, de_ch, de_at, fr_fr, \
fr_be, fr_ch, fr_ca, fr_ad, fc_ca, co_fr, es_es, es_ar, es_cl, es_co, es_mx, \
es_pe, es_ad, ca_es, ca_ad, ca_fr, eu_es, eu_fr, it_it, it_ch, pt_pt, pt_ad, \
nl_be, nl_nl
The existing searx.utils.match_language function is unsuitable for this purpose,
it is replaced by function searx.locales.get_engine_locale that is based on the
methods from the babel package.
The quant's _fetch_supported_languages function has been revised to filter out
languages 8aka locales) not supported by qwant.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:36:14 +02:00
Markus Heiser
9ae409a05a
[mod] add locale.get_engine_locale to get predictable results
...
The match_language function sometimes returns incorrect results which is why a
new function get_engine_locale is required.
A bugfix of the match_language is not easily possible, because there is almost
no documentation for it and already the call parameters are undefined. E.g. the
function processes values like the ones from yahoo::
"yahoo": [
"ar",
...
"zh_chs",
"zh_cht"
]
The get_engine_locale has been documented in detail, there is a clear
description of the assumptions as well as the requirements and approximation
rules (read doc-string for more details)::
Argument ``engine_locales`` is a python dict that maps *SearXNG locales* to
corresponding *engine locales*:
<engine>: {
# SearXNG string : engine-string
'ca-ES' : 'ca_ES',
'fr-BE' : 'fr_BE',
'fr-CA' : 'fr_CA',
'fr-CH' : 'fr_CH',
'fr' : 'fr_FR',
...
'pl-PL' : 'pl_PL',
'pt-PT' : 'pt_PT'
}
.. hint::
The *SearXNG locale* string has to be known by babel!
In the following you will find a comparison:
>>> import babel.languages
>>> from searx.utils import match_language
>>> from searx.locales import get_engine_locale
Assume we have an engine that supports the follwoing locales:
>>> lang_list = {
... "zh-CN": "zh_CN",
... "zh-HK": "zh_HK",
... "nl-BE": "nl_BE",
... "fr-CA": "fr_CA",
... }
Assumption:
A. When a user selects a language the results should be optimized according to
the selected language.
B. When user selects a language and a territory the results should be
optimized with first priority on territory and second on language.
----
Example: (Assumption A.)
A user selects region 'zh-TW' which should end in zh_HK
hint:
CN is 'Hans' and HK ('Hant') fits better to TW ('Hant')
>>> get_engine_locale('zh-TW', lang_list)
'zh_HK'
>>> lang_list[match_language('zh-TW', lang_list)]
'zh_CN'
----
Example: (Assumption A.)
A user selects only the language 'zh' which should end in CN
>>> get_engine_locale('zh', lang_list)
'zh_CN'
>>> lang_list[match_language('zh', lang_list)]
'zh_CN'
----
Example: (Assumption B.)
A user selects region 'fr-BE' which should end in nl-BE
hint:
priority should be on the territory the user selected. If the user
prefers 'fr' he will select 'fr' without a region tag.
>>> get_engine_locale('fr-BE', lang_list, default='unknown')
'nl_BE'
>>> match_language('fr-BE', lang_list, fallback='unknown')
'fr-CA'
----
Example: (Assumption A.)
A user selects only the language 'fr' which should end in fr_CA
>>> get_engine_locale('fr', lang_list)
'fr_CA'
>>> lang_list[match_language('fr', lang_list)]
'fr_CA'
----
The difference in priority on the territory is best shown with a engine that
supports the following locales:
>>> lang_list = {
... "fr-FR": "fr_FR",
... "fr-CA": "fr_CA",
... "en-GB": "en_GB",
... "nl-BE": "nl_BE",
... }
----
Example: (Assumption A.)
A user selects only a language
>>> get_engine_locale('en', lang_list)
'en_GB'
>>> match_language('en', lang_list)
'en-GB'
hint: the engine supports fr_FR and fr_CA since no territory is given, fr_FR
takes priority ..
>>> get_engine_locale('fr', lang_list)
'fr_FR'
>>> lang_list[match_language('fr', lang_list)]
'fr_FR'
----
Example: (Assumption B.)
A user selects region 'fr-BE' which should end in nl-BE
>>> get_engine_locale('fr-BE', lang_list)
'nl_BE'
>>> lang_list[match_language('fr-BE', lang_list)]
'fr_FR'
----
If the user selects a language and there are two locales like the following:
>>> lang_list = {
... "fr-BE": "fr_BE",
... "fr-CH": "fr_CH",
... }
>>>
>>> get_engine_locale('fr', lang_list)
'fr_BE'
>>> lang_list[match_language('fr', lang_list)]
'fr_BE'
Looks like both functions return the same value, but match_language depends on the
order of the dictionary (which is not predictable):
>>> lang_list = {
... "fr-CH": "fr_CH",
... "fr-BE": "fr_BE",
... }
>>> get_engine_locale('fr', lang_list)
'fr_BE'
>>> lang_list[match_language('fr', lang_list)]
'fr_CH'
>>>
The get_engine_locale selects the locale by looking at the "population percent"
and this percentage has an higher amount in BE (68.%) compared to CH (21%)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:35:55 +02:00
Markus Heiser
75bb8c45d0
[mod] decouple qwant's categories from SearXNG's categories
...
By using new property `qwant_categ:` the category of qwant is no longer bound to
the category of SearXNG.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-14 10:26:54 +02:00
ta
96ea355a1f
add twitter engine
2022-08-14 08:39:41 +07:00
Markus Heiser
0043190643
Merge pull request #1655 from return42/fix-opensearch
...
[fix] improve OpenSearch description
2022-08-13 12:36:34 +02:00
Léon Tiekötter
b56848e8d0
Merge pull request #1660 from liimee/eng-neeva
...
Add neeva engine
2022-08-13 02:53:27 +02:00
Léon Tiekötter
8fa84ee9f4
Fix time range support and add soft_max_redirects
...
Add custom time_range_url and time_range_map
Set soft_max_redirects = 2 to prevent "ErrorContext('searx/search/processors/online.py', 116, 'count_error(', None, '2 redirects, maximum: 0', ('200', 'OK', 'neeva.com')) True"
2022-08-13 07:35:15 +07:00
ta
d6dfada1a9
add neeva web engine
...
Neeva is "the world's first ad-free, private search engine" and uses data from Apple, Bing, Yelp and "others".
They claim to crawl "hundreds of millions" of URLs a day (https://twitter.com/Neeva/status/1536447373903335426 ).
2022-08-13 07:26:36 +07:00
searxng-bot
b4fea007f5
[translations] update from Weblate
...
f2997bfaeeca674f7478de6ac4fb9110a5b432e2eb01d415f96eb06ee7c79191f4dbd424
2022-08-12 07:18:14 +00:00
Markus Heiser
3b0f9c07b2
[fix] improve OpenSearch description
...
Some HTTP-Clients do have issues with the ``opensearch.xml`` from SearXNG
(related [1][2]) while other OpenSearch descriptions[3] (e.g. from qwant) work
flawles.
Inspired by the OpenSearch description from qwant and with informations from the
specification[4] the ``opensearch.xml`` has been *improved*.
- convert `<Url>` methods from lower case to upper case (`POST`|`GET`)
- add `<moz:SearchForm>` and `xmlns:moz="http://www.mozilla.org/2006/browser/search/ "`
- add `<Query role="example" searchTerms="SearXNG" />` [4]
OpenSearch description documents should include at least one Query element of
`role="example"` that is expected to return search results. Search clients may
use this example query to validate that the search engine is working properly.
- modified `<LongName>` to SearXNG
- modified `<Description>` the word 'hackable' scares uninitiated users and was removed
- add the `type="image/png"` to `<Image>`
Test can be done by::
make run
Visit http://127.0.0.1:8888/ and add the search engine to your WEB-Browser /
test with different WEB-Browser from desktop and Smartphones (are there any iOS
user here, please test on Safari and Chrome).
[1] https://app.element.io/#/room/#searxng:matrix.org/$xN_abdKhNqUlgXRBrb_9F3pqOxnSzGQ1TG0s0G9hQVw
[2] https://github.com/searxng/searxng/issues/431
[3] https://developer.mozilla.org/en-US/docs/Web/OpenSearch
[4] https://github.com/dewitt/opensearch/blob/master/opensearch-1-1-draft-6.md#the-query-element
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-11 19:04:36 +02:00
Markus Heiser
73ffa0c070
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10 21:48:34 +02:00
Johan Planchon
e0215e0cc8
add sourcehut engine
2022-08-10 21:48:12 +02:00
Markus Heiser
43c545910b
Merge pull request #1648 from unixfox/google_mobile_ui_parameter
...
output format protobuf to HTML for google mobile
2022-08-10 20:50:45 +02:00
Markus Heiser
eb02cc77c5
[fix] google - simplify XPath selectors to fetch more results
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-10 18:55:31 +02:00
Johan Planchon
90bdb23756
add lib.rs engine
2022-08-10 12:17:55 +02:00
Émilien Devos
b9f16a77db
output format protobuf to HTML for google mobile
2022-08-10 09:36:06 +00:00
Thomas Renard
d4acbcfe63
[mod] add deepl translation engine
...
This implements the Deepl Translation engine. It works nearly like lingva but
directly to the deepl API. This api only needs a to-lang, from-lang is a fake
by now.
There is a free option to use [1].
[1] https://www.deepl.com/pro-api?cta=header-pro-api for registering a free account.
2022-08-10 09:14:36 +02:00
Brock Vojković
24210fb10b
Revert PR #1633
...
This reverts the changes made to the Google results XPath in PR #1633 .
2022-08-10 03:41:39 +02:00
Léon Tiekötter
94b3656b4a
[fix] google engine: results XPath
...
Seems google rolls out changes first on the `google.com` domain and later on the
"language" domains. By example: yesterday [1] `google.com` did not work but
`google.de` and `google.fr` did work, today they do not work any longer and this
fix is needed on all domains.
Closes: https://github.com/searxng/searxng/issues/1628
[1] https://github.com/searxng/searxng/issues/1628#issuecomment-1208191816
2022-08-09 06:23:59 +02:00
Markus Heiser
925f3ff487
Merge pull request #1627 from allendema/add-marginalia
...
[enh] Initial Marginalia.nu support (foss)
2022-08-08 06:53:02 +02:00
Markus Heiser
58f630d312
Merge pull request #1623 from return42/mod-yep.com
...
[mod] engine yep.com: show all 100 results yep.com has
2022-08-08 06:52:15 +02:00
Allen
5b815b3966
[enh] initial Marginalia.nu support (foss)
...
Currently it uses a public api_key `/public/` [1]
The 'index' parameter selects the search index, corresponding to the drop down
next to the search field in the main GUI.
0: popular
1: blogs
2: big_sites
3: default
4: experimental
'experimental' is more up to date and does not exclude other sites, which is the
case with 'big sites' or 'blogs'.
[1] https://api.marginalia.nu/
[2] https://git.marginalia.nu/marginalia/marginalia.nu
[3] https://news.ycombinator.com/item?id=31536626
Closes: https://github.com/searxng/searxng/issues/1620
2022-08-08 06:31:04 +02:00
Markus Heiser
8b58cd1167
[fix] typo in uWSGI cache: searxcache --> searxngcache
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-07 12:31:09 +02:00
liimee
8c318562e2
add description and wikidata ID to wttr.in engine
2022-08-07 14:57:10 +07:00
ta
8aa018db95
add wttr.in engine
2022-08-07 13:04:18 +07:00
Markus Heiser
647e6187d7
[mod] engine yep.com: show all 100 results yep.com has
...
yep.com is still in beta, the api.yep.com does not have paging support. There
is only a 'limit' argument with a maximum of 100 results.
yep.com seems fast; there is nor need for a timeout of 12 sec.
The API returns JSON nevertheless what the HTTP header is, the "show more"
button on yep.com's web site does not set a special HTTP Accept header.
FYI: The index does not support languages, the WEB UI does not offer a language
selection of the results and the entire index seems in English.
Closes: https://github.com/searxng/searxng/issues/1619
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-06 13:21:28 +02:00
searxng-bot
0f02fcc836
[translations] update from Weblate
...
acf8bd394ad75b6eee8cbee687c19313cbe0de3245029a176eec3795f8d8f31fb3fb365faaeabbc96c71c501f7b5ba19850e7fa00cb696fc04c3785fb500f2ad0b576b830adeb6e20b025f17
2022-08-05 07:18:24 +00:00
Allen
58369e41d6
[wip] brave time range support
2022-08-04 04:47:25 +02:00
Markus Heiser
8df1f0c47e
[mod] add 'Accept-Language' HTTP header to online processores
...
Most engines that support languages (and regions) use the Accept-Language from
the WEB browser to build a response that fits to the language (and region).
- add new engine option: send_accept_language_header
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01 17:01:59 +02:00
Markus Heiser
a2badb4fe4
[doc] add description of method EngineProcessor.get_params()
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01 16:42:33 +02:00
Alexandre Flament
2babf59adc
[fix] pyright repported errors
...
The errors make pyright usage useless since a new error won't be seen [1].
[1] https://github.com/searxng/searxng/pull/1569
```
searx/compat.py:11:27 - error: Expression of type "Type[cached_property[_T@cached_property]]" cannot be assigned to declared type "Type[cached_property]"
"Type[cached_property[_T@cached_property]]" is incompatible with "Type[cached_property]"
Type "Type[cached_property[_T@cached_property]]" cannot be assigned to type "Type[cached_property]" (reportGeneralTypeIssues)
searx/utils.py:69:36 - error: Expression of type "None" cannot be assigned to parameter of type "str"
Type "None" cannot be assigned to type "str" (reportGeneralTypeIssues)
searx/utils.py:573:85 - error: Expression of type "None" cannot be assigned to parameter of type "int"
Type "None" cannot be assigned to type "int" (reportGeneralTypeIssues)
searx/webapp.py:1306:22 - error: Argument of type "str" cannot be assigned to parameter "__a" of type "BytesPath" in function "join"
Type "str" cannot be assigned to type "BytesPath"
"str" is incompatible with "bytes"
"str" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:68 - error: Argument of type "Literal['themes']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "Literal['themes']" cannot be assigned to type "BytesPath"
"Literal['themes']" is incompatible with "bytes"
"Literal['themes']" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:78 - error: Argument of type "str | Any | None" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "str | Any | None" cannot be assigned to type "BytesPath"
Type "str" cannot be assigned to type "BytesPath"
"str" is incompatible with "bytes"
"str" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:85 - error: Argument of type "Literal['img']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "Literal['img']" cannot be assigned to type "BytesPath"
"Literal['img']" is incompatible with "bytes"
"Literal['img']" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/engines/mongodb.py:8:6 - warning: Import "pymongo" could not be resolved (reportMissingImports)
searx/engines/mysql_server.py:9:8 - warning: Import "mysql.connector" could not be resolved (reportMissingImports)
searx/engines/postgresql.py:9:8 - warning: Import "psycopg2" could not be resolved from source (reportMissingModuleSource)
searx/engines/xpath.py:187:28 - warning: "categories" is not defined (reportUndefinedVariable)
searx/search/__init__.py:184:82 - warning: "flask" is not defined (reportUndefinedVariable)
searx/search/checker/background.py:19:26 - error: Type of "schedule" is partially unknown
Type of "schedule" is "(delay: Any, func: Any, *args: Any) -> Literal[True]" (reportUnknownVariableType)
searx/shared/__init__.py:8:12 - warning: Import "uwsgi" could not be resolved (reportMissingImports)
searx/shared/shared_uwsgi.py:5:8 - warning: Import "uwsgi" could not be resolved (reportMissingImports)
```
2022-07-30 18:04:44 +02:00
Markus Heiser
782f73540e
[utils/searxng.sh] implement new script to install SearXNG
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-30 13:39:35 +02:00
searxng-bot
953aaec6a3
[translations] update from Weblate
...
c0c9107c5b48bce679669e65520e92847cf52ff59d3ebe722d03c097388af012a4bcf09893fd0b728f68b2069007c99caeec96f269084863b48190abb6bbc0a51a503806c960cb938a2bd34b1064cea06742304556c87fda36a64f1c
2022-07-29 07:17:55 +00:00
Markus Heiser
14085cc0a7
Merge pull request #1580 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-07-29 07:23:02 +02:00
Markus Heiser
7602c23d71
Merge pull request #1579 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-07-29 07:22:12 +02:00
Markus Heiser
0bad4fb931
Merge pull request #1578 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-07-29 07:21:06 +02:00
Markus Heiser
7dd75ae080
Merge pull request #1576 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
2022-07-29 07:20:28 +02:00
dalf
2bdb367e8c
Update searx.data - update_engine_descriptions.py
2022-07-29 02:13:07 +00:00
dalf
fc019fb296
Update searx.data - update_currencies.py
2022-07-29 02:01:30 +00:00
dalf
c2662ec3c8
Update searx.data - update_firefox_version.py
2022-07-29 02:01:08 +00:00
dalf
385542e6c5
Update searx.data - update_ahmia_blacklist.py
2022-07-29 02:01:04 +00:00
dalf
90068b3d0b
Update searx.data - update_languages.py
2022-07-29 02:00:53 +00:00
Markus Heiser
c72d70d45c
Revert "Quick fix for google engine for EU countries"
...
This reverts commit 747cf1a246
2022-07-26 06:39:44 +02:00
Léon Tiekötter
950f036c03
[fix] google engine: results XPath
2022-07-26 00:24:15 +02:00
Émilien Devos
747cf1a246
Quick fix for google engine for EU countries
...
This revert part of the commit of 5fb2071cb2
2022-07-25 20:48:50 +00:00
Markus Heiser
0be0e63117
[fix] demo_online.py - fixed typo
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-25 20:04:00 +02:00
Emilien Devos
5fb2071cb2
[fix] google & youtube - set EU consent cookie
...
This change the previous bypass method for Google consent using
``ucbcb=1`` (6face215b8https://www.google.com/search?q=time&tbm=isch " \
-A "Mozilla/5.0 (X11; Linux i686; rv:102.0) Gecko/20100101 Firefox/102.0" \
| grep -i consent
...
location: https://consent.google.com/m?continue=https://www.google.com/search?q%3Dtime%26tbm%3Disch&gl=DE&m=0&pc=irp&uxe=eomtm&hl=en-US&src=1
set-cookie: CONSENT=PENDING+936; expires=Wed, 24-Jul-2024 11:26:20 GMT; path=/; domain=.google.com; Secure
...
PENDING & YES [2]:
Google change the way for consent about YouTube cookies agreement in EU
countries. Instead of showing a popup in the website, YouTube redirects the
user to a new webpage at consent.youtube.com domain ... Fix for this is to
put a cookie CONSENT with YES+ value for every YouTube request
[1] https://github.com/iv-org/invidious/pull/2207
[2] https://github.com/TeamNewPipe/NewPipeExtractor/issues/592
Closes: https://github.com/searxng/searxng/issues/1432
2022-07-25 13:27:06 +02:00
Markus Heiser
4231a5770b
[fix] sjp engine - convert enginename to a latin1 compliance name
...
The engine name is not only a *name* its also a identifier that is used in
logs, HTTP headers and more. Unicode characters in the name of an engine could
cause various issues.
Closes: https://github.com/searxng/searxng/issues/1544
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-24 21:10:55 +02:00
james-still
2516e21c58
[fix] emojipedia - update XPath to be relative
2022-07-24 19:14:26 +02:00
Markus Heiser
1540891561
[fix] engine tineye: handle 422 response of not supported img format
...
Closes: https://github.com/searxng/searxng/issues/1449
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-23 16:00:58 +02:00
searxng-bot
561433b12b
[translations] update from Weblate
...
cf6e9482918c1bfe4e65ecf6a54be8fecad6cb2fa6bd11709d0e8754
2022-07-22 07:20:00 +00:00
Solirs
6d646129c3
[mod] add tor_check plugin - convenient tor checking trough searxng
2022-07-19 07:34:54 +02:00
Léon Tiekötter
d339e97727
[fix] preferences: missing option value
...
Fix missing option value "0".
2022-07-17 19:51:12 +02:00
Markus Heiser
7bf4e8d12d
Merge pull request #1512 from searxng/translations_update
...
Update translations
2022-07-15 09:45:03 +02:00
Markus Heiser
4e05197444
Merge pull request #1475 from return42/Emojipedia
...
[mod] Add engine for Emojipedia
2022-07-15 09:30:40 +02:00
Markus Heiser
445cba7c02
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-15 09:26:44 +02:00
Jay
10edcbe3c2
[mod] Add engine for Emojipedia
...
Emojipedia is an emoji reference website which documents the meaning and
common usage of emoji characters in the Unicode Standard. It is owned by Zedge
since 2021. Emojipedia is a voting member of The Unicode Consortium.[1]
Cherry picked from @james-still [2[3] and slightly modified to fit SearXNG's
quality gates.
[1] https://en.wikipedia.org/wiki/Emojipedia
[2] 2fc01eb20fhttps://github.com/searx/searx/pull/3278
2022-07-15 09:26:44 +02:00
searxng-bot
f84e9f8154
[translations] update from Weblate
...
e78584e1eb3f21409160b6d118d569b8c9137f9e14d8b61fc11e318d4d53b3bb613117bfe5e383052bea37fa5ab1588132794ad3830b01f9b4d431e5c6d9841e686926568cba6d36fe45788695e7d403f02673b17d49be29fbe6e4da
2022-07-15 07:19:07 +00:00
Léon Tiekötter
8e509941b9
[mod] allow brand.issue_url to overwrite the step1 url
2022-07-10 18:43:53 +02:00
Alexandre Flament
44f2eb50a5
Merge pull request #1219 from dalf/follow_bing_redirect
...
bing.py: remove redirection links
2022-07-10 18:06:22 +02:00
Emilien Devos
6face215b8
bypass google consent with ucbcb=1
2022-07-09 21:33:24 +00:00
Brock Vojković
84e2a3bd3f
Add infinite scroll as a setting in settings.yml
2022-07-09 17:33:25 +00:00
Alexandre Flament
a1e8af0796
bing.py: resolve bing.com/ck/a redirections
...
add a new function searx.network.multi_requests to send multiple HTTP requests at once
2022-07-08 22:02:21 +02:00
Alexandre Flament
7e695c6644
Merge pull request #1478 from dalf/submit_bug_workflow
...
Engine error log: Submit a new issue button: ask the user to check if there are some existing issues.
2022-07-08 20:24:00 +02:00
Alexandre Flament
f90aed7ef9
locales.py: add support for Papiamento
2022-07-08 10:00:20 +02:00
searxng-bot
cb3a31c04d
[translations] update from Weblate
...
b1809ae3cf09e8b25a854ba3e35864339465ae781e1799d056429ebbe1e040b1d04f51ef1a09e45afab4f6de782eac5c73f6dde9eb3bf7a45c3376168511391a816ec36424adf82f25e13dcff2008c3679b9b12a1f2f61c8e7a1cd6efc02ccbf3d1afa8895c871d2f8825dd1a781c97c7290ce9c0a1286c5baa49eef3d3fbc15a1eb8798a08b01a6356344468d1fe456805da3b0c6f02ceecd8246136a4b41ee53eb448a7012f64351ea1d58744d130ce92d37cd4576e883da7a9b10f20a317fcab15b1512d6021cc86a37389c6d05e22b6ca75155e9663c49fac625
2022-07-08 07:18:05 +00:00
Alexandre Flament
be3ecf6e31
[build] /static
2022-07-08 09:04:57 +02:00
Alexandre Flament
eb489c45ea
Submit GH bug: ask the user to do some checks before submitting a new issue
2022-07-08 09:04:57 +02:00
Markus Heiser
81e8c7370f
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-07 17:16:41 +02:00
Markus Heiser
c63fab6928
Merge pull request #1443 from return42/fix-online_dictionary
...
[fix] online_dictionary: regular expression
2022-07-07 16:25:10 +02:00
Markus Heiser
480476fdf3
[fix] online_dictionary: regular expression
...
The query term of a engine-type `online_dictionary` can consist of more than one
word.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-07 15:58:29 +02:00
Alexandre Flament
df837d8b1b
Merge pull request #1428 from return42/fix-center_aligment
...
fix typo and document preference 'center_alignment' in the 'ui' section
2022-07-07 09:43:12 +02:00
Markus Heiser
c5ec8db6b3
Merge pull request #1457 from return42/fix-1435
...
[fix] engine z-zlibrary https URL
2022-07-06 13:44:08 +02:00
Markus Heiser
be2f782c9e
Merge pull request #1460 from unixfox/patch-1
...
Better explanation for the use of use_mobile_ui
2022-07-06 00:16:26 +02:00
Émilien Devos
63a995b8c1
Better explanation for the use of use_mobile_ui
2022-07-06 00:10:09 +02:00
mrpaulblack
38385e48cf
fix: return body on limiter block so there is not just a blank page
2022-07-05 22:57:26 +02:00
Markus Heiser
970a69012b
[fix] engine z-zlibrary https URL
...
before this patch:
DEBUG searx.engines.z-library : using base_url: https:https://de1lib.org
with this patch URL is fixed to:
DEBUG searx.engines.z-library : using base_url: https://de1lib.org
Closes: https://github.com/searxng/searxng/issues/1435
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-05 22:27:55 +02:00
Markus Heiser
8de0b62005
[build] /static
2022-07-04 19:06:45 +02:00
Markus Heiser
f8222eb2cd
[fix] style.less: move <dl> from infobox.attributes to .attributes class
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-04 19:06:45 +02:00
ta
14756a2674
[mod] Adds Lingva translate engine
...
Add the lingva engine (which grabs data from google translate). Results from
Lingva are added to the infobox results.
2022-07-04 19:06:45 +02:00
Xavier horwood
61ee370e18
[mod] link to public-instances can be set to hidden
...
Some administrators may want to hide the link to public_instances: If you run a
private instance for a company that wants there employees to use the private
instance instead of any of the public instances.
2022-07-04 13:26:01 +02:00
Markus Heiser
241bde5ae3
[fix] typo: add missing 'n' in center_aligment --> center_alignment
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-03 17:35:54 +02:00
Markus Heiser
4ef6263725
Merge pull request #1404 from dalf/donation_use_external_link
...
Donation link: default value to searxng.org, can be hidden or custom
2022-07-02 17:18:05 +02:00
Markus Heiser
5831c15b49
[fix] engines/openstreetmap.py typo: user_langage --> user_language
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-02 16:51:25 +02:00
Alexandre Flament
6716c6b0c3
openstreetmap engine: return the localized named.
...
For example: display "Tokyo" instead of "東京都" when the language is English.
2022-07-02 16:51:25 +02:00
Alexandre Flament
7f30ac37e9
map.html: display the intended text for the links instead of the URL
...
For example display "Tokyo (en)" instead of https://en.wikipedia.org/wiki/Tokyo
2022-07-02 16:51:25 +02:00
Markus Heiser
69a6d994e1
Merge pull request #1382 from dalf/fix_searxng_extra_update
...
fix searxng_extra/update/update*.py scripts
2022-07-02 12:33:07 +02:00
Markus Heiser
1416559f22
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-02 12:16:00 +02:00
Markus Heiser
2bf800a4b1
Update searx.data - update_currencies.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_currencies.py
Closes: https://github.com/searxng/searxng/pull/1375
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-02 12:16:00 +02:00
Alexandre Flament
f8f239fe1f
Donation link: default value to searxng.org, can be hidden or custom
...
Add a new setting: general.donation_url
By default the value is https://docs.searxng.org/donate.html
When the value is false, the link is hidden
When the value is true, the link goes to the infopage donation,
the administrator can create a custom page.
2022-07-02 11:29:21 +02:00
searxng-bot
8376833d7d
[translations] update from Weblate
2022-07-02 09:17:14 +00:00
Alexandre Flament
bcded7686e
[build] /static
2022-07-02 10:05:43 +02:00
Alexandre Flament
e3e5d2bd22
Theme: all top right icons have labels including "Preferences"
2022-07-02 10:04:35 +02:00
searxng-bot
4272ef3117
[translations] update from Weblate
...
c6c13e8c284f86fed659c9f23d76fb71874e15dc10f3978d66556a496c5a28a79bb7dc8e38bd6b551aecb8f89a74838e3f139d79d3449b5f
2022-07-01 07:18:53 +00:00
Alexandre Flament
1617ef1e41
Update searx/infopage/en/donate.md
...
Co-authored-by: Émilien Devos <contact@emiliendevos.be>
2022-06-29 21:03:01 +02:00
Alexandre FLAMENT
0e503c990a
Move donation page to docs.searxng.org and link to it from instances
...
Close #1378
2022-06-29 17:26:19 +00:00
Alexandre FLAMENT
ecccf02a02
infopage: a .md file can be remove without crash
...
An administrator might decide to remove some of the .md files.
This commit make sure to not crash the application.
2022-06-29 17:25:07 +00:00
Markus Heiser
eb3123e164
Merge pull request #1379 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-06-29 15:40:51 +02:00
dalf
a89fca9d08
Update searx.data - update_ahmia_blacklist.py
2022-06-29 07:21:09 +00:00
Markus Heiser
3a75d3c1cc
Merge pull request #1376 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-06-29 08:45:29 +02:00
dalf
11def5155e
Update searx.data - update_wikidata_units.py
2022-06-29 01:52:03 +00:00
dalf
21ab024469
Update searx.data - update_firefox_version.py
2022-06-29 01:51:46 +00:00
Alexandre Flament
0801f9a24e
Add donate.md
2022-06-28 10:59:36 +02:00
Alexandre Flament
86f14fd066
[build] /static
2022-06-25 20:32:04 +02:00
Alexandre Flament
6e2b5f3d5a
Theme: add Help and Donate links in all pages
...
Close https://github.com/searxng/searxng/issues/931
2022-06-25 20:31:40 +02:00
Alexandre Flament
4bedd7465c
Merge pull request #1346 from dalf/theme-dependencies-upgrade
...
Theme: dependencies upgrade
2022-06-25 19:27:42 +02:00
searxng-bot
bfebaa15ad
[translations] update from Weblate
...
d745649a80c8f41f
2022-06-25 15:49:33 +00:00
Alexandre Flament
0f3e98ace4
Theme: upgrade dependencies & minor update of the grunt scripts
...
Remove webfont grunt script
Update clean grunt script
2022-06-25 13:59:37 +02:00
searxng-bot
dd2577e21d
[translations] update from Weblate
...
b4ef9941a4ad5c56e9640746063e2d09da0952744d632f14136edb6725533b02030b5310
2022-06-24 07:18:15 +00:00
Markus Heiser
ed1ff4b8bc
Merge pull request #1357 from liimee/eng-3
...
Add curlie.org engine
2022-06-22 18:29:36 +02:00
ta
7c457fcf7a
add curlie engine
2022-06-22 11:46:33 +07:00
Markus Heiser
88f62cf0df
[fix] clean up templates / remove import of result_footer_rtl macro
...
A macro named 'result_footer_rtl' does not exists.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-20 19:00:10 +02:00
ta
8883aed132
[fix] google play apps engine: implement engines/google_play_apps.py
2022-06-18 16:02:39 +02:00
Alexandre Flament
189df7db4e
Merge pull request #1287 from dalf/style-center-2nd
...
Theme: add a preference to center the results (Oscar) (2nd edition)
2022-06-18 12:34:57 +02:00
Alexandre Flament
0539e38309
Workaround: index.html: remove image preload
...
Related to https://github.com/searxng/searxng/issues/1326
URL for the logo is referenced twice:
* in index.html for preloading: it contains the hash for cache busting (when static_use_hash: true)
* in searxng.min.css: to actually display the image. The URL doesn't contain the hash.
So the image preload actually loads twice the same image.
This commit removed the image preloading.
This is workaround: the real fix is to be able to use the URL with the hash in the CSS.
2022-06-18 09:04:13 +02:00
Alexandre Flament
e6c3000909
[build] /static
2022-06-18 08:58:06 +02:00
Alexandre Flament
8a85d1b0c7
Theme: add a preference to center the results (Oscar) (2nd edition)
...
related to
* #1169
* #1281
* #1286
2022-06-18 08:54:24 +02:00
Alexandre Flament
5bcbec9b06
Fix: use sys.modules.copy() to avoid RuntimeError
...
use sys.modules.copy() to avoid "RuntimeError: dictionary changed size during iteration"
see https://github.com/python/cpython/issues/89516
and https://docs.python.org/3.10/library/sys.html#sys.modules
close https://github.com/searxng/searxng/issues/1342
2022-06-18 07:39:46 +02:00
Alexandre Flament
a7b0b2ecbf
Merge pull request #1329 from samsaptidev/feature/privacypolicy_url
...
Add privacypolicy_url option
2022-06-18 07:26:40 +02:00
Léon Tiekötter
6bdc66b70e
[fix] mojeek engine: XPath
...
Update the XPath of the Mojeek engine.
2022-06-17 09:32:53 +02:00
searxng-bot
8e107a9ad6
[translations] update from Weblate
...
7d7f982361912312895d116e2f55d1a3507db1e11a7079d1aa30ed02
2022-06-17 07:17:59 +00:00
samsaptidev
31005595c9
Add privacypolicy_url option
2022-06-16 11:56:24 +02:00
ta
e9cc6ab0e7
add pub.dev engine
2022-06-15 12:55:37 +02:00
Paul Braeuning
d7a76f3772
Merge pull request #1322 from return42/fix-794
...
[fix] keyboard.js - highlightResult: don't steal focus on click event
2022-06-14 19:07:09 +02:00
Markus Heiser
ef4239c68a
[doc] fix some leftovers from ad964562c
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-14 16:31:41 +02:00
Markus Heiser
1a361e6635
[build] /static
2022-06-14 15:14:33 +02:00
Markus Heiser
882282d0e9
[fix] keyboard.js - highlightResult: don't steal focus on click event
...
For keyboard navigation the highlightResult() function in keyboard.js steals the
focus. On a mouse click event (non keyboard action) the focus should resist
where it is, otherwise a marked region gets lost. This is the reason why text
can't be selected when using simple theme with JS enabled.
Closes: https://github.com/searxng/searxng/issues/794
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-14 15:14:19 +02:00
Alexandre Flament
3ade7ffc26
[build] /static
2022-06-13 21:38:07 +02:00
Alexandre Flament
fe1683c9c6
UX fix: when the user clicks on the search input, don't move the cursor at the end
...
Related to https://github.com/searxng/searxng/pull/1153#issuecomment-1154247988
2022-06-13 21:35:14 +02:00
Markus Heiser
9b0b6a2c90
Merge pull request #1313 from unixfox/help-rate-limit-google
...
add "warn" message to notify the admin that use_mobile_ui parameter exist
2022-06-12 17:07:13 +02:00
Alexandre Flament
ee3f230d93
Autocomplete: don't suggest the current query.
...
Example of minor issue before this commit:
the autocompletion can suggest "Test" if the query is "Test".
2022-06-12 11:21:24 +02:00
Alexandre Flament
2455f1d06a
Merge pull request #1308 from allendema/add-yep-com-json
...
[enh] Add yep.com via json_engine
2022-06-12 11:09:04 +02:00
Markus Heiser
916f5f8b90
Merge pull request #1306 from return42/fix-1303
...
[fix] move locale code from webapp.py to locales.py and fix #1303
2022-06-12 10:56:59 +02:00
Markus Heiser
ad964562ce
[fix] move locale code from webapp.py to locales.py and fix #1303
...
To improve modularization this patch:
- moves *locale* related implementation from the webapp.py application to the
locale.py module.
- The initialization of the locales is now done in the application (webapp) and
is no longer done while importing searx.locales.
In the searx.locales module a new dictionary named `LOCALE_BEST_MATCH` has been
added. In this dictionary we can map languages without a translation to
languages we have a translation for.
To fix #1303 zh-HK has been mapped to zh-Hant-TW (we do not need additional
translations of traditional Chinese)
Closes: https://github.com/searxng/searxng/issues/1303
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-12 10:52:26 +02:00
Emilien Devos
0d4c066119
notify the user that use_mobile_ui parameter exist
2022-06-11 17:20:56 +02:00
Allen
fd9a13a3e5
[enh] Initial no paging support for Yep.com
...
Upstream example query:
https://yep.com/web?q=test
https://yep.com/about
2022-06-11 14:17:44 +02:00
Alexandre Flament
cd2dd5dd55
Wikidata engine: ignore dummy entities
...
Close #641
2022-06-11 11:09:21 +02:00
Alexandre Flament
d068b67a71
Wikidata engine: minor change of the SPARQL request
...
The engine can be slow especially when the query won't return any answer.
See https://www.mediawiki.org/wiki/Wikidata_Query_Service/User_Manual/MWAPI#Find_articles_in_Wikipedia_speaking_about_cheese_and_see_which_Wikibase_items_they_correspond_to
Related to #1290
2022-06-11 10:50:11 +02:00
searxng-bot
1e82dedcf3
[translations] update from Weblate
...
25debdad4ea83323034a61d212598dee9ebd1a60
2022-06-10 07:19:19 +00:00
Maciej Błędkowski
98c4156f12
Fixed typo in settings.yml
2022-06-09 17:08:14 +02:00
Alexandre Flament
ea0cddba0b
Merge pull request #1047 from return42/redis-lib
...
Add a redis library to generalize DB functions we need in SearXNG.
2022-06-06 10:59:11 +02:00
Alexandre Flament
06217ef184
[build] /static
2022-06-05 23:06:19 +02:00
Alexandre Flament
9723cef99a
Revert "Theme: add a preference to center the results (Oscar)"
...
This reverts commit 4237f5fd50
2022-06-05 23:03:26 +02:00
Alexandre Flament
f8f6b95d8f
Merge pull request #1281 from dalf/style-center
...
Theme: add a preference to center the results
2022-06-05 21:39:58 +02:00
Alexandre Flament
2c62360e6e
[build] /static
2022-06-05 20:00:11 +02:00
Alexandre Flament
4237f5fd50
Theme: add a preference to center the results (Oscar)
...
related to #1169
2022-06-05 19:59:49 +02:00
Markus Heiser
0c489a25ac
[fix] version.py: git format '%cs' is not downward compatible
...
Committer date, short format YYYY-MM-DD ('%cs') [1] is not supported by older git
versions. Instead use '%cd' committer date (format respects --date= option) [2].
[1] https://www.git-scm.com/docs/git-show#Documentation/git-show.txt-emcsem
[2] https://www.git-scm.com/docs/git-show#Documentation/git-show.txt-emcdem
Suggested-by: @ravermeister https://github.com/searxng/searxng/issues/1251#issuecomment-1146282429
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-04 09:15:26 +02:00
Markus Heiser
2de007138c
[fix] prepare for pylint 2.14.0
...
Remove issue reported by Pylint 2.14.0:
- no-self-use: has been moved to optional extension [1]
- The refactoring checker now also raises 'consider-using-generator' messages
for max(), min() and sum(). [2]
.pylintrc:
- <option name>-hint has been removed since long, Pylint 2.14.0 raises an
error on invalid options
- bad-continuation and bad-whitespace have been removed [3]
[1] https://pylint.pycqa.org/en/latest/whatsnew/2/2.14/summary.html#removed-checkers
[2] https://pylint.pycqa.org/en/latest/whatsnew/2/2.14/full.html#what-s-new-in-pylint-2-14-0
[2] https://pylint.pycqa.org/en/latest/whatsnew/2/2.6/summary.html#summary-release-highlights
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-06-03 15:41:52 +02:00
searxng-bot
bc8cd9cb8c
[translations] update from Weblate
...
1f71567c67ff4da057bf9bd75f63090b4b6756669fcfccffb28ac961ec7b3c14622896c153d0f115e16d889a2c5337a5
2022-06-03 07:18:49 +00:00
Alexandre FLAMENT
7e8a60fb27
[build] /static
2022-06-02 20:35:49 +00:00
Alexandre FLAMENT
fbad93e808
Theme: enable autofocus of #q only on the index page and when the width > 50em
...
Related to #1270
2022-06-02 20:33:31 +00:00
Markus Heiser
96dc4369d5
Merge pull request #1259 from allendema/petal-images
...
[enh] Add Petalsearch Images engine
2022-06-02 14:59:24 +02:00
Léon Tiekötter
7e95d6bb79
[mod] image proxy: allow binary/octet-stream mime type
...
The Petal Search Images engine sends the thumbnails with the binary/octet-stream mime type.
2022-06-02 14:32:37 +02:00
Allen
43dc9eb7d6
[enh] Initial Petalsearch Images support
...
Upstream example query:
https://petalsearch.com/search?query=test&channel=image&ps=50&pn=1®ion=de-de&ss_mode=off&ss_type=normal
Depending on locale it will internally use some/all results from other
engines. See:
https://seirdy.one/posts/2021/03/10/search-engines-with-own-indexes/#general-indexing-search-engines
2022-06-02 14:32:37 +02:00
Markus Heiser
e568da2314
Merge pull request #1266 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-06-01 13:49:48 +02:00
Markus Heiser
84a5e48a90
Merge pull request #1265 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-06-01 11:29:41 +02:00
Markus Heiser
78968843a8
Merge pull request #1267 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-06-01 11:24:35 +02:00
Markus Heiser
a9251cfeb4
Merge pull request #1268 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-06-01 11:24:00 +02:00
Markus Heiser
61ee915064
Merge pull request #1264 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
2022-06-01 10:34:19 +02:00
dalf
fda176144e
Update searx.data - update_engine_descriptions.py
2022-06-01 06:40:37 +00:00
dalf
f37b9978cb
Update searx.data - update_currencies.py
2022-06-01 06:32:10 +00:00
dalf
a93170725f
Update searx.data - update_firefox_version.py
2022-06-01 06:31:57 +00:00
dalf
8d6d32bf6e
Update searx.data - update_ahmia_blacklist.py
2022-06-01 06:31:54 +00:00
dalf
012d7fcaa0
Update searx.data - update_languages.py
2022-06-01 06:31:54 +00:00
dalf
ab9616c2cc
Update searx.data - update_wikidata_units.py
2022-06-01 06:31:52 +00:00
Markus Heiser
1a8ff10e30
[mod] redislib - optimize LUA script registration.
...
Instead of register the LUA script on each call, the LUA script is registered
once and the `Script` object is cached in global storage.
[1] https://github.com/searxng/searxng/pull/1047#discussion_r884143305
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-30 11:21:09 +02:00
Markus Heiser
4b185f0e11
[mod] plugins/limiter.py - use searx.redislib.incr_sliding_window
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-30 11:10:30 +02:00
Markus Heiser
08876df7c2
[mod] collection of redis functions and lua scripts (initial)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-30 11:10:30 +02:00
Léon Tiekötter
167f635924
[engine] petal search news
...
Add Petal Search News to SearXNG via XPath
2022-05-29 22:49:41 +02:00
Léon Tiekötter
f09e8abd76
[engine] petal search
...
Add Petal Search to SearXNG via XPath
2022-05-29 22:23:30 +02:00
Léon Tiekötter
7c8903c809
[fix] mojeek engine: xpath
2022-05-28 18:09:25 +02:00
Markus Heiser
e93385e6de
Merge pull request #1249 from Linerly/english-infopage
...
Capitalize website names in search-syntax.md, in the English infopage
2022-05-28 16:50:55 +02:00
Linerly
c2f7b1136e
Capitalize website names
2022-05-28 14:41:53 +00:00
Linerly
979c42f044
Replace link
2022-05-28 14:38:14 +00:00
Linerly
2871900651
Capitalize website names
2022-05-28 14:34:58 +00:00
Linerly
db26b9b13b
Replace English links to Indonesian links
2022-05-28 14:33:10 +00:00
Markus Heiser
22d8971bc9
[translation] add DE translation of about.md and search-syntax.md
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-28 14:28:51 +02:00
Markus Heiser
7686739f56
Merge pull request #1242 from Linerly/indonesian-infopage
...
Add Indonesian translations of about.md and search-syntax.md
2022-05-28 12:06:00 +02:00
searxng-bot
69886253d6
[translations] update from Weblate
...
00f6ec8e76553d1e897c7b0abed737a19a0227e5f8598b81a181f9e31c0c69415b707d4d
2022-05-27 07:19:13 +00:00
Linerly
f3134e0869
Add Indonesian translations of about.md and search-syntax.md
2022-05-27 10:06:44 +07:00
Allen
13f4dcafc1
[fix] [new] Brave - Update xpath
...
Last merge request was messed up with git.
2022-05-26 18:44:11 +02:00
Alexandre Flament
c24864a9ad
Enable duckduckgo by default
...
see https://github.com/searxng/searxng/pull/1219#discussion_r879543174
2022-05-24 23:33:12 +02:00
Alexandre Flament
cea7b71d14
Disable the bing engine
...
see
* https://github.com/searxng/searxng/discussions/1209
* https://github.com/searxng/searxng/issues/941
* https://github.com/searxng/searxng/pull/1219
2022-05-24 23:33:08 +02:00
Alexandre Flament
d694b339c5
Merge pull request #1214 from dalf/update_template_image
...
Template images.html: always use JS to lazy load the full size images
2022-05-24 23:14:47 +02:00
searxng-bot
1911d63186
[translations] update from Weblate
...
fffd40d4ae4b92e4946e5e9cc758b17b0a73f5ad36c8c1a242fec22c43d1f4ed
2022-05-20 07:19:10 +00:00
Alexandre FLAMENT
0063427309
Template images.html: lazy by JS the full size image
...
Remove lazy loading by browser / width / height:
JS is required to display this HTML fragment anyway.
Simplify the HTML template.
2022-05-18 07:29:31 +00:00
Alexandre Flament
f814ac703b
Merge pull request #1202 from julianfairfax/master
...
Preferences URL in preferences
2022-05-15 20:42:37 +02:00
Julian Fairfax
7d443dfea3
Preferences URL in preferences
...
Revert translation changes
Auto-save preferences from URL
Preferences URL in preferences
Fix that
Preferences URL in preferences
2022-05-15 20:34:04 +02:00
Allen
6ef24ffd94
[enh] Add alexandria.org engine
...
engine: json_engine
official_api_documentation: https://github.com/alexandria-org/alexandria-api/raw/master/README.md
2022-05-15 11:10:15 +02:00
searxng-bot
6b29cddadb
[translations] update from Weblate
...
2842aa38c8fd2dee6336104f2419fe866ed911ebb6afcecaa250f3493506357bdbf772e9ee7c50368411acd2
2022-05-13 07:20:35 +00:00
mrpaulblack
bc89bb4790
[build] /static
2022-05-11 00:03:42 +02:00
mrpaulblack
392c9c4243
[simple theme] add products.html template
2022-05-11 00:03:21 +02:00
Léon Tiekötter
035a4eaa09
Merge pull request #1194 from mrpaulblack/fix-leaflet-src
...
[fix] loading of external resources in JS client toolkit
2022-05-10 23:24:24 +02:00
mrpaulblack
58d4086ce1
[build] /static
2022-05-10 23:06:44 +02:00
Paul Braeuning
b47e44a008
Merge pull request #1196 from unixfox/patch-2
...
Fix typo for the limiter plugin docs
2022-05-10 22:51:03 +02:00
Émilien Devos
66b77c46c7
Fix typo
2022-05-10 20:45:59 +00:00
Émilien Devos
06cb15cbf7
Reflect the real world parameter from settings.yml
2022-05-10 20:44:35 +00:00
mrpaulblack
33c0a9e410
[fix] loading of external resources in JS client toolkit
2022-05-10 22:40:46 +02:00
mrpaulblack
c69c61838b
[fix] autocomplete and infinite scroll persistence in preferences
...
* fixes a regression from https://github.com/searxng/searxng/pull/1186
2022-05-10 22:25:42 +02:00
mrpaulblack
6b124e5120
[build] /static
2022-05-10 21:58:22 +02:00
Monty
2115f6565e
[mod] simple theme: colors, autocomplete, border
...
* change colors, autocomplete, delete border in some places
2022-05-10 21:56:43 +02:00
Léon Tiekötter
18b8bbc017
[fix] PR 1186: GET method
...
PR https://github.com/searxng/searxng/pull/1186 prevented the GET method from being selected.
2022-05-10 17:47:53 +02:00
Alexandre Flament
1e45dbbae9
[build] /static
2022-05-07 19:43:20 +02:00
Alexandre Flament
9b3efa6d8a
theme: remove __common__
2022-05-07 19:40:48 +02:00
Markus Heiser
4326009d00
[format.python] based on bugfix in 9ed626130
2022-05-07 18:23:10 +02:00
Markus Heiser
8175290867
[build] /static
2022-05-07 17:58:53 +02:00
Markus Heiser
444b1e70db
[mod] add setting: search.autocomplete_min
...
Minimun characters to type before autocompleter starts.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-07 17:58:30 +02:00
Markus Heiser
ed2a4c8087
[mod] client_settings: pass settings from server to JS client
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-05-07 17:58:30 +02:00
Markus Heiser
3f18761adb
Revert "[build] /static"
2022-05-07 17:56:30 +02:00
Markus Heiser
0f18bfc8a5
[build] /static
2022-05-07 17:36:58 +02:00
Alexandre FLAMENT
550f70b1aa
Add support for the Silesian language
2022-05-06 09:40:45 +00:00
searxng-bot
12a584c5dd
[translations] update from Weblate
...
7d941719c3fa27740c5271783540a89fc517f467f9b9f6662b3dfa75bacd0922
2022-05-06 07:18:36 +00:00
Paul Braeuning
31521f3a46
Merge pull request #1153 from return42/drop-oscar
...
[theme] peel out oscar from SearXNG development
2022-05-03 18:47:35 +02:00
Markus Heiser
8a79eb4d7b
Merge pull request #1158 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-05-01 09:51:56 +02:00
Markus Heiser
6bd6e09e14
Merge pull request #1159 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-05-01 09:51:21 +02:00
Markus Heiser
9c7e9bf1d9
Merge pull request #1157 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-05-01 09:50:28 +02:00
Markus Heiser
9e6000407a
Merge pull request #1156 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-05-01 09:49:55 +02:00
dalf
6f0a717dce
Update searx.data - update_engine_descriptions.py
2022-05-01 06:33:42 +00:00
dalf
bdfbc0ec02
Update searx.data - update_currencies.py
2022-05-01 06:26:53 +00:00
dalf
6cb08a568a
Update searx.data - update_wikidata_units.py
2022-05-01 06:26:44 +00:00
dalf
10023344a5
Update searx.data - update_ahmia_blacklist.py
2022-05-01 06:26:33 +00:00
dalf
e36d7067a9
Update searx.data - update_firefox_version.py
2022-05-01 06:26:31 +00:00
Markus Heiser
c3bb6c7059
[upd] searx/translations/messages.pot
...
generated by::
./manage pyenv.cmd pybabel extract \
-F babel.cfg \
-o "searx/translations/messages.pot"\
"searx/"
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-30 13:20:27 +02:00
Markus Heiser
ad1aca6823
[theme] delete static/themes/oscar and templates/oscar
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
templates/oscar# gelöscht: searx/static/themes/oscar/fonts/glyphicons-halflings-regular.ttf
2022-04-30 13:20:27 +02:00
Markus Heiser
e8541b6006
[theme] peel out oscar from SearXNG development
...
This is the first step of removing oscar theme
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-30 13:20:27 +02:00
Markus Heiser
fa681580bf
Merge pull request #1150 from searxng/dependabot/pip/master/pygments-2.12.0
...
Bump pygments from 2.11.2 to 2.12.0
After each update of the pygments version, we (or github action) should [1]
1. update less files:
./manage pyenv.cmd searxng_extra/update/update_pygments.py
update: static/themes/oscar/src/generated/pygments-logicodev.less
update: static/themes/oscar/src/generated/pygments-pointhi.less
update: static/themes/simple/src/generated/pygments.less
2. rebuild the static files of each themes:
make static.build.commit
[1] https://github.com/searxng/searxng/pull/2#issuecomment-826958666
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-30 07:25:35 +02:00
Markus Heiser
0275f0f5ad
[upd] ./manage pyenv.cmd searxng_extra/update/update_pygments.py
...
After each update of the pygments version, we (or github action) should [1]
1. update less files:
./manage pyenv.cmd searxng_extra/update/update_pygments.py
update: static/themes/oscar/src/generated/pygments-logicodev.less
update: static/themes/oscar/src/generated/pygments-pointhi.less
update: static/themes/simple/src/generated/pygments.less
2. rebuild the static files of each themes:
make static.build.commit
[1] https://github.com/searxng/searxng/pull/2#issuecomment-826958666
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-30 07:12:39 +02:00
Markus Heiser
fcc177b6ed
Merge pull request #1151 from searxng/translations_update
...
Update translations
2022-04-30 07:03:22 +02:00
searxng-bot
4b77fc6acf
[translations] update from Weblate
...
07ad7224
2022-04-29 08:09:27 +00:00
Léon Tiekötter
02026bcc76
[fix] library genesis engine: xpath and url
...
Changed the xpath to use the official download mirror.
Changed the URL to libgen.fun as this is the official instance. (https://en.wikipedia.org/wiki/Library_Genesis )
2022-04-27 13:11:34 +02:00
Allen
624b58764a
[enh] Add pagination to Brave
...
Also added ```&spellcheck=1``` because now it is disabled by default, not returning any ```suggestion_xpath```.
2022-04-23 14:06:53 +02:00
capric98
8c7e6cc983
[fix] FutureWarning from lxml
...
Just in case if content is None, the original code will skip extract_text(), and
just append the None value to 'content'. So just add allow_none=True, and this
will return None without raising a ValueError in extract_text().
2022-04-22 16:09:36 +02:00
Markus Heiser
62982c8812
[fix] add back missing languages & regions (followup of PR #1071 )
...
In PR #1071 the language catalog of dailymotion has been cleaned up, before
there had been over 7000 "languages" in the catalog.
As a side effect of this clean-up the language & region catalog in SearXNG has
been reduced [1].
This patch reduce the ``min_engines_per_lang`` from 13 to 12 to get the missed
languages back in language & region catalog of SearXNG.
[1] 3bb62823ec (diff-f3f00db0f87f95b882624a192e0aac21525638af0b18c9514e765fcf1991678d)
2022-04-22 12:09:42 +02:00
dependabot[bot]
1974a85461
Bump grunt-contrib-uglify in /searx/static/themes/simple
...
Bumps [grunt-contrib-uglify](https://github.com/gruntjs/grunt-contrib-uglify ) from 5.1.0 to 5.2.1.
- [Release notes](https://github.com/gruntjs/grunt-contrib-uglify/releases )
- [Changelog](https://github.com/gruntjs/grunt-contrib-uglify/blob/main/CHANGELOG )
- [Commits](https://github.com/gruntjs/grunt-contrib-uglify/compare/v5.1.0...v5.2.1 )
---
updated-dependencies:
- dependency-name: grunt-contrib-uglify
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-04-22 09:28:01 +00:00
Markus Heiser
50bac93363
Merge pull request #1094 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/grunt-1.5.2
...
Bump grunt from 1.4.1 to 1.5.2 in /searx/static/themes/simple
2022-04-22 11:25:12 +02:00
Markus Heiser
cf644b413e
[test.pyright] suppress unneeded error & warning messages
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-22 11:16:41 +02:00
searxng-bot
9fd5d3b2ac
[translations] update from Weblate
...
9398019a2768987ddc9e7f98b223bd62715e7dac5c53a0ec5906fd34691702edcc8bb018ebfab76aa8ce22fae9b6e3c66266ea2e1729fbd80d0f52931b022583f2a71d933020678210f54679
2022-04-22 07:18:46 +00:00
Markus Heiser
4ab189315b
[build] /static
2022-04-19 09:37:58 +02:00
Markus Heiser
2bcd610eeb
[fix] add missing result.length and result.author to simple theme
...
Closes: https://github.com/searxng/searxng/issues/1027
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-19 09:37:41 +02:00
Alexandre Flament
e22dc2ba36
Merge pull request #1099 from dalf/update_engine_descriptions
...
Update engine descriptions
2022-04-17 11:37:36 +02:00
Alexandre Flament
bbf13a4657
Merge pull request #1101 from allendema/pass-cookies-from-settings
...
[enh] Allow passing headers/cookies from settings.yml
2022-04-17 11:37:07 +02:00
Allen
dae8a08089
[fix[ Update only cookies/headers
2022-04-17 11:29:23 +02:00
Allen
67fb6fba84
[lint] Remove whitespace
...
From GH GUI
2022-04-17 10:42:25 +02:00
Allen
f039873e1a
[mod] Make a default domain for ebay
...
Which can be changed.
2022-04-17 10:37:12 +02:00
Allen
15862ebc35
[mod] Pass desired ebay domain in settings
...
https://www.ebay.de
https://www.ebay.com
htttps://www.ebay.es
etc
2022-04-16 19:10:35 +02:00
Allen
155333f625
[enh] Allow passing headers/cookies from settings.yml
...
Example:
- engine: xpath
- search_url: example.org
- headers: {'example_header': 'example_header'}
- cookies: {'safesearch': 'off'}
2022-04-16 17:42:04 +02:00
Alexandre Flament
7bf9e12db9
Update searx.data - update_engine_descriptions.py
2022-04-16 13:17:39 +02:00
Alexandre Flament
c474616642
Merge pull request #1071 from return42/fix-lang-dailymotion
...
[fix] dailymotion engine: filter by language & country
2022-04-16 11:54:49 +02:00
Alexandre Flament
4224607c62
searx.utils.html_to_text: replace <br/> by a space
2022-04-16 09:45:57 +02:00
Alexandre Flament
1a82e79b50
dailymotion: send valid value for the language parameter
2022-04-16 09:27:34 +02:00
Markus Heiser
3bb62823ec
[fix] dailymotion engine: filter by language & country
...
- fix the issue of fetching more the 7000 *languages*
- improve the request function and filter by language & country
- implement time_range_support & safesearch
- add more fields to the response from dailymotion (allow_embed, length)
- better clean up of HTML tags in the 'content' field.
This is more or less a complete rework based on the '/videos' API from [1].
This patch cleans up the language list in SearXNG that has been polluted by the
ISO-639-3 2 and 3 letter codes from dailymotion languages which have never been
used.
[1] https://developers.dailymotion.com/tools/
Closes: https://github.com/searxng/searxng/issues/1065
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-16 09:27:34 +02:00
Vojtěch Fošnár
ccd8305465
Merge branch 'searxng:master' into master
2022-04-15 16:10:49 +02:00
searxng-bot
9109ad706d
[translations] update from Weblate
...
10e2e02d723fc2b48c3ef0ce19b08ebf5838445aa9541b968f9c7cee54ea2973
2022-04-15 07:18:31 +00:00
dependabot[bot]
e314cfe667
Bump grunt from 1.4.1 to 1.5.2 in /searx/static/themes/simple
...
Bumps [grunt](https://github.com/gruntjs/grunt ) from 1.4.1 to 1.5.2.
- [Release notes](https://github.com/gruntjs/grunt/releases )
- [Changelog](https://github.com/gruntjs/grunt/blob/main/CHANGELOG )
- [Commits](https://github.com/gruntjs/grunt/compare/v1.4.1...v1.5.2 )
---
updated-dependencies:
- dependency-name: grunt
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-04-15 07:11:47 +00:00
Vojtěch Fošnár
de4af2fefd
[enh] add seznam autocomplete
2022-04-14 03:02:05 +02:00
Jabster28
9eb1b04f48
change "Wolfram|Alpha" to "Wolfram Alpha" in search results
2022-04-12 10:37:33 +01:00
Alexandre Flament
27f8fa6fe0
Merge pull request #1048 from Linerly/patch-1
...
Improve the about page
2022-04-09 20:30:49 +02:00
Alexandre Flament
592cea0e5e
Merge pull request #1030 from austinhuang0131/master
...
(feat) add jisho.org
2022-04-09 18:57:20 +02:00
Alexandre Flament
74c7aee9ec
jisho : code refactoring
2022-04-09 18:01:57 +02:00
Alexandre Flament
e764427153
Merge branch 'master' into switch-md-parser
2022-04-09 15:24:11 +02:00
Markus Heiser
5e7f469911
Merge pull request #1051 from return42/fix-region-name
...
[fix] add missing territory (country) name
2022-04-09 14:54:43 +02:00
Paul Braeuning
02d64772f7
Merge pull request #1066 from unixfox/fix-icons-oscar
...
Revert "[fix] return correct favicon path"
2022-04-08 10:25:40 +02:00
Paul Braeuning
604d177551
Merge pull request #1064 from capric98/pretty-url
...
fix: %2F in path will be converted to " › " in searx/webapp.py
2022-04-08 10:08:51 +02:00
searxng-bot
01bbd1d0bd
[translations] update from Weblate
...
45fc8afeb187bba29d380d6603029129be15e57271fb0c50
2022-04-08 07:19:02 +00:00
Émilien Devos
cad3d93fa2
Revert "[fix] return correct favicon path"
...
This fixes https://github.com/searxng/searxng/issues/1057
This reverts commit f99d109ceb
2022-04-07 17:56:28 +00:00
HZH
c7de5c043c
fix: %2F in path will be converted to " › "
2022-04-07 23:15:58 +08:00
Markus Heiser
9215281232
[mod] replace Markdown parser mistletoe by markdown-it-py
...
There are several reasons why we should prefer markdown-it-py over mistletoe:
- Get identical rendering results in SearXNG's `/info` pages and the SearXNG's
project documentation which is build by Sphinx-doc.
In the Sphinx-doc we use the MyST parser to render Markdown and the MyST
parser itself is built on top of the markdown-it-py package.
- markdown-it-py has a typographer that supports *replacements*
and *smartquotes* (e.g. em-dash, copyright, ellipsis, ...) [1]
- markdown-it-py is much more flexible compared to mistletoe [2]
- markdown-it-py is the fastest CommonMark compliant parser in python [3]
[1] https://markdown-it-py.readthedocs.io/en/latest/using.html#typographic-components
[2] https://markdown-it-py.readthedocs.io/en/latest/plugins.html
[3] https://markdown-it-py.readthedocs.io/en/latest/other.html#performance
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-06 15:49:50 +02:00
mrpaulblack
170f0081c9
[build] /static
2022-04-06 15:07:42 +02:00
mrpaulblack
169f8d9988
[simple theme] add netloc to image result articles
2022-04-06 15:07:05 +02:00
Linerly
22309f398b
Fix spelling and punctuation
2022-04-06 12:36:17 +00:00
Markus Heiser
19ebd0e1ac
[mod] review of the "Search Syntax" page (en)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-06 14:13:22 +02:00
Markus Heiser
655db9b003
[mod] review of the "About SearXNG" page (en)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-06 13:05:20 +02:00
Markus Heiser
effcde3d0e
[fix] add missing territory (country) name
...
Related-to: https://github.com/searxng/searxng/pull/1029#issuecomment-1086824911
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-04-05 16:48:25 +02:00
HZH
57a3252ff1
Unquote path on result page.
2022-04-05 02:37:18 +08:00
Linerly
036b46493b
Improve the about page
2022-04-02 20:51:11 +00:00
Alexandre Flament
765504ceca
Merge pull request #1031 from dalf/fix-bing-_fetch_supported_languages
...
Fix bing fetch supported languages
2022-04-02 08:23:58 +02:00
Austin Huang
19fa0095a0
(fix) satisfy the linter, and btw reduce timeout
2022-04-01 09:23:24 -04:00
Austin Huang
a399248f56
update jisho.py according to suggestions
2022-04-01 09:18:19 -04:00
dependabot[bot]
b40d57df82
Bump grunt-contrib-uglify in /searx/static/themes/oscar
...
Bumps [grunt-contrib-uglify](https://github.com/gruntjs/grunt-contrib-uglify ) from 5.0.1 to 5.1.0.
- [Release notes](https://github.com/gruntjs/grunt-contrib-uglify/releases )
- [Changelog](https://github.com/gruntjs/grunt-contrib-uglify/blob/main/CHANGELOG )
- [Commits](https://github.com/gruntjs/grunt-contrib-uglify/compare/v5.0.1...v5.1.0 )
---
updated-dependencies:
- dependency-name: grunt-contrib-uglify
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-04-01 11:18:35 +02:00
dependabot[bot]
c199eadaf9
Bump grunt-contrib-uglify in /searx/static/themes/simple
...
Bumps [grunt-contrib-uglify](https://github.com/gruntjs/grunt-contrib-uglify ) from 5.0.1 to 5.1.0.
- [Release notes](https://github.com/gruntjs/grunt-contrib-uglify/releases )
- [Changelog](https://github.com/gruntjs/grunt-contrib-uglify/blob/main/CHANGELOG )
- [Commits](https://github.com/gruntjs/grunt-contrib-uglify/compare/v5.0.1...v5.1.0 )
---
updated-dependencies:
- dependency-name: grunt-contrib-uglify
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2022-04-01 11:18:29 +02:00
searxng-bot
556e137f8e
[translations] update from Weblate
...
74fb5882303aa2103eef1150fce33e06236dc6cb666e58493a6ee1c542a5f993
2022-04-01 07:18:22 +00:00
Markus Heiser
099840f4d6
Merge pull request #1035 from searxng/update_data_update_wikidata_units.py
...
Update searx.data - update_wikidata_units.py
2022-04-01 09:02:19 +02:00
Markus Heiser
b853ab717e
Merge pull request #1034 from searxng/update_data_update_ahmia_blacklist.py
...
Update searx.data - update_ahmia_blacklist.py
2022-04-01 09:01:48 +02:00
Markus Heiser
c2de356497
Merge pull request #1033 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-04-01 09:00:51 +02:00
dalf
086517d269
Update searx.data - update_wikidata_units.py
2022-04-01 06:27:23 +00:00
dalf
d245ca97ca
Update searx.data - update_ahmia_blacklist.py
2022-04-01 06:27:22 +00:00
dalf
084d9ab4e4
Update searx.data - update_currencies.py
2022-04-01 06:27:18 +00:00
dalf
4d55523247
Update searx.data - update_firefox_version.py
2022-04-01 06:27:13 +00:00
Alexandre FLAMENT
7d31b2c0af
Update languages
2022-03-31 20:04:46 +00:00
Alexandre FLAMENT
f00cdb5e51
bing engine: _fetch_supported_languages: don't use the language code as a country
...
ref #1029
2022-03-31 20:03:34 +00:00
Austin Huang
934ae4e086
(feat) add jisho.org
...
Closes #1016
2022-03-31 14:45:39 -04:00
Alexandre Flament
d1334beb4f
Merge pull request #1023 from austinhuang0131/master
...
[fix] return correct plugin path
2022-03-29 21:27:16 +02:00
Austin Huang
96b8aac826
Extra null safety
...
Co-Authored-By: Alexandre Flament <alex.andre@al-f.net>
2022-03-29 15:17:36 -04:00
Austin Huang
6353b850b0
[fix] merge fake "plugins" endpoint back to "static"
...
https: //matrix.to/#/!vxScbLNEAmRvOraXBn:matrix.org/$0zqTtH3s-eVKlMwiAgiEJdetOkRx27EIRs-C0o8FzSg?via=libera.chat&via=matrix.org&via=tchncs.de
Co-Authored-By: Alexandre Flament <alex.andre@al-f.net>
2022-03-29 13:02:21 -04:00
