Markus Heiser
76845ea42c
[mod] engine ask.com - parse JS result to JSON
...
Parse the result list from ask.com given in the variable named
window.MESON.initialState::
<script nonce="..">
window.MESON = window.MESON || {};
window.MESON.initialState = {"siteConfig": ...
...}};
window.MESON.loadedLang = "en";
</script>
The result list is in field::
json_resp['search']['webResults']['results']
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-18 09:17:22 +01:00
Hackurei
3df53d6e50
[feat] engine: implementation of ask.com
2024-02-18 09:17:22 +01:00
searxng-bot
2aef3a556f
[translations] update from Weblate
...
be989636e0e3455cb8edc279680e0d3b7f9ff68fc5440980f3846c711618f3a1d12e762fab319100b9854a5a4aebfb23f13
2024-02-16 15:48:10 +01:00
Bnyro
11c0651ef4
[fix] lingva: redirect and parsing error
2024-02-11 11:28:47 +01:00
dalf
bffc4905ce
Update searx.data - update_currencies.py
2024-02-10 23:55:41 +01:00
Markus Heiser
bfcd41f04a
[clean] drop obsolete py3.7 compatibility
...
- https://github.com/searxng/searxng/discussions/2356
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-10 09:27:19 +01:00
Hackurei
b0fe0924a3
[feat] engine: implementation of brave goggles
2024-02-10 08:09:50 +01:00
Markus Heiser
53898b8c37
[mod] footer: i18n for the link names in the footer
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-10 08:03:43 +01:00
Bnyro
7e1b5f6cc8
[feat] footer: support for custom entries
2024-02-10 08:03:43 +01:00
searxng-bot
459389a2da
[translations] update from Weblate
...
2b940307ee7cdce39e171fae67dd6a7604668cc4c51a92e76559ba
2024-02-09 08:15:45 +01:00
Markus Heiser
df1a774003
[fix] KeyError: 'title' in results using key-value.html template
...
Since #2508 a title is required --> this is a bug when an engine uses the
key-value.html template [1], where no title is needed.
[1] https://github.com/searxng/searxng/blob/master/searx/templates/simple/result_templates/key-value.html
Closes: https://github.com/searxng/searxng/issues/3130
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-06 07:53:39 +01:00
searxng-bot
11f918296f
[translations] update from Weblate
...
a001549469f220b2aa71951ae12a2f344a700f2944179f0d42961fa5cc1c6d5c5a39252dfa01c975851a86de3d4a55d6d8d3bb8adf1f1b2e23dcb7589d6bbcc04d8739c
2024-02-02 08:18:01 +01:00
Markus Heiser
be0d756ad5
[fix] libgen.fun is down, switch to libgen.rs
...
Closes: https://github.com/searxng/searxng/issues/3178
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-01 20:32:10 +01:00
allixx
6d31ca28b5
[fix] remove missing link icon macro
2024-02-01 08:13:43 +01:00
Hermógenes Oliveira
100a150a33
Remove rtl exception
...
This right-to-left exception doesn't seem to be called for.
2024-01-31 20:03:10 +01:00
Hermógenes Oliveira
f9f0c2ec03
Fix media exposure toggle
...
Make initially hidden and the toggle button consistent.
2024-01-31 20:03:10 +01:00
Hermógenes Oliveira
fa7fef7d87
Provide template for results in file category
...
This is used, for instance, by the recoll engine.
2024-01-31 20:03:10 +01:00
Markus Heiser
ab8e5383fb
[mod] remove X-XSS-Protection headers
...
Deprecated header not used by browsers nowadays[1]:
"""In modern browsers, X-XSS-Protection has been deprecated in favor of the
Content-Security-Policy to disable the use of inline JavaScript. Its use can
introduce XSS vulnerabilities in otherwise safe websites. This should not be
used unless you need to support older web browsers that don’t yet support CSP.
It is thus recommended to set the header as X-XSS-Protection: 0."""[2]
[1] https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/X-XSS-Protection
[2] https://infosec.mozilla.org/guidelines/web_security#x-xss-protection
Closes: https://github.com/searxng/searxng/issues/3171
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-31 17:23:41 +01:00
allixx
dca78f920f
[build] /static
2024-01-31 17:22:03 +01:00
allixx
c85f706601
[fix] wrong engines padding
2024-01-31 17:22:03 +01:00
allixx
30dcaf1db6
[fix] equalize cached/proxied links left margin
2024-01-31 17:22:03 +01:00
allixx
1e03094dee
[fix] justify engines/cached/proxied vertically
2024-01-31 17:22:03 +01:00
Markus Heiser
c14b117121
[fix] brave.search - update result selectors to fit to new layout
...
Closes: https://github.com/searxng/searxng/issues/3167
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-31 16:21:56 +01:00
Bnyro
efbee96b1d
[feat] brave: fix empty content and parse published dates
2024-01-30 07:41:45 +01:00
Bnyro
90072eb6ff
[build] /static
2024-01-29 18:09:22 +01:00
Bnyro
a5decfb838
[feat] preferences: button to copy input to restore preferences hash
2024-01-29 18:09:22 +01:00
Bnyro
559b860618
[feat] engine: implementation of goodreads
2024-01-29 16:07:24 +01:00
searxng-bot
a962aab9b0
[translations] update from Weblate
...
c1a3532a2603c6894b2920c734264cc1168a21ec41823
2024-01-29 15:01:37 +01:00
dalf
62fa85287a
Update searx.data - update_wikidata_units.py
2024-01-29 14:04:24 +01:00
dalf
0ed7548d83
Update searx.data - update_firefox_version.py
2024-01-29 14:04:03 +01:00
dalf
d763934a7a
Update searx.data - update_ahmia_blacklist.py
2024-01-29 14:03:03 +01:00
dalf
14f73ef3d9
Update searx.data - update_engine_traits.py
2024-01-29 14:02:30 +01:00
dalf
a393341403
Update searx.data - update_engine_descriptions.py
2024-01-29 13:34:12 +01:00
allixx
e4cf0a7d4f
[fix] do highlight replacement at once
...
Highlights all search queries in search result in one go.
Fixes the case where search query contains word from highlight HTML code,
which causes broken HTML to appear in search results.
Closes #3057
2024-01-29 13:15:37 +01:00
Bnyro
8c73aa772b
[fix] semantic scholar: bad request
2024-01-25 06:12:08 +01:00
searxng-bot
ab5d2f32bb
[translations] update from Weblate
...
0f8246b81ce23e8ce91112731cb
2024-01-19 08:29:29 +01:00
Émilien (perso)
7c80807bb8
Block HeadlessChrome ( #3116 )
2024-01-17 09:14:36 +01:00
Jinyuan Huang
9c5f9735cf
[fix] engine: safesearch parameter in Google Videos engine ( #2762 )
...
Closes: https://github.com/searxng/searxng/issues/2762
2024-01-16 15:29:09 +01:00
Markus Heiser
8762863ebf
[mod] presearch: set WEB timeout to 4sec & single network for all request
...
timeout: 4.0
The timeout of presearch-WEB is left up from the default of 3sec to 4sec. The
engine has to send two HTTP requests, they often exceed the default timeout of
3sec. Since all other presearch categories (images, videos, news) also have a
timeout of 4 sec, the WEB search should also have the same timeout.
network: presearch
Place all HTTP requests in the same network, named ``presearch``.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
Markus Heiser
e560d7e373
[mod] presearch: add language & region support
...
In Presearch there are languages for the UI and regions for narrowing down the
search. With this change the SearXNG engine supports a search by region. The
details can be found in the documentation of the source code.
To test, you can search terms like::
!presearch bmw :zh-TW
!presearch bmw :en-CA
1. You should get results corresponding to the region (Taiwan, Canada)
2. and in the language (Chinese, Englisch).
3. The context in info box content is in the same language.
Exceptions:
1. Region or language is not supported by Presearch or
2. SearXNG user did not selected a region tag, example::
!presearch bmw :en
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
Markus Heiser
a2c269bbac
[mod] presearch: hardening engine's response against KeyErrors
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
Bnyro
0a78f59aba
[fix] presearch: safesearch, time ranges, crash when no result found
2024-01-15 19:23:26 +01:00
Markus Heiser
87f18b98ec
[fix] SyntaxWarning: invalid escape sequence '\>'
...
This patch fixes issue reported by ``make test.unit``::
searx/search/checker/impl.py:39: SyntaxWarning: invalid escape sequence '\>'
rep = ['<' + tag + '[^\>]*>' for tag in HTML_TAGS]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 18:27:21 +01:00
searxng-bot
b0b2efdc8d
[translations] update from Weblate
...
3dafa37f3a641db83fa3d2b083fb6dec1f75eb76d8b8d
2024-01-13 09:33:41 +01:00
Markus Heiser
f9c5727ddc
[mod] get rid of ./utils/brand.env and its workflow
...
All the environments defined in ./utils/brand.env are generated on the fly, so
there is no longer a need to define the brand environment in this file and all
the workflows to handle this file.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-09 16:31:19 +01:00
Bnyro
3dea7e609b
[feat] autocompleter: implementation of stract (beta)
2024-01-07 11:18:16 +01:00
Bnyro
621e1313af
[feat] engine: implementation of stract (beta)
2024-01-07 11:18:16 +01:00
searxng-bot
c90dc201fc
[translations] update from Weblate
...
a04e3b59ca4d38784780521c1b3e909528152debd5992c4d54c3e51a0c9c025dc99d1390477e0114965dacdd306a20c8853
2024-01-06 16:20:13 +01:00
Émilien (perso)
3535377c9a
Searx to SearXNG change error message
2023-12-31 16:19:14 +01:00
searxng-bot
27e26b3d65
[translations] update from Weblate
...
966bbd849d4680cb39b2cf5fbaffa8654087fc759fe0bcf9b03bfd03bd7340088ffa01ec736c44d3fdd3a15279fd68404ee941e6023241dfd42d71ca048b0b
2023-12-29 08:48:24 +01:00
dalf
4647981419
Update searx.data - update_wikidata_units.py
2023-12-29 06:09:04 +01:00
dalf
a8cc101c35
Update searx.data - update_ahmia_blacklist.py
2023-12-29 06:08:35 +01:00
dalf
59a67f30c8
Update searx.data - update_firefox_version.py
2023-12-29 06:07:46 +01:00
dalf
81e8638de0
Update searx.data - update_currencies.py
2023-12-29 06:06:51 +01:00
Markus Heiser
d676ae8ab3
[build] /static
2023-12-28 19:15:04 +01:00
Jinyuan Huang
f6d797ef43
[fix] fix a display problem in the image detail preview.
2023-12-28 19:15:04 +01:00
Markus Heiser
0d47322ac8
[build] /static
2023-12-28 18:59:14 +01:00
ahmad-alkadri
07e846e91a
Prevent default browser behavior on click event
2023-12-28 18:59:14 +01:00
Markus Heiser
8dfc1dbc5c
[fix] engine - offical URL moved to https://lingva.thedaviddelta.com/
...
The ML top-level domain has been removed from Freenom ... moved the official
instance to https://lingva.thedaviddelta.com [1]
To test use translation syntax:
!lv en-de Alternative front-end for Google Translate
[1] https://fosstodon.org/@thedaviddelta/111376540936289966
Closes: https://github.com/searxng/searxng/issues/2718
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-25 09:57:35 +01:00
Markus Heiser
2863b0f6da
Update searx.data - update_engine_traits.py
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-24 08:28:32 +01:00
Markus Heiser
6df922b9da
[fix] fetch_traits of google and zlibrary
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-24 08:28:32 +01:00
Bnyro
d6ac2b5a55
[feat] engine: implementation of bahnhof.de
2023-12-23 17:38:38 +01:00
Markus Heiser
6129b16165
[mod] simplify no results on pages > 1 to "There are no more results."
...
BTW: remove not needed whitespaces in the generated HTML
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-23 09:50:39 +01:00
obfuscated-loop
2179a418c4
[mod] Change no results error message based on page number
2023-12-23 09:50:39 +01:00
Jay
b4de72a96f
[mod] Capitalize theme names/styles in theme.html view file
2023-12-23 09:07:08 +01:00
dependabot[bot]
26737fda1b
Bump sharp from 0.32.6 to 0.33.0 in /searx/static/themes/simple
...
Bumps [sharp](https://github.com/lovell/sharp ) from 0.32.6 to 0.33.0.
- [Release notes](https://github.com/lovell/sharp/releases )
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md )
- [Commits](https://github.com/lovell/sharp/compare/v0.32.6...v0.33.0 )
---
updated-dependencies:
- dependency-name: sharp
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-12-23 07:49:03 +01:00
Markus Heiser
3665b32aff
Revert "[fix] update user agent"
...
This reverts commit 3c6549a17fhttps://github.com/searxng/searxng/pull/2826
2023-12-23 07:48:38 +01:00
searxng-bot
518dd97c89
[translations] update from Weblate
...
fc2dfc1083938cfbac7b7286fba1d066d218
2023-12-23 07:40:02 +01:00
Bnyro
8a4104b992
[feat] engine: implementation of rotten tomatoes
2023-12-11 18:59:36 +01:00
Bnyro
dda74fc9c9
[feat] engine: implementation of mdn
2023-12-11 18:57:40 +01:00
Bnyro
b5b81c9806
[feat] engine: implementation of fyyd
2023-12-11 18:56:32 +01:00
Bnyro
527e13ab46
[feat] engine: implementation of podcastindex.org
2023-12-11 18:55:16 +01:00
Bnyro
3bc85c511c
[mod] tootfinder: implement python module
2023-12-11 18:54:24 +01:00
Brock Vojkovic
0bcff32dd7
[fix] update check.searx.space IP addresses
2023-12-11 15:21:02 +01:00
searxng-bot
574ed29d3e
[translations] update from Weblate
...
fa2970d07f19144327110f1b4dbc791e0c811f45cc83a5f93c2a390d735b7aa9cad06b0997554eaa22f4e19946d1dac8b5b5c57f6eb54e3908a204d2b58e4043a40da4d89f08502e
2023-12-08 08:42:24 +01:00
Markus Heiser
3829c253ff
[mod] add option max_page to bing, brave, qwant, startpage & mojeek
...
[1] https://github.com/searxng/searxng/issues/2982#issuecomment-1808975780
Reported-by: @Damaj301damaj-lol [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-03 13:47:17 +01:00
Markus Heiser
2274d55d5a
[mod] add option max_page
...
Related: https://github.com/searxng/searxng/issues/2982
Closes: https://github.com/searxng/searxng/issues/2972
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-03 13:47:17 +01:00
dalf
5a72977efa
Update searx.data - update_currencies.py
2023-11-29 06:34:25 +01:00
dalf
b18bef17a7
Update searx.data - update_engine_descriptions.py
2023-11-29 06:24:03 +01:00
dalf
a136b0b44d
Update searx.data - update_ahmia_blacklist.py
2023-11-29 06:18:21 +01:00
dalf
3ca84cb8d7
Update searx.data - update_wikidata_units.py
2023-11-29 06:17:32 +01:00
Bnyro
bf75a8c2a0
[feat] engine: implementation of bpb
2023-11-27 16:46:41 +01:00
Bnyro
04cfce2eb8
[feat] yep: support for images and news (and safesearch)
2023-11-27 15:07:26 +01:00
Markus Heiser
ee2675c999
[update] make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-27 14:43:43 +01:00
Markus Heiser
44392bd436
[mod] improve implementation of presearch engine
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-27 14:16:42 +01:00
Bnyro
23582aac5c
[feat] implementation of presearch engine
2023-11-27 14:16:42 +01:00
obfuscated-loop
99fb565b39
[mod] Retain page numbers even when there are no results
2023-11-27 14:07:04 +01:00
Bnyro
c3cc24be12
[feat] engine: implementation of destatis
2023-11-27 13:54:48 +01:00
searxng-bot
a36eae1d68
[translations] update from Weblate
...
d0511fe50e5d09a011111634b3329df37609bb415aca14b05dce9f2f730019b389a46a052620f6911716d7001d30f17f24cb7c4062e27ba200bc5
2023-11-27 07:32:05 +01:00
obfuscated-loop
cc6058057d
[build] /static
2023-11-23 07:30:56 +01:00
obfuscated-loop
355d2dc678
[fix] Remove anchor tag outline in image results
2023-11-23 07:30:56 +01:00
searxng-bot
e99ebb3dec
[translations] update from Weblate
...
e245d1bd08ee33fca31c8c1557c925c63f4115908183bdd57115ef9db7544d823ce4d1f2902b8bafd2350f4a0510e6293fd477881443556b2f6113133818f8
2023-11-22 09:43:45 +01:00
Jinyuan Huang
3601badd84
[build] /static
2023-11-14 13:34:44 +01:00
Jinyuan Huang
903449e0b5
[fix] Images cannot be clicked anymore #3006
...
URL in sidedbar only exists in HTTP POST requests. On HTTP GET requests the
selector ``#search_url button#copy_url`` results in a ``null`` type and a
``.style.display`` raises::
Uncaught TypeError: d.querySelector(...) is null
As a result, the initialization of the event handler is no longer carried out.
Closes: https://github.com/searxng/searxng/issues/3003
Suggested-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-14 13:28:50 +01:00
searxng-bot
79db70f2b7
[translations] update from Weblate
...
2b7f195db411951c72878199f48512f9981aadcaeb0c6acc01d46d32f1dd13caafe161aac910601c9
2023-11-12 20:54:35 +01:00
Jinyuan Huang
727de1c4ef
[build] /static
2023-11-10 13:28:28 +00:00
Jinyuan Huang
8adc7b0433
add a "copy" button to the "search-url" sidebar
2023-11-10 13:28:04 +00:00
searxng-bot
96ccec1aa6
[translations] update from Weblate
...
acdcdace831a1602a9a1d1070d3
2023-11-03 10:01:28 +01:00
Markus Heiser
b5a8ddfec8
Revert "[fix] limit maximum page number of a search query to page 50." ( #2979 )
...
This reverts commit 7e2e335dd1
2023-11-01 16:55:20 +00:00
Markus Heiser
d13a8f6453
[mod] document server:public_instance & remove it out of the botdetection
...
- the option server:public_instance lacks some documentation
- the processing of this option belongs in the limiter and not
in botdetection module
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-01 06:44:56 +01:00
Markus Heiser
fd814aac86
[mod] isolation of botdetection from the limiter
...
This patch was inspired by the discussion around PR-2882 [2]. The goals of this
patch are:
1. Convert plugin searx.plugin.limiter to normal code [1]
2. isolation of botdetection from the limiter [2]
3. searx/{tools => botdetection}/config.py and drop searx.tools
4. in URL /config, 'limiter.enabled' is true only if the limiter is really
enabled (Redis is available).
This patch moves all the code that belongs to botdetection into namespace
searx.botdetection and code that belongs to limiter is placed in namespace
searx.limiter.
Tthe limiter used to be a plugin at some point botdetection was added, it was
not a plugin. The modularization of these two components was long overdue.
With the clear modularization, the documentation could then also be organized
according to the architecture.
[1] https://github.com/searxng/searxng/pull/2882
[2] https://github.com/searxng/searxng/pull/2882#issuecomment-1741716891
To test:
- check the app works without the limiter, check `/config`
- check the app works with the limiter and with the token, check `/config`
- make docs.live .. and read
- http://0.0.0.0:8000/admin/searx.limiter.html
- http://0.0.0.0:8000/src/searx.botdetection.html#botdetection
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-01 06:44:56 +01:00
sev
b05a15540e
Check public_instance in simple theme
...
Fix #2975
2023-10-31 10:40:19 +01:00
Markus Heiser
7e2e335dd1
[fix] limit maximum page number of a search query to page 50.
...
To test this PR run a local instance and try to query page 51:
http://127.0.0.1:8888/search?q=foo&pageno=51
A parameter exception will be raised:
searx.exceptions.SearxParameterException: Invalid value "51" for parameter pageno
And the client will receive a HTTP 400 (Bad request).
Closes https://github.com/searxng/searxng/issues/2972
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-29 16:17:25 +01:00
dalf
b63841f0a1
Update searx.data - update_engine_traits.py
2023-10-29 09:04:24 +01:00
dalf
a9d778ee0f
Update searx.data - update_wikidata_units.py
2023-10-29 08:45:15 +01:00
dalf
92efb941d8
Update searx.data - update_firefox_version.py
2023-10-29 08:44:59 +01:00
dalf
fa494b9be3
Update searx.data - update_currencies.py
2023-10-29 08:44:35 +01:00
dalf
1b92ea4e70
Update searx.data - update_engine_descriptions.py
2023-10-29 08:44:17 +01:00
dalf
55e7cb3e33
Update searx.data - update_ahmia_blacklist.py
2023-10-29 08:17:29 +01:00
searxng-bot
6af8644ead
[translations] update from Weblate
...
4e5e5db44e1a8d350884bddfb89d67a4114d62fe8e3286e37ab9752cdab3247cf7ea72340ea31389322151e440e4eaf42b6
2023-10-27 09:23:23 +02:00
Markus Heiser
ef56e1d684
[fix] HTMLParser: undocumented not implemented method
...
In python versions <py3.10 there is an issue with an undocumented method
HTMLParser.error() [1][2] that was deprecated in Python 3.4 and removed
in Python 3.5.
To be compatible to higher versions (>=py3.10) an error method is implemented
which throws an AssertionError exception like the higher Python versions do [3].
[1] https://github.com/python/cpython/issues/76025
[2] https://bugs.python.org/issue31844
[3] https://github.com/python/cpython/pull/8562
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-22 10:35:02 +02:00
searxng-bot
01b5b9cb8e
[translations] update from Weblate
...
2325f15835090c6a8e3a38219d894a9f4164bdbeb4b30f9b483f487f1ca1997c5a701dc4
2023-10-20 10:44:11 +02:00
Markus Heiser
b013cbb4cc
[build] /static
2023-10-13 12:56:29 +02:00
Bnyro
df2e41c150
[fix] search.js: crash on homepage when setting form listeners
2023-10-13 12:56:29 +02:00
Émilien (perso)
4280318fc5
fixing results parsing brave
2023-10-13 11:47:30 +02:00
searxng-bot
ac82daf58d
[translations] update from Weblate
...
74e401e68897dd8db16ed046a90815ecb33665d9a0c2f3ec249ef953dc6c108
2023-10-13 09:20:54 +02:00
Hackurei
efada7cba2
[fix] hackernews keyerror problem
2023-10-13 08:16:47 +02:00
Hackurei
af071121de
[fix] imgur - incorrect wikidata id
2023-10-12 09:14:00 +02:00
Markus Heiser
14323d683f
[fix] ddg-lite & ddg-extra: don't send empty vqd value
...
DDG's bot detection is sensitive to the vqd value. For some search terms (such
as extremely long search terms that are often sent by bots), no vqd value can be
determined.
If SearXNG cannot determine a vqd value, then no request should go out to
DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting
SearXNG's IP on a block list.
Requests from IPs in this block list run into timeouts.
Not sure, but it seems the block list is a sliding window: to get my IP rid from
the bot list I had to cool down my IP for 1h (send no requests from that IP to
DDG).
Since such issues can't reproduce in a local instance I tested this patch 24h on
my public SearXNG instance: There are still errors (rare), but the reliability
is still 100%.
Related:
- https://github.com/searxng/searxng/pull/2922
- https://github.com/searxng/searxng/pull/2923
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-12 08:52:28 +02:00
Markus Heiser
3388441917
[fix] ddg-lite vqd value: some search terms do not have a vqd value
...
Some search terms do not have results and therefore no vqd value
BTW: remove a leftover from 9197efa
2023-10-10 09:12:30 +02:00
Markus Heiser
9197efa2a7
[fix] duckduckgo lite engine: set HTTP header 'Referer'
...
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].
From reverse engineering:
- The Referer ``https://google.com/ `` was set in commt 257dc7d6c4https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-10 08:40:53 +02:00
Bnyro
fa5b2a7948
[mod] yacy: use official instance by default and fix crashes
2023-10-09 20:50:24 +02:00
Alex Balgavy
5d53aac20f
[mod] add hotkeys option to settings.yml
...
The change in the hotkey mechanism introduced in 317db5b04Closes : #2898
2023-10-09 18:13:00 +02:00
Hackurei
ff78b1a902
[feat] implement hackernews engine - news.ycombinator.com
2023-10-09 14:00:04 +02:00
Aine
213cb74378
[fix] matrixrooms add proper MRS integration
...
Related:
- https://github.com/searxng/searxng/issues/2918
2023-10-09 13:25:13 +02:00
Bnyro
48cb58bd2e
[feat] duckduckgo: support for videos and news
2023-10-09 06:53:43 +02:00
Bnyro
c3ab49cd90
[fix] kickass: crash when no results
2023-10-07 11:48:23 +02:00
Bnyro
f22daf8b47
[mod] piped: always show video length if available
2023-10-07 11:45:46 +02:00
Bnyro
ce270961e8
[feat] engine: implementation of mastodon
2023-10-06 10:58:23 +02:00
searxng-bot
48f8ac48d1
[translations] update from Weblate
...
68d74328142f091b7f2479c0d7ba4e6cd5929d4e5f5c3b79d44775746291184f24d7e8b16140911f9
2023-10-06 09:19:00 +02:00
Markus Heiser
fd1422a670
[mod] engine - simplify region & lang handling, make filters configurable
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-05 10:55:08 +02:00
Bnyro
3e2ae756f0
[feat] engine: implementation of radio-browser.info
2023-10-05 10:55:08 +02:00
Markus Heiser
d56b31d674
[fix] limiter / botdetection: remove http_connection method
...
Related:
- https://github.com/searxng/searxng/issues/2892#issuecomment-1742153932
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-01 20:24:22 +02:00
Jinyuan Huang
e509cb7c45
[typo] solved a typo in yahoo error message.
2023-10-01 08:29:06 +02:00
Jinyuan Huang
d4d9f2073e
[fix] Bug: Yahoo results for simplified Chinese search sometimes have the first character cut off #2866
...
Co-authored-by: Blair Noctis <n@sail.ng>
2023-10-01 08:29:06 +02:00
Bnyro
fe9386b58d
[fix] emojipedia: fix engine
2023-10-01 08:19:45 +02:00
Markus Heiser
32a4ea350e
[fix] Revision of the Bing engines
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-01 08:01:38 +02:00
jazzzooo
079636c079
[fix] engine - bing fix search, pagination, remove safesearch
2023-10-01 08:01:38 +02:00
Bnyro
5ce1792432
[feat] engine: implementation of pinterest
2023-09-30 15:01:45 +02:00
Bnyro
6096457e4d
[fix] matrixrooms.info: pagination not working properly
2023-09-30 14:51:07 +02:00
Markus Heiser
e1a8b8189f
[fix] engine - moviepilot instead of thumbnail use img_src
...
Instead of thumbnail use img_src in the result item, otherwise the "movies"
categories looks clunky.
Related:
- b4e0d2eedc (r128785388)
2023-09-30 11:29:19 +02:00
Bnyro
159629c588
[mod] tagesschau: add option to only use tagesschau urls
2023-09-30 11:00:11 +02:00
Bnyro
2ca60a19fc
[feat] engine: implementation of matrixrooms.info
2023-09-30 09:09:23 +02:00
Bnyro
d1a3fc5be6
[feat] engine: implementation of tootfinder
2023-09-29 23:00:30 +02:00
Bnyro
fc4a20f734
[mod] add movies category for tmdb, imdb and moviepilot
2023-09-29 22:37:51 +02:00
Émilien (perso)
0330648b98
[mod] warn to info for failed ping limiter
2023-09-29 22:20:56 +02:00
Bnyro
26fed56d51
[mod] settings.yml: remove plugin settings for plugins that don't exist anymore
2023-09-29 11:26:49 +02:00
searxng-bot
9a065832e0
[translations] update from Weblate
...
80bbf74ef5d554ef71771fd1b90d412012c81ac171d0aa004c40cc47e729f89f85b28cc475ce5d58140ce0600921f343f714c80f80fdef3c859e4
2023-09-29 09:12:12 +02:00
dalf
ae2762eb78
Update searx.data - update_firefox_version.py
2023-09-29 06:58:11 +02:00
dalf
18da3d65c5
Update searx.data - update_ahmia_blacklist.py
2023-09-29 06:57:40 +02:00
dalf
4a66fa3e7d
Update searx.data - update_wikidata_units.py
2023-09-29 06:56:50 +02:00
dalf
9be6e20256
Update searx.data - update_engine_traits.py
2023-09-29 06:56:10 +02:00
dalf
d821ec44dd
Update searx.data - update_currencies.py
2023-09-29 06:55:04 +02:00
dalf
cdee5aa3b9
Update searx.data - update_engine_descriptions.py
2023-09-29 06:53:05 +02:00
Bnyro
75587d03a6
[fix] categories.html: can't select social media category using search on category select
2023-09-28 10:45:49 +02:00
jazzzooo
e37d775fa2
[fix] engine - currency fix and simplify
2023-09-28 08:29:38 +02:00
Jinyuan Huang
ae28d429c9
[fix] bilibili new api used
2023-09-28 08:24:51 +02:00
jazzzooo
1a66d74673
[fix] engine - kickass update url, fix parsing, use multiple mirrors
2023-09-27 10:19:41 +02:00
Markus Heiser
0c39064d60
Update searx.data - update_engine_traits.py
...
Update searx.data - update_engine_traits.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-27 09:12:38 +02:00
Markus Heiser
b428ccc5a0
[fix] engine brave - fetch traits (modified settings menu)
...
Brave has changed it settings menu fundamental. Region codes are no longer in
the HTML page, we have to read the regional codes from a JS:
https://cdn.search.brave.com/serp/v2/_app/immutable/chunks/parameters.734c106a.js
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-27 09:12:38 +02:00
Markus Heiser
3a456b1282
[fix] engine annas archive - fetch traits (modified xpath selectors)
...
Anna’s Archive has cleaned up their languages, available file extensions and
changed the HTML form.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-27 09:12:38 +02:00
Jinyuan Huang
1f835a9f1f
solve #2839
2023-09-25 23:01:14 +02:00
jazzzooo
3c6549a17f
[fix] update user agent
2023-09-25 22:46:22 +02:00
Emilien Devos
ffec8d1b4c
add warning about enabling public_instance setting
2023-09-25 22:31:14 +02:00
Emilien Devos
47721a3485
add new parameter called server.public_instance
...
for enabling by default advanced limiter functions
in the future allow us to add features just for the public instances
2023-09-25 22:31:14 +02:00
Jinyuan Huang
1df4588279
[build] /static
2023-09-25 17:45:21 +02:00
Jinyuan Huang
98366bcf90
[fix] settings icon invisble on mobile devices
2023-09-25 17:45:21 +02:00
Alexandre Flament
19383921d7
/config: expose limiter configuration
2023-09-24 11:01:11 +02:00
Émilien (perso)
1851f27154
[mod] remove twitter ( #2843 )
2023-09-24 08:32:53 +00:00
Markus Heiser
597c68b4aa
[doc] move dosc of botdetection from developer to admin section
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-23 14:00:03 +02:00
Bnyro
75c9de02d1
[feat] engine: implementation of imgur
2023-09-22 20:50:53 +02:00
Bnyro
fb72f71f0a
[fix] internet archive scholar: crash when there's no title
2023-09-22 18:49:39 +02:00
searxng-bot
0660d20e1d
[translations] update from Weblate
...
f27a3bbd4a97336d0a91e8946b319f53731edaf10bd75ab004b8b8cdedd99c9
2023-09-22 18:05:02 +02:00
Bnyro
95885e7f9f
[build] /static
2023-09-22 17:54:55 +02:00
Bnyro
8b0b6731fc
[fix] search.less: start page search view on mobile devices
2023-09-22 17:54:55 +02:00
Markus Heiser
71358e9c67
Revert "[fix] engine - duckduckgo vqd edge-case"
...
This reverts commit 102502a4f0
2023-09-22 09:31:25 +02:00
Bnyro
51236ae47a
[feat] engine: implementation of chefkoch.de
2023-09-21 17:23:59 +02:00
jazzzooo
8bcca0e620
[fix] engine - brave don't show ads
2023-09-21 16:55:39 +02:00
jazzzooo
b729542a66
[fix] engine - google images error when no results
2023-09-21 16:38:37 +02:00
Bnyro
f0df53673e
[mod] search-syntax.md: add tutorial about the feeling lucky feature
2023-09-21 15:17:23 +02:00
Bnyro
cc2e0537a3
[feat] engine: implementation of google icons/material design icons
2023-09-21 15:16:49 +02:00
Bnyro
c999cfb422
[feat] engine: implementation of wallhaven
2023-09-21 14:25:43 +02:00
jazzzooo
102502a4f0
[fix] engine - duckduckgo vqd edge-case
2023-09-20 20:05:06 +02:00
Markus Heiser
d013f51a25
[fix] Search on category select without JavaScript PR #2740
...
Small addendum to #2740 ; search_on_category_select is now no longer a plugin.
Related: https://github.com/searxng/searxng/pull/2740#issuecomment-1725437584
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 21:03:02 +02:00
Markus Heiser
0ce10046c4
[build] /static
2023-09-19 20:15:51 +02:00
ormai
a76c8e4101
Improve the layout of the search page on mobile
2023-09-19 20:15:51 +02:00
Émilien (perso)
33496e7f51
Switch back to qwant web normal API
2023-09-19 17:07:22 +02:00
Markus Heiser
043dcbf7c5
[fix] engine qwant (web-lite) - ignore advertising adds
...
Closes: https://github.com/searxng/searxng/issues/2812
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 17:06:56 +02:00
Markus Heiser
3ac7c40b6a
[build] /static
2023-09-19 11:15:25 +02:00
Emilien Devos
33e722f83b
better error message when no results found
2023-09-19 11:10:48 +02:00
Émilien (perso)
ad725ce7d7
wikipedia wikidata infobox + disable wikisource ( #2806 )
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 10:31:02 +02:00
Bnyro
dcee823345
[feat] implement feeling lucky feature
2023-09-19 09:40:57 +02:00
Markus Heiser
71508abcbf
[build] /static
2023-09-19 08:06:06 +02:00
Jinyuan Huang
2ec77ef813
[mod] reformatted keyBindingLayouts in JS client (default, vim)
2023-09-19 08:06:06 +02:00
Markus Heiser
317db5b04f
[mod] preferences: implement drop-down menu for hotkeys (default, vim)
...
Replace the on/off checkbox of the vim-hotkeys in the preferences by a drop-down
menu.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-19 08:06:06 +02:00
Markus Heiser
09935e2897
[build] /static
2023-09-18 21:29:11 +02:00
Bnyro
a55e0ac553
[feat] search on category select without JS
...
Co-authored-by: Alexandre Flament <alex@al-f.net>
2023-09-18 21:29:11 +02:00
Bnyro
efd3a2d6d1
[feat] engine: implementation of internet archive scholar
2023-09-18 18:12:00 +02:00
jazzzooo
223b3487c3
[fix] spelling
2023-09-18 16:20:27 +02:00
Markus Heiser
a9b6963971
[fix] engine - qwant delivers only 5 pages maximum
...
all qwant engines (incl qwant-lite) delivers only 5 pages maximum
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-18 01:43:43 +02:00
jazzzooo
da1446c5ed
[fix] engine - qwant wrong error type
2023-09-18 01:43:43 +02:00
Markus Heiser
7398d525c8
[fix] qwant: subsequent fix of commit d9dbcedeb
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-17 17:52:56 +02:00
Markus Heiser
d9dbcedeb6
[feat] implementation of qwant lite for web search
...
Related: https://github.com/searxng/searxng/issues/2719
Replace: https://github.com/searxng/searxng/pull/2748
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-17 16:53:25 +02:00
Bnyro
b4e0d2eedc
[feat] engine: implemenation of moviepilot (de)
2023-09-17 14:30:56 +02:00
jazzzooo
7dfcc3386e
[fix] tagesschau videos
2023-09-16 18:40:26 +02:00
Markus Heiser
89fbac5763
[build] /static
2023-09-16 13:45:43 +02:00
Jinyuan Huang
92d0c378e0
[fix] keyboard navigation / simple theme (UI)
...
- avoid loop select
- fix select next item in mixed result lists
Replaces: https://github.com/searxng/searxng/pull/2789
Closes: https://github.com/searxng/searxng/issues/2751
Closes: https://github.com/searxng/searxng/issues/2788
2023-09-16 13:45:43 +02:00
jazzzooo
ec540a967a
[fix] brave.videos
2023-09-15 22:00:09 +02:00
jazzzooo
27477f51fd
[fix] brave.news
2023-09-15 22:00:09 +02:00
Bnyro
140125e641
[feat] implementation of the movie database
2023-09-15 19:41:37 +02:00
searxng-bot
4eebb25882
[translations] update from Weblate
...
4f055ccb89edaacb09ccb3e8934206640415d8db608c26db95be680792cd970949ad5db80921f948e3677f0ccb2dea9cd3a5038588e86b63e980b858a8660b5852633d292d25097b8ae9d7a20989ccd21a1c309f3fc3ee5e679e7420db0cf7327ffb1f542814e225f26236007bea3da4568a854d931781efe60016a6044200f1431198e61bb7acd04327a418412274159ed21b385914b774daff7b45ec84146f8707383602051b050d9ee48d6e7a20cee77e20720420f44b6
2023-09-15 09:12:13 +02:00
Justas Zabulionis
41ef73ca3a
[fix] rumble redirect
2023-09-14 19:21:21 +02:00
Justas Zabulionis
b701ee257b
[fix] habrahabr
2023-09-14 18:43:14 +02:00
Justas Zabulionis
be888810ba
[fix] pubmed content being None
2023-09-14 18:40:15 +02:00
Justas Zabulionis
cf734e6008
[fix] engine - pub.dev
2023-09-14 18:07:55 +02:00
Justas Zabulionis
92d39de410
[fix] solidtorrents redirects
2023-09-14 18:03:21 +02:00
Justas Zabulionis
cf8a6cf6db
[fix] solidtorrents pagination
2023-09-14 18:03:21 +02:00
Justas Zabulionis
8172f89075
[fix] solidtorrents
2023-09-14 18:03:21 +02:00
jazzzooo
74600c028d
[fix] engine - Crossref
...
Crossref was broken on result types journal-issue and component .. The old code
had lots of assumptions, and broke during parsing. Now the assumptions are more
explicit and checked them with the API.
2023-09-14 17:39:23 +02:00
Markus Heiser
ed6a5a01bb
[build] /static
2023-09-14 16:26:10 +02:00
Jinyuan Huang
0984b00b7e
[mod] UI smooth scroll added / CSS scroll-behavior
...
This PR improves the UX by making auto-scroll more smoother. The css is changed
so all the auto-scroll will be smoother but User-scroll will not be influenced.
The scroll-behavior CSS property sets the behavior for a scrolling box when
scrolling is triggered by the navigation or CSSOM scrolling APIs.[1]
[1] https://developer.mozilla.org/en-US/docs/Web/CSS/scroll-behavior
2023-09-14 16:26:10 +02:00
Bnyro
bf7af99ef2
[mod] make data.traits: add Odysee
2023-09-13 21:41:33 +02:00
Bnyro
3568a3cafb
[feat] odysee: implement fetch_traits for language support
2023-09-13 21:41:33 +02:00
Bnyro
09c61dabc9
[mod] odysee: time range support
2023-09-13 21:41:33 +02:00
jazzzooo
b98907e91f
[fix] engine - piped.music incorrect timestamps
2023-09-13 21:39:37 +02:00
jazzzooo
6039dbf211
[fix] engine - invidious thumbnails
2023-09-13 11:37:42 +02:00
jazzzooo
ed3819bdd5
add inv.tux.pizza
2023-09-13 11:12:01 +02:00
jazzzooo
122b4342eb
remove invidious.snopyta.org
2023-09-13 11:12:01 +02:00
jazzzooo
e2a5e183cc
[fix] settings.yml - change default invidious instances
2023-09-13 11:12:01 +02:00
jazzzooo
b2fd6304bf
[fix] engine - openstreetmap currency rendering
2023-09-13 10:56:52 +02:00
jazzzooo
976b3e21c4
[fix] engine - pypi redirect
2023-09-12 21:14:48 +02:00
jazzzooo
54a3e03b45
[fix] engine - openstreetmap currency matching
2023-09-12 20:57:05 +02:00
Bnyro
64d9587ac8
[feat] new engine: svgrepo
2023-09-12 20:38:36 +02:00
Markus Heiser
aa1453db0c
[build] /static
2023-09-12 20:30:50 +02:00
Markus Heiser
a987672340
[mod] improve handling of the hotkeys
...
- KeyboardEvent: keyCode property is depricated, replaced by key property [2]
- the check for ifDetailOpened is not necessary, because the hotkeys are not
only applicable to image-results, by example:
`!goi !go !scc hello`
- Key bindings like h for help are to be used in general (not only in vim-mode)
[1] https://developer.mozilla.org/en-US/docs/Web/API/KeyboardEvent/keyCode
[2] https://developer.mozilla.org/en-US/docs/Web/API/KeyboardEvent/key
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-12 20:30:50 +02:00
Jinyuan Huang
e6b160da62
[feature] key bindings: left & right arrow are always on
2023-09-12 20:30:50 +02:00
jazzzooo
b189578b6b
[fix] engine - brave
2023-09-12 11:31:43 +02:00
Bnyro
f182abd6f8
[mod] library of congress: fix engine
2023-09-11 19:42:31 +02:00
Bnyro
e73a6f5d14
[fix] engine deviantart: review of the result-scrapper
...
The deviantart site changed and hence deviantart is currently unusable.
2023-09-11 13:22:36 +02:00
Markus Heiser
1f7366060e
[build] /static
2023-09-11 12:27:56 +02:00
Markus Heiser
935aed7ca4
[feature] dark theme for code highlighter in the result list
...
Closes: https://github.com/searxng/searxng/issues/1354
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-11 12:27:56 +02:00
Alexandre Flament
d07c006aed
Replace chompjs with pure Python code
...
The new implementation is good enough for the current usage (brave)
2023-09-09 13:02:36 +02:00
Markus Heiser
8e45ac4271
[build] /static
2023-09-09 00:39:51 +02:00
Markus Heiser
15a3dbf7a0
[fix] preferences - layout of the "special queries" tab
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-09 00:39:51 +02:00
Bnyro
9e83c0dedc
[feat] engine: implementation of Yummly
...
Co-authored-by: Markus Heiser <markus.heiser@damarit.de>
2023-09-08 11:47:13 +02:00
Bnyro
a3d7e9c285
[mod] utils.py: add markdown_to_text helper function
2023-09-08 11:47:13 +02:00
searxng-bot
c62605b3e3
[translations] update from Weblate
...
304f6af5c76a4b6496
2023-09-08 09:20:19 +02:00
Markus Heiser
019bd97f4b
[fix] settings.yml - fix docs-links in the comments
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-06 11:35:39 +02:00
Hackurei
1f21ac7d62
[feat] engine: implementation of bilibili https://www.bilibili.com
2023-09-05 22:53:03 +02:00
Markus Heiser
696c35d2c3
[fix] engine - duckduckgo_images / determination of vqd value incorrect
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-09-05 22:24:51 +02:00
