OwlBurst/Ponysearch
1
0
Fork 0
forked from Ponysearch/Ponysearch
Code Pull requests Activity
Ponysearch/searx/engines
History
Alexandre Flament 01e2648e93 Simplify search.py, basically updated PR #518 
The timeouts in settings.yml is about the total time (not only the HTTP request but also the prepare the request and parsing the response)
It was more or less the case before since the threaded_requests function ignores the thread after the timeout even the HTTP request is ended.

New / changed stats :
* page_load_time : record the HTTP request time
* page_load_count: the number of HTTP request
* engine_time : the execution total time of an engine
* engine_time_count : the number of "engine_time" measure

The avg response times in the preferences are the engine response time (engine_load_time / engine_load_count)

To sum up :
* Search.search() filters the engines that can't process the request
* Search.search() call search_multiple_requests function
* search_multiple_requests creates one thread per engine, each thread runs the search_one_request function
* search_one_request calls the request function, make the HTTP request, calls the response function, extends the result_container
* search_multiple_requests waits for the the thread to finish (or timeout)
2016-11-05 13:45:20 +01:00
..
__init__.py Simplify search.py, basically updated PR #518 2016-11-05 13:45:20 +01:00
archlinux.py Add missing blank lines after class or function definition. 2016-08-11 17:18:12 +07:00
base.py [enh] Add BASE engine in category Science. Basic and advanced search. 2016-03-29 16:17:17 +02:00
bing.py [enh] display number of results 2016-06-28 00:06:50 +02:00
bing_images.py add time range support for bing images 2016-11-01 17:58:29 +01:00
bing_news.py add time range search for bing news 2016-11-01 17:58:29 +01:00
blekko_images.py [fix] pep8 compatibilty 2016-01-18 12:47:31 +01:00
btdigg.py add digbt engine 2016-08-13 16:19:00 +02:00
currency_convert.py Fix anomalous backslash in string 2016-07-11 23:53:13 +07:00
dailymotion.py Merge pull request #308 from dalf/versions_upgrade 2015-05-02 14:58:32 -04:00
deezer.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
deviantart.py [fix] time range detection 2016-07-26 00:28:48 +02:00
dictzone.py [fix] unicode urls 2016-09-06 17:17:42 +02:00
digbt.py [fix] results with digbit don't truncate anymore 2016-09-20 16:11:33 -05:00
digg.py [fix] pep8 compatibilty 2016-01-18 12:47:31 +01:00
doku.py Fix query encoding 2016-04-05 13:31:49 +02:00
duckduckgo.py [fix] time range detection 2016-07-26 00:28:48 +02:00
duckduckgo_definitions.py [fix] compile regex in ddg_definitions 2016-04-19 12:46:15 -05:00
dummy.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
faroo.py [fix] pep8 compatibilty 2016-01-18 12:47:31 +01:00
fdroid.py Add F-Droid search engine 2016-03-27 03:50:44 +06:00
filecrop.py Fix quantity of blank lines after code object. 2016-07-10 21:44:27 +07:00
flickr.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
flickr_noapi.py add time range search for flickr 2016-11-01 17:58:29 +01:00
frinkiac.py fix pep8 errors 2016-02-04 21:01:44 +01:00
generalfile.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
gigablast.py [fix] gigablast redirect - closes #575 2016-06-12 00:07:54 +02:00
github.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
google.py [fix] time range detection 2016-07-26 00:28:48 +02:00
google_images.py [fix] google images paging - closes #571 2016-08-13 01:13:41 +02:00
google_news.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
ina.py Add INA search engine 2016-07-09 22:09:54 +02:00
json_engine.py [fix] behaviour for page_size>1 and first_page_num>0 2016-08-14 22:10:25 +10:00
kickass.py fix kickass torrents engine 2016-10-22 05:27:18 +02:00
mediawiki.py [fix] restrict wikipedia queries to the titles to avoid irrelevant results 2016-02-09 21:21:59 +01:00
mixcloud.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
nyaa.py Fix PEP8 warnings for Nyaa.py 2016-03-27 05:23:17 +06:00
openstreetmap.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
pdbe.py initial commit of pdbe engine 2016-10-13 00:40:38 +02:00
photon.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
piratebay.py [fix] piratebay tld according to wikipedia 2015-08-25 22:56:40 +02:00
qwant.py Removed the keywords from the settings in qwant engine 2015-06-02 22:11:47 +02:00
reddit.py [fix] incorrect URLs in Reddit results - closes #538 2016-04-16 16:22:31 +06:00
scanr_structures.py Add ScanR structures search engine 2016-07-12 15:47:04 +02:00
searchcode_code.py [fix] pep8 compatibilty 2016-01-18 12:47:31 +01:00
searchcode_doc.py [fix] pep8 compatibilty 2016-01-18 12:47:31 +01:00
seedpeer.py Added seepeer to config and added seepeer search parser 2016-09-05 14:51:02 -04:00
soundcloud.py Add missing blank lines after class or function definition. 2016-08-11 17:18:12 +07:00
spotify.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
stackoverflow.py [fix] pep8 compatibilty 2016-01-18 12:47:31 +01:00
startpage.py Fix anomalous backslash in string 2016-07-11 23:53:13 +07:00
subtitleseeker.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
swisscows.py Fix anomalous backslash in string 2016-07-11 23:53:13 +07:00
tokyotoshokan.py Fix anomalous backslash in string 2016-07-11 23:53:13 +07:00
torrentz.py Add Torrentz.eu search engine 2016-03-26 05:28:58 +06:00
translated.py [fix] unicode urls 2016-09-06 17:17:42 +02:00
twitter.py [fix] handle missing url in twitter results 2015-08-25 13:12:51 +02:00
vimeo.py Fix Vimeo engine. 2015-06-12 19:53:38 +02:00
wikidata.py [fix] merge infoboxes based on weight 2016-08-05 23:51:04 -05:00
wikipedia.py [fix] urls merge in infobox (#593) 2016-08-05 23:51:04 -05:00
wolframalpha_api.py Improving Wolfram Alpha search hit content 2016-09-10 17:42:19 -04:00
wolframalpha_noapi.py #607 - noapi fix 2016-09-10 17:43:12 -04:00
www1x.py [fix] pep8 compatibilty 2016-01-18 12:47:31 +01:00
www500px.py Fix anomalous backslash in string 2016-07-11 23:53:13 +07:00
xpath.py [fix] behaviour for page_size>1 and first_page_num>0 2016-08-14 22:10:25 +10:00
yacy.py update versions.cfg to use the current up-to-date packages 2015-05-02 15:45:17 +02:00
yahoo.py [fix] time range detection 2016-07-26 00:28:48 +02:00
yahoo_news.py Fix anomalous backslash in string 2016-07-11 23:53:13 +07:00
yandex.py [fix] swisscow and yandex escaping - fixes #499 2016-01-23 15:20:36 +01:00
youtube_api.py Adds two engines : Youtube with or without API 2015-05-31 00:25:59 +02:00
youtube_noapi.py add time range search for youtube noapi 2016-11-01 17:58:29 +01:00