142 commits

Author	SHA1	Message	Date
Starbeamrainbowlabs	24775724d1	Bugfix: Correctly calculate the end offset of search context snippets	2018-09-29 13:27:17 +01:00
Starbeamrainbowlabs	284b404946	Typos in comments	2018-09-12 21:27:51 +01:00
Starbeamrainbowlabs	31d555f482	Bump version of search module	2018-07-01 12:14:06 +01:00
Starbeamrainbowlabs	1f6f780177	Restyle matching tags in search results	2018-06-30 11:46:07 +01:00
Starbeamrainbowlabs	8955d6d131	Save the character offset, not the token offset in the inverted index	2018-06-30 11:19:38 +01:00
Starbeamrainbowlabs	cdee30c286	Add $capture_offsets option to tokenize(). ... TODO: Utilise this in the indexer & update the changelog mentioning that _all_ inverted indexes will need to be rebuilt	2018-06-30 00:08:57 +01:00
Starbeamrainbowlabs	8403ffd5c3	Bugfix: Increment $i when we hit a stop word when indexing. ... There's also another bug here - in that the offsets generated contain are the index in the array of tokens, when we need it to be the index in the source text!	2018-06-29 23:51:10 +01:00
Starbeamrainbowlabs	9d7a21e993	Format the index action nicely	2018-06-29 12:08:38 +01:00
Starbeamrainbowlabs	19e49777b2	Search System; Don't bother getting a page's id if we don't need to	2018-06-26 14:28:11 +01:00
Starbeamrainbowlabs	3d3b6c491a	Seriously optimise the search system via some profiling.	2018-06-26 14:15:19 +01:00
Starbeamrainbowlabs	67648199d7	Add search time header for analysis purposes	2018-06-26 00:11:01 +01:00
Starbeamrainbowlabs	75b6b6c55f	Optimise the search context extractor, but evediently there's more work to be done.	2018-06-26 00:06:20 +01:00
Starbeamrainbowlabs	93494b6729	Transliterate in the suggest-pages action too	2018-06-25 23:03:00 +01:00
Starbeamrainbowlabs	49b91aa6f9	Search: Transliterate characters so you don't have to remember the diacritics when searching	2018-06-25 22:53:53 +01:00
Starbeamrainbowlabs	d1a10207d1	Made rebuilding search idnex progress bar fill up completely when done	2018-04-07 13:47:39 +01:00
Starbeamrainbowlabs	893492c5a6	Finish up enhancements to search system. ... I _think_ it works with utf-8 everywhere in the search system? I'm not sure - lots of testing is needed. Fortunately, I know just where to do such testing.....	2018-03-18 16:52:55 +00:00
Starbeamrainbowlabs	3dc505992d	Nuke all usages of utf8_encode, as I misunderstood what it did.	2018-03-18 16:37:25 +00:00
Starbeamrainbowlabs	24efac3c5e	Enhance utf8 support in id index & search system, but there's more work to be done.	2018-03-18 16:19:13 +00:00
Starbeamrainbowlabs	20e7c9f0fb	Minor update to apidoc comment - not worth rebuilding them over :-)	2018-02-14 23:10:20 +00:00
Starbeamrainbowlabs	90acf38f9d	Add json support to search action! :D	2018-02-14 23:08:28 +00:00
Starbeamrainbowlabs	b493476b5d	Bump version of search module	2018-02-04 13:49:52 +00:00
Starbeamrainbowlabs	0fb79ca68c	Fix forward slashes in search queries	2018-02-04 13:48:11 +00:00
Starbeamrainbowlabs	f9ad937a21	Comment feature-search with phpDoc & update docs	2017-11-20 20:40:59 +00:00
Starbeamrainbowlabs	edba3b9bf3	Update search to take the length of words into account. Fixes #134.	2017-10-15 13:42:15 +01:00
Starbeamrainbowlabs	73637fe963	Display tag names next to page names in the search results. Fixes #93.	2017-10-14 22:48:58 +01:00
Starbeamrainbowlabs	3b00f56485	Search tags as well as pages	2017-09-19 17:32:52 +01:00
Starbeamrainbowlabs	179c4b500d	Escape html in search result previews	2017-08-26 12:40:33 +01:00
Starbeamrainbowlabs	a90b72e3ad	Use rawurlencode / htmlentities in more places	2017-07-29 10:44:58 +01:00
Starbeamrainbowlabs	3266e39e03	Fix opensearch description	2017-07-16 10:26:22 +01:00
Starbeamrainbowlabs	1236ce8e4d	Add search index rebuilding action to master settings screen	2017-07-11 20:21:20 +01:00
Starbeamrainbowlabs	576b293c4e	Update apidoc comment & changelog	2017-07-10 22:10:18 +01:00
Starbeamrainbowlabs	80158541cb	Make invindex-rebuild admin only, but allow access via a POST request with the secret attached	2017-07-10 22:06:41 +01:00
Starbeamrainbowlabs	c2dcf43bc2	Add progress to invindex-rebuild - ready for addition to the master control panel	2017-07-10 21:53:52 +01:00
Starbeamrainbowlabs	51cea83402	Merge branch ikisler's preview-changes branch into master	2017-07-03 18:14:27 +01:00
Starbeamrainbowlabs	e9381da756	Fix permissions	2017-07-03 18:05:57 +01:00
Starbeamrainbowlabs	57acbc85b8	Add rawurlencode() calls everywhere in the redirect logic to fix #139	2017-06-28 11:42:11 +01:00
Starbeamrainbowlabs	4ea4315c5a	Allow access to opensearch-description when not logged in, and make opsearch description use search-redirect	2017-06-28 11:21:42 +01:00
Starbeamrainbowlabs	60ebd1340c	Improve dynamic page suggestions, and add option to output OpenSearch-compatible search suggestions	2017-06-28 10:44:44 +01:00
Starbeamrainbowlabs	eb137df2b4	Fix apidoc comments & update api docs	2017-06-28 09:45:13 +01:00
Starbeamrainbowlabs	677e1340aa	Fight the build system to make open search work. I win! I should really consider upgrading it though.	2017-06-06 21:33:11 +01:00
Starbeamrainbowlabs	96fcbb90de	Bugfix: Don't search page titles and tags for stop words	2017-03-23 21:25:55 +00:00
Starbeamrainbowlabs	313bcc7edf	Add method to return raw search result information as json	2017-03-23 21:13:20 +00:00
Starbeamrainbowlabs	d83bbb3527	Clear out the id index when rebuilding the inverted index - it sometimes goes all funny otherwise, apparently	2017-03-23 20:48:42 +00:00
Starbeamrainbowlabs	d19d83d99a	Make page names that are redirects italics in search results.	2017-03-20 20:21:25 +00:00
Starbeamrainbowlabs	8404b0cec6	Default to snippet from the page source in search result context generation - some pages may appear when the search terms appear only in the title or tags, and not the page source.	2017-03-20 20:08:56 +00:00
Starbeamrainbowlabs	5d9e464ce5	Improve search performance - fixes #130	2017-01-26 20:55:46 +00:00
Starbeamrainbowlabs	1fe9ffd775	Make dynaimc page suggestor faster. Fixes #124.	2016-11-28 14:05:23 +01:00
Starbeamrainbowlabs	46e89762af	Bump version of feature-search	2016-11-20 13:28:35 +00:00
Starbeamrainbowlabs	44e2348ab2	Add initial dynamic page suggestions. Works better in Firefox than chrome - implements idea in #113	2016-11-20 13:24:35 +00:00
Starbeamrainbowlabs	81bcef9a24	Improve search engine indexer. Fixes #117. ... It is now more liberal when deciding on word boundaries.	2016-10-25 21:12:39 +01:00
Starbeamrainbowlabs	73a09e8365	Bump versions of modules.	2016-10-18 18:58:19 +01:00
Starbeamrainbowlabs	6476877c60	Attempted to implement Opensearch (#112), but it doesn't work :/	2016-10-18 18:57:24 +01:00
Starbeamrainbowlabs	f18da4858b	Remove full stop from apidoc comment	2016-08-26 17:55:50 +01:00
Starbeamrainbowlabs	d9b5bdfb3e	Add debug idindex-show action.	2016-08-26 17:47:46 +01:00
Starbeamrainbowlabs	ca89ccd33d	Bugfix: Pageindex data for parent pages disappears when a child page is edited. Fixes #98.	2016-08-21 21:02:36 +01:00
Starbeamrainbowlabs	7589605c81	Bump version of feature-search	2016-08-21 10:59:41 +00:00
Starbeamrainbowlabs	84f6005db0	Added search time to searchr results page	2016-08-20 11:35:04 +01:00
Starbeamrainbowlabs	6c4c00b156	Added size + decode time for major indexes	2016-08-20 11:27:26 +01:00
Starbeamrainbowlabs	e3683f218f	Bump versions of modules	2016-08-19 19:54:27 +01:00
Starbeamrainbowlabs	aae9365f5a	Refine appearance of search contexts.	2016-08-19 13:47:56 +01:00
Starbeamrainbowlabs	b8dd51d1a1	Bugfix: Fully correct search context generation. Fixes #30. ... Also, fixed a critical security issue in the search context generation which would allow an editor to inject code into the user's browser.	2016-08-19 13:02:42 +01:00
Starbeamrainbowlabs	c5017919a1	Half fixed search context generation for #30. ... The problem: The matches were being sorted in the wrong direction. Next up we need to improve the context generation, as there are several contexts that are being generated without the keywork in question in them.	2016-08-19 12:02:09 +01:00
Starbeamrainbowlabs	ade3d15bca	Add class to search term highlighting. Fixes #92.	2016-08-19 10:06:21 +01:00
Starbeamrainbowlabs	27acc2420b	Make sure that all files are stored in the data directories. ... Fixes #89.	2016-08-19 10:00:03 +01:00
Starbeamrainbowlabs	77ffa2bcfc	apidoc is awesome. document a bunch of stuff, more to go	2016-06-12 21:15:43 +01:00
Starbeamrainbowlabs	cec847fd67	Update version numbers of modules. ... I forgot to do this before.... :P	2016-03-24 13:11:05 +00:00
Starbeamrainbowlabs	f6f38adae3	Improved "there isn't a page..." message on search page. Fixes #49.	2016-03-12 19:02:36 +00:00
Starbeamrainbowlabs	111d95081f	Update feature-search's description.	2016-03-12 18:52:26 +00:00
Starbeamrainbowlabs	03552b979f	Small optimisation to search queries	2015-12-26 13:06:45 +00:00
Starbeamrainbowlabs	801369387d	Cleaned up comments and added more title texts.	2015-12-26 12:55:19 +00:00
Starbeamrainbowlabs	d55132fd19	Rebuild the inverted index if it doesn't exist on search.	2015-12-05 17:27:01 +00:00
Starbeamrainbowlabs	b139f204b4	Debug the pageindex regenerator. Fixes #41.	2015-11-14 21:24:57 +00:00
Starbeamrainbowlabs	0e3a7f345a	Properly escape search terms in the context highlighter.	2015-11-14 17:02:57 +00:00
Starbeamrainbowlabs	b539cb4107	Also delete from searchindex when deleting a page. Speculative fix for #35, but it seems #41 needs fixing first.	2015-11-14 17:01:23 +00:00
Starbeamrainbowlabs	05026b9045	Bugfix the inverted index. Fixes #34.	2015-11-11 18:42:12 +00:00
Starbeamrainbowlabs	e7dfda5f75	Umm I forgot to add to the globals list... :P	2015-11-09 07:25:28 +00:00
Starbeamrainbowlabs	c7348d9c74	Begin updating module to use the new path system. Currently untested.	2015-11-08 21:15:08 +00:00
Starbeamrainbowlabs	8a86c01840	Erm right	2015-11-02 14:42:38 +00:00
Starbeamrainbowlabs	173a72fa46	Search page title and tags	2015-11-01 15:05:54 +00:00
Starbeamrainbowlabs	1c58a64134	Bugfix index comparison. I think this fixes #29.	2015-11-01 14:26:13 +00:00
Starbeamrainbowlabs	e79e522d78	Integrate search into top bar	2015-11-01 10:13:35 +00:00
Starbeamrainbowlabs	3baf2535ab	Add resultl number to left hand side of result	2015-10-31 14:16:19 +00:00
Starbeamrainbowlabs	559191757f	Add search box to search page	2015-10-31 14:05:00 +00:00
Starbeamrainbowlabs	77e4cdcc7d	Refactor context highlighter out of context extraction	2015-10-31 13:52:50 +00:00
Starbeamrainbowlabs	5a3a501c08	Add todo comments - I'm out of time now.	2015-10-29 11:32:45 +00:00
Starbeamrainbowlabs	4157a9fb6c	Begin interface work. Why is the <strong> being inserted into another <strong>???	2015-10-29 11:21:04 +00:00
Starbeamrainbowlabs	e016c5f9a7	begin writing the search engine itself O.o	2015-10-28 20:56:10 +00:00
Starbeamrainbowlabs	29acc3a5e2	More work on inverted indexes. I think we're getting there.	2015-10-28 14:31:27 +00:00
Starbeamrainbowlabs	777a27064e	Erm right. More line ending weirdness....?	2015-10-28 11:36:07 +00:00
Paul Bryan-Smith	221c61a1b3	Refine indexer by removing 'stop words'. ... More information at https://en.wikipedia.org/wiki/Stop_words	2015-10-28 09:14:41 +00:00
Starbeamrainbowlabs	725452a172	Continue working on indexer. Why is it converting to html entities....?	2015-10-28 08:03:56 +00:00
Starbeamrainbowlabs	db7bf0f7ec	begin playing around with indexing	2015-10-27 21:10:05 +00:00