Commit Graph

142 Commits

Author SHA1 Message Date
Starbeamrainbowlabs 24775724d1
Bugfix: Correctly calculate the end offset of search context snippets 2018-09-29 13:27:17 +01:00
Starbeamrainbowlabs 284b404946
Typos in comments 2018-09-12 21:27:51 +01:00
Starbeamrainbowlabs 31d555f482
Bump version of search module 2018-07-01 12:14:06 +01:00
Starbeamrainbowlabs 1f6f780177
Restyle matching tags in search results 2018-06-30 11:46:07 +01:00
Starbeamrainbowlabs 8955d6d131
Save the character offset, not the token offset in the inverted index 2018-06-30 11:19:38 +01:00
Starbeamrainbowlabs cdee30c286
Add $capture_offsets option to tokenize().
TODO: Utilise this in the indexer & update the changelog mentioning that
_all_ inverted indexes will need to be rebuilt
2018-06-30 00:08:57 +01:00
Starbeamrainbowlabs 8403ffd5c3
Bugfix: Increment $i when we hit a stop word when indexing.
There's also another bug here - in that the offsets generated contain
are the index in the array of tokens, when we need it to be the index in
the source text!
2018-06-29 23:51:10 +01:00
Starbeamrainbowlabs 9d7a21e993
Format the index action nicely 2018-06-29 12:08:38 +01:00
Starbeamrainbowlabs 19e49777b2
Search System; Don't bother getting a page's id if we don't need to 2018-06-26 14:28:11 +01:00
Starbeamrainbowlabs 3d3b6c491a
Seriously optimise the search system via some profiling. 2018-06-26 14:15:19 +01:00
Starbeamrainbowlabs 67648199d7
Add search time header for analysis purposes 2018-06-26 00:11:01 +01:00
Starbeamrainbowlabs 75b6b6c55f
Optimise the search context extractor, but evediently there's more work to be done. 2018-06-26 00:06:20 +01:00
Starbeamrainbowlabs 93494b6729
Transliterate in the suggest-pages action too 2018-06-25 23:03:00 +01:00
Starbeamrainbowlabs 49b91aa6f9
Search: Transliterate characters so you don't have to remember the diacritics when searching 2018-06-25 22:53:53 +01:00
Starbeamrainbowlabs d1a10207d1
Made rebuilding search idnex progress bar fill up completely when done 2018-04-07 13:47:39 +01:00
Starbeamrainbowlabs 893492c5a6
Finish up enhancements to search system.
I _think_ it works with utf-8 everywhere in the search system? I'm not
sure - lots of testing is needed. Fortunately, I know just where to do
such testing.....
2018-03-18 16:52:55 +00:00
Starbeamrainbowlabs 3dc505992d
Nuke all usages of utf8_encode, as I misunderstood what it did. 2018-03-18 16:37:25 +00:00
Starbeamrainbowlabs 24efac3c5e
Enhance utf8 support in id index & search system, but there's more work to be done. 2018-03-18 16:19:13 +00:00
Starbeamrainbowlabs 20e7c9f0fb
Minor update to apidoc comment - not worth rebuilding them over :-) 2018-02-14 23:10:20 +00:00
Starbeamrainbowlabs 90acf38f9d
Add json support to search action! :D 2018-02-14 23:08:28 +00:00
Starbeamrainbowlabs b493476b5d
Bump version of search module 2018-02-04 13:49:52 +00:00
Starbeamrainbowlabs 0fb79ca68c
Fix forward slashes in search queries 2018-02-04 13:48:11 +00:00
Starbeamrainbowlabs f9ad937a21 Comment feature-search with phpDoc & update docs 2017-11-20 20:40:59 +00:00
Starbeamrainbowlabs edba3b9bf3 Update search to take the length of words into account. Fixes #134. 2017-10-15 13:42:15 +01:00
Starbeamrainbowlabs 73637fe963 Display tag names next to page names in the search results. Fixes #93. 2017-10-14 22:48:58 +01:00
Starbeamrainbowlabs 3b00f56485 Search tags as well as pages 2017-09-19 17:32:52 +01:00
Starbeamrainbowlabs 179c4b500d Escape html in search result previews 2017-08-26 12:40:33 +01:00
Starbeamrainbowlabs a90b72e3ad Use rawurlencode / htmlentities in more places 2017-07-29 10:44:58 +01:00
Starbeamrainbowlabs 3266e39e03 Fix opensearch description 2017-07-16 10:26:22 +01:00
Starbeamrainbowlabs 1236ce8e4d Add search index rebuilding action to master settings screen 2017-07-11 20:21:20 +01:00
Starbeamrainbowlabs 576b293c4e Update apidoc comment & changelog 2017-07-10 22:10:18 +01:00
Starbeamrainbowlabs 80158541cb Make invindex-rebuild admin only, but allow access via a POST request with the secret attached 2017-07-10 22:06:41 +01:00
Starbeamrainbowlabs c2dcf43bc2 Add progress to invindex-rebuild - ready for addition to the master control panel 2017-07-10 21:53:52 +01:00
Starbeamrainbowlabs 51cea83402 Merge branch ikisler's preview-changes branch into master 2017-07-03 18:14:27 +01:00
Starbeamrainbowlabs e9381da756 Fix permissions 2017-07-03 18:05:57 +01:00
Starbeamrainbowlabs 57acbc85b8 Add rawurlencode() calls everywhere in the redirect logic to fix #139 2017-06-28 11:42:11 +01:00
Starbeamrainbowlabs 4ea4315c5a Allow access to opensearch-description when not logged in, and make opsearch description use search-redirect 2017-06-28 11:21:42 +01:00
Starbeamrainbowlabs 60ebd1340c Improve dynamic page suggestions, and add option to output OpenSearch-compatible search suggestions 2017-06-28 10:44:44 +01:00
Starbeamrainbowlabs eb137df2b4 Fix apidoc comments & update api docs 2017-06-28 09:45:13 +01:00
Starbeamrainbowlabs 677e1340aa Fight the build system to make open search work. I win! I should really consider upgrading it though. 2017-06-06 21:33:11 +01:00
Starbeamrainbowlabs 96fcbb90de Bugfix: Don't search page titles and tags for stop words 2017-03-23 21:25:55 +00:00
Starbeamrainbowlabs 313bcc7edf Add method to return raw search result information as json 2017-03-23 21:13:20 +00:00
Starbeamrainbowlabs d83bbb3527 Clear out the id index when rebuilding the inverted index - it sometimes goes all funny otherwise, apparently 2017-03-23 20:48:42 +00:00
Starbeamrainbowlabs d19d83d99a Make page names that are redirects italics in search results. 2017-03-20 20:21:25 +00:00
Starbeamrainbowlabs 8404b0cec6 Default to snippet from the page source in search result context generation - some pages may appear when the search terms appear only in the title or tags, and not the page source. 2017-03-20 20:08:56 +00:00
Starbeamrainbowlabs 5d9e464ce5 Improve search performance - fixes #130 2017-01-26 20:55:46 +00:00
Starbeamrainbowlabs 1fe9ffd775 Make dynaimc page suggestor faster. Fixes #124. 2016-11-28 14:05:23 +01:00
Starbeamrainbowlabs 46e89762af Bump version of feature-search 2016-11-20 13:28:35 +00:00
Starbeamrainbowlabs 44e2348ab2 Add initial dynamic page suggestions. Works better in Firefox than chrome - implements idea in #113 2016-11-20 13:24:35 +00:00
Starbeamrainbowlabs 81bcef9a24 Improve search engine indexer. Fixes #117.
It is now more liberal when deciding on word boundaries.
2016-10-25 21:12:39 +01:00
Starbeamrainbowlabs 73a09e8365 Bump versions of modules. 2016-10-18 18:58:19 +01:00
Starbeamrainbowlabs 6476877c60 Attempted to implement Opensearch (#112), but it doesn't work :/ 2016-10-18 18:57:24 +01:00
Starbeamrainbowlabs f18da4858b Remove full stop from apidoc comment 2016-08-26 17:55:50 +01:00
Starbeamrainbowlabs d9b5bdfb3e Add debug idindex-show action. 2016-08-26 17:47:46 +01:00
Starbeamrainbowlabs ca89ccd33d Bugfix: Pageindex data for parent pages disappears when a child page is edited. Fixes #98. 2016-08-21 21:02:36 +01:00
Starbeamrainbowlabs 7589605c81 Bump version of feature-search 2016-08-21 10:59:41 +00:00
Starbeamrainbowlabs 84f6005db0 Added search time to searchr results page 2016-08-20 11:35:04 +01:00
Starbeamrainbowlabs 6c4c00b156 Added size + decode time for major indexes 2016-08-20 11:27:26 +01:00
Starbeamrainbowlabs e3683f218f Bump versions of modules 2016-08-19 19:54:27 +01:00
Starbeamrainbowlabs aae9365f5a Refine appearance of search contexts. 2016-08-19 13:47:56 +01:00
Starbeamrainbowlabs b8dd51d1a1 Bugfix: Fully correct search context generation. Fixes #30.
Also, fixed a critical security issue in the search context generation which would allow an editor to inject code into the user's browser.
2016-08-19 13:02:42 +01:00
Starbeamrainbowlabs c5017919a1 Half fixed search context generation for #30.
The problem: The matches were being sorted in the wrong direction.
Next up we need to improve the context generation, as there are several contexts that are being generated without the keywork in question in them.
2016-08-19 12:02:09 +01:00
Starbeamrainbowlabs ade3d15bca Add class to search term highlighting. Fixes #92. 2016-08-19 10:06:21 +01:00
Starbeamrainbowlabs 27acc2420b Make sure that all files are stored in the data directories.
Fixes #89.
2016-08-19 10:00:03 +01:00
Starbeamrainbowlabs 77ffa2bcfc apidoc is awesome. document a bunch of stuff, more to go 2016-06-12 21:15:43 +01:00
Starbeamrainbowlabs cec847fd67 Update version numbers of modules.
I forgot to do this before.... :P
2016-03-24 13:11:05 +00:00
Starbeamrainbowlabs f6f38adae3 Improved "there isn't a page..." message on search page. Fixes #49. 2016-03-12 19:02:36 +00:00
Starbeamrainbowlabs 111d95081f Update feature-search's description. 2016-03-12 18:52:26 +00:00
Starbeamrainbowlabs 03552b979f Small optimisation to search queries 2015-12-26 13:06:45 +00:00
Starbeamrainbowlabs 801369387d Cleaned up comments and added more title texts. 2015-12-26 12:55:19 +00:00
Starbeamrainbowlabs d55132fd19 Rebuild the inverted index if it doesn't exist on search. 2015-12-05 17:27:01 +00:00
Starbeamrainbowlabs b139f204b4 Debug the pageindex regenerator. Fixes #41. 2015-11-14 21:24:57 +00:00
Starbeamrainbowlabs 0e3a7f345a Properly escape search terms in the context highlighter. 2015-11-14 17:02:57 +00:00
Starbeamrainbowlabs b539cb4107 Also delete from searchindex when deleting a page. Speculative fix for #35, but it seems #41 needs fixing first. 2015-11-14 17:01:23 +00:00
Starbeamrainbowlabs 05026b9045 Bugfix the inverted index. Fixes #34. 2015-11-11 18:42:12 +00:00
Starbeamrainbowlabs e7dfda5f75 Umm I forgot to add to the globals list... :P 2015-11-09 07:25:28 +00:00
Starbeamrainbowlabs c7348d9c74 Begin updating module to use the new path system. Currently untested. 2015-11-08 21:15:08 +00:00
Starbeamrainbowlabs 8a86c01840 Erm right 2015-11-02 14:42:38 +00:00
Starbeamrainbowlabs 173a72fa46 Search page title and tags 2015-11-01 15:05:54 +00:00
Starbeamrainbowlabs 1c58a64134 Bugfix index comparison. I think this fixes #29. 2015-11-01 14:26:13 +00:00
Starbeamrainbowlabs e79e522d78 Integrate search into top bar 2015-11-01 10:13:35 +00:00
Starbeamrainbowlabs 3baf2535ab Add resultl number to left hand side of result 2015-10-31 14:16:19 +00:00
Starbeamrainbowlabs 559191757f Add search box to search page 2015-10-31 14:05:00 +00:00
Starbeamrainbowlabs 77e4cdcc7d Refactor context highlighter out of context extraction 2015-10-31 13:52:50 +00:00
Starbeamrainbowlabs 5a3a501c08 Add todo comments - I'm out of time now. 2015-10-29 11:32:45 +00:00
Starbeamrainbowlabs 4157a9fb6c Begin interface work. Why is the <strong> being inserted into another <strong>??? 2015-10-29 11:21:04 +00:00
Starbeamrainbowlabs e016c5f9a7 begin writing the search engine itself O.o 2015-10-28 20:56:10 +00:00
Starbeamrainbowlabs 29acc3a5e2 More work on inverted indexes. I think we're getting there. 2015-10-28 14:31:27 +00:00
Starbeamrainbowlabs 777a27064e Erm right. More line ending weirdness....? 2015-10-28 11:36:07 +00:00
Starbeamrainbowlabs 221c61a1b3 Refine indexer by removing 'stop words'.
More information at https://en.wikipedia.org/wiki/Stop_words
2015-10-28 09:14:41 +00:00
Starbeamrainbowlabs 725452a172 Continue working on indexer. Why is it converting to html entities....? 2015-10-28 08:03:56 +00:00
Starbeamrainbowlabs db7bf0f7ec begin playing around with indexing 2015-10-27 21:10:05 +00:00