History: Search within files
Preview of version: 27
Starting in Tiki10, Tiki can natively index .docx, .xlsx and .pptx files. So you no longer need to install anything. It will even work on shared hosting!
- This is done with Zend Framework: http://framework.zend.com/manual/1.11/en/learning.lucene.indexing.html
Starting in Tiki18, Tiki can natively index .pdf files
- This is done via https://github.com/christian-vigh-phpclasses/PdfToText
Search within files
It is possible, once you enabled "Automatic indexing of file content" (Control Panels, File Galleries, Indexing tab ), to index the content of the files which are in the File Gallery so they can be retreived by a search. If you have a script that extracts the file content into a text, you can associate the script to the Mime type and the files content will be indexed.
If you want to search on files in the file galleries, you must provide handlers to extract the text for the file's MIME type (some may still work by default). The commands, such as strings or pdftotext must exist on your server. The type-command associations are defined in the Indexing tab of the Admin: File Gallery page.
To check support on your server, use Tiki Check.
| MIME Type | System command | Ubuntu/Debian package with command |
| application/vnd.oasis.opendocument.presentation | odt2txt %1 | odt2txt |
| application/vnd.oasis.opendocument.spreadsheet | odt2txt %1 | odt2txt |
| application/vnd.oasis.opendocument.text | odt2txt %1 | odt2txt |
| application/vnd.openxmlformats-officedocument.wordprocessingml.document | docx2txt.pl %1 - | |
| application/ms-excel | xls2csv %1 | catdoc |
| application/ms-powerpoint | catppt %1 | catdoc |
| application/msword | catdoc %1 or strings %1 | catdoc |
| application/pdf | pstotext %1 or pdftotext %1 - | poppler-utils or pstotext |
| application/postscript | pstotext %1 | pstotext |
| application/ps | pstotext %1 | pstotext |
| application/rtf | catdoc %1 | catdoc |
| application/sgml | col -b %1 or strings %1 | bsdmainutils |
| application/vnd.ms-excel | xls2csv %1 | catdoc |
| application/vnd.ms-powerpoint | catppt %1 | catdoc |
| application/x-msexcel | xls2csv %1 | catdoc |
| application/x-pdf | pstotext %1 | poppler-utils or pstotext |
| application/x-troff-man | man -l %1 | man-db |
| text/enriched | col -b %1 or strings %1 | bsdmainutils |
| text/html | elinks -dump -no-home %1 | elinks |
| text/plain | col -b %1 or strings %1 | bsdmainutils |
| text/richtext | col -b %1 or strings %1 | bsdmainutils |
| text/sgml | col -b %1 or strings %1 | bsdmainutils |
| text/tab-separated-values | col -b %1 or strings %1 | bsdmainutils |
Several tools can be used to extract search strings; many Unix sites have "strings", which can detect things which appear to be text within files although without the accuracy of more specialized tools.
Ensure that the system command entered prints its output to the screen (standard output) and not to a file. Try the command on a console and check the manual. E.g. you have to add a trailing "-" to pdftotext.
It might be needed to clear the Tiki Cache after installing a new handler for the system to pick it up.
It's better if you have fileinfo installed to avoid misidentified mimetypes (install php-pear if you are using php < 5.3).
To install all required packages in a Debian-based server, you can use this command:
sudo apt-get install bsdmainutils catdoc elinks man-db odt2txt php-pear pstotext
To install required packages on ClearOS:
http://wikisuite.org/How-to-configure-ClearOS-to-permit-Tiki-Wiki-CMS-Groupware-to-search-within-files
Related: