History: Search within files
Source of version: 28
Copy to clipboard
^ This page should be merged with ((Check file indexing)) ^
^ Starting in ((Tiki8)), many handlers are [https://sourceforge.net/p/tikiwiki/code/34667|included in the code]
Starting in ((Tiki10)), Tiki can natively index .docx, .xlsx and .pptx files. So you no longer need to install anything. It will even work on shared hosting!
* This is done with Zend Framework: http://framework.zend.com/manual/1.11/en/learning.lucene.indexing.html
Starting in ((Tiki18)), Tiki can natively index .pdf files
* This is done via [https://github.com/christian-vigh-phpclasses/PdfToText]
^
! Search within files
It is possible, once you enabled "Automatic indexing of file content" (Control Panels, File Galleries, ((Gallery Search Indexing|Search Indexing tab)) ), to index the content of the files which are in the ((File Gallery)) so they can be retreived by a ((search)). If you have a script that extracts the file content into a text, you can associate the script to the Mime type and the files content will be indexed.
If you want to search on files in the file galleries, you must provide handlers to extract the text for the file's MIME type (some may still work by default). The commands, such as ''strings'' or ''pdftotext'' must exist on your server. The type-command associations are defined in the ((Gallery Search Indexing|Indexing tab)) of the ((File Gallery|Admin: File Gallery)) page.
To check support on your server, use Tiki ((Check)).
|| __MIME Type__ | __System command__ | __Ubuntu/Debian package with command__
application/vnd.oasis.opendocument.presentation | odt2txt %1 | odt2txt
application/vnd.oasis.opendocument.spreadsheet | odt2txt %1 | odt2txt
application/vnd.oasis.opendocument.text | odt2txt %1 | odt2txt
application/vnd.openxmlformats-officedocument.wordprocessingml.document | docx2txt.pl %1 - |
application/ms-excel | xls2csv %1 | catdoc
application/ms-powerpoint | catppt %1 | catdoc
application/msword | catdoc %1 %%% or %%% strings %1| catdoc
application/pdf | pstotext %1 %%% or %%% pdftotext %1 - | poppler-utils or pstotext
application/postscript | pstotext %1 | pstotext
application/ps | pstotext %1 | pstotext
application/rtf | catdoc %1 | catdoc
application/sgml | col -b %1 %%% or %%% strings %1 | bsdmainutils
application/vnd.ms-excel | xls2csv %1 | catdoc
application/vnd.ms-powerpoint | catppt %1 | catdoc
application/x-msexcel | xls2csv %1 | catdoc
application/x-pdf | pstotext %1 | poppler-utils or pstotext
application/x-troff-man | man -l %1 | man-db
text/enriched | col -b %1 %%% or %%% strings %1 | bsdmainutils
text/html | elinks -dump -no-home %1 | elinks
text/plain | col -b %1 %%% or %%% strings %1| bsdmainutils
text/richtext | col -b %1 %%% or %%% strings %1| bsdmainutils
text/sgml | col -b %1 %%% or %%% strings %1| bsdmainutils
text/tab-separated-values | col -b %1 %%% or %%% strings %1| bsdmainutils ||
Several tools can be used to extract search strings; many Unix sites have "strings", which can detect things which appear to be text within files although without the accuracy of more specialized tools.
Ensure that the system command entered prints its output to the screen (standard output) and not to a file. Try the command on a console and check the manual. E.g. you have to add a trailing "-" to pdftotext.
It might be needed to clear the Tiki ((Cache)) after installing a new handler for the system to pick it up.
It's better if you have [http://www.php.net/manual/en/book.fileinfo.php|fileinfo] installed to avoid misidentified mimetypes (install php-pear if you are using php < 5.3).
To install all required packages in a Debian-based server, you can use this command:
{CODE(colors="bash", wrap="1")}
sudo apt-get install bsdmainutils catdoc elinks man-db odt2txt php-pear pstotext
{CODE}
To install required packages on ClearOS:
http://wikisuite.org/How-to-configure-ClearOS-to-permit-Tiki-Wiki-CMS-Groupware-to-search-within-files
Related:
* http://stosberg.net/odt2txt/