FoxTrot Search Forum
FoxTrot Search for macOS Forum

Home » Public Forums » FoxTrot Search User Forum » Which is better? Several small/medium indexes or one huge/massive index?
Re: Which is better? Several small/medium indexes or one huge/massive index? [message #676 is a reply to message #674] Thu, 01 February 2018 10:27 Go to previous messageGo to previous message
FoxTrot Engineering
Messages: 376
Registered: April 2020
Senior Member
'Ajk Sanders' via foxtrot-search wrote:

> Which is better?
>
> Several small/medium indexes or one huge/massive index?

It depends…

If some of your indexed data is rarely modified (e.g. some archives or reference documents), while some other are frequently modified, it is usually wise to handle them in different FoxTrot indices; updating your frequently-modified-data index will be quite faster.

The same goes if you index logically distinct sets of data, and often know in which sets you want to search or not.

If you have an (i)Mac Pro with many cores and fast SSD drive, indexing / updating multiple indices in parallel may also be faster than having a single monolithic index.

In the other cases, a single massive index should be an acceptable choice (as long as your hardware is adequate with the mass of data you index). We recently found a bug which currently limits the size of an index to 16 GB (or more precisely, the size of some file inside the .ftindex package), and this will be fixed in a later version.

By the way, what is exactly "huge/massive" for you? In the 1.35 TB of data you are talking of, what part is actually textual data, rather than video / images etc?


Jérôme - CTM Engineering


------------------------------------------------------------ ---------
"I've been using Powermail for around 3 years now and find that it's
extremely stable. The interface is clear and intuitive and not cluttered
like other programs (Apple Mail and Eudora, e.g.). Filters work well,
and it does all that one would expect from an email client. The program
is robust and straightforward. It's a great application."
PowerMail user comment on www.versiontracker.com


Download a demo version from www.ctmdev.com
------------------------------------------------------------ ---------

--

---


Jérôme - FoxTrot Engineering
 
Read Message
Read Message
Read Message
Read Message
Read Message
Previous Topic: Spotlight's extended attributes (custom metadata) are missing from Foxtrot
Next Topic: Spotlight's extended attributes (custom metadata) are missing from Foxtrot
Goto Forum:
  


Current Time: Sun Mar 03 16:20:41 GMT+1 2024