| Re: BUG: Foxtrot looks like it is not indexing large files completely [message #1602 is a reply to message #1601] |
Sat, 24 December 2022 04:15   |
Atlas
Messages: 142
Registered: August 2009
|
Senior Member |
|
|
FoxTrot Engineering wrote on Fri, 23 December 2022 19:18- there is a bug that can make these settings have no effect (PlainTextFileLimitMB, PlainTextPreferredEncodings, and "prefer alternatives: plain text files: FoxTrot built-in"). Not sure when this bug was introduced. So even if you set both PlainTextFileLimitMB and Aliases for .tsv files, you may still have the 10 MB limit of Spotlight's importer.
Thanks for looking into this. I think what you said above is exactly the case. I'm seeing a bug where I've set both PlainTextFileLimitMB and Aliases for .tsv files, and Foxtrot is still not indexing large .tsv or .csv files completely. This seems to happen on both version 7.5.3 and 7.5.2. To be honest, I'm not sure how widespread is this problem, because the index size limit might affect other files beyond just html, tsv, and csv. If Foxtrot is indeed producing incomplete indexes for large file sizes, I strongly recommend that we prioritize fixing this bug, because I think it's a pretty serious issue. Incomplete indexes produce queries that fail in silence, because everything looks like they work as expected until the user is searching for a keyword that appears later in the document. Alternatively, if we're unable to fix it, we should at least understand the conditions when this bug occur (what kind of files have file size limit, and how large are the limits), so that users can proactive try to avoid it.
[Updated on: Sat, 24 December 2022 04:16] Report message to a moderator |
|
|
|
] 
FoxTrot Search Forum
Search
Help
Members
Register
Login
Home
