Home » Public Forums » FoxTrot Search User Forum » Missing files in index and other weirdness when updating the index.
| Missing files in index and other weirdness when updating the index. [message #264] |
Wed, 04 March 2015 00:14  |
Arthur Elsenaar
Messages: 3
Registered: March 2015
|
Junior Member |
|
|
Am trying out FT Personal search. I have build an index of mainly ebooks
and audio files. When the index has been build, it shows some 99.000+
files, having an index size of ~550MB. I then noticed known files to be
missing in the index. I select Update Folder in Index.. and point to the
containing folder. It finds another ~4000 files which got indexed fine and
are searchable. I run through some more folders in the same way and it
finds even more!
Now, when I select Update Index Entirely from the menu, it re-indexes, but
when finished, it drops back to the first number of files in the index and
I have lost again the missing files...
I am running latest 5.1b1 and files served via afp on a synology nas,
formatted ext4.
Any ideas how to fix this?
|
|
|
|
| Re: Missing files in index and other weirdness when updating the index. [message #265 is a reply to message #264] |
Thu, 05 March 2015 10:14  |
FoxTrot Engineering
Messages: 406
Registered: April 2020
|
Senior Member |
|
|
Arthur Elsenaar wrote:
> I then noticed known files to be
> missing in the index. I select Update Folder in Index.. and point to the
> containing folder. It finds another ~4000 files which got indexed fine and
> are searchable. I run through some more folders in the same way and it
> finds even more!
>
> Now, when I select Update Index Entirely from the menu, it re-indexes, but
> when finished, it drops back to the first number of files in the index and
> I have lost again the missing files...
What you describe can happen if, for some reason, the indexer skips all the contents of a folder when building or updating the whole index. When you do a manual partial update on a subfolder of the skipped folder, it gets successfully indexed, until you update the whole index and the originally skipped folder is skipped again.
Here are some cases where a folder can be skipped:
- you have added it to the "skipping these subfolders" list
- this folder is hidden in the Finder (or should be hidden, in case the Finder has been configured to show hidden files); this is the case for filenames that name begin with a dot, or when the file or folder has an "invisible" attribute (unless if "also index hidden files and packages contents" is checked)
- folders shown by the Finder as a simple files, like applications (.app) and other kinds of bundles or packages (unless if "also index hidden files and packages contents" is checked)
Maybe some folders in your NAS have an attribute or specificity that make FoxTrot skip them... FoxTrot does not follow symbolic links, but I don't think this is your case, as the partial update should have not worked in this case. Can you determine which folder has been skipped (ie, none of its content has been indexed)?
Kind regards
Jérôme - CTM Engineering
------------------------------------------------------------ ---------
"I want to thank you for writing FoxTrot Pro and Personal; they are
fabulous applications. I use Professional, but I demoed Personal
to my wife last night; after less than 30 seconds, she said "I'll
buy it."
FoxTrot Professional Search user comment
Download a demo version from www.foxtrot.ch
------------------------------------------------------------ ---------
Jérôme - FoxTrot Engineering
|
|
|
|
| Re: Missing files in index and other weirdness when updating the index. [message #268 is a reply to message #265] |
Thu, 05 March 2015 15:10 |
Arthur Elsenaar
Messages: 3
Registered: March 2015
|
Junior Member |
|
|
Thanks for the response! None of the cause cases you list apply. It is a
normal folder with no special attributes. It's name starts with an
underscore like many sibling folders; in this case named "_electronica",
which sits on a NAS share named "audio". But all this would not make FT
skip that folder does it? There are a few more files or perhaps folders
skipped, but have to find out which. If you need more info, let me know!
Thanks again!
On Thursday, March 5, 2015 at 10:14:33 AM UTC+1, FoxTrot Engineering wrote:
>
> Arthur Elsenaar wrote:
>
>> I then noticed known files to be
>> missing in the index. I select Update Folder in Index.. and point to the
>> containing folder. It finds another ~4000 files which got indexed fine
> and
>> are searchable. I run through some more folders in the same way and it
>> finds even more!
>>
>> Now, when I select Update Index Entirely from the menu, it re-indexes,
> but
>> when finished, it drops back to the first number of files in the index
> and
>> I have lost again the missing files...
>
> What you describe can happen if, for some reason, the indexer skips all
> the contents of a folder when building or updating the whole index. When
> you do a manual partial update on a subfolder of the skipped folder, it
> gets successfully indexed, until you update the whole index and the
> originally skipped folder is skipped again.
>
> Here are some cases where a folder can be skipped:
>
> - you have added it to the "skipping these subfolders" list
>
> - this folder is hidden in the Finder (or should be hidden, in case the
> Finder has been configured to show hidden files); this is the case for
> filenames that name begin with a dot, or when the file or folder has an
> "invisible" attribute (unless if "also index hidden files and packages
> contents" is checked)
>
> - folders shown by the Finder as a simple files, like applications (.app)
> and other kinds of bundles or packages (unless if "also index hidden files
> and packages contents" is checked)
>
> Maybe some folders in your NAS have an attribute or specificity that make
> FoxTrot skip them... FoxTrot does not follow symbolic links, but I don't
> think this is your case, as the partial update should have not worked in
> this case. Can you determine which folder has been skipped (ie, none of its
> content has been indexed)?
>
> Kind regards
>
>
> Jérôme - CTM Engineering
>
>
> "I want to thank you for writing FoxTrot Pro and Personal; they are
> fabulous applications. I use Professional, but I demoed Personal
> to my wife last night; after less than 30 seconds, she said "I'll
> buy it."
> FoxTrot Professional Search user comment
>
> Download a demo version from www.foxtrot.ch
>
>
|
|
|
|
| Re: Missing files in index and other weirdness when updating the index. [message #269 is a reply to message #268] |
Thu, 05 March 2015 17:46 |
FoxTrot Engineering
Messages: 406
Registered: April 2020
|
Senior Member |
|
|
Arthur Elsenaar wrote:
> Thanks for the response! None of the cause cases you list apply.
Another thing would cause skipping a folder: if its name ends with ".noindex", or if it contains a file named ".noindex" (which should not be visible in the Finder).
To make sure that this is not the case, type the following command in e Terminal window:
ls -a1 {folderpath}
You can either type the actual folder path instead of {folderpath}, or drag the folder to the Terminal window to insert its path in the command line. Type the number "1" after "-a" (however, a lowercase "L" should also be OK).
Jérôme - CTM Engineering
------------------------------------------------------------ ---------
"I sleep much better since I don't feel quite as disorganized."
FoxTrot Professional Search user comment on macupdate.com
Download a demo version from www.foxtrot.ch
------------------------------------------------------------ ---------
Jérôme - FoxTrot Engineering
|
|
|
|
| Re: Missing files in index and other weirdness when updating the index. [message #270 is a reply to message #269] |
Fri, 06 March 2015 22:42 |
Arthur Elsenaar
Messages: 3
Registered: March 2015
|
Junior Member |
|
|
Unfortunately it isn't that option either. I have show hidden files enabled
at default in the finder and also searched for a .noindex file, but no
avail.
Strange, do you have more ideas what can cause this issue?
Thanks!
On Thursday, March 5, 2015 at 5:46:45 PM UTC+1, FoxTrot Engineering wrote:
>
> Arthur Elsenaar wrote:
>
>> Thanks for the response! None of the cause cases you list apply.
>
> Another thing would cause skipping a folder: if its name ends with
> ".noindex", or if it contains a file named ".noindex" (which should not be
> visible in the Finder).
> To make sure that this is not the case, type the following command in e
> Terminal window:
>
> ls -a1 {folderpath}
>
> You can either type the actual folder path instead of {folderpath}, or
> drag the folder to the Terminal window to insert its path in the command
> line. Type the number "1" after "-a" (however, a lowercase "L" should also
> be OK).
>
>
> Jérôme - CTM Engineering
>
>
> "I sleep much better since I don't feel quite as disorganized."
> FoxTrot Professional Search user comment on macupdate.com
>
> Download a demo version from www.foxtrot.ch
>
>
|
|
|
|
| Re: Missing files in index and other weirdness when updating the index. [message #277 is a reply to message #269] |
Wed, 11 March 2015 14:04 |
Sergei Mikheyev
Messages: 5
Registered: March 2015
|
Junior Member |
|
|
Dear FoxTrot Support,
Why FoxTrot Pro does not recognize and index some files? I added a
collection of .htm and .xls files and Foxtrot does not display them during
searches. These files are however searchable on my other search engine -
dtSearch. I'd greatly appreciate if you could help me resolve this problem.
Thank you and best regards,
Sergei
On Thursday, March 5, 2015 at 5:46:45 PM UTC+1, FoxTrot Engineering wrote:
>
> Arthur Elsenaar wrote:
>
>> Thanks for the response! None of the cause cases you list apply.
>
> Another thing would cause skipping a folder: if its name ends with
> ".noindex", or if it contains a file named ".noindex" (which should not be
> visible in the Finder).
> To make sure that this is not the case, type the following command in e
> Terminal window:
>
> ls -a1 {folderpath}
>
> You can either type the actual folder path instead of {folderpath}, or
> drag the folder to the Terminal window to insert its path in the command
> line. Type the number "1" after "-a" (however, a lowercase "L" should also
> be OK).
>
>
> Jérôme - CTM Engineering
>
>
> "I sleep much better since I don't feel quite as disorganized."
> FoxTrot Professional Search user comment on macupdate.com
>
> Download a demo version from www.foxtrot.ch
>
>
|
|
|
|
| Re: Missing files in index and other weirdness when updating the index. [message #278 is a reply to message #277] |
Wed, 11 March 2015 14:06 |
CTM Development
Messages: 57
Registered: April 2014
|
Member |
|
|
Sir,
If your files are indeed in directories meant to be indexed AND they do not show up as blacklisted in FoxTrot, then we would need to receive examples of unindexed files in order to answer.
Please send these to ctm-support [at] ctmdev.com
Thank you,
Chantal Favre
> On Mar 11, 2015, at 2:04 PM, Sergei Mikheyev wrote:
>
> Dear FoxTrot Support,
>
> Why FoxTrot Pro does not recognize and index some files? I added a collection of .htm and .xls files and Foxtrot does not display them during searches. These files are however searchable on my other search engine - dtSearch. I'd greatly appreciate if you could help me resolve this problem.
>
> Thank you and best regards,
>
> Sergei
>
> On Thursday, March 5, 2015 at 5:46:45 PM UTC+1, FoxTrot Engineering wrote:
> Arthur Elsenaar wrote:
>
>> Thanks for the response! None of the cause cases you list apply.
>
> Another thing would cause skipping a folder: if its name ends with ".noindex", or if it contains a file named ".noindex" (which should not be visible in the Finder).
> To make sure that this is not the case, type the following command in e Terminal window:
>
> ls -a1 {folderpath}
>
> You can either type the actual folder path instead of {folderpath}, or drag the folder to the Terminal window to insert its path in the command line. Type the number "1" after "-a" (however, a lowercase "L" should also be OK).
>
>
> Jérôme - CTM Engineering
>
>
> "I sleep much better since I don't feel quite as disorganized."
> FoxTrot Professional Search user comment on macupdate.com
>
> Download a demo version from www.foxtrot.ch
>
>
>
|
|
|
|
| Re: Missing files in index and other weirdness when updating the index. [message #279 is a reply to message #278] |
Wed, 11 March 2015 14:19 |
Sergei Mikheyev
Messages: 5
Registered: March 2015
|
Junior Member |
|
|
Dear Chantal,
Thank you for your prompt reply. Before I send you a file for inspection,
may you could tell what what you mean by "my files are in directories meant
to be indexed"? Also, if you could tell me where to check that these files
are not blacklisted in Foxtrot. I could then quickly check these two points
and maybe find the answers without having to send you the files.
Your support is much appreciated.
Best regards,
Sergei
On Wednesday, March 11, 2015 at 2:07:11 PM UTC+1, CTM Development wrote:
>
> Sir,
>
> If your files are indeed in directories meant to be indexed AND they do
> not show up as blacklisted in FoxTrot, then we would need to receive
> examples of unindexed files in order to answer.
>
> Please send these to ctm-support [at] ctmdev.com
>
> Thank you,
>
> Chantal Favre
>
> On Mar 11, 2015, at 2:04 PM, Sergei Mikheyev > wrote:
>
> Dear FoxTrot Support,
>
> Why FoxTrot Pro does not recognize and index some files? I added a
> collection of .htm and .xls files and Foxtrot does not display them during
> searches. These files are however searchable on my other search engine -
> dtSearch. I'd greatly appreciate if you could help me resolve this problem.
>
> Thank you and best regards,
>
> Sergei
>
> On Thursday, March 5, 2015 at 5:46:45 PM UTC+1, FoxTrot Engineering wrote:
>>
>> Arthur Elsenaar wrote:
>>
>>> Thanks for the response! None of the cause cases you list apply.
>>
>> Another thing would cause skipping a folder: if its name ends with
>> ".noindex", or if it contains a file named ".noindex" (which should not be
>> visible in the Finder).
>> To make sure that this is not the case, type the following command in e
>> Terminal window:
>>
>> ls -a1 {folderpath}
>>
>> You can either type the actual folder path instead of {folderpath}, or
>> drag the folder to the Terminal window to insert its path in the command
>> line. Type the number "1" after "-a" (however, a lowercase "L" should also
>> be OK).
>>
>>
>> Jérôme - CTM Engineering
>>
>>
>> "I sleep much better since I don't feel quite as disorganized."
>> FoxTrot Professional Search user comment on macupdate.com
>>
>> Download a demo version from www.foxtrot.ch
>>
>>
>
>
>
>
|
|
|
|
Goto Forum:
Current Time: Thu Dec 26 11:26:23 GMT+1 2024
|
] 
FoxTrot Search Forum
Search
Help
Members
Register
Login
Home
