| Gmail archive in 70GB mbox file; how to process for FT indexing? [message #1918] |
Fri, 14 March 2025 22:42  |
mma165
Messages: 6
Registered: March 2025
|
Junior Member |
|
|
Hi,
I'm wondering if anyone has tips on how to process a 70GB mbox file (an archive of gmail) for indexing with FT. I thought perhaps conversion to an sqlite db would work but that did not. Should it be split into individual messages via something like
cat mylistserve.mbox | formail -ds sh -c 'cat > msg.$FILENO'
?
I'm trying to avoid this if possible due to the vast number of files that would create. However I don't know what the intermediate approach between a single 70GB mbox and some number of smaller files would be.
-Malcolm
|
|
|
|
| Re: Gmail archive in 70GB mbox file; how to process for FT indexing? [message #1941 is a reply to message #1918] |
Thu, 01 May 2025 16:50  |
Grant Barrett
Messages: 35
Registered: October 2019
|
Member |
|
|
I had a similar issue and resolved it with Thunderbird using the ImportExportTools NG extension. Thunderbird isn't very slick but because it's been around so long there is a ton of information, expertise, and how-tos out there on importing the mbox. And it does what you need. Once you get the mbox into Thunderbird, create a new index in FoxTrot, then go to the Indexing > Managing Indices window. Select your new index. Then click on the Indexed Data tab. You will see two Predefined locations specifically for Mozilla Thunderbird. I have selected them both for my particular index. You're good to go; they will be indexed and searchable like any other index.
In my case, I use Thunderbird as an offline Gmail backup, rather than relying on irregular Google Checkouts for safekeeping. It gives me some peace of mind, plus gives me an alternate way to search hundreds of thousands of email messages across more than 25 years.
|
|
|
|
] 
FoxTrot Search Forum
Search
Help
Members
Register
Login
Home
