Re: Include LLM feature [message #1943 is a reply to message #1909] |
Thu, 01 May 2025 17:09   |
Grant Barrett
Messages: 35 Registered: October 2019
|
Member |
|
|
I have been thinking about this, too, as I have tried all the other LLM solutions that purport to be able to index my documents and offer me insights. And what bothers me about most of them is:
—They want me to put my documents in the cloud. I don't want that because they are mine, there are too many, and their total byte size is large.
—They can't handle my volume of documents. I constantly change, update, delete and add to my documents in my own space, time, and way.
—They don't want to use the way I already have my documents stored and sorted. I have a background in certain professions that gives me expertise that many software developers don't have; they should trust my (and all users') preferences and knowledge, if possible, or at least let the user have the option to go their own way.
—They aren't always using platform-native tools already in place. I don't want to have yet another copy of the same open source models installed in yet a different place on my hard drives, or another version of Python, or another copy of tools that I have taken care to get from the right vendors in the right versions and keep up to date in the right ways. (With caveats about env, pyenv, etc.) They should do a lot better about trying to work with what is already there.
—FoxTrot Professional has already done a lot of the heavy-lifting of figuring out importers for many of the key file types. Many of the LLM vendors are way behind even on that one fundamental thing.
—Similarly, my personal OCR is better than the LLM-based software makers trying to work in that space, usually, at least at what I am willing to pay per page. Yet they will throw a barely tweaked version of pytesseract at a PDF and call it OCR. I work with multilingual dictionaries, and they can't be programmatically handled in that way. (I recognize that there is a whole business-to-business market that does not care about my academic and personal OCR needs! That's okay.)
So! When I think about FoxTrot as an on-ramp to some sort of LLM document-examining-using software, I see that it has some distinct advantages. I hope Jerome and the crew figure out something excellent!
|
|
|