What I'm wondering is, if there is a way to automatically find the best encoding for the bytes. Automatically find all the sequences that can be cached. I don't see how that's not possible, but I imagine it is otherwise it would've been done already. It seems like it would be best solved in the area of DNA sequence analysis.

What I'm wondering is, if there is a way to automatically find the best encoding for the bytes. Automatically find all the sequences that can be put into a dictionary. I don't see how that's not possible, but I imagine it is otherwise it would've been done already. It seems like it would be best solved in the area of DNA sequence analysis.

I have seen some text compression stuff (natural language compression, as opposed to arbitrary byte or integer compression), such as An Efficient Compression Code for Text Databases. It sounds like they basically use the words as symbols, create a dictionary from them, and replace them with integers. So something like this:

Then that would mean the text is turned into:

I am looking for text compression algorithms (natural language compression, rather than compression of arbitrary binary data).

I have seen for example An Efficient Compression Code for Text Databases. This algorithm basically uses the words as symbols, creates a dictionary from them, and replaces them with integers. So something like this:

Then the text is turned into: