Best way to index and search leaked databases?

I am in the tb range with breaches collected, obviously it would be highly impractical to search this through grep or any tools, I would just combine everything by the first line alphabetically, but this would only work for searching by email or whatever happens to be listed first.

Commercial breach searching sites have collections larger than mine and search them almost instantly, does anyone have an idea of how they are set up?