Bitweasil wrote:That said, I do have some ideas up my sleeve that may *dramatically* improve performance on high hash counts. Order of magnitude or more, potentially. InsidePro is doing a much better (faster) job on large hash lists, and I had some brainstorms on how they might be doing it.
Yeah... these are looking, so far, to be pretty sweet.
Still working on it (had to change a bunch of code around, but getting multi-length hash support in as well), it'll likely slow performance on a single hash a bit, but should kick check rates on Very Large Hash Lists (50k or above) into the trillions of checks per second or greater range. My goal is 1 000 000 000 000 checks per second on sufficiently large (10M element or greater) lists. Initial testing indicates this may be possible.
The main limit is that I will require large amounts of video RAM to do this - for a 5M element list, 512MB will be required, and will grow from there with larger lists. I will attempt to degrade gracefully (but still usefully) on lower end cards.
I'm also tightening up the code much further, and making it easier to add more hashes to. Hopefully I will be releasing something this weekend, at least for Linux.