NOTE: Why not use our List Manager to crack your lists? Its easy and enables better management.

NOTE: When cracking WPA/WPA2 passwords, make sure you check gpuhash.me first incase it's already been processed.

Home - General Discussion - combinding dicts


9 Results - Page 1 of 1 -
1
Author Message
Avatar
Bladedsha

Status: n/a
Joined: Sun, 28 Oct 2012
Posts: 24
Team:
Reputation: 9 Reputation
Offline
Mon, 29 Oct 2012 @ 18:18:30

whats the best way to combind dicts and filter out duplicate lines, but still keep the dicts a decent size by say cutting them at say 500mbs ea?


Avatar
M@LIK

Status: n/a
Joined: Fri, 02 Mar 2012
Posts: 558
Team:
Reputation: 208 Reputation
Offline
Mon, 29 Oct 2012 @ 18:26:23

If you're good enough with command-line tools, use UnixUtils. (Download if you're on Windows, Linux has these already)
If you're NOT, a good tool with GUI is Unified List Manager (ULM).


Avatar
Vegeta

Status: n/a
Joined: Wed, 19 Sep 2012
Posts: 26
Team:
Reputation: 9 Reputation
Offline
Mon, 29 Oct 2012 @ 18:55:15

You don't need huge wordlists... a simple wordlist+ some rulles is enough. anyway if you want to combine dicts use this command with unixutils or linux:

said:

cat "dictsdir"\*


then to sort and remove dups use this:
said:

sort -u dict.txt > sorted.txt


and to split them:
said:

split dict.txt 500M


edited by Vegeta on 29/10/2012


Avatar
Bladedsha

Status: n/a
Joined: Sun, 28 Oct 2012
Posts: 24
Team:
Reputation: 9 Reputation
Offline
Mon, 29 Oct 2012 @ 19:11:27

that ULM tool is just what i was thinking about. thanks a ton for that link.
Vegeta. im still pretty new to this so i haven't really figured out how to use rules efficiently. is there a good place to read up good rules practice?


Avatar
Vegeta

Status: n/a
Joined: Wed, 19 Sep 2012
Posts: 26
Team:
Reputation: 9 Reputation
Offline
Mon, 29 Oct 2012 @ 19:17:56

read for rules here:
http://kaoticcreations.blogspot.com/2011/09/explanation-of-hashcat-rules.html
http://kaoticcreations.blogspot.com/2011/06/cracking-password-hashes-with-cpu-gpu.html


Avatar
Bladedsha

Status: n/a
Joined: Sun, 28 Oct 2012
Posts: 24
Team:
Reputation: 9 Reputation
Offline
Mon, 29 Oct 2012 @ 20:18:26

cat'ing my dictdir as a whole prob wasn't the best idea... just throwing that out there 7 almost 8gigs of words spamming though cmd is kinda funny tho...


Avatar
Vegeta

Status: n/a
Joined: Wed, 19 Sep 2012
Posts: 26
Team:
Reputation: 9 Reputation
Offline
Mon, 29 Oct 2012 @ 22:05:01

you have to cat it in outfile like this

said:

cat dirofdics\* > combined.txt


Avatar
Bladedsha

Status: n/a
Joined: Sun, 28 Oct 2012
Posts: 24
Team:
Reputation: 9 Reputation
Offline
Mon, 29 Oct 2012 @ 22:42:25

Vegeta said:

you have to cat it in outfile like this

said:

cat dirofdics\* > combined.txt


ya at first i figured it would store it in the ram for use then i looked it up, i got it working now, thanks tho.


Avatar
proman

Status: n/a
Joined: Fri, 07 Dec 2012
Posts: 3
Team:
Reputation: 0 Reputation
Offline
Fri, 07 Dec 2012 @ 19:16:31

Input | Output: VMerge_001 | VMerge_001_ULM_001
Items input: 353475036
Items output: 209469701
Items removed: 144005335
Input size: 3,44 GB(s)
Output size: 2,14 GB(s)
Time taken: 19 mins 27 secs

very nice tool for combine large dic file, so remove your duplicate line character and customize your dict with this tool



9 Results - Page 1 of 1 -
1

We have a total of 189037 messages in 23452 topics.
We have a total of 21254 registered users.
Our newest registered member is Bezuma.