NOTE: Why not use our List Manager to crack your lists? Its easy and enables better management.

NOTE: When cracking WPA/WPA2 passwords, make sure you check gpuhash.me first incase it's already been processed.

Home - General Discussion - 203 GB of wordlists merged into one :)


41 Results - Page 1 of 2 -
1 2
Author Message
Avatar
blandyuk
Admin / Owner
Status: Trusted
Joined: Tue, 05 Jul 2011
Posts: 3226
Team: HashKiller
Reputation: 7734 Reputation
Offline
Tue, 22 Jan 2019 @ 20:20:01

203 GB of wordlists merged into one. The lists used are:

antipublic
b0n3z
b0n3z-sorted-wordlist
crackstation.txt
DCHTPassv1.0.txt
HyperionOnHackForumsNetRELEASE.txt
Md5decrypt-awesome-wordlist
MegaCracker.txt
passcape_comp
Super_mega_dic.txt
weakpass_2

merged its 112 GB

Merge complete to: C:\Cracking\_wordlists\huge-dict.txt
Total words : 21,172,592,037
Words skipped: 36,391,403
Duplicates removed: 8,867,744,762
$HEX[...] conversions: 53,113,687
Total time: 6 hrs 12 mins 43.488 secs

Have to see how it does on some runs hehe.


Please read the forum rules | Please read the paid section rules
I accept private hash lists, with forum donations only.
BTC: 1JZGVq58m4RS1QQS8JE5xndzDFy2BvGU6y
GPU Power: 9x GTX 1070 + 6x GTX 1080

Avatar
s3in!c
Moderator
Status: Elite
Joined: Wed, 10 Apr 2013
Posts: 902
Team:
Reputation: 1285 Reputation
Offline
Tue, 22 Jan 2019 @ 20:24:27

And where is hashes.org? :P


+Rep if I helped

Hashes.org - Powerful Community Password Recovery
Hashtopolis - Hashcat distributed cracking tool

BTC: 1VTuiKrNoytU1PvYrF3J7VapQ9oPg93Jn

Avatar
TigerBook29

Status: Cracker
Joined: Sat, 12 Jan 2019
Posts: 101
Team:
Reputation: 111 Reputation
Offline
Tue, 22 Jan 2019 @ 20:40:28

Dude, a few weeks ago, before christmas, I used App.Merge.exe to merge and sort every wordlist on weakpass.com. I have attached the results in a text file, however I have a question; this problem has occurred twice:

Merge complete to: Weakpass_part2.txt
Total words : 11681657260
Words skipped: 1599
Duplicates removed: 4004343991
$HEX[...] conversions: 4145760
Total time: 7 hrs 6 mins 41.257 secs

Merge complete to: Weakpass_part2.5.txt
Total words : 6641055039
Words skipped: 807
Duplicates removed: 154963
$HEX[...] conversions: 0
Total time: 5 hrs 13 mins 18.808 secs

[THIS IS THE RESULT OF MERGING THE WORDLISTS ABOVE]
Merge complete to: Weakpass_part2_full.txt
Total words : 14312240799
Words skipped: 10 [WHY ARE WORDS SKIPPED HERE, IF INVALID WORDS WERE REMOVED IN THE WORDLISTS BEFOREHAND?]
Duplicates removed: 2254766177
$HEX[...] conversions: 0
Total time: 6 hrs 55 mins 13.852 secs

Merge complete to: Weakpass_part3_full.txt
Total words : 13581938645
Words skipped: 1194
Duplicates removed: 4597505472
$HEX[...] conversions: 191762067
Total time: 8 hrs 32 mins 39.657 secs

Merge complete to: Weakpass_part4_full.txt
Total words : 13574369215
Words skipped: 134
Duplicates removed: 8055334069
$HEX[...] conversions: 733994
Total time: 9 hrs 10 mins 37.398 secs

Merge complete to: Weakpass_part3&4_full.txt
Total words : 14455718665
Words skipped: 135 [SAME ISSUE HERE]
Duplicates removed: 3123724800
$HEX[...] conversions: 0
Total time: 6 hrs 38 mins 2.479 secs


BTC: 1FFP5BE9Uw5KWFuqd2gqAmdATQJukep5BT
+Rep, if I helped! :)

http://wordlist-warehouse.rf.gd/

Attachments: Login to view attachments.
Avatar
Szul

Status: Elite
Joined: Sat, 15 Sep 2012
Posts: 1564
Team:
Reputation: 1468 Reputation
Offline
Tue, 22 Jan 2019 @ 20:43:50

Tiger how big is output file ? and any Chance to share it ? I also think about download all weak pass and merge it but when i realize how long it would take i didnt do it :/


Jabber: Szul@jabb.im
Discord Szul#4608
4 x GTX 1080
TEAM HASHCAT

Avatar
TigerBook29

Status: Cracker
Joined: Sat, 12 Jan 2019
Posts: 101
Team:
Reputation: 111 Reputation
Offline
Tue, 22 Jan 2019 @ 20:49:30

Oh god! I knew someone would ask this...

The file is 258GB in size, I have made absolutely certain that no wordlist was missed out and double checked all information processed, as well as hashing/varifying each output when copied to a different location, with multiple algorithms...I was worried about data loss xD

I can compress it using 7zip, uzing the LZMA2 algorithm, which will have the highest lossless compression ratio but uploading may take some time.


BTC: 1FFP5BE9Uw5KWFuqd2gqAmdATQJukep5BT
+Rep, if I helped! :)

http://wordlist-warehouse.rf.gd/

Avatar
Szul

Status: Elite
Joined: Sat, 15 Sep 2012
Posts: 1564
Team:
Reputation: 1468 Reputation
Offline
Tue, 22 Jan 2019 @ 20:51:22

or make .torrent from this file, then users will share file each other


Jabber: Szul@jabb.im
Discord Szul#4608
4 x GTX 1080
TEAM HASHCAT

Avatar
TigerBook29

Status: Cracker
Joined: Sat, 12 Jan 2019
Posts: 101
Team:
Reputation: 111 Reputation
Offline
Tue, 22 Jan 2019 @ 20:51:40

Oh and it took like 4 weeks to download every list but i wasn't downloading consistantly, however no wordlists have been added/removed from weakpass, within that timeframe. I could try torrenting it but you would have to bear with me, I won't be able to do it 24/7.


BTC: 1FFP5BE9Uw5KWFuqd2gqAmdATQJukep5BT
+Rep, if I helped! :)

http://wordlist-warehouse.rf.gd/

Avatar
s3in!c
Moderator
Status: Elite
Joined: Wed, 10 Apr 2013
Posts: 902
Team:
Reputation: 1285 Reputation
Offline
Tue, 22 Jan 2019 @ 20:52:28

Sorry about that it might sound like nagging. I just want to point out (in case people think that hashes.org is included in weakpass' dictionary anyway) afaik the weakpass included only some older lists of hashes.org which might miss a lot of the new founds


+Rep if I helped

Hashes.org - Powerful Community Password Recovery
Hashtopolis - Hashcat distributed cracking tool

BTC: 1VTuiKrNoytU1PvYrF3J7VapQ9oPg93Jn

Avatar
blandyuk
Admin / Owner
Status: Trusted
Joined: Tue, 05 Jul 2011
Posts: 3226
Team: HashKiller
Reputation: 7734 Reputation
Offline
Tue, 22 Jan 2019 @ 20:55:32

I missed a couple of very large lists but good enough for my purposes.

Hashes.org is in my smaller wordlists so not needed.

App.merge removes lines over 4096 chars as pointless.


Please read the forum rules | Please read the paid section rules
I accept private hash lists, with forum donations only.
BTC: 1JZGVq58m4RS1QQS8JE5xndzDFy2BvGU6y
GPU Power: 9x GTX 1070 + 6x GTX 1080

Avatar
Szul

Status: Elite
Joined: Sat, 15 Sep 2012
Posts: 1564
Team:
Reputation: 1468 Reputation
Offline
Tue, 22 Jan 2019 @ 20:56:01

Tiger my pc run 24/7 and got 150/20 internet so can help if need


Jabber: Szul@jabb.im
Discord Szul#4608
4 x GTX 1080
TEAM HASHCAT

Avatar
TigerBook29

Status: Cracker
Joined: Sat, 12 Jan 2019
Posts: 101
Team:
Reputation: 111 Reputation
Offline
Tue, 22 Jan 2019 @ 20:58:17

Hmm...if you are okay waiting, I will be able to start compressing the files on Thursday @ 7:30AM GMT +00:00, then I will report back here, with the new filesize and the .torrent file, however the compressing will take most of the day, so i will not be able to start seeding on that day...that's the plan. Oh Gawd I hope it doesn't take an eternity to compress.


BTC: 1FFP5BE9Uw5KWFuqd2gqAmdATQJukep5BT
+Rep, if I helped! :)

http://wordlist-warehouse.rf.gd/

Avatar
Szul

Status: Elite
Joined: Sat, 15 Sep 2012
Posts: 1564
Team:
Reputation: 1468 Reputation
Offline
Tue, 22 Jan 2019 @ 20:59:23

before we start, how fast is Your internet upload speed, if its low better dont start and upset of waiting


Jabber: Szul@jabb.im
Discord Szul#4608
4 x GTX 1080
TEAM HASHCAT

Avatar
TigerBook29

Status: Cracker
Joined: Sat, 12 Jan 2019
Posts: 101
Team:
Reputation: 111 Reputation
Offline
Tue, 22 Jan 2019 @ 21:02:33

blandyuk said:

I missed a couple of very large lists but good enough for my purposes.

Hashes.org is in my smaller wordlists so not needed.

App.merge removes lines over 4096 chars as pointless.

Yes but if I removed lines over 4096 chars long in the first two parts I merged/sorted, why then are there lines with chars longer than 4096 in those sorted files that I then merged/sorted into a bigger file?

Also @everyone, I merged all the wordlists in parts, with the default App.Merge.exe arguments.


BTC: 1FFP5BE9Uw5KWFuqd2gqAmdATQJukep5BT
+Rep, if I helped! :)

http://wordlist-warehouse.rf.gd/

Avatar
TigerBook29

Status: Cracker
Joined: Sat, 12 Jan 2019
Posts: 101
Team:
Reputation: 111 Reputation
Offline
Tue, 22 Jan 2019 @ 21:07:57

Szul said:

before we start, how fast is Your internet upload speed, if its low better dont start and upset of waiting

Not great :/

I don't care though, if it's easier/faster for you, rather than manually clicking each link (It was absolute hell, I couldn't/didn't know how to use any downloader scripts due to mediafire advertising), then I don't mind waiting.


BTC: 1FFP5BE9Uw5KWFuqd2gqAmdATQJukep5BT
+Rep, if I helped! :)

http://wordlist-warehouse.rf.gd/

Attachments: Login to view attachments.
Avatar
Szul

Status: Elite
Joined: Sat, 15 Sep 2012
Posts: 1564
Team:
Reputation: 1468 Reputation
Offline
Tue, 22 Jan 2019 @ 21:09:21

ok, it would take weeks to upload at 6mb/s... thanks but its waist of time


Jabber: Szul@jabb.im
Discord Szul#4608
4 x GTX 1080
TEAM HASHCAT

Avatar
s3in!c
Moderator
Status: Elite
Joined: Wed, 10 Apr 2013
Posts: 902
Team:
Reputation: 1285 Reputation
Offline
Tue, 22 Jan 2019 @ 21:11:08

6MB/s or &Mbit/s? With 6MB/s you could upload 100GB in less than 5h (assuming that you would keep 6MB/s all the time in average)


+Rep if I helped

Hashes.org - Powerful Community Password Recovery
Hashtopolis - Hashcat distributed cracking tool

BTC: 1VTuiKrNoytU1PvYrF3J7VapQ9oPg93Jn

Avatar
Szul

Status: Elite
Joined: Sat, 15 Sep 2012
Posts: 1564
Team:
Reputation: 1468 Reputation
Offline
Tue, 22 Jan 2019 @ 21:12:15

Mbits according to screenshot


Jabber: Szul@jabb.im
Discord Szul#4608
4 x GTX 1080
TEAM HASHCAT

Avatar
TigerBook29

Status: Cracker
Joined: Sat, 12 Jan 2019
Posts: 101
Team:
Reputation: 111 Reputation
Offline
Tue, 22 Jan 2019 @ 21:14:25

Mega bits, not Mega bytes
6.39Mib/s is 0.79875MB/s
Absolute crap!

Shall I do it anyway?


BTC: 1FFP5BE9Uw5KWFuqd2gqAmdATQJukep5BT
+Rep, if I helped! :)

http://wordlist-warehouse.rf.gd/

Avatar
s3in!c
Moderator
Status: Elite
Joined: Wed, 10 Apr 2013
Posts: 902
Team:
Reputation: 1285 Reputation
Offline
Tue, 22 Jan 2019 @ 21:18:09

Ah ok, then I see. Would take something 2d I guess.


+Rep if I helped

Hashes.org - Powerful Community Password Recovery
Hashtopolis - Hashcat distributed cracking tool

BTC: 1VTuiKrNoytU1PvYrF3J7VapQ9oPg93Jn

Avatar
TigerBook29

Status: Cracker
Joined: Sat, 12 Jan 2019
Posts: 101
Team:
Reputation: 111 Reputation
Offline
Tue, 22 Jan 2019 @ 21:22:47

Took me I think it was a total of ~9 days to sort the files, on an AMD A4-6300 3.70GHz 3.70GHz processor, I only used 4 threads for sorting though. (You can calculate the exact time it took with the results in the text file in my first post on this topic.) Downloading I didn't calculate but I guess in total it was around ~2/3 days, yah.

Worth it?


BTC: 1FFP5BE9Uw5KWFuqd2gqAmdATQJukep5BT
+Rep, if I helped! :)

http://wordlist-warehouse.rf.gd/

Avatar
dipeperon

Status: Member
Joined: Tue, 03 Apr 2018
Posts: 430
Team:
Reputation: 431 Reputation
Offline
Wed, 23 Jan 2019 @ 01:58:53

I'm sceptic that these list you used are all actually cracked passwords :p


My haschat stuff (rules, scripts): https://github.com/theherp/Hashcat-stuff

Avatar
blandyuk
Admin / Owner
Status: Trusted
Joined: Tue, 05 Jul 2011
Posts: 3226
Team: HashKiller
Reputation: 7734 Reputation
Offline
Wed, 23 Jan 2019 @ 06:53:47

I've slightly improved the sorting speed of App.Merge.exe so download latest v0.61 below:

https://hashkiller.co.uk/downloads/App.Merge.zip


Please read the forum rules | Please read the paid section rules
I accept private hash lists, with forum donations only.
BTC: 1JZGVq58m4RS1QQS8JE5xndzDFy2BvGU6y
GPU Power: 9x GTX 1070 + 6x GTX 1080

Avatar
dda

Status: Senior
Joined: Fri, 06 Jun 2014
Posts: 1523
Team:
Reputation: 2509 Reputation
Offline
Wed, 23 Jan 2019 @ 10:15:31

blandyuk said:

I've slightly improved the sorting speed of App.Merge.exe so download latest v0.61 below:

https://hashkiller.co.uk/downloads/App.Merge.zip


after sorting, the file is doubled. the output file lines become more than twice


Avatar
DarkDeath25

Status: Member
Joined: Tue, 04 Sep 2018
Posts: 253
Team:
Reputation: 238 Reputation
Offline
Wed, 23 Jan 2019 @ 12:11:56

dda said:

blandyuk said:

I've slightly improved the sorting speed of App.Merge.exe so download latest v0.61 below:

https://hashkiller.co.uk/downloads/App.Merge.zip


after sorting, the file is doubled. the output file lines become more than twice

i confirm that

From 71.7 Go To 111 Go with 2 billon duplicate removed


Rep+ is appreciated
Discord : DarkDeath25#0342
BTC if i helped : 125jYmWxjJGtHJSfhoTQCjDnYNZEdbEHKV

Avatar
blandyuk
Admin / Owner
Status: Trusted
Joined: Tue, 05 Jul 2011
Posts: 3226
Team: HashKiller
Reputation: 7734 Reputation
Offline
Wed, 23 Jan 2019 @ 12:35:31

Sorry! Please download App.Merge again as I released test code which caused an issue. Its fixed now so please download again using same link and re-test.


Please read the forum rules | Please read the paid section rules
I accept private hash lists, with forum donations only.
BTC: 1JZGVq58m4RS1QQS8JE5xndzDFy2BvGU6y
GPU Power: 9x GTX 1070 + 6x GTX 1080

Avatar
DarkDeath25

Status: Member
Joined: Tue, 04 Sep 2018
Posts: 253
Team:
Reputation: 238 Reputation
Offline
Wed, 23 Jan 2019 @ 14:14:00

blandyuk said:

Sorry! Please download App.Merge again as I released test code which caused an issue. Its fixed now so please download again using same link and re-test.

Yep it's all ok
From 71.7 Go To 40.8 Go
Thank you


Rep+ is appreciated
Discord : DarkDeath25#0342
BTC if i helped : 125jYmWxjJGtHJSfhoTQCjDnYNZEdbEHKV

Avatar
payknight

Status: Cracker
Joined: Wed, 13 Apr 2016
Posts: 672
Team: just4fun
Reputation: 372 Reputation
Offline
Wed, 23 Jan 2019 @ 15:41:54

blandyuk said:

I missed a couple of very large lists but good enough for my purposes.

Hashes.org is in my smaller wordlists so not needed.

App.merge removes lines over 4096 chars as pointless.

u should however edit the app.merge to accepte up to 64GB of RAM .
just saying that 3gb of ram is pretty mandatory nowdays.
and be able to give more ram would process the files faster no ?


+rep if i helped
BTC : 1PAyKniGHt7yyCb8HdsziTHBEFX6zkGSHz

Avatar
blandyuk
Admin / Owner
Status: Trusted
Joined: Tue, 05 Jul 2011
Posts: 3226
Team: HashKiller
Reputation: 7734 Reputation
Offline
Wed, 23 Jan 2019 @ 16:34:05

Well, not really as the app has to purge all data to files so the disk ends up being the bottleneck anyway. If you had 64GB, it would still have to purge it to disk and thus, take as long as the disk requires.

It's only the initial reading part which uses 3GB of RAM. The sort / dup removal and final merge does not use much RAM really.


Please read the forum rules | Please read the paid section rules
I accept private hash lists, with forum donations only.
BTC: 1JZGVq58m4RS1QQS8JE5xndzDFy2BvGU6y
GPU Power: 9x GTX 1070 + 6x GTX 1080

Avatar
weed

Status: Scammer
Joined: Mon, 14 Jan 2019
Posts: 28
Team:
Reputation: 20 Reputation
Offline
Fri, 25 Jan 2019 @ 01:48:58

WARNING! User is BANNED and maybe a SCAMMER.

Thank you

Merge complete to: lll.txt
Total words : 1142443555
Words skipped: 40
Duplicates removed: 456065507
$HEX[...] conversions: 60756
Total time: 0 hrs 22 mins 38.81 secs


Avatar
weed

Status: Scammer
Joined: Mon, 14 Jan 2019
Posts: 28
Team:
Reputation: 20 Reputation
Offline
Fri, 25 Jan 2019 @ 02:01:29

WARNING! User is BANNED and maybe a SCAMMER.

It would be better if your app deletes the file after merging it
I mean when position is 100% delete the wordlist so it opens more memory at hard drive.



41 Results - Page 1 of 2 -
1 2

We have a total of 206388 messages in 25426 topics.
We have a total of 22591 registered users.
Our newest registered member is Overcoming.