CeWL – Custom Word List Generator

CeWL the Custom Word List generator is a ruby app which spiders a given URL to a specified depth, optionally following external links, and returns a list of words which can then be used for password crackers such as John the Ripper.

CeWL - Custom Word List Generator
CeWL – Custom Word List Generator

By default, Custom Word List Generator sticks to just the site you have specified and will go to a depth of 2 links, this behavior can be changed by passing arguments. All words of three characters and over are output to stdout. This length can be increased and the words can be written to a file rather than screen so the app can be automated.

Custom Word List Generator by the end will generate from the target:

  • A word list of all unique words found on the target site.
  • A list of all email addresses found in mailto links.
  • A list of usernames/author details from meta data found in any documents on the site.

User may include an associated command line app, FAB (Files Already Bagged) which uses the same meta data extraction techniques to create author/creator lists from already downloaded.

There are a large list of options to customize the way you want to spider your target this to avoid any blocking device installed.

You can read more and download the tool over here: https://github.com/digininja/CeWL

Share