Wget

Anyone ever use Wget or something similar to crawl an online journal database?

What if I wanted to extract every single .pdf and have them placed neatly into sub-directories, organized by journal name?

wget -r -np -A.pdf whatever-the-url-is

Erm possibly - haven't used it in years, don't blame me if you end up downloading the whole internet ... I seem to remember something about robots.txt preventing crawling (mass downloading) on sites as well