WWW FAQs: How do I measure the size of a website?


2006-06-28: What do you mean by the "size" of a website? Are you trying to count distinct web pages? Or do you also include images in your concept of size? How about videos? Are you concerned about the number of distinct items, or about the total disk space involved?

You'll need to settle those questions for yourself. But regardless of what you're trying to measure, the best way to get that answer is to use wget. wget is an excellent website "mirroring" tool that can download an entire site to your hard drive... and then you can simply peek at the folder's properties on the Windows desktop (or Linux, or MacOS X...) to find out how many files it contains and how much disk space they occupy.

For complete information about using wget, see the article How do I mirror another website?

Legal Note: yes, you may use sample HTML, Javascript, PHP and other code presented above in your own projects. You may not reproduce large portions of the text of the article without our express permission.

Got a LiveJournal account? Keep up with the latest articles in this FAQ by adding our syndicated feed to your friends list!