Visualizing the SiteMap of a large (page number) website [closed]

Question

I'm looking for a tool or service that can spider a web domain with a large number of pages, create a sitemap, and then visualize that map in a way that will help me see, understand and group content (I'm new to the site) Something like a tree-view or other standard Site Map visualizations would be great. I am yet unable to find a tool that does this (I've found plenty of things to spider the site and create an xml file, nothing to visualize it)

Thanks!

Hodden

Just out of curiosity, how large is large? 100 pages? 1000? 10000? more? – Fruit

Answer 1

The software Gephi and one of its plugins provides exactly the function that you need.

Elledge

Answer 2

For visualization you can check D3.js

For example Force-Directed Graph

Hereinafter

Answer 3

Visualize website structure you can with Site Visualizer software.

Download and install it, then create new project and click Start toolbutton. After the site will be crawled, open Visual Sitemap tab and click Draw button. Visual map of the site will be created as a set of pages (rectangles) and links (arrows). Click on a rectangle in order to highlight all outbound links of the page. You can also save this visualization to an image file: png, jpg, bmp, etc.:

Affect

This program crashed my computer when I tried to use it on a large site. Tried a second time and same results. – Kalmar

What is the site you're trying to crawl? – Affect

@dcc, you can also contact the support team, and we'll help you with crawling of any website. – Affect