javascript: how to fetch the content of a web page

Question

In JS is it possible to fetch the content of a web page assigning it to a variable? For example, why the following toy code does not work?

var req = new XMLHttpRequest();
req.open('GET', 'http://www.google.com', false);
req.send(null);
if(req.status == 200)
  alert(req.responseText);

Is there a better method/code?

Severity

en.wikipedia.org/wiki/Same_origin_policy – Duodenal

Answer 1

use a server-side proxy like a php-page that reads the desired page and then make ajax calls to that proxy through javascript :

var req = new XMLHttpRequest();

req.open('GET', 'proxy.php?url=http://www.google.com', false);
req.send(null);

if(req.status == 200) {
   alert(req.responseText);
}

Rexanne

Answer 2

The above does not work, because Ajax requests cannot access files/pages on other domains, due to security concerns. Typically, you can make a script using [Insert Server Side Language here] to download the requested page. Then your javascript can make a request to this page.

There is also 'JSONP', but this is typically used on sites that provide specific JSONP access, which most random URL's do not.

Lagunas

Answer 3

For security reasons, you cannot use AJAX to send a request to a different domain.

Gewgaw

Answer 4

If you really need to do this, you can try using jQuery and iFrames (read more at (read more http://softwareas.com/cross-domain-communication-with-iframes).

Also, you can try with Access-Control-Allow-Origin: http://yourdomain:1234/ in headers, google for Cross-Origin Resource Sharing. It's relativelly new though, not all browsers know about this. That also depends if you have the control of the other server headers generation and few other things.

Lukey