What is the best way to see a URL exists and the response is not a 404 ?

I am working on a project which lists file sharing urls from the likes of Oron, filespost, depositfiles etc that reports sharing of copyrighted materials to identified content owners and rights hol...