googlebot Questions
2
Solved
I'm having an error with my website where it's not showing on Google any more. It had been well indexed last week, but now has no pages indexed. No major changes were made for this, but when I use ...
Wreckfish asked 5/11, 2015 at 11:7
2
I need to block some of my pages from search engines.How can I do that ?
App has been developed by using ASP.net MVC and AngularJS. Thanks in advance.
These are the urls which I want to block from...
Luffa asked 11/8, 2015 at 13:25
2
I am making a website with personal articles. The body of my articles is a basic div containing paragraphs, but recently I found it useful to use some span's out of the paragraphs to manage my cont...
Nodus asked 24/4, 2015 at 16:23
3
Solved
For SEO, I have been tasked with adding a rel="nofollow" to all external links*.
The simplest and least obtrusive way to add rel="nofollow" to each external link is with some jQuery. I've done thi...
Oversubtlety asked 15/1, 2013 at 10:45
1
Solved
I'm deciding whether it's safe to develop my client-facing app in AngularJS using pushState.
I've read that when using pushState in an AngularJS app, we don't need to worry about Googlebot because...
Selenography asked 14/1, 2015 at 21:55
2
Solved
Some hours my web site's server has too much load.
Which HTTP status code should I send to the Googlebot that visits my website?
Is "269 Call Back Later" this suitable for this case, or 503 Servi...
Meathead asked 18/8, 2012 at 21:36
1
Solved
Google has just completed (I saw the page refresh in front of me right now) JavaScript indexing. Which is cool since I no longer need all my tooling for that. Google will now execute JavaScript - t...
Makebelieve asked 27/5, 2014 at 14:0
1
So I just had a nuts hour trying to figure out why my logs went berserk with slow PHP script warnings literally a few times every minute for the last few hours.
I was initially concentrating on the...
5
Solved
Is it possible for google or any other crawler to crawl and index a page which returns a 301 status code?
I have seen a page in google, which has had a 301 for months. However the cache date of th...
Soileau asked 24/10, 2013 at 11:0
5
Solved
I'm going to block all US IPs using .htaccess this way :
<Limit GET HEAD POST>
order deny,allow
deny from 3.0.0.0/8
deny from 4.0.0.0/25
deny from 4.0.0.128/26
deny from 4.0.0.192/28
deny fr...
1
Two days in a row my site has gone down and started responding with Error 500 to every request. Both times, I found this in the logs.
Started GET "/apple-touch-icon-precomposed.png"
Processing by ...
Dumbbell asked 6/9, 2013 at 10:19
3
Solved
I would like to generate HTML Snapshots using Watir, hosted on Heroku.
Google's Full Specification for Making AJAX Applications Crawlable suggests using HTMLUnit... see How do I create an HTML...
Turoff asked 30/8, 2010 at 0:11
2
Solved
I have a very interesting problem that I am failing to explain.
Every 2 to 6 seconds googlebot (I have looked up googlebots IP, its the real thing [using host IP]) is requesting a page on our site...
Eleventh asked 2/12, 2012 at 6:17
2
Solved
I have an rewrite recursion error somewhere on my website that Google Bot caused, but I can't find the url that caused it because my Loglevel is low. I raised it but it has not happened again so fa...
Lasso asked 9/2, 2011 at 16:20
4
Solved
When googlebot crawls pages does it have session? For example I am storing some variables on the session and using them in my site's pages. When googlebot crawls these pages will I still have the s...
Annadiane asked 31/10, 2011 at 19:54
3
Solved
Let says someone has 'legitimately' hidden content within a page.
To explain this further, imagine the following:
<div id="tab-one">This is the content inside tab one</div>
<div id...
4
Solved
In the last couple of days, we have started to receive a missing template error when the google bot attempts to access our main home page (welcome/index). I have been staring at this for a couple o...
Serafina asked 16/1, 2012 at 14:57
2
Solved
Looking through my search logs from time to time, I notice that by far the biggest user of my search engine is the google-bot. What gives? Is it looking for content that might not be directly acces...
2
Solved
I don't have a lot of hair, but I'm pulling out what little of it is left.
My MVC3 app serves images via Action like so
/Image/ShowImage/25-000252?t=a&o=1
a is predefined image size, o is ...
Cheops asked 11/6, 2011 at 15:13
1
Solved
I would like to know if it's possible to paginate using cursors and keep those pages optimized for SEO at the same time.
/page/1
/page/2
Using offsets, gives to Google bot some information about...
Piselli asked 19/9, 2011 at 9:19
1
Solved
The Googlebot seems to be crawling up inside my jQuery and creating links ending in /a that don't exist and then reporting them as 404 errors.
http://www.mySite.com/a
The site validates green at t...
Solnit asked 21/4, 2011 at 20:17
1
Solved
I am having the hardest time determining the cause of our Asp.net site not getting indexed in search engines - the entire site. When I use google's "Fetch As Googlebot" tool, it throws the below er...
3
Solved
I am bouncing between posting this here and on Superuser. Please excuse me if you feel this does not belong here.
I am observing the behavior described here - Googlebot is requesting random urls o...
Mccartney asked 30/3, 2010 at 17:59
2
I have login/signup popups on my site which are in hidden div by default.
According to Google SEO and hidden elements googlebot should NOT see it.
But Google Webmaster tool says that keywords "ema...
2
Solved
Googlebot has been occasionally indexing one of our sites with a bad query string parameter. I am not sure how it is getting this query string parameter (there don't appear to be any sites linking ...
Boast asked 20/8, 2009 at 21:22
© 2022 - 2025 — McMap. All rights reserved.