googlebot Questions
9
Solved
Is it possible to fine-tune directives to Google to such an extent that it will ignore part of a page, yet still index the rest?
There are a couple of different issues we've come across whic...
Scleroprotein asked 30/9, 2009 at 11:5
4
Solved
I see significant traffic coming from this Bot when we send SMS to users. I am trying to get more details about this bot. Any pointers describing what it does, how important it is, and can we...
2
Solved
I have a website with a video from Vimeo embedded as:
<iframe src="//player.vimeo.com/video/496371201" frameborder="0"></iframe>
Google says that it cannot index th...
5
Solved
I would like to tell Google not to index certain parts of the page. In Yandex (russian SE) there's a very useful tag called <noindex>. How can it be done with Google?
3
I am trying to tell Google and other search engines not to crawl some parts of my web page.
What I do is:
<!--googleoff: all-->
<select name="ddlCountry" id="ddlCountry">
<option ...
Elayneelazaro asked 14/1, 2013 at 6:21
2
Solved
I have made the Pull Request to this project, which is owned by google. So, google asks for Contributor Licence Agreement. which I have signed here. I have created CLA.
Firsly, I thought that ther...
Chlorothiazide asked 26/7, 2019 at 6:19
2
Solved
I can't seem to find a clear answer on this.
If my page looks like this:
<html>
<head>
<script>
var mypets = [
{ 'type': 'dog', 'name':'rover' },
{ 'type': 'cat', 'name':'k...
Zeringue asked 14/10, 2013 at 18:52
9
Solved
I have my blog (you can see it if you want, from my profile), and it's fresh, as well as google robots parsing results are.
The results were alarming to me. Apparently the most common 2 wor...
2
probably duplicate question Best way to set up 404 pages in a angular SPA? but I didn't find a reliable answer for my question .
I'm curious to know if there is a way to tell googlebot about a 404 ...
Karnak asked 14/3, 2016 at 14:17
3
I have used CodeIgniter to develop my website but when my website is searched in Google, Google shows links to the files (pdf) in a particular folder and user can view these files (pdf) directly wi...
Stipend asked 3/9, 2012 at 11:34
4
I have a few single page web apps on multiple domains that heavily rely on javascript/ajax to fetch and show content. Based on logs and search results I can tell that googlebot runs javascript on s...
Wonderstricken asked 23/3, 2014 at 8:42
6
Solved
I'm running a site with a lot of content, but little traffic, on a middle-of-the-road dedicated server.
Occasionally, Googlebot will stampede us, resulting in Apache maxing out its memory, and ca...
Sewerage asked 25/8, 2009 at 13:55
2
I'm having an issue with getting Googlebot to correctly render my webpage(s).
It's rendering the header and one "row" of my page (just the page's top background picture), and then failing to rende...
Littleton asked 29/6, 2016 at 15:13
3
Look at the robots.txt of this site:
fr2.dk/robots.txt
The content is:
User-Agent: Googlebot
Disallow: /
That ought to tell google not to index the site, no?
If true, why does the site appear...
Inlaw asked 22/1, 2011 at 16:50
3
Solved
I am working on Angular2 based web app. I used Angular CLI to generate app and then to build it for prod. I have hosted website on AWS S3 & Cloudfront. When I use 'Fetch as Google' tool from th...
1
I have a react-router site on Amazon S3, with 404 redirects set to hit index.html, where they find the code they need and the site does what it should.
In Google Webmaster Tools, "Fetch as Google"...
Branch asked 23/3, 2017 at 19:1
7
Solved
I can't seem to find any information on how google determines if you are cloaking your content. How, from a technical standpoint, do you think they are determining this? Are they sending in things ...
Tombola asked 10/12, 2009 at 2:51
1
Solved
I'm using the following Nginx configuration to prevent the indexing of content in some of my folders when I use the x-robots tag
location ~ .*/(?:archive|filter|topic)/.* {
add_header X-Robots-Tag...
4
Since the end of may, I have a lot of new 404 errors in the Smartphone Crawl Errors page in Webmaster Tools / Google search console. All of them starts with /m/ or /mobile/, none of which are exist...
Intercut asked 12/6, 2015 at 8:7
4
We have an AngularJS site using HTML5 routes. I just did some test "Fetch as Google" runs. The results are a bit confusing:
On the fetching tab, I see our site as it looks on view source, with a...
4
I have an AngularJS application that is injected into 3rd party sites. It injects dynamic content into a div on the 3rd party page. Google is successfully indexing this dynamic content but does not...
Reproachful asked 12/10, 2016 at 22:35
1
I have a new site and a new domain, will take about 2 months to complete development and then will go live. Only then I want google starts crawling and indexing my site.
So the question is how to "...
Iciness asked 14/9, 2016 at 16:29
3
Solved
I use jQuery to retrieve content from the database with a json request. It then replaces a wildcard in the HTML (like %title%) with the actual content. This works great and this way I can maintain ...
3
Solved
I have been investigate a bit. Will code below work? Not so easy to check.
RewriteEngine on
HostnameLookups Double
RewriteCond %{REMOTE_HOST} (\.googlebot\.com) [NC]
RewriteRule ^(.*)$ /do-some...
0
I have an AJAX site leuker.nl and when googlebot comes along the site is started and it will retrieve an XML file from my backend server that contains site text.
The HTTP GET request used to retrie...
1 Next >
© 2022 - 2025 — McMap. All rights reserved.