Exception: Quota Error: User Rate Limit Exceeded

Question

I have a Apps Script where I Loop trough my Google Analytics Account till I get to a certain Profile.
if (profileItems[i].getName() == "Dev Test" )
Than in another function (see bellow) I make the call to the Google Analytics API and always get the Exception thrown: Exception: Quota Error: User Rate Limit Exceeded

function getReportDataForProfile(profileId) {
var tableId = 'ga:' + profileId;
var startDate = getLastNdays(14);   // 2 weeks (a fortnight) ago.
var endDate = getLastNdays(0);      // Today.

var optArgs = {
  'dimensions': 'ga:keyword',              // Comma separated list of dimensions.
  'sort': '-ga:visits,ga:keyword',         // Sort by visits descending, then keyword.
  'segment': 'dynamic::ga:isMobile==Yes',  // Process only mobile traffic.
  'filters': 'ga:source==google',          // Display only google traffic.
  'start-index': '1',
  'max-results': '250'                     // Display the first 250 results.
};

//
//Exponential Backoff
//
for (var n=0; n<6; n++) {
try {
     var results = Analytics.Data.Ga.get(
     tableId,                  // Table id (format ga:xxxxxx).
     startDate,                // Start-date (format yyyy-MM-dd).
     endDate,                  // End-date (format yyyy-MM-dd).
     'ga:visits,ga:pageviews', // Comma seperated list of metrics.
     optArgs);
 } catch(e) {
   if (n == 5) {
     //var results = e;
     //throw new Error('Quota ERROR');
     throw (e) 
   } 
   Utilities.sleep((Math.pow(2,n)*1000) + (Math.round(Math.random() * 1000)));
  }    
}   
 return results;
}   

• I increased the number of the Per user Limit in the API Console to 10.0
  
• The used Porcentage is 6%
  
• And I applied the Exponential Backoff
  
• I also believe that by just asking for the Visits and PageViews I am not exagerating my number of calls.

The full code

Any ideias what is going on?

Kaiserslautern

Answer 1

Maybe you are exceeding the max request per profile per second. That looks like it's set to 10 (https://developers.google.com/analytics/devguides/reporting/core/v3/limits-quotas)

Tenuis

Answer 2

That's indeed because you are not allowed to query more than 10 requests per seconds. I'm posting a solution here (even if that's an old question) because it may help others:

/**
 * CallLimiter
 * @param {Number} numberOfCalls how many calls per duration are we allowed to do
 * @param {Number} duration      duration in ms
 */
function CallLimiter(numberOfCalls, duration){
  var lastCall = 0;
  var tokens   = 0;

  return function limiter(f){
    var now = +new Date();

    if (now - lastCall > duration) {
      tokens = numberOfCalls;
    }

    if (tokens <= 0) {
      tokens = numberOfCalls;
      // wait for `duration` before calling limiter(f) again
      return setTimeout(limiter.bind(this, f), duration);
    }

    tokens--;
    lastCall = now;
    f();
  };
}

And here is how to use it:

// Stub...
var Analytics = {Data: {Ga:{get:function(cb){
        cb();
}}}};

function app(){
  // Wrap the api call inside a limiter
  limiter(function(){

    Analytics.Data.Ga.get(function(err, data){
      // do something with the data...

      // ... then, loop if necessary
      app();
    });

  });
}

// Start
app();

And here is a blocking Scala version:

class CallLimiter(rate: Throttler.Rate) {
  var lastCall       = 0
  var duration       = rate.duration.toMillis
  var current_tokens = 0

  def apply[A](f: () => A): A = {
    val d = new Date().getTime

    if (d - lastCall > duration) {
      current_tokens = rate.numberOfCalls
    }
    if (current_tokens <= 0) {
      // wait for `duration` before calling f()
      Thread.sleep(duration)
      current_tokens = rate.numberOfCalls
    }
    current_tokens = current_tokens - 1
    lastCall = d
    f()
  }
}

Usage:

import akka.contrib.throttle.Throttler

val limiter = new CallLimiter(new Rate(10, Duration(1, TimeUnit.SECONDS)))
val accounts = limiter(() => analytics.management().accounts().list().execute().getItems)

Catharine

Your solution is good, but if I have 20 calls waiting on the 10 call limit, your critical section ends with all of them being released at once, hitting the rate limit. – Philippians

Answer 3

You can update the "per-user rate limit" yourself in the Developers Console, in the Quotas section.

This limit is meant to protect you from accidental usage.

You can learn more here: https://developers.google.com/console/help/new/#cappingusage

Carbolize