google-cloud-pubsub Questions
2
Solved
We have a data pipeline built in Google Cloud Dataflow that consumes messages from a pubsub topic and streams them into BigQuery. In order to test that it works successfully we have some tests that...
Sihon asked 30/11, 2021 at 15:58
2
Solved
Update: Link to repo is moved to answer because repo is now updated with code from answer below.
Problem description
Current code is working, but it is using gcloud beta emulators pubsub from googl...
Strasbourg asked 4/9, 2021 at 19:23
2
Solved
In my GCP project (project A) I have created a Pub/sub topic (topicA) and messages published in this pub/sub topic needs to be consumed in other GCP project (project B) by Subscription (subscriptio...
Incapacious asked 21/6, 2020 at 9:37
1
I am facing the following error while running a streaming pipeline (python) in Apache Beam on Flinkrunner. The pipeline contains a GCP pub/sub io source and pub/sub target.
WARNING:root:Make sure t...
Nikolas asked 12/7, 2021 at 4:58
1
I am using firebase functions with pubsub. The functions are invoked every time there is an incoming message (push)
I am looking at incorporating retry mechanism for the functions. The retry is not...
Aphotic asked 9/5, 2022 at 4:24
2
Solved
I'm new to Google Cloud SQL and Pub/Sub. I couldn't find documentation anywhere about this. But another question's accepted and upvoted answer seems to say it is possible to publish a Pub/Sub messa...
Broglie asked 1/9, 2020 at 2:6
3
Trying to figure out the best way to test PubSub push endpoints locally. We tried with ngrok.io, but you must own the domain in order to whitelist (the tool for doing so is also broken… resulting i...
Bonanza asked 29/7, 2016 at 20:58
2
Error: too much contention on these datastore entities. please try again.
at /Users/wgosse/Documents/data-transfer-request/node_modules/grpc/src/node/src/client.js:554:15 code: 409, metadata: Metad...
Lunitidal asked 13/12, 2017 at 15:44
4
Solved
I am learning Google Cloud Pub/Sub and following this official document : Writing and Responding to Pub/Sub Messages - Python
When I deploy it to cloud, and try to submit the message,
I get the ...
Anasarca asked 3/6, 2016 at 21:13
1
So, the message size limit is 10Mb.
I've been using Pub/Sub as both an input and output for data pipelines because of its low latency. The assumption here is that the Pub/Sub is the fastest mechani...
Penicillate asked 22/12, 2021 at 7:8
4
I have a simple python script that uses Google pubsub to detect new files in the google cloud storage. The script simply adds new messages to a queue where another thread processes those messages:
...
Mallorca asked 16/2, 2018 at 20:29
3
I tried to execute gmail api's watch on my two gmail accounts and it works fine.
But when the other user tried to do so, it shows this error:
HTTP error 400 : "Only one user push notification c...
Hibachi asked 30/7, 2015 at 5:55
1
I am using the Go SDK with Apache Beam to build a simple Dataflow pipeline that will get data from a query and publish the data to pub/sub with the following code:
package main
import (
"con...
Cornstarch asked 20/10, 2021 at 19:0
1
Solved
The PubSub service account is service-<PROJECT_NUMBER>@gcp-sa-pubsub.iam.gserviceaccount.com
The command described here to create an IAM policy binding succeeds, which shows that the service ...
Perquisite asked 14/10, 2021 at 10:12
2
Solved
I have a Cloud Function that is being triggered from a Pub/Sub topic.
I want to rate limit my Cloud Function, so I set the max instances to 5. In my case, there will be a lot more produced messages...
Pharmacopoeia asked 19/8, 2021 at 11:7
3
Solved
I need this ability to send push notifications for an action in a mobile app but wait for the user to undo the action until say 10 seconds.
Is it possible to delay the processing of a message publ...
Halfwitted asked 28/9, 2016 at 8:34
2
I have a cloud run service which will run upto 60 minutes.The pubsub is the trigger point for execution of cloud run service.
pubsub configuration for Retry policy is set to max (600s).
Now when a ...
Seringapatam asked 31/8, 2021 at 12:17
2
I wrote a function that receive a http request and send a e-mail. But, I would like receive a http request and send a pub message. The problem is that the documentation is not clear. How I do that?...
Orchestra asked 13/1, 2018 at 14:30
4
Almost all of the examples of pub/sub available over web uses String messages.
How do I publish message other than text messages like Java Object, JSON or AVRO to topic and then consume it through...
Salesroom asked 3/7, 2018 at 7:42
1
We have a pubsub subscription setup passing requests to a Google Cloud Function.
Both the cloud function and the subscription to it are set to "Retry on Failure" (both with exponential b...
Shaneka asked 4/8, 2021 at 2:38
1
I'm attempting to create a SubscriberClient using ImpersontatedCredentials (impersonating a service account) using the python pubsub API, and then creating some subscriptions with that client. I'm ...
Transmittance asked 2/8, 2021 at 21:8
2
Solved
I have a pubsub topic with a number of pull subscriptions. I would like some mechanism where I can publish a message with a "priority" label that causes the message to jump as near to the front of ...
Bigford asked 24/9, 2018 at 20:5
1
There is an issue with my company's Pub/Sub. Some of our messages are stuck and the oldest unacked message age is increasing over time.
1 day charts:
and when I go to metrics explorer and select ...
Weigela asked 20/7, 2021 at 15:55
2
GCP documentation says the max runtime a cloud run container can be 60 min (Timeouts greater than 15 minutes are a Beta feature.) Now, one of the way to trigger cloud run is via pub-sub push subscr...
Ganja asked 11/2, 2021 at 15:38
1
Solved
I am new to GCP. I am trying to use Pub/Sub service with schema definition using protobuf.
Schema:
syntax = "proto3";
import "google/protobuf/any.proto";
message Endorsement {...
Savonarola asked 12/7, 2021 at 4:40
© 2022 - 2025 — McMap. All rights reserved.