Generic GCloudError thrown by psqworker

[ddaws]

I am unsure if this is a problem with gcloud-python or with psq though I am receiving an error when attempting occasionally when running the psqworker.

The error thrown :

Traceback (most recent call last):
  File "/home/dawsonreid/.envs/fb_utm_sync/bin/psqworker", line 11, in <module>
    sys.exit(main())
  File "/home/dawsonreid/.envs/fb_utm_sync/local/lib/python2.7/site-packages/click/core.py", line 716, in __call__
    return self.main(*args, **kwargs)
  File "/home/dawsonreid/.envs/fb_utm_sync/local/lib/python2.7/site-packages/click/core.py", line 696, in main
    rv = self.invoke(ctx)
  File "/home/dawsonreid/.envs/fb_utm_sync/local/lib/python2.7/site-packages/click/core.py", line 889, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/dawsonreid/.envs/fb_utm_sync/local/lib/python2.7/site-packages/click/core.py", line 534, in invoke
    return callback(*args, **kwargs)
  File "/home/dawsonreid/.envs/fb_utm_sync/local/lib/python2.7/site-packages/psq/psqworker.py", line 92, in main
    worker.listen()
  File "/home/dawsonreid/.envs/fb_utm_sync/local/lib/python2.7/site-packages/psq/worker.py", line 79, in listen
    super(MultiprocessWorker, self).listen()
  File "/home/dawsonreid/.envs/fb_utm_sync/local/lib/python2.7/site-packages/psq/worker.py", line 38, in listen
    block=True)
  File "/home/dawsonreid/.envs/fb_utm_sync/local/lib/python2.7/site-packages/psq/queue.py", line 94, in dequeue
    return_immediately=not block, max_messages=max)
  File "/home/dawsonreid/.envs/fb_utm_sync/local/lib/python2.7/site-packages/gcloud/pubsub/subscription.py", line 210, in pull
    method='POST', path='%s:pull' % (self.path,), data=data)
  File "/home/dawsonreid/.envs/fb_utm_sync/local/lib/python2.7/site-packages/gcloud/connection.py", line 343, in api_request
    error_info=method + ' ' + url)
gcloud.exceptions.GCloudError

psqworker will run properly for sometime before erroring out.

[tseaver]

gcloud.exceptions.make_exception only raises a GCloudError if it cannot decode a more specific error type using the response status code. There should be some information about the reason for the API request failure in the message passed into the GCloudError.

Note that there may be occasional, transient failures in making API requests. At the moment, gcloud-python does not attempt to handle such errors for you: your application (psq.worker, in this case) needs to have a policy about how retries, etc. are done.

[dhermes]

I'm surprised the traceback doesn't contain more. The error raised has two arguments:

error = GCloudError(message, errors)

[theacodes]

your application (psq.worker, in this case) needs to have a policy about how retries, etc. are done.

I wrote psq, so that falls on me. You're probably right that it's just a transient error, but it is rather interesting that there isn't any more details.

[dhermes]

@jonparrott You aren't very good at vacation. Thanks for chiming in!

@dreid93 Any chance there is a bit more in the error message? If not, care to use pdb, ipdb or %debug in IPython to step into the error?

[theacodes]

@dhermes I leave tomorrow. :P

On Tue, Mar 29, 2016, 10:25 AM Danny Hermes notifications@github.com
wrote:

@jonparrott https://github.com/jonparrott You aren't very good at
vacation. Thanks for chiming in!

@dreid93 https://github.com/dreid93 Any chance there is a bit more in
the error message? If not, care to use pdb, ipdb or %debug in IPython to
step into the error?

—
You are receiving this because you were mentioned.

Reply to this email directly or view it on GitHub
#1672 (comment)

[ddaws]

@dhermes I will attempt to step into the error to recreate though I cannot consistently reproduce. I will be watching for the error today.

Env Info :

$ python --version
Python 2.7.9

$ pip --version
pip 8.1.1 from ... /local/lib/python2.7/site-packages (python 2.7)

$ pip freeze
cffi==1.5.2
click==6.3
colorlog==2.6.1
configparser==3.5.0b2
cryptography==1.2.3  
enum34==1.1.2  
facebookads==2.5.1  
gcloud==0.11.0
googleapis-common-protos==1.1.0
httplib2==0.9.2
idna==2.0
ipaddress==1.0.16
oauth2client==2.0.1
protobuf==3.0.0b2.post2
psq==0.2.1
pyasn1==0.1.9
pyasn1-modules==0.0.8
pycparser==2.14
pymongo==3.2.1
pyOpenSSL==0.15.1
requests==2.9.1
rsa==3.3
six==1.10.0
Werkzeug==0.11.4

[theacodes]

PSQ version 0.3.0 has been released which should fix this. Please report and further issues over there. Thank you! :)