BigQuery authentication on remote servers

[andrioni]

Hello, I can't get the BigQuery auth to work on remote servers:

WARNING:root:This function, oauth2client.tools.run(), and the use of the gflags library are deprecated and will be removed in a future version of the library.
Your browser has been opened to visit:

    big-url-here

If your browser is on a different machine then exit and re-run
this application with the command-line parameter

  --noauth_local_webserver

Even if I try to open that URL on my workstation, it tries to redirect me to a local server. The documentation says that:

Should the browser not be available, or fail to launch, a code will be provided to complete the process manually.

however, I've yet to see this alternative.

Any help?

[jreback]

cc @jacobschaer

[andrewryno]

What I wound up doing to get around this was to run a basic query using an iPython notebook, authenticating with Google BigQuery, and then copying the resulting bigquery_credentials.dat file to the remote servers. Initially I had to just rename the .bigquery.v2.token that the old client used. Annoying, but it at least works since it has a refresh token so I don't need to touch it. Would be nice to get a better flow going.

[jacobschaer]

@andrewryno Just curious, what would a good flow be for you? I haven't had this use case in a while... When we originally wrote the module it would yield a token string to enter into your browser. What version of the bigquery libraries are you using?

[andrewryno]

@jacobschaer I've thought about it a bit but haven't come up with a great solution. As long as I can do it in a REPL on a remote server without a browser, that's fine. I can't remember which tool it was (old bq version possibly), but they output the URL for you to go to manually, set the redirect_uri to urn:ietf:wg:oauth:2.0:oob which gives you a code to enter into the CLI. Won't try to open a browser automatically but you do it manually to finish the flow. It's the installed application flow instead of a user flow.

[parthea]

This exists in the latest code (0.17.0). When I run df.to_gbq() without the bigquery_credentials.dat the code seems to fail silently. I see the following message: Your browser has been opened to visit: When I click on the link, it redirects me to http://localhost:8080/, which fails since the iPython server is remote.

I would like to try and develop a feature to improve the authentication flow on remote servers if no one else is working on it.

[parthea]

I see there is a PR for this already, although I haven't had a chance to try it #8590 . The PR was closed and code wasn't merged. Do we re-open #8590 or create a new PR?

[jreback]

@parthea you could certainly pull that out and re-purpose it (e.g. you can incorporate parts of that and/or copy) and then just open a new PR