The StarThinker project will no longer receive new solution contributions from the Google team.
Please read the full StarThinker Open Source Support Ends At Google article for more details.



All

settings_input_component Google API To BigQuery

Execute any Google API function and store results to BigQuery.



lock_openGet Access listGit Hub sourcePython menu_bookColab airAirflow thumb_upTest



Impact Level

Spend Optimization
Spend Growth
Time Savings
Account Health
Csat Improvement

Value Proposition

Call any Google API ednpoint.
Move results into BigQuery.

Instructions

Enter an api name and version.
Specify the function using dot notation.
Specify the arguments using json.
Iterate is optional, use if API returns a list of items that are not unpacking correctly.
The API Key may be required for some calls.
The Developer Token may be required for some calls.
Give BigQuery dataset and table where response will be written.
All API calls are based on discovery document, for example the Campaign Manager API.

Details

Open Source YES
Age June 10, 2018 (4 years, 6 months)
Authors kenjora@google.com
Shedule Days Configured by user.
Shedule Hours Configured by user.
[
    {
        "google_api": {
            "auth": {
                "field": {
                    "name": "auth_read",
                    "kind": "authentication",
                    "order": 1,
                    "default": "user",
                    "description": "Credentials used for reading data."
                }
            },
            "api": {
                "field": {
                    "name": "api",
                    "kind": "string",
                    "order": 1,
                    "default": "displayvideo",
                    "description": "See developer guide."
                }
            },
            "version": {
                "field": {
                    "name": "version",
                    "kind": "string",
                    "order": 2,
                    "default": "v1",
                    "description": "Must be supported version."
                }
            },
            "function": {
                "field": {
                    "name": "function",
                    "kind": "string",
                    "order": 3,
                    "default": "advertisers.list",
                    "description": "Full function dot notation path."
                }
            },
            "kwargs": {
                "field": {
                    "name": "kwargs",
                    "kind": "json",
                    "order": 4,
                    "default": {
                        "partnerId": 234340
                    },
                    "description": "Dictionray object of name value pairs."
                }
            },
            "kwargs_remote": {
                "field": {
                    "name": "kwargs_remote",
                    "kind": "json",
                    "order": 5,
                    "default": {},
                    "description": "Fetch arguments from remote source."
                }
            },
            "key": {
                "field": {
                    "name": "api_key",
                    "kind": "string",
                    "order": 6,
                    "default": "",
                    "description": "Associated with a Google Cloud Project."
                }
            },
            "headers": {
                "developer-token": {
                    "field": {
                        "name": "developer_token",
                        "kind": "string",
                        "order": 7,
                        "default": "",
                        "description": "Associated with your organization."
                    }
                },
                "login-customer-id": {
                    "field": {
                        "name": "login_customer_id",
                        "kind": "string",
                        "order": 8,
                        "default": "",
                        "description": "Associated with your Adwords account."
                    }
                }
            },
            "results": {
                "bigquery": {
                    "dataset": {
                        "field": {
                            "name": "dataset",
                            "kind": "string",
                            "order": 9,
                            "default": "",
                            "description": "Existing dataset in BigQuery."
                        }
                    },
                    "table": {
                        "field": {
                            "name": "table",
                            "kind": "string",
                            "order": 10,
                            "default": "",
                            "description": "Table to write API call results to."
                        }
                    }
                }
            }
        }
    }
]


Run This Workflow In Minutes On Google Cloud

Everything from a quick Google Cloud UI to reference developer code for your team in one GitHub repository.

Deployment Stepslaunch Developer Guidebuild UI How Tolaptop