The StarThinker project will no longer receive new solution contributions from the Google team.
Please read the full StarThinker Open Source Support Ends At Google article for more details.



All

donut_large DV360 Report To BigQuery

Move existing DV360 reports into a BigQuery table.



lock_openGet Access listGit Hub sourcePython menu_bookColab airAirflow thumb_upTest



Instructions

Specify either report name or report id to move a report.
A schema is recommended, if not provided it will be guessed.
The most recent valid file will be moved to the table.

Details

Open Source YES
Age Aug. 14, 2017 (5 years, 4 months)
Authors kenjora@google.com
Shedule Days Configured by user.
Shedule Hours Configured by user.
[
    {
        "dbm": {
            "auth": {
                "field": {
                    "name": "auth_read",
                    "kind": "authentication",
                    "order": 0,
                    "default": "user",
                    "description": "Credentials used for reading data."
                }
            },
            "report": {
                "report_id": {
                    "field": {
                        "name": "dbm_report_id",
                        "kind": "integer",
                        "order": 2,
                        "default": "",
                        "description": "DV360 report ID given in UI, not needed if name used."
                    }
                },
                "name": {
                    "field": {
                        "name": "dbm_report_name",
                        "kind": "string",
                        "order": 3,
                        "default": "",
                        "description": "Name of report, not needed if ID used."
                    }
                }
            },
            "out": {
                "bigquery": {
                    "auth": {
                        "field": {
                            "name": "auth_write",
                            "kind": "authentication",
                            "order": 1,
                            "default": "service",
                            "description": "Authorization used for writing data."
                        }
                    },
                    "dataset": {
                        "field": {
                            "name": "dbm_dataset",
                            "kind": "string",
                            "order": 4,
                            "default": "",
                            "description": "Existing BigQuery dataset."
                        }
                    },
                    "table": {
                        "field": {
                            "name": "dbm_table",
                            "kind": "string",
                            "order": 5,
                            "default": "",
                            "description": "Table to create from this report."
                        }
                    },
                    "schema": {
                        "field": {
                            "name": "dbm_schema",
                            "kind": "json",
                            "order": 6,
                            "description": "Schema provided in JSON list format or empty value to auto detect."
                        }
                    },
                    "header": true,
                    "is_incremental_load": {
                        "field": {
                            "name": "is_incremental_load",
                            "kind": "boolean",
                            "order": 7,
                            "default": false,
                            "description": "Clear data in destination table during this report's time period, then append report data to destination table."
                        }
                    }
                }
            }
        }
    }
]


Run This Workflow In Minutes On Google Cloud

Everything from a quick Google Cloud UI to reference developer code for your team in one GitHub repository.

Deployment Stepslaunch Developer Guidebuild UI How Tolaptop