The StarThinker project will no longer receive new solution contributions from the Google team.
Please read the full StarThinker Open Source Support Ends At Google article for more details.



All

donut_small CM360 Report To BigQuery

Move existing CM report into a BigQuery table.



lock_openGet Access listGit Hub sourcePython menu_bookColab airAirflow thumb_upTest



Instructions

Specify an account id.
Specify either report name or report id to move a report.
The most recent valid file will overwrite the table.
Schema is pulled from the official CM specification.

Details

Open Source YES
Age Aug. 14, 2017 (5 years, 4 months)
Authors kenjora@google.com
Shedule Days Configured by user.
Shedule Hours Configured by user.
[
    {
        "dcm": {
            "auth": {
                "field": {
                    "name": "auth_read",
                    "kind": "authentication",
                    "order": 0,
                    "default": "user",
                    "description": "Credentials used for reading data."
                }
            },
            "report": {
                "account": {
                    "field": {
                        "name": "account",
                        "kind": "integer",
                        "order": 2,
                        "default": "",
                        "description": "CM network id."
                    }
                },
                "report_id": {
                    "field": {
                        "name": "report_id",
                        "kind": "integer",
                        "order": 3,
                        "default": "",
                        "description": "CM report id, empty if using name ."
                    }
                },
                "name": {
                    "field": {
                        "name": "report_name",
                        "kind": "string",
                        "order": 4,
                        "default": "",
                        "description": "CM report name, empty if using id instead."
                    }
                }
            },
            "out": {
                "bigquery": {
                    "auth": {
                        "field": {
                            "name": "auth_write",
                            "kind": "authentication",
                            "order": 1,
                            "default": "service",
                            "description": "Credentials used for writing data."
                        }
                    },
                    "dataset": {
                        "field": {
                            "name": "dataset",
                            "kind": "string",
                            "order": 5,
                            "default": "",
                            "description": "Dataset to be written to in BigQuery."
                        }
                    },
                    "table": {
                        "field": {
                            "name": "table",
                            "kind": "string",
                            "order": 6,
                            "default": "",
                            "description": "Table to be written to in BigQuery."
                        }
                    },
                    "header": true,
                    "is_incremental_load": {
                        "field": {
                            "name": "is_incremental_load",
                            "kind": "boolean",
                            "order": 7,
                            "default": false,
                            "description": "Clear data in destination table during this report's time period, then append report data to existing table."
                        }
                    }
                }
            }
        }
    }
]


Run This Workflow In Minutes On Google Cloud

Everything from a quick Google Cloud UI to reference developer code for your team in one GitHub repository.

Deployment Stepslaunch Developer Guidebuild UI How Tolaptop