The StarThinker project will no longer receive new solution contributions from the Google team.
Please read the full StarThinker Open Source Support Ends At Google article for more details.



All

arrow_forward Storage To Table

Move using bucket and path prefix.



lock_openGet Access listGit Hub sourcePython menu_bookColab airAirflow



Instructions

Specify a bucket and path prefix, * suffix is NOT required.
Every time the job runs it will overwrite the table.

Details

Open Source YES
Age March 15, 2018 (4 years, 9 months)
Authors kenjora@google.com
Shedule Days Configured by user.
Shedule Hours Configured by user.
[
    {
        "bigquery": {
            "auth": {
                "field": {
                    "name": "auth_read",
                    "kind": "authentication",
                    "order": 1,
                    "default": "user",
                    "description": "Credentials used for reading data."
                }
            },
            "from": {
                "bucket": {
                    "field": {
                        "name": "bucket",
                        "kind": "string",
                        "order": 1,
                        "default": "",
                        "description": "Google cloud bucket."
                    }
                },
                "path": {
                    "field": {
                        "name": "path",
                        "kind": "string",
                        "order": 2,
                        "default": "",
                        "description": "Path prefix to read from, no * required."
                    }
                }
            },
            "to": {
                "auth": {
                    "field": {
                        "name": "auth_write",
                        "kind": "authentication",
                        "order": 1,
                        "default": "service",
                        "description": "Credentials used for writing data."
                    }
                },
                "dataset": {
                    "field": {
                        "name": "dataset",
                        "kind": "string",
                        "order": 3,
                        "default": "",
                        "description": "Existing BigQuery dataset."
                    }
                },
                "table": {
                    "field": {
                        "name": "table",
                        "kind": "string",
                        "order": 4,
                        "default": "",
                        "description": "Table to create from this query."
                    }
                }
            },
            "schema": {
                "field": {
                    "name": "schema",
                    "kind": "json",
                    "order": 5,
                    "default": "[]",
                    "description": "Schema provided in JSON list format or empty list."
                }
            }
        }
    }
]


Run This Workflow In Minutes On Google Cloud

Everything from a quick Google Cloud UI to reference developer code for your team in one GitHub repository.

Deployment Stepslaunch Developer Guidebuild UI How Tolaptop