The StarThinker project will no longer receive new solution contributions from the Google team.
Please read the full StarThinker Open Source Support Ends At Google article for more details.



All

file_download Email Fetch

Import emailed CM report, Dv360 report, csv, or excel into a BigQuery table.



lock_openGet Access listGit Hub sourcePython menu_bookColab airAirflow



Instructions

The person executing this recipe must be the recipient of the email.
Give a regular expression to match the email subject, link or attachment.
The data downloaded will overwrite the table specified.

Details

Open Source YES
Age Oct. 2, 2018 (4 years, 3 months)
Authors kenjora@google.com
Shedule Days Configured by user.
Shedule Hours Configured by user.
[
    {
        "email": {
            "auth": {
                "field": {
                    "name": "auth_read",
                    "kind": "authentication",
                    "order": 1,
                    "default": "user",
                    "description": "Credentials used for reading data."
                }
            },
            "read": {
                "from": {
                    "field": {
                        "name": "email_from",
                        "kind": "string",
                        "order": 1,
                        "default": "",
                        "description": "Must match from field."
                    }
                },
                "to": {
                    "field": {
                        "name": "email_to",
                        "kind": "string",
                        "order": 2,
                        "default": "",
                        "description": "Must match to field."
                    }
                },
                "subject": {
                    "field": {
                        "name": "subject",
                        "kind": "string",
                        "order": 3,
                        "default": "",
                        "description": "Regular expression to match subject."
                    }
                },
                "link": {
                    "field": {
                        "name": "link",
                        "kind": "string",
                        "order": 4,
                        "default": "",
                        "description": "Regular expression to match email."
                    }
                },
                "attachment": {
                    "field": {
                        "name": "attachment",
                        "kind": "string",
                        "order": 5,
                        "default": "",
                        "description": "Regular expression to match atttachment."
                    }
                }
            },
            "write": {
                "bigquery": {
                    "dataset": {
                        "field": {
                            "name": "dataset",
                            "kind": "string",
                            "order": 6,
                            "default": "",
                            "description": "Existing dataset in BigQuery."
                        }
                    },
                    "table": {
                        "field": {
                            "name": "table",
                            "kind": "string",
                            "order": 7,
                            "default": "",
                            "description": "Name of table to be written to."
                        }
                    },
                    "schema": {
                        "field": {
                            "name": "schema",
                            "kind": "json",
                            "order": 8,
                            "default": "[]",
                            "description": "Schema provided in JSON list format or empty list."
                        }
                    },
                    "header": {
                        "field": {
                            "name": "header",
                            "kind": "boolean",
                            "order": 9,
                            "default": false,
                            "description": "Does the csv contain a header row."
                        }
                    },
                    "is_incremental_load": {
                        "field": {
                            "name": "is_incremental_load",
                            "kind": "boolean",
                            "order": 10,
                            "default": false,
                            "description": "Append report data to table based on date column, de-duplicates."
                        }
                    }
                }
            }
        }
    }
]


Run This Workflow In Minutes On Google Cloud

Everything from a quick Google Cloud UI to reference developer code for your team in one GitHub repository.

Deployment Stepslaunch Developer Guidebuild UI How Tolaptop