Features
| Feature | Supported | Notes |
|---|---|---|
| Set pipeline frequency | Yes | For more details, see the guide. |
| Full load synchronization | Yes | |
| Dadosfera service account | Yes | Share the spreadsheet with the service email as a Viewer. |
Share the Spreadsheet
Since version 1.8.0, the connector uses the Dadosfera service account. In Google Drive, share the spreadsheet with drive-dadosfera@meta-router-351022.iam.gserviceaccount.com with Viewer permission. Paste the spreadsheet link into the pipeline configuration.
If your pipeline uses the previous OAuth connection, follow the migration notice shown in the pipeline configuration.
Quick Start
To create a pipeline, open the Collect module, go to "Pipelines", and click "New Pipeline".
Choose the Data Source
Use an existing source or register a new one
Pipeline Information
Assign a name and a brief description to your pipeline.
Pipeline Configuration Parameters
| Field name | Description | Example |
|---|---|---|
| Spreadsheet link | Full spreadsheet URL. | https://docs.google.com/spreadsheets/d/spreadsheetId/edit#gid=0 |
Click "Save and Continue".
❗ File Extension
A spreadsheet created in Excel and uploaded to Google Drive is saved with the xlsx or xls extension. Before collecting it into Dadosfera, check whether the file is still in either format. If it was not converted automatically, go to File > Save as Google Sheets.
Specify Tabs
After sharing the spreadsheet, specify which tabs to import during data collection. Enter the exact name of each tab and press Enter.
📘
When entering more than one tab, a separate dataset is created in the catalog for each imported tab.
🚧
In this connector version, column names must not contain double quotation marks: ".
Frequency
- Finally, configure how often your pipeline should run. Choose one of the available options or enter a custom frequency using a cron expression. For more information, see the guide.
📘
The default time zone for scheduling is UTC.
All frequency methods define when extractions begin. They do not control how long replication runs or when the data actually reaches its destination.
Done! Wait for collection to run on the scheduled day and time.
To run the pipeline immediately, you can start it manually within 30 seconds after creating it. Go to "Pipelines", "List", and "Synchronize Pipeline".
After a few minutes, your pipeline will be cataloged as a Data Asset in the Explore tab.
You can also open "View pipeline" in the pipeline list to review the summary, collected entities and columns, execution history, and micro-transformation history.