Features
| Feature | Supported | Notes |
|---|---|---|
| Set pipeline frequency | Yes | For more details, see the guide. |
| Full load synchronization | Yes | |
| Incremental synchronization | No | |
| Service Account connection | Yes | Follow the steps to generate your account secrets file here. |
Quick Start
To create a pipeline, open the Collect module, go to "Pipelines", and click "New Pipeline".
Choose the Data Source
Use an existing source or register a new one
Connection Parameters (Source Registration)
Requirements
Create a Service Account in Google Cloud.
Create the account at this address.
Create a key.
Open the Keys tab, select JSON as the key type, and save the generated file. It can only be downloaded at this time.
Associate the credentials with Google Analytics.
To grant this service account access to your Google Analytics data, add its email address as a new user in your Google Analytics account:
- Go to "Admin > User Management".
- Assign viewer permissions.
Enable the APIs.
Visit the Google Analytics Reporting API dashboard and confirm that the project used in the previous step is selected. Enable the API using the button at the top, so that it changes to "Disable API".
Next, visit the Google Analytics API dashboard, confirm that the project used in the previous step is selected, and enable this API as well.
Enter the JSON in the Dadosfera interface.
| Field name | Description | Formato |
|---|---|---|
| Chave secreta | JSON containing your account's secret keys. Follow the steps to generate it here. | { "type": "", "project_id": "", "private_key_id": "", "private_key": "", "client_email": "", "client_id": "", "auth_uri": "", "token_uri": "", "auth_provider_x509_cert_url": "", "client_x509_cert_url": "" } |
Pipeline Information
Assign a name and a brief description to your pipeline.
Pipeline Configuration Parameters
| Field name | Description | Example |
|---|---|---|
| View ID | Follow the steps to obtain your view ID here. | 188274549 |
| Start date | Determines how much historical data will be extracted. | dd/mm/aaaa |
| End date (optional) | Determines how much historical data will be extracted. | dd/mm/aaaa |
For more information, see this guide.
Click "Save and Continue".
Specify Entities
After entering the credentials, you can view and select the entities and columns from the connected source to import during data collection.
You can also define the synchronization mode per entity. For more information, see the guide.
📘
When selecting more than one entity, a separate dataset is created in the catalog for each imported table or view.
Frequency
- Finally, configure how often your pipeline should run. Choose one of the available options or enter a custom frequency using a cron expression. For more information, see the guide.
📘
The default time zone for scheduling is UTC.
All frequency methods define when extractions begin. They do not control how long replication runs or when the data actually reaches its destination.
Done! Wait for collection to run on the scheduled day and time.
To run the pipeline immediately, you can start it manually within 30 seconds after creating it. Go to "Pipelines", "List", and "Synchronize Pipeline".
After a few minutes, your pipeline will be cataloged as a Data Asset in the Explore tab.
You can also open "View pipeline" in the pipeline list to review the summary, collected entities and columns, execution history, and micro-transformation history.