Skip to main content

Features

FeatureSupportedNotes
Set pipeline frequencyYesFor more details, see the guide.
Full load synchronizationYesSee the tables
Incremental synchronizationYesSee the tables
OAuth connectionYes

Quick Start

To create a pipeline, open the Collect module, go to "Pipelines", and click "New Pipeline".

Choose the Data Source​

Use an existing source or register a new one​

Connection Parameters (Source Registration)​

Field nameDescriptionExample
Account IDUnique identifier of the account associated with the ads. Find your ID here.1471426329522916
Authorize and saveAuthorize the Dadosfera application to access and collect data from your account.

For details about the access required to connect, see this guide.

Pipeline Information​

Assign a name and a brief description to your pipeline.​

Pipeline Configuration Parameters​

📘 Volume Limit

Facebook Ads enforces rate limits. Check here whether your collection will stay within the limit.

Field nameDescriptionExample
Start dateDetermines how much historical data will be extracted.dd/mm/aaaa
End date (optional)Determines how much historical data will be extracted.dd/mm/aaaa
Include deleted objectsSelect this option if you have deleted tables you want to collect

Click "Save and Continue".

Specify Objects​

Synchronization available for each object:

  • campaigns
    • Replication strategy: INCREMENTAL | FULL_TABLE
  • adsets
    • Replication strategy: INCREMENTAL | FULL_TABLE
  • ads_insights_region
    • Replication strategy: INCREMENTAL | FULL_TABLE
  • ads_insights_platform_and_device
    • Replication strategy: INCREMENTAL | FULL_TABLE
  • ads_insights_hourly_advertiser
    • Replication strategy: INCREMENTAL | FULL_TABLE
  • ads_insights_dma
    • Replication strategy: INCREMENTAL | FULL_TABLE
  • ads_insights_country
    • Replication strategy: INCREMENTAL | FULL_TABLE
  • ads_insights_age_and_gender
    • Replication strategy: INCREMENTAL | FULL_TABLE
  • ads_insights
    • Replication strategy: INCREMENTAL | FULL_TABLE
  • ads
    • Replication strategy: INCREMENTAL | FULL_TABLE
  • adcreative
    • Replication strategy: FULL_TABLE

After entering the credentials, you can view and select the entities and columns from the connected source to import during data collection.

You can also define the synchronization mode per object. For more information, see the guide.

📘

When selecting more than one entity, a separate dataset is created in the catalog for each imported table or view.

Frequency​

  • Finally, configure how often your pipeline should run. Choose one of the available options or enter a custom frequency using a cron expression. For more information, see the guide.

📘

  • The default time zone for scheduling is UTC.

  • All frequency methods define when extractions begin. They do not control how long replication runs or when the data actually reaches its destination.

Done! Wait for collection to run on the scheduled day and time.

To run the pipeline immediately, you can start it manually within 30 seconds after creating it. Go to "Pipelines", "List", and "Synchronize Pipeline".

After a few minutes, your pipeline will be cataloged as a Data Asset in the Explore tab.

You can also open "View pipeline" in the pipeline list to review the summary, collected entities and columns, execution history, and micro-transformation history.