-
Notifications
You must be signed in to change notification settings - Fork 77
Integrate upstream package variables into Quickstart #179
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from all commits
6d1d3b0
b4e9e12
83f48fc
e39e8a3
465cc71
d19fd18
9f534d2
a95337c
e6056cb
55ec20a
c0e5090
bbaa6a6
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -5,50 +5,260 @@ multi_connector_config: | |
| database_key: amazon_ads_database | ||
| union_schema_key: amazon_ads_union_schemas | ||
| model_variable: ad_reporting__amazon_ads_enabled | ||
| public_models: | ||
| - amazon_ads__account_report | ||
| - amazon_ads__portfolio_report | ||
| - amazon_ads__campaign_report | ||
| - amazon_ads__ad_group_report | ||
| - amazon_ads__ad_report | ||
| - amazon_ads__keyword_report | ||
| - amazon_ads__search_report | ||
| apple_search_ads: | ||
| database_key: apple_search_ads_database | ||
| union_schema_key: apple_search_ads_union_schemas | ||
| model_variable: ad_reporting__apple_search_ads_enabled | ||
| public_models: | ||
| - apple_search_ads__organization_report | ||
| - apple_search_ads__campaign_report | ||
| - apple_search_ads__ad_group_report | ||
| - apple_search_ads__ad_report | ||
| - apple_search_ads__keyword_report | ||
| - apple_search_ads__search_term_report | ||
| facebook_ads: | ||
| database_key: facebook_ads_database | ||
| union_schema_key: facebook_ads_union_schemas | ||
| model_variable: ad_reporting__facebook_ads_enabled | ||
| public_models: | ||
| - facebook_ads__account_report | ||
| - facebook_ads__campaign_report | ||
| - facebook_ads__ad_set_report | ||
| - facebook_ads__ad_report | ||
| - facebook_ads__url_report | ||
| - facebook_ads__url_tags | ||
| - facebook_ads__country_report | ||
| - facebook_ads__region_report | ||
| google_ads: | ||
| database_key: google_ads_database | ||
| union_schema_key: google_ads_union_schemas | ||
| model_variable: ad_reporting__google_ads_enabled | ||
| public_models: | ||
| - google_ads__account_report | ||
| - google_ads__campaign_report | ||
| - google_ads__campaign_bid_modifiers_report | ||
| - google_ads__campaign_budget_diagnostics_report | ||
| - google_ads__ad_group_report | ||
| - google_ads__ad_report | ||
| - google_ads__keyword_report | ||
| - google_ads__search_term_report | ||
| - google_ads__url_report | ||
| supported_vars: | ||
| google_auto_tagging_enabled: | ||
| type: boolean | ||
| value: false | ||
| description: "Are you leveraging the auto-tag feature within Google Ads instead of manually adding UTMs to ads?" | ||
| display_name: "Google Ads: Auto-Tagging Enabled" | ||
| google_ads__spend_low: | ||
| type: float | ||
| value: 100.0 | ||
| description: "Low threshold for spend in your local currency. Campaigns with spend under this value will be categorized as 'low spend'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: Spend Low Threshold" | ||
| google_ads__spend_high: | ||
| type: float | ||
| value: 500.0 | ||
| description: "High threshold for spend in your local currency. Campaigns with spend over this value will be categorized as 'high spend'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: Spend High Threshold" | ||
| google_ads__cpc_low: | ||
| type: float | ||
| value: 1.0 | ||
| description: "Low threshold for cost-per-click (CPC) in your local currency. Campaigns with CPC under this value will be considered 'low CPC'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: CPC Low Threshold" | ||
| google_ads__cpc_high: | ||
| type: float | ||
| value: 3.0 | ||
| description: "High threshold for cost-per-click (CPC) in your local currency. Campaigns with CPC over this value will be considered 'high CPC'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: CPC High Threshold" | ||
| google_ads__ctr_low: | ||
| type: float | ||
| value: 0.015 | ||
| description: "Low threshold for click-through rate (CTR) as decimal. Campaigns with CTR under this value will be considered 'low CTR'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: CTR Low Threshold" | ||
| google_ads__ctr_high: | ||
| type: float | ||
| value: 0.03 | ||
| description: "High threshold for click-through rate (CTR) as decimal. Campaigns with CTR over this value will be considered 'high CTR'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: CTR High Threshold" | ||
| google_ads__bid_modifier_low: | ||
| type: float | ||
| value: 0.7 | ||
| description: "Low threshold for bid modifiers as decimal. Bid modifiers under this value will be considered 'significant negative adjustment'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: Bid Modifier Low Threshold" | ||
| google_ads__bid_modifier_high: | ||
| type: float | ||
| value: 1.5 | ||
| description: "High threshold for bid modifiers as decimal. Bid modifiers over this value will be considered 'high positive adjustment'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: Bid Modifier High Threshold" | ||
| google_ads__budget_low: | ||
| type: float | ||
| value: 0.75 | ||
| description: "Low threshold for budget utilization as decimal. Budget utilization above this value indicates moderate constraint. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: Budget Utilization Low Threshold" | ||
| google_ads__budget_high: | ||
| type: float | ||
| value: 0.95 | ||
| description: "High threshold for budget utilization as decimal. Budget utilization above this value will be considered 'budget constrained'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: Budget Utilization High Threshold" | ||
| google_ads__location_targeting_low: | ||
| type: float | ||
| value: 5.0 | ||
| description: "Low threshold for number of location targets. Campaigns with fewer than this many location targets will be considered 'limited targeting'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: Location Targeting Low Threshold" | ||
| google_ads__location_targeting_high: | ||
| type: float | ||
| value: 50.0 | ||
| description: "High threshold for number of location targets. Campaigns with more than this many location targets will be considered 'broad targeting'. REQUIRED: A value must be provided to avoid runtime failures." | ||
| display_name: "Google Ads: Location Targeting High Threshold" | ||
| linkedin_ads: | ||
| database_key: linkedin_ads_database | ||
| union_schema_key: linkedin_ads_union_schemas | ||
| model_variable: ad_reporting__linkedin_ads_enabled | ||
| public_models: | ||
| - linkedin_ads__account_report | ||
| - linkedin_ads__campaign_group_report | ||
| - linkedin_ads__campaign_report | ||
| - linkedin_ads__creative_report | ||
| - linkedin_ads__url_report | ||
| - linkedin_ads__monthly_campaign_country_report | ||
| - linkedin_ads__monthly_campaign_region_report | ||
| supported_vars: | ||
| linkedin_ads__use_local_currency: | ||
| type: boolean | ||
| value: false | ||
| description: "Present costs in local currency instead of USD. Please note that conversion values are only available in local currency" | ||
| display_name: "LinkedIn Ads: Use Local Currency" | ||
| linkedin_ads__conversion_fields: | ||
| type: list | ||
| value: | ||
| - "external_website_conversions" | ||
| - "one_click_leads" | ||
| description: "Metrics from `AD_ANALYTICS_BY_CAMPAIGN`, `AD_ANALYTICS_BY_CREATIVE`, `MONTHLY_AD_ANALYTICS_BY_MEMBER_COUNTRY`, AND `MONTHLY_AD_ANALYTICS_BY_MEMBER_REGION` that will be tracked as conversions" | ||
| display_name: "LinkedIn Ads: Conversion Metrics" | ||
| bingads: | ||
| database_key: microsoft_ads_database | ||
| union_schema_key: microsoft_ads_union_schemas | ||
| model_variable: ad_reporting__microsoft_ads_enabled | ||
| public_models: | ||
| - microsoft_ads__account_report | ||
| - microsoft_ads__campaign_report | ||
| - microsoft_ads__ad_group_report | ||
| - microsoft_ads__ad_report | ||
| - microsoft_ads__keyword_report | ||
| - microsoft_ads__search_report | ||
| - microsoft_ads__url_report | ||
| - microsoft_ads__campaign_country_report | ||
| - microsoft_ads__campaign_region_report | ||
| supported_vars: | ||
| microsoft_ads_auto_tagging_enabled: | ||
| type: boolean | ||
| value: false | ||
| description: "Are you leveraging the auto-tag feature within Microsoft Ads instead of manually adding UTMs to ads?" | ||
| display_name: "Microsoft Ads: Auto-Tagging Enabled" | ||
| pinterest_ads: | ||
| database_key: pinterest_database | ||
| union_schema_key: pinterest_ads_union_schemas | ||
| model_variable: ad_reporting__pinterest_ads_enabled | ||
| public_models: | ||
| - pinterest_ads__advertiser_report | ||
| - pinterest_ads__campaign_report | ||
| - pinterest_ads__ad_group_report | ||
| - pinterest_ads__pin_promotion_report | ||
| - pinterest_ads__keyword_report | ||
| - pinterest_ads__url_report | ||
| - pinterest_ads__campaign_country_report | ||
| - pinterest_ads__campaign_region_report | ||
| reddit_ads: | ||
| database_key: reddit_ads_database | ||
| union_schema_key: reddit_ads_union_schemas | ||
| model_variable: ad_reporting__reddit_ads_enabled | ||
| public_models: | ||
| - reddit_ads__account_report | ||
| - reddit_ads__campaign_report | ||
| - reddit_ads__ad_group_report | ||
| - reddit_ads__ad_report | ||
| - reddit_ads__url_report | ||
| - reddit_ads__campaign_country_report | ||
| supported_vars: | ||
| reddit_ads__conversion_event_types: | ||
| type: list | ||
| value: | ||
| - "lead" | ||
| - "purchase" | ||
| - "custom" | ||
| description: "`event_name` values from `*_CONVERSIONS_REPORT` tables that will be tracked as conversions" | ||
| display_name: "Reddit Ads: Conversion Event Types" | ||
| snapchat_ads: | ||
| database_key: snapchat_database | ||
| union_schema_key: snapchat_ads_union_schemas | ||
| model_variable: ad_reporting__snapchat_ads_enabled | ||
| public_models: | ||
| - snapchat_ads__account_report | ||
| - snapchat_ads__campaign_report | ||
| - snapchat_ads__ad_squad_report | ||
| - snapchat_ads__ad_report | ||
| - snapchat_ads__url_report | ||
| - snapchat_ads__campaign_country_report | ||
| - snapchat_ads__campaign_region_report | ||
| supported_vars: | ||
| snapchat_ads__conversion_fields: | ||
| type: list | ||
| value: | ||
| - "conversion_purchases" | ||
| description: "Report metrics that will be tracked as conversions" | ||
| display_name: "Snapchat Ads: Conversion Metrics" | ||
| tiktok_ads: | ||
| database_key: tiktok_ads_database | ||
| union_schema_key: tiktok_ads_union_schemas | ||
| model_variable: ad_reporting__tiktok_ads_enabled | ||
| public_models: | ||
| - tiktok_ads__advertiser_report | ||
| - tiktok_ads__campaign_report | ||
| - tiktok_ads__ad_group_report | ||
| - tiktok_ads__ad_report | ||
| - tiktok_ads__url_report | ||
| - tiktok_ads__campaign_country_report | ||
| twitter_ads: | ||
| database_key: twitter_ads_database | ||
| union_schema_key: twitter_ads_union_schemas | ||
| model_variable: ad_reporting__twitter_ads_enabled | ||
| public_models: | ||
| - twitter_ads__account_report | ||
| - twitter_ads__campaign_report | ||
| - twitter_ads__line_item_report | ||
| - twitter_ads__promoted_tweet_report | ||
| - twitter_ads__keyword_report | ||
| - twitter_ads__url_report | ||
| - twitter_ads__campaign_country_report | ||
| - twitter_ads__campaign_region_report | ||
| supported_vars: | ||
| twitter_ads__conversion_fields: | ||
| type: list | ||
| value: | ||
| - "conversion_purchases_metric" | ||
| - "conversion_custom_metric" | ||
| description: "Which fields should be included in calculating the total number of conversions" | ||
| display_name: "Twitter Ads: Conversion Count Fields" | ||
| twitter_ads__conversion_sale_amount_fields: | ||
| type: list | ||
| value: | ||
| - "conversion_purchases_sale_amount" | ||
| - "conversion_custom_sale_amount" | ||
| description: "Which `*_sale_amount` fields should be included in calculating the total value of conversions" | ||
| display_name: "Twitter Ads: Conversion Value Fields" | ||
|
|
||
| table_variables: | ||
|
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. looks like we have a few non-essential tables in the individual packages that feed into some end models. do we need to bring these in here?
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Ah yep lemme add
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Added but adjusted the variable names slightly to indicate which source they belong to ( |
||
| amazon_ads__portfolio_history_enabled: | ||
| - portfolio_history | ||
| _fivetran_quickstart_amazon_product_ad_history: | ||
| - product_ad_history | ||
| apple_search_ads__using_search_terms: | ||
| - search_term_report | ||
| pinterest__using_keywords: | ||
|
|
@@ -68,12 +278,24 @@ table_variables: | |
| - campaign_regions_report | ||
| google_ads__using_search_term_keyword_stats: | ||
| - search_term_keyword_stats | ||
| google_ads__using_campaign_bid_modifier_history: | ||
| - campaign_bid_modifier_history | ||
| google_ads__using_campaign_budget_history: | ||
| - campaign_budget_history | ||
| google_ads__using_campaign_criterion_history: | ||
| - campaign_criterion_history | ||
| google_ads__using_campaign_bidding_strategy_history: | ||
| - campaign_bidding_strategy_history | ||
| facebook_ads__using_demographics_country: | ||
| - demographics_country | ||
| - demographics_country_actions | ||
| facebook_ads__using_demographics_region: | ||
| - demographics_region | ||
| - demographics_region_actions | ||
| _fivetran_quickstart_facebook_basic_ad_actions: | ||
| - basic_ad_actions | ||
| _fivetran_quickstart_facebook_basic_ad_action_values: | ||
| - basic_ad_action_values | ||
| linkedin_ads__using_geo: | ||
| - geo | ||
| linkedin_ads__using_monthly_ad_analytics_by_member_country: | ||
|
|
@@ -83,17 +305,21 @@ table_variables: | |
| microsoft_ads__using_geographic_daily_report: | ||
| - geographic_performance_daily_report | ||
| reddit_ads__using_business_account: | ||
| - business_account | ||
| - business_account | ||
| reddit_ads__using_campaign_country_report: | ||
| - campaign_country_report | ||
| reddit_ads__using_campaign_country_conversions_report: | ||
| - campaign_country_conversions_report | ||
| snapchat_ads__using_campaign_country_report: | ||
| - campaign_geo_country_daily_report | ||
| snapchat_ads__using_campaign_region_report: | ||
| snapchat_ads__using_campaign_region_report: | ||
| - campaign_geo_region_daily_report | ||
| _fivetran_quickstart_snapchat_creative_url_tag_history: | ||
| - creative_url_tag_history | ||
| tiktok_ads__using_campaign_country_report: | ||
| - campaign_country_report | ||
| tiktok_ads__using_location: | ||
| - location | ||
|
|
||
| destination_configurations: | ||
| databricks: | ||
|
|
@@ -113,4 +339,4 @@ public_models: [ | |
| "ad_reporting__url_report", | ||
| "ad_reporting__monthly_campaign_country_report", | ||
| "ad_reporting__monthly_campaign_region_report" | ||
| ] | ||
| ] | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,5 +1,5 @@ | ||
| name: 'ad_reporting' | ||
| version: '2.7.0' | ||
| version: '2.7.1' | ||
|
|
||
| config-version: 2 | ||
|
|
||
|
|
||
Large diffs are not rendered by default.
Large diffs are not rendered by default.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It looks we still haven't brought in
facebook_ads__conversion_action_typesfor both facebook_ads and ad_reporting even though we have conversions brought in other packages, are there complexities here too?Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah definitely too complex to have in here for now -- it involves some string parsing that can break easily