Skip to content

Fix missing data #208

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
malikmammar wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Fix missing data #208

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
2b359dc
Modify Data Source
malikmammar Jul 14, 2026
d9969d1
Fix missing data
malikmammar Jul 14, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions config.toml.exemple.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# DO NOT EDIT THIS FILE - DO NOT EDIT THIS FILE - DO NOT EDIT THIS FILE

default_connection_name = "advanced_data_engineering_snowflake"

[connections]
[connections.advanced_data_engineering_snowflake]
account=""
user=""
password=""
25 changes: 13 additions & 12 deletions module-1/hamburg_weather/pipeline/data/load_tasty_bytes.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,8 @@ CREATE TABLE {{env}}_tasty_bytes.raw_pos.country
iso_currency VARCHAR(3),
iso_country VARCHAR(2),
city VARCHAR(16777216),
city_population VARCHAR(16777216)
city_population VARCHAR(16777216),
city_id NUMBER(18,0)
);


Expand Down Expand Up @@ -293,17 +294,17 @@ USE WAREHOUSE demo_build_wh;


-- country table load
-- COPY INTO {{env}}_tasty_bytes.raw_pos.country
-- (
-- country_id,
-- country,
-- iso_currency,
-- iso_country,
-- city_id,
-- city,
-- city_population
-- )
-- FROM @{{env}}_tasty_bytes.public.s3load/raw_pos/country/;
COPY INTO {{env}}_tasty_bytes.raw_pos.country
(
country_id,
country,
iso_currency,
iso_country,
city_id,
city,
city_population
)
FROM @{{env}}_tasty_bytes.public.s3load/raw_pos/country/;


-- franchise table load
Expand Down
4 changes: 2 additions & 2 deletions module-1/hamburg_weather/pipeline/objects/views/views.sql
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,8 @@ SELECT
TO_VARCHAR(hd.date_valid_std, 'YYYY-MM') AS yyyy_mm,
pc.city_name AS city,
c.country AS country_desc
FROM WEATHER_SOURCE_LLC_FROSTBYTE.onpoint_id.history_day hd
JOIN WEATHER_SOURCE_LLC_FROSTBYTE.onpoint_id.postal_codes pc
FROM PELMOREX_WEATHER_SOURCE_FROSTBYTE.onpoint_id.history_day hd
JOIN PELMOREX_WEATHER_SOURCE_FROSTBYTE.onpoint_id.postal_codes pc
ON pc.postal_code = hd.postal_code
AND pc.country = hd.country
JOIN {{env}}_tasty_bytes.raw_pos.country c
Expand Down