Skip to content

Add script for extracting raw PeMS text data into formatted parquet files#8

Open
timand32-sandag wants to merge 3 commits into
masterfrom
parquet-extract
Open

Add script for extracting raw PeMS text data into formatted parquet files#8
timand32-sandag wants to merge 3 commits into
masterfrom
parquet-extract

Conversation

@timand32-sandag

Copy link
Copy Markdown
Collaborator

No description provided.

@anneku anneku left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Getting the following error:

The system cannot find the path specified: 'data\pems\txt\2025\station_5min'

The station_5min data downloaded automatically to data\2026.

Please update the download path in download-PeMS-data.py or the README to document if users need to manually adjust the filepath and year in extract_parquet.

Both the download and the extract script should have consistent file paths now
@timand32-sandag

Copy link
Copy Markdown
Collaborator Author

Getting the following error:

The system cannot find the path specified: 'data\pems\txt\2025\station_5min'

The station_5min data downloaded automatically to data\2026.

Please update the download path in download-PeMS-data.py or the README to document if users need to manually adjust the filepath and year in extract_parquet.

Commit 95ddeb9 should make both the download and extract script use the same file structure.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants