Create Data Dictionary work Working File: cbc_cleaned_usa_merged.csv

[rectheworld]

Inputs
cbc_cleaned_usa_merged.csv - Contain volunteer submitted cbc data and the weather data for the closest noaa station. Distances are measured in meters.

Output
A CSV File containing:

• Name of Field
• Definition of Field
• Source of Field
• Example of Field

[costa-rica]

Nick
I"m working on this issue

[costa-rica]

Hi Ren,
Thanks so much for giving me this particular task. It really helped a lot.

Here’s my “first” attempt at a data dictionary. I’ve just got the column names, count of missing, count of obs and pct populated. I’ve done a lot of research for changing column name and for some reason I’m stuck with column 0. I will figure it out, mostly likely with a very basic question on stackoverflow - yes poor form but when i change the name it doesn't recognize - i will figure out. Anyway, two questions:
1-you had two other columns: def and example. For def do you have a source or should i give it my best shot at a first go defining what i think they are? What do you have in mind for example?
2-How and where should I save the table, csv on github?

bird_data_dictionary_1.txt

[costa-rica]

Ok, bear with me... I'm just putting this version cuz I don't want you to think i've forgotten. Rather i've just been immersed in this and this is how log its taken me :))))))))))))

I will update with cleaner version or anything you might suggest, this week.

+----+-----------------------------+--------------------+---------------+----------+-----------------------------------------+
| | colNames | pctPopulated | colHasLetters | colTypes | funkyEntries |
+----+-----------------------------+--------------------+---------------+----------+-----------------------------------------+
| 0 | Unnamed: 0 | 1.0 | False | int64 | |
| 1 | circle_name | 1.0 | True | object | |
| 2 | country_state | 1.0 | True | object | |
| 3 | lat | 1.0 | False | float64 | |
| 4 | lon | 1.0 | False | float64 | |
| 5 | count_year | 1.0 | False | int64 | |
| 6 | count_date | 1.0 | False | object | |
| 7 | n_field_counters | 0.9982583065380493 | False | float64 | |
| 8 | n_feeder_counters | 0.4580877098963916 | False | float64 | |
| 9 | min_field_parties | 0.5069444444444444 | False | float64 | |
| 10 | max_field_parties | 0.5132636655948553 | False | float64 | |
| 11 | field_hours | 0.8969609682029296 | False | float64 | |
| 12 | feeder_hours | 0.5729836548767417 | False | float64 | |
| 13 | nocturnal_hours | 0.5548298499464095 | False | float64 | |
| 14 | field_distance | 0.916164255091104 | False | float64 | |
| 15 | nocturnal_distance | 0.5040081279028225 | False | float64 | |
| 16 | distance_units | 0.9976889067524116 | True | object | |
| 17 | min_temp | 0.7460253662022152 | False | float64 | |
| 18 | max_temp | 0.7459807073954984 | False | float64 | |
| 19 | temp_unit | 0.5129063951411219 | False | float64 | |
| 20 | min_wind | 0.7296579135405502 | False | float64 | |
| 21 | max_wind | 0.7302384780278671 | False | float64 | |
| 22 | wind_unit | 0.5129063951411219 | False | float64 | |
| 23 | min_snow | 0.699959807073955 | False | float64 | |
| 24 | max_snow | 0.700350571632726 | False | float64 | |
| 25 | snow_unit | 0.4817903715612719 | False | float64 | |
| 26 | am_cloud | 0.7456569310468024 | False | float64 | |
| 27 | pm_cloud | 0.7452103429796355 | False | float64 | |
| 28 | am_rain | 0.7412915326902465 | False | object | looks like multiple entries in one cell |
| 29 | pm_rain | 0.7406216505894962 | False | object | looks like multiple entries in one cell |
| 30 | am_snow | 0.7395051804215791 | False | object | looks like multiple entries in one cell |
| 31 | pm_snow | 0.7391144158628081 | False | object | looks like multiple entries in one cell |
| 32 | field_distance_imperial | 0.916164255091104 | False | float64 | |
| 33 | field_distance_metric | 0.916164255091104 | False | float64 | |
| 34 | nocturnal_distance_imperial | 0.5040081279028225 | False | float64 | |
| 35 | nocturnal_distance_metric | 0.5040081279028225 | False | float64 | |
| 36 | min_snow_imperial | 0.699959807073955 | False | float64 | |
| 37 | min_snow_metric | 0.699959807073955 | False | float64 | |
| 38 | max_snow_metric | 0.700350571632726 | False | float64 | |
| 39 | max_snow_imperial | 0.700350571632726 | False | float64 | |
| 40 | min_temp_imperial | 0.7162937656305823 | False | float64 | |
| 41 | max_temp_imperial | 0.6490264380135763 | False | float64 | |
| 42 | min_temp_metric | 0.7459360485887817 | False | float64 | |
| 43 | max_temp_metric | 0.7456234369417649 | False | float64 | |
| 44 | min_wind_metric | 0.729646748838871 | False | float64 | |
| 45 | max_wind_metric | 0.7302161486245087 | False | float64 | |
| 46 | min_wind_imperial | 0.729646748838871 | False | float64 | |
| 47 | max_wind_imperial | 0.7302273133261878 | False | float64 | |
| 48 | station_key | 1.0 | False | object | |
| 49 | circle_coordinates | 1.0 | False | object | |
| 50 | closest_station_id | 1.0 | False | object | |
| 51 | closest_station_lat | 1.0 | False | float64 | |
| 52 | closest_station_lng | 1.0 | False | float64 | |
| 53 | distance | 1.0 | False | float64 | |
| 54 | circle_num | 1.0 | False | int64 | |
| 55 | date | 0.6007837620578778 | True | object | |
| 56 | id | 0.6007837620578778 | True | object | |
| 57 | name | 0.6007837620578778 | True | object | |
| 58 | precipitation_value | 0.6007837620578778 | True | float64 | |
| 59 | state | 0.6007837620578778 | True | object | |
| 60 | temp_max_value | 0.6007837620578778 | True | float64 | |
| 61 | temp_min_value | 0.6007837620578778 | True | float64 | |
+----+-----------------------------+--------------------+---------------+----------+-----------------------------------------+

[nbanion]

Hi guys-- could you still use help with this issue?

[rectheworld]

Hi Nathan, Yeah we have added new fields in the more recent files that would need to be added at some point. If you are up to the task you will need to pull down the most recent branch of the code. Keep an eye on the audubon-cbc channel, we will be doing a project night soon.

…

-Ren

On Mon, Jun 15, 2020 at 2:02 PM Nathan Banion ***@***.***> wrote: Hi guys-- could you still use help with this issue? — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#37 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACS2563NROF2I2YGCWWO5LLRWZO2VANCNFSM4KQW6URQ> .