duplicates - Bulkley

[Mateo9569]

Hi Simon, here is a table showing all the pscis ids for our phase 1 sites. It was entered into the system twice. We'd like to retain everything from stream_crossing_id 198109 down to 198117, and get rid of the duplicates which are from 198108 up to 198100. In reference to issue here: NewGraphEnvironment/fish_passage_bulkley_2022_reporting#41

[smnorris]

Thanks Mateo! Any chance you could post the ids as text so I can copy/paste?

[Mateo9569]

198100, 198101, 198102, 198103, 198104, 198105, 198106, 198107, 198108

198109, 198110, 198111, 198112, 198113, 198114, 198115, 198116, 198117

[NewGraphEnvironment]

csv is attached as well
pscis_phase1_dups.csv

edit - 20250107 - this csv is now out of date. please see below for updated version.

[NewGraphEnvironment]

no action required from our end but thought I would update this with a complete list and clear direction for which of the duplicates we hope to keep in PSCIS so as to match our record keeping which will likely land in
a table here in the "Results" section.

Perhaps obviously - a TRUE value in the remove column indicates the value we hope will be discarded as we are tracking the stream_crossing_ids marked as FALSE. Please disregard the csv in the comment above this from Jan 2023. I will edit to there to note as well.

duplicates_pscis.csv

[smnorris]

@NewGraphEnvironment - just to confirm - still ok to delete these from PSCIS?

my_crossing_reference	stream_crossing_id	stream_name	road_number	dupe_number	remove
1801071	198109	Perow Creek	Transmission Line	2	TRUE
2022083050	198110	Stock Creek	Private	2	TRUE
1802798	198111	Coffin Creek	Spur	2	TRUE
1805507	198112	Stock Creek	CN Railway	2	TRUE
1802069	198113	Johnny David Creek	Spur	2	TRUE
2022083001	198114	Stock Creek	Private	2	TRUE
2022091001	198115	Waterfall Creek	13 Avenue	2	TRUE
2022091002	198116	Waterfall Creek	Highway 16	2	TRUE
2022091003	198117	Waterfall Creek	9th Avenue	2	TRUE
17501664	198400	Five Mile Creek	Highway 97	2	TRUE

[smnorris]

198109 to 198117 look good to remove, but there is no 17501664 in the assessments table and only 198400 is on Five Mile Creek at Hwy 97 just outside of Williams Lake. I'll leave that one out for now

[smnorris]

hmm, maybe not 198116, there is a confirmation associated with that one now.

[NewGraphEnvironment]

looks like i have most or all of these backwards. will confirm and redo the spreadsheet. sorry

[smnorris]

No problem, I am finding that going through even the simplest duplicates is still a complicated exercise

[NewGraphEnvironment]

backwards day. Had them all reversed. Below is a link to the corrected spreadsheet. thanks for catching that. Removal of the wrong ones would have been terrible

https://github.com/NewGraphEnvironment/fish_passage_template_reporting/blob/main/data/qa/duplicates_pscis.csv

duplicates_pscis.csv

[smnorris]

Thanks!

The only reason it was caught is that I'm running the fixes against PSCIS testing database before submitting - one delete failed because there is a confirmation associated with the point.