Repository navigation
Conversation
|
Bump @henrikingo :) |
henrikingo
left a comment
There was a problem hiding this comment.
+1
Thanks Alex. I think this is as discussed in #118 and with these changes I'm good to go for a next release. Two comments just to highlight where there's future work:
This is actualy a fairly superficial change, yet it ends up being hundreds of lines changed. Ok, so half of that is test coverage, which is good, but the other half is ust because we copypasted the same code around each new importer. This aspect of the code deserves a serious refactoring. But let's release this first. The new e-divisive implementation deserves to get out there!
What's the difference between --branch and --attrs branch? The truth is, there's no need for a separate --branch option, it's just a dimension/label like many other attributes. (repository url, operating system, etc...)
+1, I plan to refactor the importer code soon as a step towards #55.
hmmm, I did not realize one can pass attributes via CLI. Let me experiment with it; we may not need |
Lines 163 to 181 in 2bb687f Additionally, this attribute list is Fallout-specific with |
This PR contains my understanding of what we want to achieve in #118.
Changes:
regressionscommand is removed as a Datastax-specific thing.analyzecovers all interesting use cases.analyze --branchis ConfigArgParsified and can be configured viaBRANCHenv variable.analyze --branchis unified as much as possible across importers. As a standard, I used Graphite%BRANCHsyntax. It is reused it in Postgres and BigQuery importers plus. Csv importer has its own thing. It looks at abranchcolumn and behaves in the following way:--branchis not specified, it works as before.--branchis not specified, the importer checks that that column contains a unique value a guardrail against mixing results between different branches.--branchis specified, the importer will filter out values for rows where the value in branch column is not equal to the passed value.--branchis specified, the importer throws.--branchnow and a test config has at least one%BRANCH, a user must pass it.%{BRANCH}is escaped against SQL injections in PostgreSQL and BigQuery, just in case.