Running a medium sized file in XL. Simple group_by with one list column returned. Works if I only return the group_by colmn, but when I add the list, it ends up with missing data in the middle of the return payload. If I run it with slight;ly more data (but not all) than the first place it otherwise loses data, then it returns all row. Thus, I believe it has something to do with the size of the data.
wrangles:
- filter:
input: eam_attributeName
not_equal: ADDITIONAL INFO
- replace:
input: eam_attributeName
find: '[-.@()]'
replace: ' '
output: Att Name
# - format.trim:
# input: Att Name
- select.group_by:
by: Att Name # Att Name
list:
- eam_classificationName
# - split.text:
# input: Att Name
# char: 'regex:[ /]'
# skip_empty: true
# output: Att Terms
# - python:
# output: Att Terms
# command: |
# [x for x in Att_Terms if x not in ${ignore_terms}]
- select.list_element:
input: eam_classificationName.list
element: '0:5'
output: Categories
write:
- excel.sheet:
name: Attribute Names and Categories
Running a medium sized file in XL. Simple group_by with one list column returned. Works if I only return the group_by colmn, but when I add the list, it ends up with missing data in the middle of the return payload. If I run it with slight;ly more data (but not all) than the first place it otherwise loses data, then it returns all row. Thus, I believe it has something to do with the size of the data.