ValueError

[JK-430]

Hello, thank you a lot for sharing your work! I tried running this with my Intellicage data, but the program closes after giving ValueError message. At first, the message said "ValueError: This sheet is too large!", so I thought the data is too large as the data was collected over 8 days. But when I tried with a smaller file (data collected over 4 days), the program closed again with a different ValueError message. Do you know any way to troubleshoot these issues?

[NiRuff]

Hey JK-430,
so in both cases there is some pandas error. The first case seems as if the excel file that is supposed to be written is too large for the pivot table.

Which settings did you use there?
Is it possible that you defined many and/or very small timeframes for the pivot analysis?

Maybe you could try it with your full file and 24 hours for the pivot analysis for now.

It would also be helpful if you could send me the settings you used - you can find them in the log file.

And one more thing - do the excel files that are created (e.g. Default_visit_learning_Data.xlsx) look more or less as expected?
So we could rule out that there is some problem with the input files.

Best,
Nicolas

[JK-430]

I had loaded the txt files and ran the program with the default setting and got the messages I mentioned.

I tried after setting the hour interval as 24, but I get the same ValueError message saying that the sheet is too large, without any change in sheet size (25, 17636).

I just realized that I got a new folder with three files in Default folder without any other file elsewhere.

I think the excel files look as expected. The mean values are not calculated per group, so the second plot (Pivot per group) is empty, but except for that, I guess the data went through correctly. Are these files all the outcomes as expected, or should there be something more? And where can I find the log file you mentioned?

[NiRuff]

The log file should be written where your "Default" folder is located.
But it is possible that it was not written as the program did not terminate.
Currently it is hard for me to say what the problem might be - you could also try out the example data here from the github to see if there is a general problem possibly to some package versions - if the example data works but oyur data doesn't, we can further go into it together.

So please tell me if the exaxmple data works and if not you can contact me via mail (nicolas.ruffini@lir-mainz.de) and we can futher see if we can find a solution.
Best,
Nicolas

[NiRuff]

I had a look into your data and the problem now and found two issues that arose with your dataset.

Issue number one: your dataset is large

This caused xlsx to throw an error when computing e.g. the learning rate per nosepoke. I included this feature to be able to not only see how the mice perform per time but also in relation to the actual trials they had. However, xlsx has an upper column limit for its files. Therefor I changed the code to check, if the number of columns for the xlsx file is still within the limits or not. If it is too big, the xlsx file will now only be created per hour. If you still want to have the data per nosepoke you can still retrieve it by choosing the CSV option.

Issue number two: you had two modules in your experiment, one of which contained no single lick.

I now added some more error catching in case there are empty files processed within intellipy. There should be no more issues arising from this problem.

Please download the new version of intellipy by typing
pip install intellipy --upgrade in your command line window (e.g. Anaconda Prompt or windows shell).