Custom docs UI fixes

[maxpumperla]

No description provided.

[slinlee]

@maxpumperla for the auto tests I'm running into an issue where if I run pytest tests/ the schema.yaml and saved model aren't copied first. Pytest imports all the modules and when it gets to config.py that one expects the schema.yaml to exist already.

You can see the error output here https://github.com/SkymindIO/policy-server/pull/126/checks

Do you have a go-to way to avoid this? Do you kick off tests differently? Thanks.

[maxpumperla]

@slinlee no, I've been trying to resolve this last week. Actually I have tests for all examples ready locally that are parametrised unit tests, but only the first will pass. I'm not quite sure how to address this yet.

[slinlee]

@slinlee no, I've been trying to resolve this last week. Actually I have tests for all examples ready locally that are parametrised unit tests, but only the first will pass. I'm not quite sure how to address this yet.

@maxpumperla will only the first one pass even when you're running it locally?

[maxpumperla]

yes, I don't know the reason for it. it might be the way pytest collects tests. But even then, if I sleep for long enough, I should be able to make the tests pass, but it doesn't quite seem to work. Also, as suspected, sometimes we do need the timestep key word and sometimes we don't. I suspect it's the tensorflow version used, but I don't find anything in their docs (or those of ray).

[slinlee]

yes, I don't know the reason for it. it might be the way pytest collects tests. But even then, if I sleep for long enough, I should be able to make the tests pass, but it doesn't quite seem to work. Also, as suspected, sometimes we do need the timestep key word and sometimes we don't. I suspect it's the tensorflow version used, but I don't find anything in their docs (or those of ray).

@maxpumperla
I was hoping that pytest --forked would help us at least have config.py set up properly for each suite of tests. It seems to crash for me though. https://github.com/pytest-dev/pytest-forked

[maxpumperla]

@slinlee thanks, let me have a closer look at this tomorrow!