Slooow tests with multiprocess run

[lanwen]

Hello!

We have a lot of tests (11k) and use nose to run them in many processes with --processes=$NCPU flag.

The complete line is nosetests --rednose -s --processes=$NCPU --process-timeout=300 tests
But rednose slows tests up to 10 times.

How it can be profiled?

nose==1.2.1
rednose==1.2.1

[JBKahn]

Interesting. If you use --with-profile which is a nose provided plugin, we can compare the results of a run with and without rednose?

[JBKahn]

It's just hard for me to test without access to problematic tests. If you can recreate this with a smaller sample of same tests, then I can do some digging.

[lanwen]

Seems that multiprocess runner can't work together with profiler by default...

...
File "/usr/lib/python2.7/unittest/main.py", line 95, in __init__
    self.runTests()
  File "/code/local/lib/python2.7/site-packages/nose/core.py", line 197, in runTests
    result = self.testRunner.run(self.test)
  File "/code/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py", line 361, in run
    self.collect(test, testQueue, tasks, to_teardown, result)
  File "/code/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py", line 306, in collect
    test_addr = self.addtask(testQueue,tasks,case)
  File "/code/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py", line 520, in addtask
    test_addr = MultiProcessTestRunner.address(case)
  File "/code/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py", line 535, in address
    raise Exception("Unable to convert %s to address" % case)
Exception: Unable to convert <function run_and_profile at 0x467b668> to address

:(

[JBKahn]

Hmm I'll try to think of what is making it slow. Can you try reproducing
with a small set of sample tests. Hard when I have nothing to work with.

On Thu, Jun 16, 2016, 6:53 PM Merkushev Kirill notifications@github.com
wrote:

Seems that multiprocess runner can't work together with profiler by
default...

...
File "/usr/lib/python2.7/unittest/main.py", line 95, in init
self.runTests()
File "/code/local/lib/python2.7/site-packages/nose/core.py", line 197, in runTests
result = self.testRunner.run(self.test)
File "/code/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py", line 361, in run
self.collect(test, testQueue, tasks, to_teardown, result)
File "/code/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py", line 306, in collect
test_addr = self.addtask(testQueue,tasks,case)
File "/code/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py", line 520, in addtask
test_addr = MultiProcessTestRunner.address(case)
File "/code/local/lib/python2.7/site-packages/nose/plugins/multiprocess.py", line 535, in address
raise Exception("Unable to convert %s to address" % case)
Exception: Unable to convert <function run_and_profile at 0x467b668> to address

:(

—
You are receiving this because you commented.

Reply to this email directly, view it on GitHub
#8 (comment), or mute
the thread
https://github.com/notifications/unsubscribe/ACiBvcuSnvDrSBfd_u40xOq7DRG-IcvVks5qMdPvgaJpZM4I3lIl
.

[lanwen]

Yep, will try to reproduce it on weekend

[azmeuk]

Hi, is there some news about this bug? rednose is currently unusable on my project.

[lanwen]

Didn't find weekend for global reproducing, sorry. (On small number of tests it doesn't reproducing)
Does any know big open source project using nosetests to try reproduce on it?

[JBKahn]

There are other issues with multiprocessing and rednose i.e. #14

Might be related.