Skip to content

Reverted incorrect (and very slow) process pool code in analyzeOffets function in offsets.py#8

Open
terrycojones wants to merge 1 commit intomasterfrom
fix-analyzeOffets
Open

Reverted incorrect (and very slow) process pool code in analyzeOffets function in offsets.py#8
terrycojones wants to merge 1 commit intomasterfrom
fix-analyzeOffets

Conversation

@terrycojones
Copy link
Copy Markdown
Member

@terrycojones terrycojones commented Apr 9, 2026

And fixed the function name typo. Added a few f-strings.

The process pool map call needed an itertools.repeat around the alignedReads arg. The arg lists to the map function were also of different lengths (can be checked with strict=True as of Python 3.14 See https://docs.python.org/3/library/functions.html#map). When I fixed the code it was extremely slow because it forks over 3000 processes and has to serialize and pass the alignedReads object (which has 30,000 reads in it) for each created process. It's much, much faster just to use the original code. So I reverted to the code as it was before the process pool approach.

… function in offsets.py (and fixed the function name typo). Added a few f-strings.
@terrycojones terrycojones requested a review from imLew April 9, 2026 21:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants