Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Shared threadpool #1489

Merged
merged 9 commits into from
Oct 10, 2021
Merged

Shared threadpool #1489

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
51b3529
do not store return values by default
TheTechromancer Sep 30, 2021
ef57639
pass callback with every submit()
TheTechromancer Oct 5, 2021
4ae7402
flake8 fixes
TheTechromancer Oct 5, 2021
1c860ed
shared threadpool between all modules
TheTechromancer Oct 7, 2021
0d48eed
flake8 fixes
TheTechromancer Oct 7, 2021
8094d6a
change taskName to help avoid conflicts
TheTechromancer Oct 7, 2021
d20c012
minor bug fixes + performance improvements
TheTechromancer Oct 8, 2021
433ecc4
move threadpool tests to new file
TheTechromancer Oct 8, 2021
bf11b2e
better error handling in scan status checks
TheTechromancer Oct 8, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
change taskName to help avoid conflicts
  • Loading branch information
@TheTechromancer
TheTechromancer committed Oct 7, 2021
commit 8094d6ad3bc6ca3085480553982faddcedff35fa
2 changes: 1 addition & 1 deletion spiderfoot/plugin.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -525,7 +525,7 @@ def threadWorker(self):
if self.__name__.startswith('sfp__stor_'):
self.handleEvent(sfEvent)
else:
self.sharedThreadPool.submit(self.handleEvent, sfEvent, taskName=self.__name__, maxThreads=self.maxThreads)
self.sharedThreadPool.submit(self.handleEvent, sfEvent, taskName=f"{self.__name__}_threadWorker", maxThreads=self.maxThreads)
self._running = False
except KeyboardInterrupt:
self.sf.debug(f"Interrupted module {self.__name__}.")
Expand Down