Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Evaluation Files #44

Open
wants to merge 30 commits into
base: main
Choose a base branch
from
Open

Evaluation Files #44

wants to merge 30 commits into from

Conversation

UP2040499
Copy link
Owner

No description provided.

@UP2040499
Statements for Evaluation
7bd1008 
These statements have links and dates for reference.
Will likely be removed later for processing requirements.

Took 24 minutes
@UP2040499
Updated links
43437ee 
Took 3 minutes
@UP2040499
Removing links due to these files being processed badly
f2ba97c 
Took 1 minute
@UP2040499
Change file structure so that the eval statements are in correct place
3719d89 
Took 10 minutes
@UP2040499
Catch exception if Remote closes connection w/o response
ca862a9 
Took 27 seconds
@UP2040499
Fix exception block and put in all modules that need it
8274c03 
Took 4 minutes
@UP2040499
Put exception block in all modules that need it
af7bc23
@UP2040499
Another attempt to fix chromedriver crashes
f8830e8 
Took 6 minutes
@UP2040499
add error logging to webdriver code
4256348 
(Should never have added selenium)

Took 7 minutes
@UP2040499
fix logs location
4f7710f 
Took 4 minutes
@UP2040499
add --no-sandbox argument for running as root user in colab
32bcd35 
Took 5 minutes
@UP2040499
move --no-sandbox to start and remove 'chromedriver' reference
d78798d 
Took 3 minutes
@UP2040499
Ensure driver is quit before return statements
4b4ee1d 
Took 3 minutes
@UP2040499
Add chromedriver path to driver declaration
07bdb10 
This change means this branch will only work on google colab

Took 3 minutes
@UP2040499
fix incorrect path to chromedriver
8413529 
Took 6 minutes
@UP2040499
Added exception catch block in case content type does not exist
53d3751 
Took 5 minutes
@UP2040499
fix typo
8992d23 
Took 2 minutes
@UP2040499
fix the same typo in different file
83b2b9d 
Took 2 minutes
@UP2040499
change multiprocessing pool call so that it deals with crashed proceses
1b76a62 
Took 10 minutes
@UP2040499
Remove logging in get_text functions which may be causing freezing
2b26cb5 
Took 3 minutes
@UP2040499
attempt to fix deadlock with spawn start method
1329b1d 
Took 10 minutes
@UP2040499
add pid console logs to figure out which process is hanging
c0ed7dc 
Took 4 minutes
@UP2040499
fix console logs
8622b42 
Took 2 minutes
@UP2040499
Target info scoring seems to be working, removing logging
5ba9d08 
Took 6 minutes
@UP2040499
add exception blocks for the driver.get(url) statements
5515b86 
Took 3 minutes
@UP2040499
attempt to fix popular info finder hanging
58071b3 
Took 4 minutes
@UP2040499
add pid logging to popular info finder
25e0239 
Took 4 minutes
@UP2040499
refactor: restructure the find_entities method to try and fix hanging
6e1e8dc 
Took 4 minutes
@UP2040499
add exception catch to avoid issues if a session is not created
9b5f387 
Took 3 minutes
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
Testing & Evaluation Completed
Development

Successfully merging this pull request may close these issues.
1 participant
@UP2040499