Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove chrome install no longer needed for pacta.data.scraping #98

Merged
merged 3 commits into from
Feb 9, 2024

Conversation

cjyetman
Copy link
Member

@cjyetman cjyetman commented Feb 9, 2024

closes #91

@cjyetman
Copy link
Member Author

cjyetman commented Feb 9, 2024

This seems to work on my machine. Can either @jdhoffa and/or @AlexAxthelm verify that one their machines?

@jdhoffa
Copy link
Member

jdhoffa commented Feb 9, 2024

Can you point me to input files that I can test this with?

@cjyetman
Copy link
Member Author

cjyetman commented Feb 9, 2024

Can you point me to input files that I can test this with?

It should work with any valid input files. The input files are largely irrelevant to this change because this change should only affect the ability to run pacta.data.scraping::get_index_regions().

@jdhoffa
Copy link
Member

jdhoffa commented Feb 9, 2024

I have no input datasets on my computer ("valid" or otherwise), and am unsure where such data lives now, so I am unable to review this in its entirety.

If you think that, for this particular PR, stepping through the run_pacta_data_preparation.R until the point of pacta.data.scraping::get_index_regions() is sufficient, then I can do that.

But in general, I would prefer not merging PRs to PROD repos without sufficiently testing their stability (in the absence of any kind of real automated CI/CD)

(NIT: A big nudge towards us making pacta.demo.data :) )

@cjyetman
Copy link
Member Author

cjyetman commented Feb 9, 2024

If you think that, for this particular PR, stepping through the run_pacta_data_preparation.R until the point of pacta.data.scraping::get_index_regions() is sufficient, then I can do that.

Unfortunately not, because this PR does not affect the running-in-RStudio method of running data.prep at all, it only impacts whether running in the specified Docker image/container will have the necessary system dependencies.

But in general, I would prefer not merging PRs to PROD repos without sufficiently testing their stability (in the absence of any kind of real automated CI/CD)

💯 that's why I'm hoping one or both of you can verify it too

@cjyetman
Copy link
Member Author

cjyetman commented Feb 9, 2024

Though, if one of you has a way to step through the process in the Docker container to only test that pacta.data.scraping::get_index_regions() still works and you're confident/satisfied with that, I guess that would be enough.

@jdhoffa
Copy link
Member

jdhoffa commented Feb 9, 2024

Docker run triggered, I will let you know what happens at the scraping step

@jdhoffa
Copy link
Member

jdhoffa commented Feb 9, 2024

Success:
Screenshot 2024-02-09 at 12 41 28

@cjyetman cjyetman merged commit 230a11a into main Feb 9, 2024
@cjyetman cjyetman deleted the remove-chrome-install branch February 9, 2024 11:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

remove no longer necessary install of Chrome and its dependencies
2 participants