Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE REQUEST] Add filter for similar pages #174

Closed
epi052 opened this issue Dec 26, 2020 · 0 comments · Fixed by #175
Closed

[FEATURE REQUEST] Add filter for similar pages #174

epi052 opened this issue Dec 26, 2020 · 0 comments · Fixed by #175
Labels
enhancement New feature or request has-PR

Comments

@epi052
Copy link
Owner

epi052 commented Dec 26, 2020

Is your feature request related to a problem? Please describe.
I want to be able to filter on pages similar to the one provided.

--filter-similar-to http://somesite.com/404

steps

  • request the given page(s)
  • store response body
  • use a fuzzy string match algorithm to ID near-duplicate pages of the stored response (jaro, levenshtein, n-gram, cosine... something)
  • filter out responses that meet a certain similarity threshold
@epi052 epi052 added the enhancement New feature or request label Dec 26, 2020
@epi052 epi052 mentioned this issue Dec 26, 2020
13 tasks
@epi052 epi052 added the has-PR label Dec 26, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request has-PR
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant