Skip to content
This repository has been archived by the owner on Dec 16, 2022. It is now read-only.

Bias Metrics #5139

Merged
merged 10 commits into from
May 13, 2021
Merged

Bias Metrics #5139

Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
85f9639
finished WEAT
Apr 21, 2021
22574b1
finished bias metrics
Apr 21, 2021
596cba0
updated CHANGELOG
Apr 21, 2021
8d57b56
fixed gpu issu
Apr 21, 2021
95a2409
fixed gpu issue
Apr 21, 2021
b5e17a9
Merge branch 'main' into arjuns/bias-metrics
AkshitaB May 12, 2021
9e49e53
changed to association without ground truth
May 12, 2021
ce9b30a
resolved merge conflicts
May 12, 2021
d49ab68
expanded NLI to include more NLI scores and work in batched and distr…
May 13, 2021
2d83927
removed evaluate bias mitigation command from this PR
May 13, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
updated CHANGELOG
  • Loading branch information
Arjun Subramonian committed Apr 21, 2021
commit 596cba0d56d9aefa17771f24b2ab91b3670e6118
1 change: 1 addition & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
- Added a `quiet` parameter to the `MultiProcessDataLoading` that disables `Tqdm` progress bars.
- The test for distributed metrics now takes a parameter specifying how often you want to run it.
- Created the fairness module and added four fairness metrics: `Independence`, `Separation`, `Sufficiency`, and `DemographicParityWithoutGroundTruth`.
- Added three bias metrics to the fairness module: `WordEmbeddingAssociationTest`, `EmbeddingCoherenceTest`, and `NaturalLanguageInference`.

### Changed

Expand Down