Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat/migration ipfs download #8064

Merged
merged 33 commits into from
May 12, 2021
+1,186 −27
Merged

Feat/migration ipfs download #8064

Changes from 1 commit
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
bddfa4d
Move ipfsdir.go into separate package
gammazero Apr 7, 2021
0565e80
move defaultFetchLimit to fetcher.go
gammazero Apr 8, 2021
b838384
Create IpfsFetcher
gammazero Apr 8, 2021
b5aae2c
Use IpfsFetcher to download migrations
gammazero Apr 8, 2021
6963d0c
Check return from connect()
gammazero Apr 8, 2021
5bdef8c
Move ipfsdir pkg back into migrations, and put ipfsfetcher into a sep…
gammazero Apr 8, 2021
f65110a
Review changes and more tests
gammazero Apr 8, 2021
806831d
log ipfs fetcher close error
gammazero Apr 8, 2021
df9a2ca
Multifetcher only return fetch errors if all fetchers fail
gammazero Apr 9, 2021
0994fba
Read IPFS peers from existing config
gammazero Apr 9, 2021
8a7a4c3
Disable listening for inbound connections
gammazero Apr 9, 2021
de0eaba
Download migrations, and add them to IPFS, based on CLI flags.
gammazero Apr 12, 2021
f9da061
Read peers from CLI flag instead of from existing config file
gammazero Apr 13, 2021
1e16ba1
fix test
gammazero Apr 13, 2021
18bdb52
Add migrations from temp IPFS node after migration
gammazero Apr 14, 2021
55f239b
Build on go < 1.16
gammazero Apr 14, 2021
ac8aa16
fix missed error check
gammazero Apr 14, 2021
890bd7e
Migration temp node listens on any port available
gammazero Apr 16, 2021
e5254d2
Configure migration from config and not from CLI flags
gammazero Apr 17, 2021
163c003
check error return
gammazero Apr 17, 2021
9768016
Review changes
gammazero Apr 19, 2021
3a0be4c
Use latest config
gammazero Apr 20, 2021
ee577fe
Document Migration config
gammazero Apr 20, 2021
9727b4f
error message formatting
gammazero Apr 20, 2021
7d16a95
manually load the config when migrating
Stebalien Apr 20, 2021
96bad6f
fix: factor the migration file reading code into a function
Stebalien Apr 20, 2021
d40d0f1
Move readMigrationConfig into migration.go
gammazero Apr 23, 2021
8d1dbfa
Attempt to read Bootstrap and Peering from config
gammazero May 3, 2021
03454b7
Revert to previous multihash version
gammazero May 4, 2021
bd6646f
Additional unit tests
gammazero May 4, 2021
3a4d85e
Update documentation
gammazero May 4, 2021
40d412a
Better error messages
gammazero May 4, 2021
e37896d
Review changes
gammazero May 6, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix test
  • Loading branch information
@gammazero
gammazero committed May 11, 2021
commit 1e16ba1ef0ed79ce714a55c8e1f498d96ed76770
2 changes: 1 addition & 1 deletion repo/fsrepo/migrations/ipfsfetcher/ipfsfetcher_test.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ func TestInitIpfsFetcher(t *testing.T) {
t.Errorf("failed to init ipfs node: %s", f.openErr)
} else {
// Start ipfs node
f.ipfs, stopFunc, f.openErr = startTempNode(f.ipfsTmpDir, f.peers)
f.ipfs, stopFunc, f.openErr = startTempNode(f.ipfsTmpDir, nil)
if f.openErr != nil {
t.Errorf("failed to start ipfs node: %s", f.openErr)
return
Expand Down