Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sync Against L1 and API #183

Merged
merged 178 commits into from
Jun 13, 2022
Merged

Sync Against L1 and API #183

merged 178 commits into from
Jun 13, 2022

Conversation

stdevMac
Copy link
Member

Fixes #91
Fixes #88
Fixes #96

Changes:

  • Sync Against L1
  • Sync Against Feeder Gateway

Types of changes

What types of changes does your code introduce?

  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation Update

Testing

Requires testing

  • Yes
  • No

In case you checked yes, did you write tests??

  • Yes
  • No

stdevMac and others added 30 commits March 25, 2022 16:30
@stdevMac
Squashed commit of the following:
47c80d9 
commit 0f549758e30e44d561b0b992977f9c63e2df7c31
Merge: d732bc6 e538bce
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 25 15:32:07 2022 -0400

    Merge remote-tracking branch 'origin/main' into core/state-root-sync

commit d732bc666cc03bbbc93ccc130c237a6a5c7faf06
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 25 13:01:25 2022 -0400

    Fix errors in Feeder Gateway Client and add state for Starknet State

commit 4f5fe55bd3675e5a761dfac6b83067ad7ca2c43b
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 25 12:59:29 2022 -0400

    Change comment in Ethereum State Synchronizer

commit fe2be2b33cf7ca7d9073165a1a4b1b9d8b0db0e1
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 25 12:57:50 2022 -0400

    Fix issue in db implementation

commit 6379ff9a0bcaf7d47b3c9f6b9bc0763df8a55f67
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 25 12:56:11 2022 -0400

    Change some types of feeder_gateway

commit 23186a9248005801825226b583dcf399ddad09ac
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Mar 22 17:30:34 2022 -0400

    Add struct to starknet in config

commit 7f734def087d84f7b31894e06597da2395d19686
Merge: c151dca aefc127
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Mar 22 17:24:52 2022 -0400

    Merge branch 'core/feeder_getaway' into core/state-root

    # Conflicts:
    #	README.md
    #	internal/config/config.go

commit c151dca25a1ffef8ef25dafe9bf94d94589e85f0
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Mar 22 10:24:23 2022 -0400

    Change name of ethereum state syncronizer

commit aba75652259fd9894873fe5cdde22f76f396ddac
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Mar 22 10:15:32 2022 -0400

    Add database connection to Synchronizer

commit df9043c
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:56:56 2022 -0400

    Update readme

commit a862668
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:54:58 2022 -0400

    handle layer 1 sync over config

commit 7a6b5e1
Merge: 47774a0 5eeaee2
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:43:30 2022 -0400

    Merge remote-tracking branch 'origin/main' into core/state-root

commit 47774a0
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:39:26 2022 -0400

    Add documentation for Ethereum Syncronizer

commit f2d7c60
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:35:54 2022 -0400

    Add Layer 1 Syncronizer to process runner

commit 0ecce31
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:34:20 2022 -0400

    Add Synchronizer to state root calculator

commit 0078b04
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:31:11 2022 -0400

    Add log when closing rpc server

commit bd7000c
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 16:28:53 2022 -0400

    restructure state_root

commit f30b1eb
Merge: 8b0799e a7ccdc5
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 18 06:29:58 2022 -0400

    Merge remote-tracking branch 'origin/main' into core/state-root

    # Conflicts:
    #	README.md
    #	cmd/main.go
    #	configs/gateway.go
    #	docs/static/img/log.png
    #	go.mod
    #	go.sum
    #	internal/chainid.go
    #	internal/sn_keccak.go

commit aefc127
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 18:56:03 2022 -0400

    [doc] Fix docusaurus docs

commit a8ba122
Merge: acf3a8b a7ccdc5
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 18:35:34 2022 -0400

    Merge remote-tracking branch 'origin/main' into core/feeder_getaway

commit acf3a8b
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 16:13:40 2022 -0400

    Remove unused line

commit 8050068
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 14:15:08 2022 -0400

    Add test case for coverage

commit ddbb866
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 14:06:53 2022 -0400

    Add tests for feeder_gateway CallContract

commit 66bad94
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 13:59:58 2022 -0400

    Add tests for feeder_gateway GetBlockHashById

commit 8635f7c
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 13:54:54 2022 -0400

    Add tests for feeder_gateway GetTransactionIdByHash

commit 3232c0c
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:51:55 2022 -0400

    Add tests for feeder_gateway GetTransactionHashById

commit c6c9768
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:50:00 2022 -0400

    Add tests for feeder_gateway GetBlockIdByHash

commit 1fc8d36
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:46:21 2022 -0400

    Add tests for feeder_gateway TestGetTransactionReceipt

commit a28a17f
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:43:11 2022 -0400

    Add tests for feeder_gateway GetTransaction

commit 184877b
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:03:35 2022 -0400

    Add test for GetTransactionStatus

commit 1895681
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:00:47 2022 -0400

    Add test for getStorage at

commit cc3d54b
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 10:57:04 2022 -0400

    Add test for GetFullContract from feeder_gateway

commit d7cec4c
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 10:48:57 2022 -0400

    Add test for GetCode from feeder_gateway

commit abe8884
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 10:30:26 2022 -0400

    Add test for GetStateUpdate

commit 455fe63
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 10:20:13 2022 -0400

    Add response for storage diffs

commit 037a1ef
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 09:25:49 2022 -0400

    Add test for getBlock in feeder gateway

commit 1ff959e
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 22:27:09 2022 -0400

    Change gateway to feeder_gateway as package name

commit a955bff
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 22:25:16 2022 -0400

    Set as notested in coverage types related to gateway

commit dd03dcb
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 22:23:13 2022 -0400

    Set as notested in coverage autogenerated file

commit 560eff6
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:49:05 2022 -0400

    Restructurate tests for feeder

commit c77b838
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:40:21 2022 -0400

    Connect mocked http.client to test

commit 04f04d5
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:38:03 2022 -0400

    Add generated code for mock http.client

commit 49837df
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:36:38 2022 -0400

    Add directives for client mocking generator

commit 24afc9f
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:36:09 2022 -0400

    Update go mod

commit f441ece
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:30:27 2022 -0400

    Update go.{mod,sum}

commit 10daea0
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:30:02 2022 -0400

    Delete unused file

commit 89b64b7
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Mar 15 10:36:37 2022 -0400

    Update go mods

commit 9380d70
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 06:10:32 2022 -0400

    Add small test for GetContractAddress and solve small isuues

commit 650f31d
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:58:46 2022 -0400

    Set as public gateway client methods

commit 0085639
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:51:55 2022 -0400

    Add to getTransactionHashById and getTransactionIdByHash proper implementation of params and returns

commit e266aae
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:47:20 2022 -0400

    Add params and response for getBlockIdByHash

commit 614197b
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:41:44 2022 -0400

    Add params and response for getBlockHashById

commit c480126
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:38:30 2022 -0400

    Add params, response struct for getTransactionReceipt

commit c3c2462
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:30:07 2022 -0400

    Add getTransaction paramas and response

commit 77dbea9
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:40:38 2022 -0400

    Add getTransactionStatus paramas and response

commit bad6674
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:33:52 2022 -0400

    Add get_storege_at paramas and response

commit 3be51c4
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:24:11 2022 -0400

    Add params and response for get_full_contract request

commit b0f6093
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:21:46 2022 -0400

    Add params and response for get_state_update request

commit 3cc2594
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:19:10 2022 -0400

    Add params and response for get_code request

commit d83225e
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:13:43 2022 -0400

    Add StarknetBlock response for getBlock in feeder Gateway

commit 519a82d
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 22:47:32 2022 -0400

    Add basic types for starknet transactions and callContract request

commit 16e8934
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 20:40:11 2022 -0400

    Add base test for feeder gateway

commit 0b1c2f3
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 20:31:00 2022 -0400

    Add default configs for Feeder gateway client

commit 908d58e
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 20:20:52 2022 -0400

    Add to readme default starknet_network and getaway in config

commit 8e3d8bc
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 20:15:41 2022 -0400

    Add configuration for Starknet network and set Goerli as default

commit a413864
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 20:14:59 2022 -0400

    Add files for types and client in Feeder Gateway

commit 8b0799e
Author: kassim <alkassimk@gmail.com>
Date:   Thu Feb 24 06:44:27 2022 +0100

    add logs for GetStateRoot

commit e72b5a4
Merge: 7b56a8a 9935592
Author: kassim <alkassimk@gmail.com>
Date:   Thu Feb 24 06:35:44 2022 +0100

    Merge branch 'log/add_logging_to_project' into core/state-root

commit 7b56a8a
Author: kassim <alkassimk@gmail.com>
Date:   Thu Feb 24 06:33:42 2022 +0100

    change ethereum node url

commit bfcdc3b
Author: kassim <alkassimk@gmail.com>
Date:   Wed Feb 23 12:20:45 2022 +0100

    fetch state root directly from header

commit 9935592
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Feb 22 19:10:11 2022 -0500

    Add logs for sn_keccak

commit 108d0a6
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Feb 22 19:07:02 2022 -0500

    Add debugging for encoding of chain ID

commit 5731832
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Feb 22 19:03:34 2022 -0500

    Use logrus as logging in main

commit db279be
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Feb 22 18:58:23 2022 -0500

    Add instructions for log in README

commit 7d987c5
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Feb 22 18:56:03 2022 -0500

    Add sirupsen/log for logging to app

commit 5f2f951
Author: kassim <alkassimk@gmail.com>
Date:   Tue Feb 22 09:53:38 2022 +0100

    create config to hold endpoint

commit cce4741
Author: kassim <alkassimk@gmail.com>
Date:   Mon Feb 21 19:47:11 2022 +0100

    fix: get state root

commit 58ff2f6
Author: kassim <alkassimk@gmail.com>
Date:   Mon Feb 21 15:44:53 2022 +0100

    fetch L1 block data
@stdevMac
Remove merge line in Readme
bfc3869
@stdevMac
Add feeder to state retrieval
32bde04
@stdevMac
Remove .idea files
73cff3a
@stdevMac
Merge remote-tracking branch 'origin/main' into core/state-root
ddb81ed 
# Conflicts:
#	README.md
#	cmd/juno/cli/root.go
#	docs/docs/sidebars.js
#	docs/docusaurus.config.js
#	go.mod
#	go.sum
#	internal/config/config.go
#	pkg/rpc/feeder_test.go
@stdevMac
Add changes for fetching logs and events
9057279
@stdevMac
Fetching Starknet Fact from contract in L1
51b1167
feat: create binary trie
938bd76
refactor: implement delete method
20a127b
docs: update documentation
ed4a097
@stdevMac
Add fastSync for state
dc8451a
test: add tests for exported methods
c0931d6
@stdevMac
Merge branch 'main' into core/trie
c30245d
@stdevMac
Update feeder gateway
8c98cb0
@stdevMac
Update State fetch from l1 and feeder gateway
108b6b3
@stdevMac
Merge remote-tracking branch 'origin/main' into core/state-root
cc086d3
@stdevMac
Getting pages from contract
9ffe40b
refactor: substitute recursive put with loop
083508f 
This also fixes an issue where deleting certain keys would not result in
an updated commitment value.
test: satisfy code coverage tool
34c84c8
@stdevMac
Fix minor error in GetCode
ccc0ae9
@stdevMac
Merge remote-tracking branch 'origin/main' into core/state-root
7e4563f
@stdevMac
Merge remote-tracking branch 'origin/core/trie' into code/state_plus_…
17fc2c1 
…trie
@stdevMac
calculate state root and state diff
abb6068
@stdevMac
fetch info from l1 and format to used structs
eb9930f
refactor: minor changes to improve clarity
93ee0b3
fix: fix issue caused by overflow
79baafb
@stdevMac
Trie updates
cc16c16
@stdevMac
update of state
9385b46
@stdevMac
Merge remote-tracking branch 'origin/core/trie' into code/state_plus_…
951964c 
…trie
@stdevMac
work in formatting on key insertion
acfe21c
adriantpaez
adriantpaez requested changes Jun 9, 2022
View reviewed changes
Copy link
Contributor

@adriantpaez adriantpaez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't know if these changes are 100% correct or if we can do it on another PR later

.github/workflows/juno-build.yml Outdated Show resolved Hide resolved
cmd/juno/cli/root.go Show resolved Hide resolved
internal/db/db_test.go Outdated Show resolved Hide resolved
cmd/juno/cli/root.go Show resolved Hide resolved
joshklop
joshklop requested changes Jun 12, 2022
View reviewed changes
Copy link
Contributor

@joshklop joshklop left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Found a few more things we should discuss before merging.

pkg/starknet/state.go Outdated Show resolved Hide resolved
pkg/starknet/state.go Outdated Show resolved Hide resolved
internal/config/config.go Show resolved Hide resolved
stdevMac and others added 15 commits June 12, 2022 20:16
@stdevMac
Merge remote-tracking branch 'origin/main' into core/state_plus_trie
236f823
@joshklop
Fix bytes <--> hex conversions
a95a062 
`common.Hex2Bytes` does not work if the `0x` prefix exists.
@joshklop
Merge branch 'core/state_plus_trie' of https://github.com/NethermindE…
29f7a83 
…th/juno into core/state_plus_trie
@joshklop
Set DataDir properly on non-Windows machines
67d94af
@joshklop
Fix naming in contractHash service
f97ce64
@joshklop
Format
2659553
@joshklop
Ensure mdbx transactions remain on single thread
bc90300
@stdevMac
Remove share folder
3bb6e03
@stdevMac
Merge remote-tracking branch 'origin/main' into core/state_plus_trie
f7da87e 
# Conflicts:
#	internal/services/block.go
#	internal/services/transactions.go
@stdevMac
Solve merge issues
669da5a
@stdevMac
Solve format
dbfd15a 
Signed-off-by: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
@stdevMac
use mkdir all for dataPath
623605e
@stdevMac
Merge remote-tracking branch 'origin/main' into core/state_plus_trie
4c8fc80
@stdevMac
Remove unused params in config
646d33a
@stdevMac
Merge remote-tracking branch 'origin/main' into core/state_plus_trie
1c5da85
@joshklop joshklop merged commit 59ce13f into main Jun 13, 2022
@stdevMac stdevMac deleted the core/state_plus_trie branch July 5, 2022 22:07
IronGauntlets pushed a commit that referenced this pull request Aug 18, 2022
@stdevMac @adriantpaez
@joshklop @IronGauntlets
Sync Against L1 and API (#183)
f946602 
* Squashed commit of the following:

commit 0f549758e30e44d561b0b992977f9c63e2df7c31
Merge: d732bc6 e538bce
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 25 15:32:07 2022 -0400

    Merge remote-tracking branch 'origin/main' into core/state-root-sync

commit d732bc666cc03bbbc93ccc130c237a6a5c7faf06
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 25 13:01:25 2022 -0400

    Fix errors in Feeder Gateway Client and add state for Starknet State

commit 4f5fe55bd3675e5a761dfac6b83067ad7ca2c43b
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 25 12:59:29 2022 -0400

    Change comment in Ethereum State Synchronizer

commit fe2be2b33cf7ca7d9073165a1a4b1b9d8b0db0e1
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 25 12:57:50 2022 -0400

    Fix issue in db implementation

commit 6379ff9a0bcaf7d47b3c9f6b9bc0763df8a55f67
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 25 12:56:11 2022 -0400

    Change some types of feeder_gateway

commit 23186a9248005801825226b583dcf399ddad09ac
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Mar 22 17:30:34 2022 -0400

    Add struct to starknet in config

commit 7f734def087d84f7b31894e06597da2395d19686
Merge: c151dca aefc127
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Mar 22 17:24:52 2022 -0400

    Merge branch 'core/feeder_getaway' into core/state-root

    # Conflicts:
    #	README.md
    #	internal/config/config.go

commit c151dca25a1ffef8ef25dafe9bf94d94589e85f0
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Mar 22 10:24:23 2022 -0400

    Change name of ethereum state syncronizer

commit aba75652259fd9894873fe5cdde22f76f396ddac
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Mar 22 10:15:32 2022 -0400

    Add database connection to Synchronizer

commit df9043c
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:56:56 2022 -0400

    Update readme

commit a862668
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:54:58 2022 -0400

    handle layer 1 sync over config

commit 7a6b5e1
Merge: 47774a0 5eeaee2
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:43:30 2022 -0400

    Merge remote-tracking branch 'origin/main' into core/state-root

commit 47774a0
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:39:26 2022 -0400

    Add documentation for Ethereum Syncronizer

commit f2d7c60
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:35:54 2022 -0400

    Add Layer 1 Syncronizer to process runner

commit 0ecce31
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:34:20 2022 -0400

    Add Synchronizer to state root calculator

commit 0078b04
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 19:31:11 2022 -0400

    Add log when closing rpc server

commit bd7000c
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 21 16:28:53 2022 -0400

    restructure state_root

commit f30b1eb
Merge: 8b0799e a7ccdc5
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Fri Mar 18 06:29:58 2022 -0400

    Merge remote-tracking branch 'origin/main' into core/state-root

    # Conflicts:
    #	README.md
    #	cmd/main.go
    #	configs/gateway.go
    #	docs/static/img/log.png
    #	go.mod
    #	go.sum
    #	internal/chainid.go
    #	internal/sn_keccak.go

commit aefc127
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 18:56:03 2022 -0400

    [doc] Fix docusaurus docs

commit a8ba122
Merge: acf3a8b a7ccdc5
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 18:35:34 2022 -0400

    Merge remote-tracking branch 'origin/main' into core/feeder_getaway

commit acf3a8b
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 16:13:40 2022 -0400

    Remove unused line

commit 8050068
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 14:15:08 2022 -0400

    Add test case for coverage

commit ddbb866
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 14:06:53 2022 -0400

    Add tests for feeder_gateway CallContract

commit 66bad94
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 13:59:58 2022 -0400

    Add tests for feeder_gateway GetBlockHashById

commit 8635f7c
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 13:54:54 2022 -0400

    Add tests for feeder_gateway GetTransactionIdByHash

commit 3232c0c
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:51:55 2022 -0400

    Add tests for feeder_gateway GetTransactionHashById

commit c6c9768
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:50:00 2022 -0400

    Add tests for feeder_gateway GetBlockIdByHash

commit 1fc8d36
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:46:21 2022 -0400

    Add tests for feeder_gateway TestGetTransactionReceipt

commit a28a17f
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:43:11 2022 -0400

    Add tests for feeder_gateway GetTransaction

commit 184877b
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:03:35 2022 -0400

    Add test for GetTransactionStatus

commit 1895681
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 11:00:47 2022 -0400

    Add test for getStorage at

commit cc3d54b
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 10:57:04 2022 -0400

    Add test for GetFullContract from feeder_gateway

commit d7cec4c
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 10:48:57 2022 -0400

    Add test for GetCode from feeder_gateway

commit abe8884
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 10:30:26 2022 -0400

    Add test for GetStateUpdate

commit 455fe63
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 10:20:13 2022 -0400

    Add response for storage diffs

commit 037a1ef
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Thu Mar 17 09:25:49 2022 -0400

    Add test for getBlock in feeder gateway

commit 1ff959e
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 22:27:09 2022 -0400

    Change gateway to feeder_gateway as package name

commit a955bff
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 22:25:16 2022 -0400

    Set as notested in coverage types related to gateway

commit dd03dcb
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 22:23:13 2022 -0400

    Set as notested in coverage autogenerated file

commit 560eff6
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:49:05 2022 -0400

    Restructurate tests for feeder

commit c77b838
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:40:21 2022 -0400

    Connect mocked http.client to test

commit 04f04d5
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:38:03 2022 -0400

    Add generated code for mock http.client

commit 49837df
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:36:38 2022 -0400

    Add directives for client mocking generator

commit 24afc9f
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:36:09 2022 -0400

    Update go mod

commit f441ece
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:30:27 2022 -0400

    Update go.{mod,sum}

commit 10daea0
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Wed Mar 16 18:30:02 2022 -0400

    Delete unused file

commit 89b64b7
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Mar 15 10:36:37 2022 -0400

    Update go mods

commit 9380d70
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 06:10:32 2022 -0400

    Add small test for GetContractAddress and solve small isuues

commit 650f31d
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:58:46 2022 -0400

    Set as public gateway client methods

commit 0085639
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:51:55 2022 -0400

    Add to getTransactionHashById and getTransactionIdByHash proper implementation of params and returns

commit e266aae
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:47:20 2022 -0400

    Add params and response for getBlockIdByHash

commit 614197b
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:41:44 2022 -0400

    Add params and response for getBlockHashById

commit c480126
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:38:30 2022 -0400

    Add params, response struct for getTransactionReceipt

commit c3c2462
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Mon Mar 14 05:30:07 2022 -0400

    Add getTransaction paramas and response

commit 77dbea9
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:40:38 2022 -0400

    Add getTransactionStatus paramas and response

commit bad6674
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:33:52 2022 -0400

    Add get_storege_at paramas and response

commit 3be51c4
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:24:11 2022 -0400

    Add params and response for get_full_contract request

commit b0f6093
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:21:46 2022 -0400

    Add params and response for get_state_update request

commit 3cc2594
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:19:10 2022 -0400

    Add params and response for get_code request

commit d83225e
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 23:13:43 2022 -0400

    Add StarknetBlock response for getBlock in feeder Gateway

commit 519a82d
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 22:47:32 2022 -0400

    Add basic types for starknet transactions and callContract request

commit 16e8934
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 20:40:11 2022 -0400

    Add base test for feeder gateway

commit 0b1c2f3
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 20:31:00 2022 -0400

    Add default configs for Feeder gateway client

commit 908d58e
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 20:20:52 2022 -0400

    Add to readme default starknet_network and getaway in config

commit 8e3d8bc
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 20:15:41 2022 -0400

    Add configuration for Starknet network and set Goerli as default

commit a413864
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Sun Mar 13 20:14:59 2022 -0400

    Add files for types and client in Feeder Gateway

commit 8b0799e
Author: kassim <alkassimk@gmail.com>
Date:   Thu Feb 24 06:44:27 2022 +0100

    add logs for GetStateRoot

commit e72b5a4
Merge: 7b56a8a 9935592
Author: kassim <alkassimk@gmail.com>
Date:   Thu Feb 24 06:35:44 2022 +0100

    Merge branch 'log/add_logging_to_project' into core/state-root

commit 7b56a8a
Author: kassim <alkassimk@gmail.com>
Date:   Thu Feb 24 06:33:42 2022 +0100

    change ethereum node url

commit bfcdc3b
Author: kassim <alkassimk@gmail.com>
Date:   Wed Feb 23 12:20:45 2022 +0100

    fetch state root directly from header

commit 9935592
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Feb 22 19:10:11 2022 -0500

    Add logs for sn_keccak

commit 108d0a6
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Feb 22 19:07:02 2022 -0500

    Add debugging for encoding of chain ID

commit 5731832
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Feb 22 19:03:34 2022 -0500

    Use logrus as logging in main

commit db279be
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Feb 22 18:58:23 2022 -0500

    Add instructions for log in README

commit 7d987c5
Author: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>
Date:   Tue Feb 22 18:56:03 2022 -0500

    Add sirupsen/log for logging to app

commit 5f2f951
Author: kassim <alkassimk@gmail.com>
Date:   Tue Feb 22 09:53:38 2022 +0100

    create config to hold endpoint

commit cce4741
Author: kassim <alkassimk@gmail.com>
Date:   Mon Feb 21 19:47:11 2022 +0100

    fix: get state root

commit 58ff2f6
Author: kassim <alkassimk@gmail.com>
Date:   Mon Feb 21 15:44:53 2022 +0100

    fetch L1 block data

* Remove merge line in Readme

* Add feeder to state retrieval

* Remove .idea files

* Add changes for fetching logs and events

* Fetching Starknet Fact from contract in L1

* feat: create binary trie

* refactor: implement delete method

* docs: update documentation

* Add fastSync for state

* test: add tests for exported methods

* Update State fetch from l1 and feeder gateway

* Getting pages from contract

* refactor: substitute recursive put with loop

This also fixes an issue where deleting certain keys would not result in
an updated commitment value.

* test: satisfy code coverage tool

* Fix minor error in GetCode

* calculate state root and state diff

* fetch info from l1 and format to used structs

* refactor: minor changes to improve clarity

* fix: fix issue caused by overflow

* Trie updates

* update of state

* work in formatting on key insertion

* test: add test for state commitment

* Working fetching

* solve issues in blocks sync, 150>

* add ABI service

* Check sync between l1 and feeder gateway

* add State storage service (contract code)

* Remove comments from db package

* Remove comments that appears Juno presentation cli

* Update database codebase

* Add Storer interface as KvStorer

* Remove operations

* Update state fetcher

* refactors

* refactor

* refactors and comments

* Add changes for memory hash contract address

* Add transaction db

* Update MemoryPagesContract Address

* Add initial tests for transactiondb

* Add test for transactionDB

* Update values on the db using transactions

* Update initialization on Starknet Synchronizer

* Add service for contractHash storage

* Until block 91

* fix database error

* Load ContractState from database instead from map

* Add database using transactions

* Fix test for transaction database

* add more comments

* Update Fact values

* Update sync fact for l1

* update database

* Remove comments in db

* Add coverage

* Update coverage

* solve error compiling and more coverage

* Update for the digest calculation after merge

* solver error in rpc response

* improve types and coverage

* Remove unused config

* Fix small issues syncing

* Minor refactoring

* Add test for updateState function

Most of the changes outside of the `state_test.go` file are meant
to push side effects and global services up the call stack as far
as possible. We prefer pass them around as parameters, making
functions far easier to test.

* Changes on comments

* Update database fields and services

* Refactor and add test for parsePages

* Add test for numeric values and remove chainID calls

* Fixed values

* Add test for getFactInfo

* Basic test usage for loadContract function

* Add more test for contracts

* Improve coverage

* initial commit

* Solve compilation issues

* Change juno1 to juno

* Update project build on github

* Add test for processPagesHashes

* Clean up test and mock ethclient

* fix: ascii art printed twice

* Remove unused function

* Move updateState to utils.go

* Make all SequenceNumbers int64

* Update last block synced in one place

* Make all sequence numbers uint64

* Add minor fixs

* Call services update on L1Sync too

* Add TestUpdateStateAndCommit

* Remove duplicated longMsg

* Small refactoring on state

* Fix bug with mistaken go routine

* Add documentation

* Fill coverage

* Remove severity alert

* Add notest in unreachable code

* Call basic to services

* Add conversor for StateCode

* Run formater

* Convert from feeder ABI to db ABI

* Add transactions conversion from feeder to db

* Add block convertor

* Add tests for state code function

* Add testing for conversion functions and small refactor

* Fill coverage

* Solve formatter issue

* Parse commits

* Use DbPath for all databases

Also format root.go

* Fix syncing bug

Using `BytesToHash`+`.Hex()` includes the `0x`, which is
needed for the key in the database.

* syncing: pick up where you left off

* Fix sync process

* Adding services

* feeder: retry twice on error

* Update sync process order

* Fix goerli class_hash method from api and abi fix

* Fixing tests and coverage

* Small fixes to make toDbAbi test pass

* Format

* Fix state commitment issue on L1 sync (#208)

* Fix mismatched fact issue

If we cancel execution while processing a Starknet block that has
a corresponding LogStateUpdate in the same Ethereum block as the
previous Starknet block's LogStateUpdate (e.g. Starknet block 20)
and restart, we will get an error "state commitments do not
match". That is because we incorrectly populate `factVal` in
`getFactInfo` with information from both LogStateUpdates, rather
than the one corresponding to the current sequence number.

This fix ensures that we correctly filter the LogStateUpdates for
the one that corresponds to the current StateTransitionFact.

* Format

* Fix feeder pkg coverage

* Format code

* Add syncing documentation

* Move sync documentation under features directory

* Simple fixes

* Fix blocks not storing

* Solve hashService reference

* Fix bytes <--> hex conversions

`common.Hex2Bytes` does not work if the `0x` prefix exists.

* Set DataDir properly on non-Windows machines

* Fix naming in contractHash service

* Format

* Ensure mdbx transactions remain on single thread

* Remove share folder

* Solve merge issues

* Solve format

Signed-off-by: Marcos Antonio Maceo Reyes <marcosmaceowork@gmail.com>

* use mkdir all for dataPath

* Remove unused params in config

Co-authored-by: Tshaka Eric Lekholoane <_@tshaka.co>
Co-authored-by: stdevAdrianPaez <adriantpaez@gmail.com>
Co-authored-by: Josh Klopfenstein <joshklop10@gmail.com>
Co-authored-by: Josh Klopfenstein <31332481+joshklop@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@joshklop joshklop joshklop approved these changes

@adriantpaez adriantpaez adriantpaez approved these changes

@tshakalekholoane tshakalekholoane Awaiting requested review from tshakalekholoane

Assignees

@joshklop joshklop

@stdevMac stdevMac

Labels
Core Features or changes related to core package Optimisation New feature or request
Projects
None yet
Milestone
No milestone
3 participants
@stdevMac @joshklop @adriantpaez