Gekko crashes while running watcher/tradebot #2442

alexandershalin · 2018-08-13T10:28:06Z

Note: this is the technical bug tracker, please use other platforms for getting support and starting a (non technical) discussion. See the getting help page for details.

I'm submitting a ...
[x ] bug report
[ ] question about the decisions made in the repository

Action taken (what you did)
Installed version 0.6.5 from the scratch
Started live gekko (neuralnet) from UI at Binance

Expected result (what you hoped would happen)
Order should be placed

Actual result (unexpected outcome)
Gekko was running for a while and crased at one moment (seems that it tried to place an order)

Other information (e.g. detailed explanation, stacktraces, related issues, suggestions how to fix, links for us to have context, eg. stackoverflow, etc)

Aug 13 09:15:22 ip-172-31-31-32 gekko[8596]: --> GET /api/imports 200 1ms 364b
Aug 13 09:27:26 ip-172-31-31-32 gekko[8596]: events.js:183
Aug 13 09:27:26 ip-172-31-31-32 gekko[8596]: throw er; // Unhandled 'error' event
Aug 13 09:27:26 ip-172-31-31-32 gekko[8596]: ^
Aug 13 09:27:26 ip-172-31-31-32 gekko[8596]: Error: read ECONNRESET
Aug 13 09:27:26 ip-172-31-31-32 gekko[8596]: at _errnoException (util.js:992:11)
Aug 13 09:27:26 ip-172-31-31-32 gekko[8596]: at TCP.onread (net.js:618:25)
Aug 13 09:27:26 ip-172-31-31-32 systemd[1]: gekko.service: Main process exited, code=exited, status=1/FAILURE
Aug 13 09:27:26 ip-172-31-31-32 systemd[1]: gekko.service: Unit entered failed state.
Aug 13 09:27:26 ip-172-31-31-32 systemd[1]: gekko.service: Failed with result 'exit-code'.
Aug 13 09:27:36 ip-172-31-31-32 systemd[1]: gekko.service: Service hold-off time over, scheduling restart.
Aug 13 09:27:36 ip-172-31-31-32 systemd[1]: Stopped gekko.service.
Aug 13 09:27:36 ip-172-31-31-32 systemd[1]: Started gekko.service.

2018-08-13-08-08-tradebot-710049575725727.log

alexandershalin · 2018-08-13T10:32:24Z

Seems that this issue is not directly related to Binance or strat used. Gekko should handle this exception somehow and do not restart.

alexandershalin · 2018-08-13T10:43:37Z

Tried to start tradebot one more time. Watcher was created but strat runner was not.
Tried to start watcher only. The same problem here.

Aug 13 10:36:38 ip-172-31-31-32 gekko[8959]: <-- GET /api/configPart/candleWriter
Aug 13 10:36:38 ip-172-31-31-32 gekko[8959]: --> GET /api/configPart/candleWriter 200 1ms 47b
Aug 13 10:36:38 ip-172-31-31-32 gekko[8959]: <-- GET /api/strategies
Aug 13 10:36:38 ip-172-31-31-32 gekko[8959]: <-- GET /api/configPart/performanceAnalyzer
Aug 13 10:36:38 ip-172-31-31-32 gekko[8959]: --> GET /api/configPart/performanceAnalyzer 200 1ms 144b
Aug 13 10:36:38 ip-172-31-31-32 gekko[8959]: --> GET /api/strategies 200 4ms 2.67kb
Aug 13 10:36:38 ip-172-31-31-32 gekko[8959]: <-- GET /api/configPart/paperTrader
Aug 13 10:36:38 ip-172-31-31-32 gekko[8959]: --> GET /api/configPart/paperTrader 200 0ms 132b
Aug 13 10:37:02 ip-172-31-31-32 gekko[8959]: <-- POST /api/startGekko
Aug 13 10:37:02 ip-172-31-31-32 gekko[8959]: 2018-08-13 10:37 Gekko 2018-08-13-10-37-watcher-205997879003161 started.
Aug 13 10:37:02 ip-172-31-31-32 gekko[8959]: --> POST /api/startGekko 200 8ms 1.23kb
Aug 13 10:40:30 ip-172-31-31-32 gekko[8959]: events.js:183
Aug 13 10:40:30 ip-172-31-31-32 gekko[8959]: throw er; // Unhandled 'error' event
Aug 13 10:40:30 ip-172-31-31-32 gekko[8959]: ^
Aug 13 10:40:30 ip-172-31-31-32 gekko[8959]: Error: read ECONNRESET
Aug 13 10:40:30 ip-172-31-31-32 gekko[8959]: at errnoException (util.js:992:11)
Aug 13 10:40:30 ip-172-31-31-32 gekko[8959]: at TCP.onread (net.js:618:25)
Aug 13 10:40:30 ip-172-31-31-32 systemd[1]: gekko.service: Main process exited, code=exited, status=1/FAILURE
Aug 13 10:40:30 ip-172-31-31-32 systemd[1]: gekko.service: Unit entered failed state.
Aug 13 10:40:30 ip-172-31-31-32 systemd[1]: gekko.service: Failed with result 'exit-code'.
Aug 13 10:40:40 ip-172-31-31-32 systemd[1]: gekko.service: Service hold-off time over, scheduling restart.
Aug 13 10:40:40 ip-172-31-31-32 systemd[1]: Stopped gekko.service.
Aug 13 10:40:40 ip-172-31-31-32 systemd[1]: Started gekko.service.
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: ______ ________ __ __ __ __ ______
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: / \ / |/ | / |/ | / | /
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: /$$$$$$ |$$$$$$$$/ $$ | /$$/ $$ | /$$/ /$$$$$$ |
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: $$ | $$/ $$ | $$ |/$$/ $$ |/$$/ $$ | $$ |
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: $$ |/ |$$ | $$ $$< $$ $$< $$ | $$ |
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: $$ |$$$$ |$$$$$/ $$$$$ \ $$$$$ \ $$ | $$ |
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: $$ _$$ |$$ |_____ $$ |$$ \ $$ |$$ \ $$ _$$ |
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: $$ $$/ $$ |$$ | $$ |$$ | $$ |$$ $$/
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: $$$$$$/ $$$$$$$$/ $$/ $$/ $$/ $$/ $$$$$$/
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: Gekko v0.6.5
Aug 13 10:40:40 ip-172-31-31-32 gekko[9599]: I'm gonna make you rich, Bud Fox.

askmike · 2018-08-14T01:20:45Z

Strange:

Error: read ECONNRESET

So something got disconnected, but I'm not sure what.

Could you tell me:

What kind of gekko (live or paper trader)?
What exchange? -> Binance
Did you use any plugins?
Did you have a browser session open at the time?
What browser (& version)?
What database (assuming default sqlite)?

alexandershalin · 2018-08-14T08:30:31Z

What kind of gekko (live or paper trader)?

Didn't try to run paper trader. Tried market watcher and tradebot to reproduce this issue.

What exchange? -> Binance

Yes, Binance

Did you use any plugins?

No additional plugins were used.

Did you have a browser session open at the time?

Yes, I guess browser was open.

What browser (& version)?

Google Chrome, 68.0.3440.106 (x64)

What database (assuming default sqlite)?

Yes, SQLite.

xbromy · 2018-08-14T10:20:04Z

That's the error on my instance. Same Answers like @alexandershalin. Current dev branch today.

Aug 14 10:02:42 Test02 gekko[7963]: <-- GET /api/imports
Aug 14 10:02:42 Test02 gekko[7963]: --> GET /api/imports 200 2ms 2b
Aug 14 10:02:42 Test02 gekko[7963]: <-- GET /api/gekkos
Aug 14 10:02:42 Test02 gekko[7963]: --> GET /api/gekkos 200 1ms 4.6kb
Aug 14 10:02:42 Test02 gekko[7963]: <-- GET /api/apiKeys
Aug 14 10:02:42 Test02 gekko[7963]: --> GET /api/apiKeys 200 1ms 11b
Aug 14 10:02:42 Test02 gekko[7963]: <-- GET /api/exchanges
Aug 14 10:02:42 Test02 gekko[7963]: --> GET /api/exchanges 200 6ms 87.73kb
Aug 14 10:02:45 Test02 gekko[7963]: <-- POST /api/getCandles
Aug 14 10:02:45 Test02 gekko[7963]: --> POST /api/getCandles 200 308ms 248b
Aug 14 10:16:14 Test02 gekko[7963]: events.js:167
Aug 14 10:16:14 Test02 gekko[7963]: throw er; // Unhandled 'error' event
Aug 14 10:16:14 Test02 gekko[7963]: ^
Aug 14 10:16:14 Test02 gekko[7963]: Error: read ECONNRESET
Aug 14 10:16:14 Test02 gekko[7963]: at TCP.onread (net.js:659:25)
Aug 14 10:16:14 Test02 gekko[7963]: Emitted 'error' event at:
Aug 14 10:16:14 Test02 gekko[7963]: at WebSocket.finalize (/home/username/gekko/node_modules/ws/lib/WebSocket.js:182:41)
Aug 14 10:16:14 Test02 gekko[7963]: at Socket.emit (events.js:182:13)
Aug 14 10:16:14 Test02 gekko[7963]: at emitErrorNT (internal/streams/destroy.js:82:8)
Aug 14 10:16:14 Test02 gekko[7963]: at emitErrorAndCloseNT (internal/streams/destroy.js:50:3)
Aug 14 10:16:14 Test02 gekko[7963]: at process._tickCallback (internal/process/next_tick.js:63:19)
Aug 14 10:16:14 Test02 gekko[7963]: disconnect
Aug 14 10:16:14 Test02 gekko[7963]: disconnect
Aug 14 10:16:14 Test02 systemd[1]: gekko.service: Main process exited, code=exited, status=1/FAILURE
Aug 14 10:16:14 Test02 systemd[1]: gekko.service: Unit entered failed state.
Aug 14 10:16:14 Test02 systemd[1]: gekko.service: Failed with result 'exit-code'.
Aug 14 10:16:24 Test02 systemd[1]: gekko.service: Service hold-off time over, scheduling restart.
Aug 14 10:16:24 Test02 systemd[1]: Stopped gekko.service.

xbromy · 2018-08-14T18:22:43Z

@askmike let us know if there is more to test 😄

alexandershalin · 2018-08-14T19:10:36Z

Tried to more things:

Paper trader: the same problem
Internet Explorer instead of Chrome (actually do not think that it is browser related): the same problem.

Gekko is not usable for me currently :(

xbromy · 2018-08-14T19:13:23Z

Yes it's strange. it's running fine using commandline but on UI setup it crashes. And yes, I had also crashes in night when I haven't open the web browser.

askmike · 2018-08-20T06:57:45Z

I just pushed a bunch of error handling related to the websocket. Can everyone (@xbromy, @alexandershalin, et al.) please run the development branch and report strange logs? See here: https://gekko.wizb.it/docs/installation/updating_gekko.html#Updating-the-develop-branch

xbromy · 2018-08-20T07:18:35Z

Okay, I updated and switched to UI. Let's see.

askmike · 2018-08-20T09:56:14Z

Is there anything in the logs? Have you updated dependencies?

…

On Mon, Aug 20, 2018 at 4:33 PM, Alexander Shalin ***@***.***> wrote: I receive the following error right after update to develop branch. Aug 20 08:30:40 ip-172-31-31-32 gekko[26218]: RECEIVED ERROR IN GEKKO INSTANCE 2018-08-20-08-30-tradebot-467908376750755 Aug 20 08:30:40 ip-172-31-31-32 gekko[26218]: This Gekko instance encountered an error and can't continue — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub <#2442 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AA7MD01fATIAv4-vBwxWicN3Oae77KcOks5uSnRSgaJpZM4V6QcM> .

-- PGP key at keybase.io/mikevanrossum <https://keybase.io/mikevanrossum/key.asc>

alexandershalin · 2018-08-20T14:12:56Z

@askmike yes, forgot to update dependencies. Seems that this issue is fixed on my side now.

xbromy · 2018-08-20T15:40:49Z

@alexandershalin How to update dependencies?

askmike · 2018-08-20T15:41:57Z

@xbromy https://gekko.wizb.it/docs/installation/updating_gekko.html#Updating-the-develop-branch

…

On Mon, Aug 20, 2018 at 11:40 PM, xbromy ***@***.***> wrote: @alexandershalin <https://github.com/alexandershalin> How to update dependencies? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#2442 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AA7MD83O8clAu4uRiT477XvbCAXpGGAeks5uStiKgaJpZM4V6QcM> .

-- PGP key at keybase.io/mikevanrossum <https://keybase.io/mikevanrossum/key.asc>

alexandershalin · 2018-08-20T15:43:51Z

@xbromy in the case of using some custom strats (Neuralnet e.g.) you also need to update dependencies for these strats.

xbromy · 2018-08-20T16:04:25Z

Ah yes rest I already did. It's working fine since a few hours. Looks great.

alexandershalin changed the title ~~Gekko crashes trying to place live order~~ Gekko crashes while running tradebot Aug 13, 2018

alexandershalin changed the title ~~Gekko crashes while running tradebot~~ Gekko crashes while running watcher/tradebot Aug 13, 2018

This was referenced Aug 19, 2018

Gekko live don't work #2459

Closed

Hotfix/ws server error handling #2462

Merged

askmike closed this as completed in #2462 Aug 20, 2018

xbromy mentioned this issue Aug 24, 2018

Gekko crashed #2476

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Gekko crashes while running watcher/tradebot #2442

Gekko crashes while running watcher/tradebot #2442

alexandershalin commented Aug 13, 2018

alexandershalin commented Aug 13, 2018

alexandershalin commented Aug 13, 2018 •

edited

Loading

askmike commented Aug 14, 2018

alexandershalin commented Aug 14, 2018 •

edited

Loading

xbromy commented Aug 14, 2018

xbromy commented Aug 14, 2018

alexandershalin commented Aug 14, 2018

xbromy commented Aug 14, 2018

askmike commented Aug 20, 2018

xbromy commented Aug 20, 2018

askmike commented Aug 20, 2018 via email

alexandershalin commented Aug 20, 2018

xbromy commented Aug 20, 2018

askmike commented Aug 20, 2018 via email

alexandershalin commented Aug 20, 2018

xbromy commented Aug 20, 2018

Gekko crashes while running watcher/tradebot #2442

Gekko crashes while running watcher/tradebot #2442

Comments

alexandershalin commented Aug 13, 2018

alexandershalin commented Aug 13, 2018

alexandershalin commented Aug 13, 2018 • edited Loading

askmike commented Aug 14, 2018

alexandershalin commented Aug 14, 2018 • edited Loading

xbromy commented Aug 14, 2018

xbromy commented Aug 14, 2018

alexandershalin commented Aug 14, 2018

xbromy commented Aug 14, 2018

askmike commented Aug 20, 2018

xbromy commented Aug 20, 2018

askmike commented Aug 20, 2018 via email

alexandershalin commented Aug 20, 2018

xbromy commented Aug 20, 2018

askmike commented Aug 20, 2018 via email

alexandershalin commented Aug 20, 2018

xbromy commented Aug 20, 2018

alexandershalin commented Aug 13, 2018 •

edited

Loading

alexandershalin commented Aug 14, 2018 •

edited

Loading