Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TestSaveMemory* tests fail due to a potential deadlock #12

Closed
ustiugov opened this issue Jun 18, 2020 · 1 comment
Closed

TestSaveMemory* tests fail due to a potential deadlock #12

ustiugov opened this issue Jun 18, 2020 · 1 comment
Assignees
@plamenmpetrov
Labels
bug Something isn't working
Projects
vHive Roadmap

Comments

@ustiugov
Copy link
Member 

DEBU[2020-06-18T22:44:38.669241662+02:00] FwdRPC: Received a response from the  function instance  fID=4
DEBU[2020-06-18T22:44:38.669332846+02:00] Function has to shut down its instance, served 40 requests  fID=4
DEBU[2020-06-18T22:44:38.669422176+02:00] Removing instance (async)                     fID=4
DEBU[2020-06-18T22:44:38.669630749+02:00] Orchestrator received StopVM                  vmID=4_0
DEBU[2020-06-18T22:44:38.669860859+02:00] Function is inactive, starting the instance...  fID=4
DEBU[2020-06-18T22:44:38.669950956+02:00] Adding instance                               fID=4
DEBU[2020-06-18T22:44:38.670046416+02:00] StartVM: Received StartVM                     image="ustiugov/helloworld:runner_workload" vmID=4_1
DEBU[2020-06-18T22:44:38.670172832+02:00] Allocating a VM instance                      vmID=4_1
PANI[2020-06-18T22:44:48.670603722+02:00] Failed to acquire semaphore for NI allocate (or timed out) 
--- FAIL: TestSaveMemorySerial (14.39s)
panic: (*logrus.Entry) (0x14c1340,0xc000272a10) [recovered]
        panic: (*logrus.Entry) (0x14c1340,0xc000272a10)

goroutine 24 [running]:
testing.tRunner.func1(0xc0003bc300)
        /usr/local/go/src/testing/testing.go:874 +0x69f
panic(0x14c1340, 0xc000272a10)
        /usr/local/go/src/runtime/panic.go:679 +0x1b2
github.com/sirupsen/logrus.Entry.log(0xc000134000, 0xc000721680, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
        /home/ustiugov/go/pkg/mod/github.com/sirupsen/logrus@v1.5.0/entry.go:261 +0x613
github.com/sirupsen/logrus.(*Entry).Log(0xc0002727e0, 0xc000000000, 0xc000750d68, 0x1, 0x1)
        /home/ustiugov/go/pkg/mod/github.com/sirupsen/logrus@v1.5.0/entry.go:289 +0x15f
github.com/sirupsen/logrus.(*Logger).Log(0xc000134000, 0x0, 0xc000750d68, 0x1, 0x1)
        /home/ustiugov/go/pkg/mod/github.com/sirupsen/logrus@v1.5.0/logger.go:193 +0xa3
github.com/sirupsen/logrus.(*Logger).Panic(...)
        /home/ustiugov/go/pkg/mod/github.com/sirupsen/logrus@v1.5.0/logger.go:234
github.com/sirupsen/logrus.Panic(...)
        /home/ustiugov/go/pkg/mod/github.com/sirupsen/logrus@v1.5.0/exported.go:129
github.com/ustiugov/fccd-orchestrator/misc.(*NiPool).Allocate(0xc000271b60, 0x0, 0x0, 0x0)
        /home/ustiugov/go/pkg/mod/github.com/ustiugov/fccd-orchestrator/misc@v0.0.0-20200608162316-88962af36173/ni_pool.go:61 +0x619
github.com/ustiugov/fccd-orchestrator/misc.(*VMPool).Allocate(0xc000271b30, 0xc00045c980, 0x3, 0x1, 0x1, 0xc0001d08b0)
        /home/ustiugov/go/pkg/mod/github.com/ustiugov/fccd-orchestrator/misc@v0.0.0-20200608162316-88962af36173/vm_pool.go:53 +0x28e
github.com/ustiugov/fccd-orchestrator/ctriface.(*Orchestrator).StartVM(0xc000302d80, 0x162ce00, 0xc0000f2ea0, 0xc00045c980, 0x3, 0x14e32a6, 0x23, 0x0, 0x0, 0x0, ...)
        /home/ustiugov/go/pkg/mod/github.com/ustiugov/fccd-orchestrator/ctriface@v0.0.0-20200617143218-c9b3c238ebd2/iface.go:162 +0x2cd
github.com/ustiugov/fccd-orchestrator.(*Function).AddInstance(0xc0003dc090)
        /home/ustiugov/staged-data-tiering/fccd-orchestrator/functions.go:307 +0x45b
github.com/ustiugov/fccd-orchestrator.(*Function).Serve.func1()
        /home/ustiugov/staged-data-tiering/fccd-orchestrator/functions.go:224 +0xc5
sync.(*Once).doSlow(0xc00045c8a0, 0xc000751c58)
        /usr/local/go/src/sync/once.go:66 +0x101
sync.(*Once).Do(0xc00045c8a0, 0xc000751c58)
        /usr/local/go/src/sync/once.go:57 +0x69
github.com/ustiugov/fccd-orchestrator.(*Function).Serve(0xc0003dc090, 0x162cdc0, 0xc000036088, 0x14c9359, 0x1, 0x14e32a6, 0x23, 0x14caea5, 0x5, 0x0, ...)
        /home/ustiugov/staged-data-tiering/fccd-orchestrator/functions.go:220 +0x33d
github.com/ustiugov/fccd-orchestrator.(*FuncPool).Serve(0xc0003a8660, 0x162cdc0, 0xc000036088, 0x14c9359, 0x1, 0x14e32a6, 0x23, 0x14caea5, 0x5, 0xc00072ae40, ...)
        /home/ustiugov/staged-data-tiering/fccd-orchestrator/functions.go:114 +0xed
github.com/ustiugov/fccd-orchestrator.TestSaveMemorySerial(0xc0003bc300)
        /home/ustiugov/staged-data-tiering/fccd-orchestrator/fccd-orchestrator_test.go:202 +0x16b
testing.tRunner(0xc0003bc300, 0x1503e68)
        /usr/local/go/src/testing/testing.go:909 +0x19a
created by testing.(*T).Run
        /usr/local/go/src/testing/testing.go:960 +0x652
exit status 2
FAIL    github.com/ustiugov/fccd-orchestrator   14.447s
@ustiugov ustiugov added the bug Something isn't working label Jun 18, 2020
@ustiugov ustiugov added this to In progress in vHive Roadmap Jun 18, 2020
@ustiugov ustiugov moved this from In progress to To do in vHive Roadmap Jun 18, 2020
@plamenmpetrov plamenmpetrov moved this from To do to In progress in vHive Roadmap Jun 19, 2020
@ustiugov ustiugov moved this from In progress to Enhancements in vHive Roadmap Jun 23, 2020
@ustiugov
Copy link
Member Author

resolved by PR #23

HermioneKT pushed a commit that referenced this issue Jan 31, 2024
@KTCyber @HermioneKT
# This is a combination of 154 commits.
6674807 
# This is the 1st commit message:

refactor

# This is the commit message #2:

modify powerNodeSelector

# This is the commit message #3:

modify powerNodeSelector

# This is the commit message #4:

modify powerNodeSelector

# This is the commit message #5:

modify namespace

# This is the commit message #6:

modify namespace

# This is the commit message #7:

add namespace

# This is the commit message #8:

init power manager script

# This is the commit message #9:

add go code

# This is the commit message #10:

test

# This is the commit message #11:

test

# This is the commit message #12:

test

# This is the commit message #13:

test

# This is the commit message #14:

go.sum

# This is the commit message #15:

go sum

# This is the commit message #16:

go mod tidy

# This is the commit message #17:

test

# This is the commit message #18:

test

# This is the commit message #19:

test

# This is the commit message #20:

test

# This is the commit message #21:

test

# This is the commit message #22:

test

# This is the commit message #23:

test

# This is the commit message #24:

test

# This is the commit message #25:

test

# This is the commit message #26:

test

# This is the commit message #27:

test

# This is the commit message #28:

test

# This is the commit message #29:

print output

# This is the commit message #30:

test

# This is the commit message #31:

test

# This is the commit message #32:

test

# This is the commit message #33:

test

# This is the commit message #34:

test

# This is the commit message #35:

test

# This is the commit message #36:

test

# This is the commit message #37:

test

# This is the commit message #38:

test

# This is the commit message #39:

test

# This is the commit message #40:

refactor

# This is the commit message #41:

change val

# This is the commit message #42:

test

# This is the commit message #43:

test

# This is the commit message #44:

test

# This is the commit message #45:

exp1

# This is the commit message #46:

add url

# This is the commit message #47:

test

# This is the commit message #48:

test

# This is the commit message #49:

test auth

# This is the commit message #50:

test

# This is the commit message #51:

test

# This is the commit message #52:

test

# This is the commit message #53:

test

# This is the commit message #54:

test

# This is the commit message #55:

fix bug

# This is the commit message #56:

remove log

# This is the commit message #57:

test

# This is the commit message #58:

test

# This is the commit message #59:

test

# This is the commit message #60:

fix loop

# This is the commit message #61:

increase invocation

# This is the commit message #62:

test

# This is the commit message #63:

test

# This is the commit message #64:

test

# This is the commit message #65:

test

# This is the commit message #66:

test

# This is the commit message #67:

test

# This is the commit message #68:

test

# This is the commit message #69:

Test

# This is the commit message #70:

test

# This is the commit message #71:

test

# This is the commit message #72:

test

# This is the commit message #73:

test

# This is the commit message #74:

test

# This is the commit message #75:

test

# This is the commit message #76:

test

# This is the commit message #77:

test

# This is the commit message #78:

test

# This is the commit message #79:

test

# This is the commit message #80:

test

# This is the commit message #81:

test

# This is the commit message #82:

test

# This is the commit message #83:

test

# This is the commit message #84:

test

# This is the commit message #85:

test

# This is the commit message #86:

test

# This is the commit message #87:

test

# This is the commit message #88:

test

# This is the commit message #89:

test

# This is the commit message #90:

test1

# This is the commit message #91:

test

# This is the commit message #92:

test

# This is the commit message #93:

test

# This is the commit message #94:

test

# This is the commit message #95:

test

# This is the commit message #96:

test

# This is the commit message #97:

test

# This is the commit message #98:

test

# This is the commit message #99:

test

# This is the commit message #100:

test

# This is the commit message #101:

test

# This is the commit message #102:

test

# This is the commit message #103:

test

# This is the commit message #104:

test

# This is the commit message #105:

test

# This is the commit message #106:

test

# This is the commit message #107:

test

# This is the commit message #108:

test

# This is the commit message #109:

test1

# This is the commit message #110:

test

# This is the commit message #111:

test

# This is the commit message #112:

Test

# This is the commit message #113:

test

# This is the commit message #114:

test

# This is the commit message #115:

test

# This is the commit message #116:

test

# This is the commit message #117:

test

# This is the commit message #118:

test

# This is the commit message #119:

Test

# This is the commit message #120:

Test

# This is the commit message #121:

test

# This is the commit message #122:

test

# This is the commit message #123:

Test

# This is the commit message #124:

test

# This is the commit message #125:

test

# This is the commit message #126:

test

# This is the commit message #127:

test

# This is the commit message #128:

test

# This is the commit message #129:

test

# This is the commit message #130:

test

# This is the commit message #131:

test

# This is the commit message #132:

test

# This is the commit message #133:

test

# This is the commit message #134:

test

# This is the commit message #135:

test

# This is the commit message #136:

test

# This is the commit message #137:

test

# This is the commit message #138:

test

# This is the commit message #139:

test

# This is the commit message #140:

test

# This is the commit message #141:

test

# This is the commit message #142:

test

# This is the commit message #143:

Test

# This is the commit message #144:

Test

# This is the commit message #145:

Test

# This is the commit message #146:

Test

# This is the commit message #147:

test

# This is the commit message #148:

test

# This is the commit message #149:

test

# This is the commit message #150:

test

# This is the commit message #151:

test

# This is the commit message #152:

test

# This is the commit message #153:

test

# This is the commit message #154:

Test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@plamenmpetrov plamenmpetrov

Labels
bug Something isn't working
Projects
vHive Roadmap
  
Enhancements
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ustiugov @plamenmpetrov