Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Async I/O (syscalls 245 - 249) #1584

Open
wants to merge 34 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
0b2b56a
Individually stub each AIO syscall
kmeisthax Sep 27, 2021
175c52c
Add a structure in the task for AIO contexts to live in.
kmeisthax Sep 27, 2021
9c4a3f8
Implement `io_setup`
kmeisthax Sep 28, 2021
241fe79
Implement `io_destroy`.
kmeisthax Sep 30, 2021
5f041a3
Store the owning PID of each AIO context, so that resolved requests c…
kmeisthax Oct 1, 2021
9912680
Elaborate on the event structure to be able to hold pending requests,…
kmeisthax Oct 1, 2021
cce2d45
Add method for submitting a pending event.
kmeisthax Oct 1, 2021
314f335
Add functions for retrieving pending events from a context.
kmeisthax Oct 3, 2021
5390cf5
Add AIO syscalls to systrace
kmeisthax Oct 3, 2021
0cf305b
Add aioctx table method for retrieving (and retaining) a context by i…
kmeisthax Oct 3, 2021
032d31d
Half-implement io_submit.
kmeisthax Oct 3, 2021
ecfeae1
Add `aioctx_cancel_event` & other documentation fixes
kmeisthax Oct 3, 2021
da5a606
Add io_submit op so that FDs can handle asynchronous operations.
kmeisthax Oct 3, 2021
a4560f5
Add method to complete pending events.
kmeisthax Oct 4, 2021
9510f30
Add fallback for filesystems that don't yet implement true async I/O.
kmeisthax Oct 4, 2021
1dd76fe
Submitted events must retain the guest address of the IOCB structure …
kmeisthax Oct 4, 2021
8638202
Implement completion polling (io_getevents)
kmeisthax Oct 4, 2021
1c9f39a
Everything except io_setup takes a context ID directly, not a pointer…
kmeisthax Oct 4, 2021
d678aad
Properly initialize the lock and refcount in AIO contexts.
kmeisthax Oct 10, 2021
940d53d
Fix a bunch of bounds checks
kmeisthax Oct 10, 2021
21bd634
Always NULL out contexts in the task context table when removing them…
kmeisthax Oct 10, 2021
b504474
Add E2E test for AIO read and write.
kmeisthax Oct 10, 2021
867e899
Don't specify an enum impl type because gcc doesn't support that C gi…
kmeisthax Oct 11, 2021
09b2e07
In fallback code, treat FDSYNC as a full FSYNC.
kmeisthax Oct 24, 2021
fc90511
Pull the pread/pwrite emulation code out into separate functions.
kmeisthax Oct 25, 2021
8ffda31
Add E2E test for vectored async IO
kmeisthax Oct 25, 2021
f270bc1
Implement vectored async IO fallback
kmeisthax Oct 25, 2021
9769c6e
Fix incorrect/spurious failure on seeking to non-zero offsets
kmeisthax Oct 25, 2021
0a8c063
Remove implicit coercions in tests so that they don't sign-extend thi…
kmeisthax Oct 31, 2021
e8d3c9f
Add a condition variable for waiting on events, and wait for it to be…
kmeisthax Nov 21, 2021
6ea8dce
Formatting & consistency nits
kmeisthax Nov 21, 2021
1174ec7
Rip out and replace the `AIO_IOCB_` family of constants with a host s…
kmeisthax Nov 21, 2021
399265e
Also rip out the `AIO_IO_EVENT` constants for another host-compiled s…
kmeisthax Nov 21, 2021
6c09ad5
Remove e2e tests dependency on `linux/aio_abi.h` header
kmeisthax Nov 21, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
Prev Previous commit
Next Next commit
Add aioctx_cancel_event & other documentation fixes
  • Loading branch information
kmeisthax committed Nov 14, 2021
commit ecfeae1a6d7228c9006c942ca4561d932d1419f3
16 changes: 15 additions & 1 deletion fs/aio.c
Original file line number Diff line number Diff line change
Expand Up @@ -108,6 +108,19 @@ signed int aioctx_submit_pending_event(struct aioctx *ctx, uint64_t user_data, s
return index;
}

void aioctx_cancel_event(struct aioctx *ctx, unsigned int index) {
if (ctx == NULL) return;

lock(&ctx->lock);

if (index > ctx->events_capacity) return;

if (ctx->events[index].tag == AIOCTX_PENDING)
ctx->events[index].tag = AIOCTX_NONE;

unlock(&ctx->lock);
}

void aioctx_lock(struct aioctx* ctx) {
kmeisthax marked this conversation as resolved.
Show resolved Hide resolved
if (ctx == NULL) return;

Expand All @@ -120,8 +133,9 @@ void aioctx_unlock(struct aioctx* ctx) {
unlock(&ctx->lock);
}

signed int aioctx_pending_event(struct aioctx *ctx, int index, struct aioctx_event_pending **event) {
signed int aioctx_get_pending_event(struct aioctx *ctx, unsigned int index, struct aioctx_event_pending **event) {
if (ctx == NULL) return _EINVAL;
if (!ctx->is_owned_by_task) return _EINVAL;
if (index >= ctx->events_capacity) return _EINVAL;
if (ctx->events[index].tag != AIOCTX_PENDING) return _EINVAL;

Expand Down
15 changes: 12 additions & 3 deletions fs/aio.h
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ struct aioctx_event_pending {
// The bounds of the guest memory buffer.
uint64_t nbytes;

// The current guest memory buffer offset.
// The file offset to perform the I/O operation.
int64_t offset;
};

Expand Down Expand Up @@ -173,6 +173,13 @@ void aioctx_release_from_task(struct aioctx *ctx);
// event data up until the event is resolved.
signed int aioctx_submit_pending_event(struct aioctx *ctx, uint64_t user_data, struct aioctx_event_pending pending_data);

// Cancel a pending I/O event, freeing the event index for reuse.
//
// This should only be used if the submitted FD has signalled a synchronous
// error (e.g. EINVAL) which indicates that it does not plan to complete the
// event later.
void aioctx_cancel_event(struct aioctx *ctx, unsigned int index);

void aioctx_lock(struct aioctx* ctx);
void aioctx_unlock(struct aioctx* ctx);

Expand All @@ -183,13 +190,15 @@ void aioctx_unlock(struct aioctx* ctx);
//
// This function returns _EINVAL if the given index is not a valid event, not a
// pending event, or if the context has been released by it's supporting task.
// In the event that this function returns an error, the
// In the event that this function returns an error, the event should be
// considered cancelled. Any resources related to the event should be disposed
// of.
//
// This function is not synchronized and returns pointers to the context's
// internal structures. As such, you must retain and lock the table before
// calling this function, and drop all internal pointers before unlocking or
// releasing the context. Do not hold the lock for longer than necessary as you
// may serialize or deadlock other I/O requests.
signed int aioctx_pending_event(struct aioctx *ctx, int index, struct aioctx_event_pending **event);
signed int aioctx_get_pending_event(struct aioctx *ctx, unsigned int index, struct aioctx_event_pending **event);

#endif