Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Async I/O (syscalls 245 - 249) #1584

Open
wants to merge 34 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
0b2b56a
Individually stub each AIO syscall
kmeisthax Sep 27, 2021
175c52c
Add a structure in the task for AIO contexts to live in.
kmeisthax Sep 27, 2021
9c4a3f8
Implement `io_setup`
kmeisthax Sep 28, 2021
241fe79
Implement `io_destroy`.
kmeisthax Sep 30, 2021
5f041a3
Store the owning PID of each AIO context, so that resolved requests c…
kmeisthax Oct 1, 2021
9912680
Elaborate on the event structure to be able to hold pending requests,…
kmeisthax Oct 1, 2021
cce2d45
Add method for submitting a pending event.
kmeisthax Oct 1, 2021
314f335
Add functions for retrieving pending events from a context.
kmeisthax Oct 3, 2021
5390cf5
Add AIO syscalls to systrace
kmeisthax Oct 3, 2021
0cf305b
Add aioctx table method for retrieving (and retaining) a context by i…
kmeisthax Oct 3, 2021
032d31d
Half-implement io_submit.
kmeisthax Oct 3, 2021
ecfeae1
Add `aioctx_cancel_event` & other documentation fixes
kmeisthax Oct 3, 2021
da5a606
Add io_submit op so that FDs can handle asynchronous operations.
kmeisthax Oct 3, 2021
a4560f5
Add method to complete pending events.
kmeisthax Oct 4, 2021
9510f30
Add fallback for filesystems that don't yet implement true async I/O.
kmeisthax Oct 4, 2021
1dd76fe
Submitted events must retain the guest address of the IOCB structure …
kmeisthax Oct 4, 2021
8638202
Implement completion polling (io_getevents)
kmeisthax Oct 4, 2021
1c9f39a
Everything except io_setup takes a context ID directly, not a pointer…
kmeisthax Oct 4, 2021
d678aad
Properly initialize the lock and refcount in AIO contexts.
kmeisthax Oct 10, 2021
940d53d
Fix a bunch of bounds checks
kmeisthax Oct 10, 2021
21bd634
Always NULL out contexts in the task context table when removing them…
kmeisthax Oct 10, 2021
b504474
Add E2E test for AIO read and write.
kmeisthax Oct 10, 2021
867e899
Don't specify an enum impl type because gcc doesn't support that C gi…
kmeisthax Oct 11, 2021
09b2e07
In fallback code, treat FDSYNC as a full FSYNC.
kmeisthax Oct 24, 2021
fc90511
Pull the pread/pwrite emulation code out into separate functions.
kmeisthax Oct 25, 2021
8ffda31
Add E2E test for vectored async IO
kmeisthax Oct 25, 2021
f270bc1
Implement vectored async IO fallback
kmeisthax Oct 25, 2021
9769c6e
Fix incorrect/spurious failure on seeking to non-zero offsets
kmeisthax Oct 25, 2021
0a8c063
Remove implicit coercions in tests so that they don't sign-extend thi…
kmeisthax Oct 31, 2021
e8d3c9f
Add a condition variable for waiting on events, and wait for it to be…
kmeisthax Nov 21, 2021
6ea8dce
Formatting & consistency nits
kmeisthax Nov 21, 2021
1174ec7
Rip out and replace the `AIO_IOCB_` family of constants with a host s…
kmeisthax Nov 21, 2021
399265e
Also rip out the `AIO_IO_EVENT` constants for another host-compiled s…
kmeisthax Nov 21, 2021
6c09ad5
Remove e2e tests dependency on `linux/aio_abi.h` header
kmeisthax Nov 21, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
Prev Previous commit
Next Next commit
Rip out and replace the AIO_IOCB_ family of constants with a host s…
…tructure and static asserts
  • Loading branch information
kmeisthax committed Nov 21, 2021
commit 1174ec79ad482e255b47bf4d505c896e13297f44
58 changes: 35 additions & 23 deletions kernel/aio.c
Original file line number Diff line number Diff line change
Expand Up @@ -9,18 +9,33 @@

// Guest memory offsets for the IOCB structure.
// Calculated by a test program compiled and ran in iSH itself.
const size_t AIO_IOCB_DATA = 0;
const size_t AIO_IOCB_KEY = 8;
const size_t AIO_IOCB_RW_FLAGS = 12;
const size_t AIO_IOCB_LIO_OPCODE = 16;
const size_t AIO_IOCB_REQPRIO = 18;
const size_t AIO_IOCB_FILDES = 20;
const size_t AIO_IOCB_BUF = 24;
const size_t AIO_IOCB_NBYTES = 32;
const size_t AIO_IOCB_OFFSET = 40;
const size_t AIO_IOCB_RESERVED2 = 48;
const size_t AIO_IOCB_FLAGS = 56;
const size_t AIO_IOCB_RESFD = 60;
struct _guest_iocb {
uint64_t data;
uint32_t key;
uint32_t rw_flags;
uint16_t lio_opcode;
int16_t reqprio;
uint32_t fildes;
uint64_t buf;
uint64_t nbytes;
int64_t offset;
uint64_t reserved2;
uint32_t flags;
uint32_t resfd;
};

static_assert(offsetof(struct _guest_iocb, data) == 0, "IOCB order");
static_assert(offsetof(struct _guest_iocb, key) == 8, "IOCB order");
static_assert(offsetof(struct _guest_iocb, rw_flags) == 12, "IOCB order");
static_assert(offsetof(struct _guest_iocb, lio_opcode) == 16, "IOCB order");
static_assert(offsetof(struct _guest_iocb, reqprio) == 18, "IOCB order");
static_assert(offsetof(struct _guest_iocb, fildes) == 20, "IOCB order");
static_assert(offsetof(struct _guest_iocb, buf) == 24, "IOCB order");
static_assert(offsetof(struct _guest_iocb, nbytes) == 32, "IOCB order");
static_assert(offsetof(struct _guest_iocb, offset) == 40, "IOCB order");
static_assert(offsetof(struct _guest_iocb, reserved2) == 48, "IOCB order");
static_assert(offsetof(struct _guest_iocb, flags) == 56, "IOCB order");
static_assert(offsetof(struct _guest_iocb, resfd) == 60, "IOCB order");

// Guest memory offsets for the IO_EVENT structure.
// Also confirmed by test program.
Expand Down Expand Up @@ -124,19 +139,16 @@ dword_t sys_io_submit(dword_t ctx_id, dword_t u_nr, addr_t iocbpp) {
addr_t iocbp = 0;
if (user_get(iocbpp + i * sizeof(addr_t), iocbp)) goto fault;

uint64_t user_data = 0;
if (user_get(iocbp + AIO_IOCB_DATA, user_data)) goto fault;
struct _guest_iocb giocb = {0};
if (user_get(iocbp, giocb)) goto fault;

struct aioctx_event_pending host_iocb;
uint16_t op = 0;

if (user_get(iocbp + AIO_IOCB_LIO_OPCODE, op)) goto fault;
host_iocb.op = (enum aioctx_op)op;

if (user_get(iocbp + AIO_IOCB_FILDES, host_iocb.fd)) goto fault;
if (user_get(iocbp + AIO_IOCB_BUF, host_iocb.buf)) goto fault;
if (user_get(iocbp + AIO_IOCB_NBYTES, host_iocb.nbytes)) goto fault;
if (user_get(iocbp + AIO_IOCB_OFFSET, host_iocb.offset)) goto fault;
host_iocb.op = (enum aioctx_op)giocb.lio_opcode;
host_iocb.fd = giocb.fildes;
host_iocb.buf = giocb.buf;
host_iocb.nbytes = giocb.nbytes;
host_iocb.offset = giocb.offset;

lock(&current->files->lock);

Expand All @@ -152,7 +164,7 @@ dword_t sys_io_submit(dword_t ctx_id, dword_t u_nr, addr_t iocbpp) {
break;
}

err = aioctx_submit_pending_event(ctx, user_data, iocbp, host_iocb);
err = aioctx_submit_pending_event(ctx, giocb.data, iocbp, host_iocb);
if (err < 0) {
// TODO: This assumes the usual pattern of "first IOCB errors, all
// others stop processing without erroring"
Expand Down