0% found this document useful (0 votes)

22 views59 pages

C++ Coroutines - Gor Nishanov - CppCon 2015

Uploaded by

alan88w

We take content rights seriously. If you suspect this is your content, claim it here.

Available Formats

Download as PDF, TXT or read online on Scribd

0% found this document useful (0 votes)

22 views59 pages

C++ Coroutines - Gor Nishanov - CppCon 2015

Uploaded by

alan88w

We take content rights seriously. If you suspect this is your content, claim it here.

Available Formats

Download as PDF, TXT or read online on Scribd

You are on page 1/ 59

C++ Coroutines

a negative overhead abstraction

Gor Nishanov • [email protected]
CppCon 2015 C++ Coroutines 9/25/2015 2
000100 IDENTIFICATION DIVISION.
000200 PROGRAM-ID. HELLOWORLD.
000300*
000400 ENVIRONMENT DIVISION.
000500 CONFIGURATION SECTION.
000600 SOURCE-COMPUTER. RM-COBOL.
000700 OBJECT-COMPUTER. RM-COBOL.
000800
001000 DATA DIVISION.
001100 FILE SECTION.
001200
100000 PROCEDURE DIVISION.
100100
100200 MAIN-LOGIC SECTION.
100300 BEGIN.
100400 DISPLAY " " LINE 1 POSITION 1 ERASE EOS.
100500 DISPLAY "Hello world!" LINE 15 POSITION 10.
100600 STOP RUN.
100700 MAIN-LOGIC-EXIT.
100800 EXIT.

CppCon 2015 C++ Coroutines 9/25/2015 3

CppCon 2015 C++ Coroutines 9/25/2015 4
CppCon 2015 C++ Coroutines 9/25/2015 5
CppCon 2015 C++ Coroutines 9/25/2015 6
CppCon 2015 C++ Coroutines 9/25/2015 7


Melvin Conway

Joel Erdwinn

CppCon 2015 C++ Coroutines

image credits: wikipedia commons, Communication of the ACM vol.6 No.7 July 1963

9/26/2015 8


Melvin Conway

Joel Erdwinn

CppCon 2015 C++ Coroutines

image credits: wikipedia commons, Communication of the ACM vol.6 No.7 July 1963

9/25/2015 9
Subroutine Coroutine

1 S A 1 S A
Basic Symbol Basic Symbol Basic Name
Reducer 2 C Y 2 C Y Reducer Reducer

S A Write to
3 S Y A A
Tape

S Y
output token
S A
S A read token

S A
C Y S Y read token

S A
Subroutine
C Y
Subroutine CY C
Coroutine Subroutine
Subroutine
CppCon 2015 C++ Coroutines 9/25/2015 10
100 cards per minute!

CppCon 2015 C++ Coroutines 9/25/2015 11

9/25/2015 CppCon 2015 C++ Coroutines 12
Async state machine

Connecting Reading

Failed Completed

9/25/2015 CppCon 2015 C++ Coroutines 13

Trivial if synchronous
int tcp_reader(int total)
{
char buf[4 * 1024];
auto conn = Tcp::Connect("127.0.0.1", 1337);
for (;;)
{
auto bytesRead = conn.Read(buf, sizeof(buf));
total -= bytesRead;
if (total <= 0 || bytesRead == 0) return total;
}
}

9/25/2015 CppCon 2015 C++ Coroutines 14

std::future<T> and std::promise<T>
shared_state<T>

atomic<long> refCnt;
mutex lock;
variant<empty, T, exception_ptr> value;
conditional_variable ready;

promise<T>
future<T> intrusive_ptr<shared_state<T>>
intrusive_ptr<shared_state<T>>
set_value(T)
wait() set_exception(exception_ptr)
T get()

9/25/2015 CppCon 2015 C++ Coroutines 15

future<int> tcp_reader(int64_t total) { N4399 Working Draft,
struct State { Technical Specification for C++
Extensions for Concurrency
char buf[4 * 1024];
int64_t total;
Tcp::Connection conn;

.then
explicit State(int64_t total) : total(total) {}
};
auto state = make_shared<State>(total);
return Tcp::Connect("127.0.0.1", 1337).then(
[state](future<Tcp::Connection> conn) {
state->conn = std::move(conn.get());
return do_while([state]()->future<bool> {
if (state->total <= 0) return make_ready_future(false);
return state->conn.read(state->buf, sizeof(state->buf)).then(
[state](future<int> nBytesFut) {
auto nBytes = nBytesFut.get()
if (nBytes == 0) return make_ready_future(false);
state->total -= nBytes;
return make_ready_future(true);
});
}); future<void> do_while(function<future<bool>()> body) {
}); return body().then([=](future<bool> notDone) {
} return notDone.get() ? do_while(body) : make_ready_future(); });
9/25/2015 } CppCon 2015 C++ Coroutines 16
Forgot something
int tcp_reader(int total)
{
char buf[4 * 1024];
auto conn = Tcp::Connect("127.0.0.1", 1337);
for (;;)
{
auto bytesRead = conn.Read(buf, sizeof(buf));
total -= bytesRead;
if (total <= 0 || bytesRead == 0) return total;
}
}

9/25/2015 CppCon 2015 C++ Coroutines 17

future<int> tcp_reader(int64_t total) {
struct State {
char buf[4 * 1024];
int64_t total;
Tcp::Connection conn;
explicit State(int64_t total) : total(total) {}
};
auto state = make_shared<State>(total);
return Tcp::Connect("127.0.0.1", 1337).then(
[state](future<Tcp::Connection> conn) {
state->conn = std::move(conn.get());
return do_while([state]()->future<bool> {
.then
if (state->total <= 0) return make_ready_future(false);
return state->conn.read(state->buf, sizeof(state->buf)).then(
[state](future<int> nBytesFut) {
auto nBytes = nBytesFut.get()
if (nBytes == 0) return make_ready_future(false);
state->total -= nBytes;
return make_ready_future(true);
}); // read
}); // do_while
}); // Tcp::Connect
}
9/25/2015 CppCon 2015 C++ Coroutines 18
future<int> tcp_reader(int64_t total) {
struct State {
char buf[4 * 1024];
int64_t total;
Tcp::Connection conn;
explicit State(int64_t total) : total(total) {}
};
auto state = make_shared<State>(total);
return Tcp::Connect("127.0.0.1", 1337).then(
[state](future<Tcp::Connection> conn) {
state->conn = std::move(conn.get());
return do_while([state]()->future<bool> {
.then
if (state->total <= 0) return make_ready_future(false);
return state->conn.read(state->buf, sizeof(state->buf)).then(
[state](future<int> nBytesFut) {
auto nBytes = nBytesFut.get()
if (nBytes == 0) return make_ready_future(false);
state->total -= nBytes;
return make_ready_future(true);
}); // read
}); // do_while
}).then([state](future<void>){return make_ready_future(state->total)});
}
9/25/2015 CppCon 2015 C++ Coroutines 19
Hand-crafted async state machine (1/3)
class tcp_reader ③
① ②
{ Connecting Reading
char buf[64 * 1024];
Tcp::Connection conn; ④ ⑤
promise<int> done;
Failed Completed
int total;

explicit tcp_reader(int total): total(total) {}

② void OnConnect(error_code ec, Tcp::Connection newCon);

③ void OnRead(error_code ec, int bytesRead);
④ void OnError(error_code ec);
⑤ void OnComplete();

public:
① static future<int> start(int total);
};
int main() {
cout << tcp_reader::start(1000 * 1000 * 1000).get(); }
9/25/2015 CppCon 2015 C++ Coroutines 20
Hand-crafted async state machine (2/3)
future<int> tcp_reader::start(int total) {
auto p = make_unique<tcp_reader>(total);
auto result = p->done.get_future();
Tcp::Connect("127.0.0.1", 1337,
[raw = p.get()](auto ec, auto newConn) {
raw->OnConnect(ec, std::move(newConn));
});
p.release();
return result;
}

void tcp_reader::OnConnect(error_code ec,

Tcp::Connection newCon)
{
if (ec) return OnError(ec);
conn = std::move(newCon);
conn.Read(buf, sizeof(buf),
[this](error_code ec, int bytesRead)
{ OnRead(ec, bytesRead); });
}
9/25/2015 CppCon 2015 C++ Coroutines 21
Hand-crafted async state machine (3/3)
void tcp_reader::OnRead(error_code ec, int bytesRead) {
if (ec) return OnError(ec);
total -= bytesRead;
if (total <= 0 || bytesRead == 0) return OnComplete();
conn.Read(buf, sizeof(buf),
[this](error_code ec, int bytesRead) {
OnRead(ec, bytesRead); });
}

void OnError(error_code ec) {

auto cleanMe = unique_ptr<tcp_reader>(this);
done.set_exception(make_exception_ptr(system_error(ec)));
}

void OnComplete() {
auto cleanMe = unique_ptr<tcp_reader>(this);
done.set_value(total);
}

9/25/2015 CppCon 2015 C++ Coroutines 22

Async state machine

Connecting Reading

Failed Completed

9/25/2015 CppCon 2015 C++ Coroutines 23

Trivial
auto tcp_reader(int total) -> int
{
char buf[4 * 1024];
auto conn = Tcp::Connect("127.0.0.1", 1337);
for (;;)
{
auto bytesRead = conn.Read(buf, sizeof(buf));
total -= bytesRead;
if (total <= 0 || bytesRead == 0) return total;
}
}

9/25/2015 CppCon 2015 C++ Coroutines 24

Trivial
auto tcp_reader(int total) -> future<int>
{
char buf[4 * 1024];
auto conn = await Tcp::Connect("127.0.0.1", 1337);
for (;;)
{
auto bytesRead = await conn.Read(buf, sizeof(buf));
total -= bytesRead;
if (total <= 0 || bytesRead == 0) return total;
}
}

9/25/2015 CppCon 2015 C++ Coroutines 25

What about perf?
int main() {
printf("Hello, world\n");
}

Coroutines Hand-Crafted Hello

MB/s 495 (1.3x) 380 0

Binary size 25 (0.85x) 30 9

(Kbytes)

Visual C++ 2015 RTM. Measured on Lenovo W540 laptop. Transmitting & Receiving 1GB over loopback IP addr
9/25/2015 CppCon 2015 C++ Coroutines 26
Coroutines are closer to the metal

Handcrafted
State
Machines

Coroutines
I/O Abstractions
(Callback based) I/O Abstraction
(Awaitable based)

OS / Low Level Libraries

Hardware

9/25/2015 CppCon 2015 C++ Coroutines 28

How to map high level call to OS API?
conn.Read(buf, sizeof(buf),
[this](error_code ec, int bytesRead)
{ OnRead(ec, bytesRead); });

template <class Cb>

void Read(void* buf, size_t bytes, Cb && cb);

Windows: WSARecv(fd, ..., OVERLAPPED) Posix aio: aio_read(fd, ..., aiocbp)

OVERLAPPED aiocbp

Function Function
Object Object

9/25/2015 CppCon 2015 C++ Coroutines 29

struct OverlappedBase : os_async_context { os_async_ctx
virtual void Invoke(std::error_code, int bytes) = 0; OVERLAPPED /aiocbp
virtual ~OverlappedBase() {} Function
Object
static void io_complete_callback(CompletionPacket& p) {
auto me = unique_ptr<OverlappedBase>(static_cast<OverlappedBase*>(p.overlapped));
me->Invoke(p.error, p.byteTransferred);
}
};
After open associate a socket handle with a threadpool and a callback
ThreadPool::AssociateHandle(sock.native_handle(), &OverlappedBase::io_complete_callback);

template <typename Fn> struct CompletionWithCount : OverlappedBase, private Fn

{
CompletionWithCount(Fn fn) : Fn(std::move(fn)) {}

void Invoke(std::error_code ec, int count) override { Fn::operator()(ec, count); }

};
template <typename Fn> unique_ptr<OverlappedBase> make_handler_with_count(Fn && fn) {
return std::make_unique<CompletionWithCount<std::decay_t<Fn>>(std::forward<Fn>(fn));
}
9/25/2015 CppCon 2015 C++ Coroutines 30
conn.Read(buf, sizeof(buf),
[this](error_code ec, int bytesRead)
{ OnRead(ec, bytesRead); });

template <typename F>

void Read(void* buf, int len, F && cb) {
return Read(buf, len, make_handler_with_count(std::forward<F>(cb)));
}

void Read(void* buf, int len, std::unique_ptr<detail::OverlappedBase> o)

{
auto error = sock.Receive(buf, len, o.get());
if (error) {
if (error.value() != kIoPending) {
o->Invoke(error, 0);
return;
}
}
o.release();
}

9/25/2015 CppCon 2015 C++ Coroutines 31

await conn.Read(buf, sizeof(buf));

?
9/25/2015 CppCon 2015 C++ Coroutines 32
Awaitable – Concept of the Future<T>

Present
T
.await_ready()
F<T> → bool

Present
T
.await_suspend(cb)
F<T> x Fn → void

Present

.await_resume()
T F<T> → T

await expr-of-awaitable-type

9/25/2015 CppCon 2015 C++ Coroutines 33

await <expr>
Expands into an expression equivalent of

{
auto && tmp = <expr>;
if (!await_ready(tmp)) {
await_suspend(tmp, <coroutine-handle>);
suspend
resume
}
return await_resume(tmp);
}

9/25/2015 CppCon 2015 C++ Coroutines 34

Overlapped Base from before
struct OverlappedBase : os_async_context
{
virtual void Invoke(std::error_code, int bytes) = 0;
virtual ~OverlappedBase() {}

static void io_complete_callback(CompletionPacket& p) {

auto me = static_cast<OverlappedBase*>(p.overlapped);
auto cleanMe = unique_ptr<OverlappedBase>(me);

me->Invoke(p.error, p.byteTransferred);
}
};

9/25/2015 CppCon 2015 C++ Coroutines 35

Overlapped Base for awaitable
struct AwaiterBase : os_async_context
{
coroutine_handle<> resume; sizeof(void*)
std::error_code err; no dtor
int bytes;

static void io_complete_callback(CompletionPacket& p) {

auto me = static_cast<AwaiterBase*>(p.overlapped);
me->err = p.error;
me->bytes = p.byteTransferred;
me->resume(); mov rcx, [rcx]
} jmp [rcx]
};

9/25/2015 CppCon 2015 C++ Coroutines 36

await conn.Read(buf, sizeof(buf));

?
9/25/2015 CppCon 2015 C++ Coroutines 37
auto Connection::Read(void* buf, int len) {
struct awaiter: AwaiterBase {
Connection* me;
void* buf;
awaiter(Connection* me, void* buf, int len) : me(me), buf(buf) { bytes = len; }

bool await_ready() { return false; }

void await_suspend(coroutine_handle<> h) {
this->resume = h;
auto error = me->sock.Receive(buf, bytes, this);
if (error.value() != kIoPending)
throw system_error(err);
struct AwaiterBase : os_async_context {
} coroutine_handle<> resume;
std::error_code err;
int bytes;
int await_resume() {
if (this->err) throw system_error(err); static void io_complete_callback(CompletionPacket& p){
auto me = static_cast<AwaiterBase*>(p.overlapped);
return bytes; me->err = p.error;
} me->bytes = p.byteTransferred;
me->resume();
}; }
return awaiter{ this, buf, len }; };

}
9/25/2015 CppCon 2015 C++ Coroutines 38
Trivial
auto tcp_reader(int total) -> future<int>
{
char buf[4 * 1024];
auto conn = await Tcp::Connect("127.0.0.1", 1337);
for (;;)
{
auto bytesRead = await conn.Read(buf, sizeof(buf));
total -= bytesRead;
if (total <= 0 || bytesRead == 0) return total;
}
}

9/25/2015 CppCon 2015 C++ Coroutines 39

Can we make it better?

50% I/O completes synchronously

50% I/O with I/O pending error

SetFileCompletionNotificationModes(h,
FILE_SKIP_COMPLETION_PORT_ON_SUCCESS);

9/25/2015 CppCon 2015 C++ Coroutines 40

SetFileCompletionNotificationModes(h,
FILE_SKIP_COMPLETION_PORT_ON_SUCCESS);

Take advantage of synchronous completions

void Read(void* buf, int len, std::unique_ptr<detail::OverlappedBase> o)

{
auto error = sock.Receive(buf, len, o.get());
if (error) {
if (error.value() != kIoPending) {
o->Invoke(error, 0);
return;
}
}
o.release();
}

9/25/2015 CppCon 2015 C++ Coroutines 41

SetFileCompletionNotificationModes(h,
FILE_SKIP_COMPLETION_PORT_ON_SUCCESS);

Take advantage of synchronous completions

void Read(void* buf, int len, std::unique_ptr<detail::OverlappedBase> o)

{
auto error = sock.Receive(buf, len, o.get());

if (error.value() != kIoPending) {
o->Invoke(error, len);
return;
}

o.release();
}

9/25/2015 CppCon 2015 C++ Coroutines 42

SetFileCompletionNotificationModes(h,
FILE_SKIP_COMPLETION_PORT_ON_SUCCESS);

Take advantage of synchronous completions

SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1> >::Invoke(std::error_code ec, int count) Line 31
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1> >::Invoke(std::error_code ec, int count) Line 31
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1> >::Invoke(std::error_code ec, int count) Line 31
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
void Read(void* buf, int len, std::unique_ptr<detail::OverlappedBase>
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1> o)Line
>::Invoke(std::error_code ec, int count) 31
{
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1>
>::Invoke(std::error_code ec, int count) Line 31
auto error = sock.Receive(buf, len, o.get()); >::Invoke(std::error_code ec, int count) Line
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1> 31
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1> >::Invoke(std::error_code ec, int count) Line 31
if (error.value() != kIoPending) {
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1> >::Invoke(std::error_code ec, int count) Line 31
o->Invoke(error, len);
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
return;
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1>
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
>::Invoke(std::error_code ec, int count) Line 31

}
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1>
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
>::Invoke(std::error_code ec, int count) Line 31

SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1>
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
o.release();
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1>
Stack
>::Invoke(std::error_code ec, int count) Line 31

>::Invoke(std::error_code ec, int count) Line 31

SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
}
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1>
SuperLean.exe!improved::tcp_reader::OnRead(std::error_code ec, int bytesRead) Line 254
SuperLean.exe!improved::detail::CompletionWithSizeT<<lambda_ee38b7a750c7f550b4ee1dd60c2450c1>
Overflow
>::Invoke(std::error_code ec, int count) Line 31

>::Invoke(std::error_code ec, int count) Line 31

void tcp_reader::OnRead(std::error_code ec, int bytesRead) {

if (ec) return OnError(ec);

total -= (int)bytesRead;
if (total <= 0 || bytesRead == 0) return OnComplete();
bytesRead = sizeof(buf);

conn.Read(buf, bytesRead,
[this](std::error_code ec, int bytesRead) {
OnRead(ec, bytesRead); }) ;
}

9/25/2015 CppCon 2015 C++ Coroutines 44

Now handling synchronous completion

void tcp_reader::OnRead(std::error_code ec, int bytesRead) {

do {
if (ec) return OnError(ec);
total -= (int)bytesRead;
if (total <= 0 || bytesRead == 0) return OnComplete();
bytesRead = sizeof(buf);
} while (
conn.Read(buf, bytesRead,
[this](std::error_code ec, int bytesRead) {
OnRead(ec, bytesRead); }));
}

9/25/2015 CppCon 2015 C++ Coroutines 45

Let’s measure the improvement (handwritten)

MB/s Executable size

Handcrafted Coroutine Handcrafted Coroutine

Original 380 495 30 25

Synchr Completion. Opt 485 30

9/25/2015 CppCon 2015 C++ Coroutines 46

SetFileCompletionNotificationModes(h,
auto Connection::Read(void* buf, int len) { FILE_SKIP_COMPLETION_PORT_ON_SUCCESS);
struct awaiter: AwaiterBase {
Connection* me;
void* buf;
awaiter(Connection* me, void* buf, int len) : me(me), buf(buf) { bytes = len; }

bool await_ready() { return false; }

void await_suspend(coroutine_handle<> h) {
this->resume = h;
auto error = me->sock.Receive(buf, bytes, this);
if (error.value() == kIoPending) return;
if (error) throw system_error(err);
struct AwaiterBase : os_async_context {
return; coroutine_handle<> resume;
} std::error_code err;
int bytes;

int await_resume() { static void io_complete_callback(CompletionPacket& p){

auto me = static_cast<AwaiterBase*>(p.overlapped);
if (this->err) throw system_error(err); me->err = p.error;
return bytes; me->bytes = p.byteTransferred;
me->resume();
} }
}; };

return awaiter{ this, buf, len };

} 9/25/2015 CppCon 2015 C++ Coroutines 48
auto Connection::Read(void* buf, int len) {
struct awaiter: AwaiterBase {
Connection* me;
void* buf;
awaiter(Connection* me, void* buf, int len) : me(me), buf(buf) { bytes = len; }

bool await_ready() { return false; }

bool await_suspend(coroutine_handle<> h) {
this->resume = h;
auto error = me->sock.Receive(buf, bytes, this);
if (error.value() == kIoPending) return true;
if (error) throw system_error(err);
struct AwaiterBase : os_async_context {
return false; coroutine_handle<> resume;
} std::error_code err;
int bytes;

int await_resume() { static void io_complete_callback(CompletionPacket& p){

auto me = static_cast<AwaiterBase*>(p.overlapped);
if (this->err) throw system_error(err); me->err = p.error;
return bytes; me->bytes = p.byteTransferred;
me->resume();
} }
}; };

return awaiter{ this, buf, len };

} 9/25/2015 CppCon 2015 C++ Coroutines 49
await <expr>
Expands into an expression equivalent of

{
auto && tmp = <expr>;
if (!await_ready(tmp)) {
await_suspend(tmp, <coroutine-handle>);
suspend
resume
}
return await_resume(tmp);
}

9/25/2015 CppCon 2015 C++ Coroutines 50

await <expr>
Expands into an expression equivalent of

{
auto && tmp = <expr>;
if (!await_ready(tmp) &&
await_suspend(tmp, <coroutine-handle>) {
suspend
resume
}
return await_resume(tmp);
}

9/25/2015 CppCon 2015 C++ Coroutines 51

Let’s measure the improvement (coroutine)

MB/s Executable size

Handcrafted Coroutine Handcrafted Coroutine

Original 380 495 30 25

Synchr Completion. Opt 485 1028 30 25

9/25/2015 CppCon 2015 C++ Coroutines 52

Can we make it better?

9/25/2015 CppCon 2015 C++ Coroutines 54

Getting rid of the allocations
class tcp_reader {
std::unique_ptr<detail::OverlappedBase> wo;
…

tcp_reader(int64_t total) : total(total) {

wo = detail::make_handler_with_count(
[this](auto ec, int nBytes) {OnRead(ec, nBytes); });
…
}

void OnRead(std::error_code ec, int bytesRead) {

if (ec) return OnError(ec);
do {
total -= (int)bytesRead;
if (total <= 0 || bytesRead == 0) return OnComplete();
bytesRead = sizeof(buf);
} while (conn.Read(buf, bytesRead, wo.get()));
}

9/25/2015 CppCon 2015 C++ Coroutines 55

Let’s measure the improvement (handcrafted)

MB/s Executable size

Handcrafted Coroutine Handcrafted Coroutine

Original 380 495 30 25

Synchr Completion. Opt 485 1028 30 25
Prealloc handler 690 1028 28 25

9/25/2015 CppCon 2015 C++ Coroutines 56

Coroutines are popular!
Python: PEP 0492
DART 1.9
Future<int> getPage(t) async { async def abinary(n):
var c = new http.Client(); if n <= 0:
try { return 1
var r = await c.get('http://url/search?q=$t'); l = await abinary(n - 1)
print(r); r = await abinary(n - 1)
return r.length();C#
return l + 1 + r
} finally { async Task<string> WaitAsynchronouslyAsync()
await c.close(); {
} await Task.Delay(10000); HACK (programming language)
} return "Finished";
}
async function gen1(): Awaitable<int> {
C++17
$x = await Batcher::fetch(1);
future<string> WaitAsynchronouslyAsync()
{ $y = await Batcher::fetch(2);
await sleep_for(10ms); return $x + $y;
return "Finished“s; }
}
9/25/2015 CppCon 2015 C++ Coroutines 58
Generalized Function POF
Coroutine
Designer Monadic*
await - suspend

User Task
await

Generator
yield

Async
Compiler Generator
image credits: Три богатыря и змей горыныч does not care await + yield

9/25/2015 CppCon 2015 C++ Coroutines 59

Design Principles
• Scalable (to billions of concurrent coroutines)
• Efficient (resume and suspend operations comparable in cost
to a function call overhead)
• Seamless interaction with existing facilities with no overhead
• Open ended coroutine machinery allowing library designers to
develop coroutine libraries exposing various high-level
semantics, such as generators, goroutines, tasks and more.
• Usable in environments where exceptions are forbidden or not
available

9/25/2015 CppCon 2015 C++ Coroutines 60

Coroutines – a negative overhead abstraction
• Proposal is working through C++ standardization committee
(C++17?)
• Experimental implementation in VS 2015 RTM
• Clang implementation is in progress
• more details:
• CppCon 2014 presentation on coroutines
http://github.com/cppcon
• http://www.open-
std.org/JTC1/SC22/WG21/docs/papers/2015/n4499.pdf
• Pre-Kona mailing (P0054, P0055, P0056)
9/25/2015 CppCon 2015 C++ Coroutines 61
Thank you!

Kavya Kotacherry, Daveed Vandevoorde, Richard Smith, Jens Maurer,

Lewis Baker, Kirk Shoop, Hartmut Kaiser, Kenny Kerr, Artur Laksberg, Jim
Radigan, Chandler Carruth, Gabriel Dos Reis, Deon Brewis, Jonathan
Caves, James McNellis, Stephan T. Lavavej, Herb Sutter, Pablo Halpern,
Robert Schumacher, Viktor Tong, Geoffrey Romer, Michael Wong, Niklas
Gustafsson, Nick Maliwacki, Vladimir Petter, Shahms King, Slava
Kuznetsov, Tongari J, Lawrence Crowl, Valentin Isac
and many more who contributed

9/26/2015 CppCon 2015 C++ Coroutines 62

Questions?

9/25/2015 CppCon 2015 C++ Coroutines 63

Service Manual Skanmobile
100% (11)
Service Manual Skanmobile
136 pages
Douglas E Comer David L Stevens Internetworking With Tcpip Vol 3 Client Server Programming and Applications For The Windows TM Socke PDF
No ratings yet
Douglas E Comer David L Stevens Internetworking With Tcpip Vol 3 Client Server Programming and Applications For The Windows TM Socke PDF
528 pages
Operator's Manual B-85344en 03
No ratings yet
Operator's Manual B-85344en 03
358 pages
Digital Transformation With Business Process Management (PDFDrive)
No ratings yet
Digital Transformation With Business Process Management (PDFDrive)
191 pages
Maintain Inventory of Equipment, Software and Documentation
83% (6)
Maintain Inventory of Equipment, Software and Documentation
35 pages
Book Shop Management System
64% (11)
Book Shop Management System
42 pages
Management Advisory Services by Roque Solution Manual PDF
24% (29)
Management Advisory Services by Roque Solution Manual PDF
3 pages
Using C++ To Connect To Web Services - Steve Gates - CppCon 2014
No ratings yet
Using C++ To Connect To Web Services - Steve Gates - CppCon 2014
40 pages
Safety Precautions of Electronics Laboratory
No ratings yet
Safety Precautions of Electronics Laboratory
3 pages
Savariammal
No ratings yet
Savariammal
58 pages
The Digital Utility PDF
100% (1)
The Digital Utility PDF
76 pages
Coroutines in CPP
No ratings yet
Coroutines in CPP
206 pages
An Introduction To CPP Coroutines Through A Thread Scheduling Demonstration
No ratings yet
An Introduction To CPP Coroutines Through A Thread Scheduling Demonstration
108 pages
C++ Metaprogramming - Fedor Pikus - CppCon 2015
100% (1)
C++ Metaprogramming - Fedor Pikus - CppCon 2015
76 pages
Practical-9: Wireshark Packet Capture and Measurement of Various Types of Delay in TCP
No ratings yet
Practical-9: Wireshark Packet Capture and Measurement of Various Types of Delay in TCP
22 pages
In-Depth Network Programming in C++
No ratings yet
In-Depth Network Programming in C++
5 pages
TCP Udp Checksum
100% (1)
TCP Udp Checksum
7 pages
Algorithmic Differentiation - C++ and Extremum Estimation - Matt P. Dziubinski - CppCon 2015
No ratings yet
Algorithmic Differentiation - C++ and Extremum Estimation - Matt P. Dziubinski - CppCon 2015
283 pages
Elements of Transport Protocols
No ratings yet
Elements of Transport Protocols
29 pages
Await 2.0 - Stackless Resumable Functions - Gor Nishanov - CppCon 2014
No ratings yet
Await 2.0 - Stackless Resumable Functions - Gor Nishanov - CppCon 2014
58 pages
Content Writing Guidelines
No ratings yet
Content Writing Guidelines
12 pages
Functional Programming - Functors and Monads - Michał Dominiak - CppCon 2015
100% (1)
Functional Programming - Functors and Monads - Michał Dominiak - CppCon 2015
19 pages
Check 2
100% (1)
Check 2
8 pages
HEIGHT.en (hd lắp đặt 7
No ratings yet
HEIGHT.en (hd lắp đặt 7
17 pages
III B.tech Mechanical Course Structure and Syllabus
No ratings yet
III B.tech Mechanical Course Structure and Syllabus
51 pages
Error Control: An Engineering Approach To Computer Networking
No ratings yet
Error Control: An Engineering Approach To Computer Networking
32 pages
RCPP - Seamless R and C++ Integration - Matt P. Dziubinski - CppCon 2015
No ratings yet
RCPP - Seamless R and C++ Integration - Matt P. Dziubinski - CppCon 2015
137 pages
Viewing The World Through Array-Shaped Glasses - Łukasz Mendakiewicz - CppCon 2014
No ratings yet
Viewing The World Through Array-Shaped Glasses - Łukasz Mendakiewicz - CppCon 2014
131 pages
The Canonical Class - Michael Caisse - CppCon 2014
No ratings yet
The Canonical Class - Michael Caisse - CppCon 2014
138 pages
Compile-Time Tools For Generic Programming in C++ - Abel Sinkovics - CppCon 2015
No ratings yet
Compile-Time Tools For Generic Programming in C++ - Abel Sinkovics - CppCon 2015
241 pages
NP-UNIT1 - Introduction To Transport Layer
No ratings yet
NP-UNIT1 - Introduction To Transport Layer
62 pages
Check 4
100% (1)
Check 4
7 pages
Simple Extensible Pattern Matching With C++14 - John Bandela - CppCon 2015
No ratings yet
Simple Extensible Pattern Matching With C++14 - John Bandela - CppCon 2015
118 pages
Asio 的异步模型
No ratings yet
Asio 的异步模型
21 pages
Being Smart About Pointers - Michael VanLoon - CppCon 2015
No ratings yet
Being Smart About Pointers - Michael VanLoon - CppCon 2015
47 pages
From Functional To Parallel - Stochastic Modelling in C++ - Kevin Carpenter - CppCon 2015
No ratings yet
From Functional To Parallel - Stochastic Modelling in C++ - Kevin Carpenter - CppCon 2015
64 pages
STL Algorithms in Action - Michael VanLoon - CppCon 2015
No ratings yet
STL Algorithms in Action - Michael VanLoon - CppCon 2015
99 pages
C++ On The Web - JF Bastien - CppCon 2015
No ratings yet
C++ On The Web - JF Bastien - CppCon 2015
24 pages
Where Did My Performance Go - Fedor Pikus - CppCon 2014
No ratings yet
Where Did My Performance Go - Fedor Pikus - CppCon 2014
66 pages
Panel Discussion On C++ Technical Specifications
No ratings yet
Panel Discussion On C++ Technical Specifications
25 pages
Benchmarking C++ Code - Bryce Adelstein Lelbach - CppCon 2015
No ratings yet
Benchmarking C++ Code - Bryce Adelstein Lelbach - CppCon 2015
79 pages
C++11, 14, 17 Atomics - The Deep Dive - Michael Wong - CppCon 2015
No ratings yet
C++11, 14, 17 Atomics - The Deep Dive - Michael Wong - CppCon 2015
69 pages
The Birth of Study Group 14 - Nicolas Guillemot, Sean Middleditch, Michael Wong - CppCon 2015
No ratings yet
The Birth of Study Group 14 - Nicolas Guillemot, Sean Middleditch, Michael Wong - CppCon 2015
44 pages
C++ Multi-Dimensional Arrays For Computational Physics and Applied Mathematics - Pramod Gupta - CppCon 2015
No ratings yet
C++ Multi-Dimensional Arrays For Computational Physics and Applied Mathematics - Pramod Gupta - CppCon 2015
43 pages
Afertig 2023 Cppindia Con CPP Coroutines From Scratch
No ratings yet
Afertig 2023 Cppindia Con CPP Coroutines From Scratch
22 pages
Modernizing Legacy C++ Code - Gregory and McNellis - CppCon 2014
No ratings yet
Modernizing Legacy C++ Code - Gregory and McNellis - CppCon 2014
81 pages
Lwip Introduction
No ratings yet
Lwip Introduction
66 pages
Rebuilding Boost Date-Time For C++11 - Jeff Garland - CppCon 2014
No ratings yet
Rebuilding Boost Date-Time For C++11 - Jeff Garland - CppCon 2014
56 pages
IOWA-LX-600: User Manual
No ratings yet
IOWA-LX-600: User Manual
159 pages
Unit-3 2 CN Bda Aiml
No ratings yet
Unit-3 2 CN Bda Aiml
49 pages
Reactive Stream Processing Rx4DDS - Sumant Tambe - CppCon 2015
No ratings yet
Reactive Stream Processing Rx4DDS - Sumant Tambe - CppCon 2015
51 pages
Library Foundations For Asynchronous Operations, Revision 1: Document Number: N3964 Revises: Date: Reply To
No ratings yet
Library Foundations For Asynchronous Operations, Revision 1: Document Number: N3964 Revises: Date: Reply To
32 pages
Afertig 2024 Meeting CPP Online cpp20s Coroutines For Beginners
No ratings yet
Afertig 2024 Meeting CPP Online cpp20s Coroutines For Beginners
22 pages
Types Don't Know # - Howard Hinnant - CppCon 2014
No ratings yet
Types Don't Know # - Howard Hinnant - CppCon 2014
95 pages
STL Features and Implementation Techniques - Stephan T. Lavavej - CppCon 2014
No ratings yet
STL Features and Implementation Techniques - Stephan T. Lavavej - CppCon 2014
47 pages
QT - Modern User Interfaces For C++ - Milian Wolff - CppCon 2015
No ratings yet
QT - Modern User Interfaces For C++ - Milian Wolff - CppCon 2015
43 pages
Contracts For Dependable C++ - Gabriel Dos Reis - CppCon 2015
No ratings yet
Contracts For Dependable C++ - Gabriel Dos Reis - CppCon 2015
35 pages
The Implementation of Value Types - Lawrence Crowl - CppCon 2014
No ratings yet
The Implementation of Value Types - Lawrence Crowl - CppCon 2014
71 pages
Asio Guide
No ratings yet
Asio Guide
9 pages
Easy Compilation From TouchDevelop To ARM Cortex-M0 Using C++11 - Jonathan Protzenko - CppCon 2015
No ratings yet
Easy Compilation From TouchDevelop To ARM Cortex-M0 Using C++11 - Jonathan Protzenko - CppCon 2015
20 pages
Rajat CN - LAB - FILE
No ratings yet
Rajat CN - LAB - FILE
29 pages
Lecture 2
No ratings yet
Lecture 2
53 pages
Functional Design Explained - David Sankel - CppCon 2015
No ratings yet
Functional Design Explained - David Sankel - CppCon 2015
43 pages
Homework 1 Solution and Some Questions: Ying Zhang
No ratings yet
Homework 1 Solution and Some Questions: Ying Zhang
22 pages
TCP - TX Process Model
No ratings yet
TCP - TX Process Model
10 pages
User Datagram Protocol (UDP) - Packet Checksums - Reliability: Sliding Window - TCP Connection Setup - TCP Windows, Retransmissions, and
No ratings yet
User Datagram Protocol (UDP) - Packet Checksums - Reliability: Sliding Window - TCP Connection Setup - TCP Windows, Retransmissions, and
40 pages
Introducing Brigand - Edouard Alligand and Joel Falcou - CppCon 2015
No ratings yet
Introducing Brigand - Edouard Alligand and Joel Falcou - CppCon 2015
9 pages
Implementation of Checksum
No ratings yet
Implementation of Checksum
26 pages
EZ Cam Bubba Cam
No ratings yet
EZ Cam Bubba Cam
29 pages
Unix Unit-V
No ratings yet
Unix Unit-V
52 pages
8.2. 20 Lab4
No ratings yet
8.2. 20 Lab4
15 pages
University of Cape Town Department of Computer Science CSC3002F Class Test 1 March 2018
No ratings yet
University of Cape Town Department of Computer Science CSC3002F Class Test 1 March 2018
55 pages
COMP445 Fall 2006: Lab Assignment 1
No ratings yet
COMP445 Fall 2006: Lab Assignment 1
19 pages
IPv4 and IPv6 Interoperability
No ratings yet
IPv4 and IPv6 Interoperability
19 pages
How To Call C Libraries From C++ - Lisa Lippincott - CppCon 2014
No ratings yet
How To Call C Libraries From C++ - Lisa Lippincott - CppCon 2014
20 pages
DCN Exp (6 9)
No ratings yet
DCN Exp (6 9)
19 pages
HW 1
No ratings yet
HW 1
4 pages
C++ in The Telecom Industry - Yani Miguel - CppCon 2015
No ratings yet
C++ in The Telecom Industry - Yani Miguel - CppCon 2015
13 pages
CNE Project Documentation 2024 6411074882897253
No ratings yet
CNE Project Documentation 2024 6411074882897253
10 pages
8.7. 3 Lab2
No ratings yet
8.7. 3 Lab2
10 pages
Software Test Plan (STP) Template
No ratings yet
Software Test Plan (STP) Template
13 pages
8.6. 2 Lab1
No ratings yet
8.6. 2 Lab1
9 pages
Error Control: An Engineering Approach To Computer Networking
No ratings yet
Error Control: An Engineering Approach To Computer Networking
32 pages
Laboratory Work: Application Layer: Network Programming With Sockets
No ratings yet
Laboratory Work: Application Layer: Network Programming With Sockets
10 pages
Experiment 2
No ratings yet
Experiment 2
8 pages
Project2 Spec CS118 2021Sv3
No ratings yet
Project2 Spec CS118 2021Sv3
9 pages
Practical-9: Wireshark Packet Capture and Measurement of Various Types of Delay in TCP
No ratings yet
Practical-9: Wireshark Packet Capture and Measurement of Various Types of Delay in TCP
27 pages
Fixed CPP Programs
No ratings yet
Fixed CPP Programs
3 pages
Oraw The Schematie Diagram of 3-Way Handshaking For Connection Establishment in
No ratings yet
Oraw The Schematie Diagram of 3-Way Handshaking For Connection Establishment in
16 pages
02 Network Reference Model
No ratings yet
02 Network Reference Model
42 pages
Distinguishing Coroutines and Fibers
No ratings yet
Distinguishing Coroutines and Fibers
3 pages
1.distributed Chat Server Using TCP Sockets in C' Receiver
No ratings yet
1.distributed Chat Server Using TCP Sockets in C' Receiver
26 pages
CN Midanswers
No ratings yet
CN Midanswers
19 pages
HPC Lab Manual
No ratings yet
HPC Lab Manual
47 pages
Tutorwinwsock
No ratings yet
Tutorwinwsock
6 pages
CS0051 - Module 02
No ratings yet
CS0051 - Module 02
22 pages
Issues in Client/Server Programming
No ratings yet
Issues in Client/Server Programming
30 pages
Ahmed Ayman Mechanical Engineer
No ratings yet
Ahmed Ayman Mechanical Engineer
5 pages
Updated Fixed CPP Programs
No ratings yet
Updated Fixed CPP Programs
6 pages
HSN Solution
No ratings yet
HSN Solution
65 pages
Control Lab 2
No ratings yet
Control Lab 2
7 pages
Project Schedule Management
No ratings yet
Project Schedule Management
20 pages
Eaton
No ratings yet
Eaton
2 pages
04421001193-Aditya Bhuvad
No ratings yet
04421001193-Aditya Bhuvad
33 pages
E Learning System Srs Using 2021 Template
No ratings yet
E Learning System Srs Using 2021 Template
41 pages
Check Credit Score List 2025-01-20
No ratings yet
Check Credit Score List 2025-01-20
13 pages
Network
No ratings yet
Network
3 pages
ICT Summative Assessment 1
No ratings yet
ICT Summative Assessment 1
2 pages
Metal Skin Well Management
No ratings yet
Metal Skin Well Management
17 pages
Documentation Sheet Steel Spring Isolator General
No ratings yet
Documentation Sheet Steel Spring Isolator General
2 pages
Animation Courses in Andhra Pradesh
No ratings yet
Animation Courses in Andhra Pradesh
4 pages
Department of Education: Republic of The Philippines
No ratings yet
Department of Education: Republic of The Philippines
5 pages
Domino Utility Vs Enterprise Server + CAL Pricing
No ratings yet
Domino Utility Vs Enterprise Server + CAL Pricing
3 pages
IT9420 Encoder
No ratings yet
IT9420 Encoder
1 page
Sample Answers: Network Programming - Spring 2003 Midterm Exam
No ratings yet
Sample Answers: Network Programming - Spring 2003 Midterm Exam
6 pages
Bharghav Srivatsav Yerravalli-SOP
No ratings yet
Bharghav Srivatsav Yerravalli-SOP
2 pages

C++ Coroutines - Gor Nishanov - CppCon 2015

Uploaded by

C++ Coroutines - Gor Nishanov - CppCon 2015

Uploaded by

C++ Coroutines

a negative overhead abstraction

CppCon 2015 C++ Coroutines 9/25/2015 3

CppCon 2015 C++ Coroutines

CppCon 2015 C++ Coroutines

CppCon 2015 C++ Coroutines 9/25/2015 11

9/25/2015 CppCon 2015 C++ Coroutines 13

9/25/2015 CppCon 2015 C++ Coroutines 14

9/25/2015 CppCon 2015 C++ Coroutines 15

9/25/2015 CppCon 2015 C++ Coroutines 17

explicit tcp_reader(int total): total(total) {}

② void OnConnect(error_code ec, Tcp::Connection newCon);

void tcp_reader::OnConnect(error_code ec,

void OnError(error_code ec) {

9/25/2015 CppCon 2015 C++ Coroutines 22

9/25/2015 CppCon 2015 C++ Coroutines 23

9/25/2015 CppCon 2015 C++ Coroutines 24

9/25/2015 CppCon 2015 C++ Coroutines 25

Coroutines Hand-Crafted Hello

MB/s 495 (1.3x) 380 0

Binary size 25 (0.85x) 30 9

OS / Low Level Libraries

9/25/2015 CppCon 2015 C++ Coroutines 28

template <class Cb>

Windows: WSARecv(fd, ..., OVERLAPPED*) Posix aio: aio_read(fd, ..., aiocbp*)

9/25/2015 CppCon 2015 C++ Coroutines 29

template <typename Fn> struct CompletionWithCount : OverlappedBase, private Fn

void Invoke(std::error_code ec, int count) override { Fn::operator()(ec, count); }

template <typename F>

void Read(void* buf, int len, std::unique_ptr<detail::OverlappedBase> o)

9/25/2015 CppCon 2015 C++ Coroutines 31

9/25/2015 CppCon 2015 C++ Coroutines 33

9/25/2015 CppCon 2015 C++ Coroutines 34

static void io_complete_callback(CompletionPacket& p) {

9/25/2015 CppCon 2015 C++ Coroutines 35

static void io_complete_callback(CompletionPacket& p) {

9/25/2015 CppCon 2015 C++ Coroutines 36

bool await_ready() { return false; }

9/25/2015 CppCon 2015 C++ Coroutines 39

50% I/O completes synchronously

9/25/2015 CppCon 2015 C++ Coroutines 40

Take advantage of synchronous completions

void Read(void* buf, int len, std::unique_ptr<detail::OverlappedBase> o)

9/25/2015 CppCon 2015 C++ Coroutines 41

Take advantage of synchronous completions

void Read(void* buf, int len, std::unique_ptr<detail::OverlappedBase> o)

9/25/2015 CppCon 2015 C++ Coroutines 42

Take advantage of synchronous completions

>::Invoke(std::error_code ec, int count) Line 31

>::Invoke(std::error_code ec, int count) Line 31

void tcp_reader::OnRead(std::error_code ec, int bytesRead) {

if (ec) return OnError(ec);

9/25/2015 CppCon 2015 C++ Coroutines 44

void tcp_reader::OnRead(std::error_code ec, int bytesRead) {

9/25/2015 CppCon 2015 C++ Coroutines 45

MB/s Executable size

Handcrafted Coroutine Handcrafted Coroutine

Original 380 495 30 25

9/25/2015 CppCon 2015 C++ Coroutines 46

bool await_ready() { return false; }

int await_resume() { static void io_complete_callback(CompletionPacket& p){

return awaiter{ this, buf, len };

bool await_ready() { return false; }

int await_resume() { static void io_complete_callback(CompletionPacket& p){

return awaiter{ this, buf, len };

9/25/2015 CppCon 2015 C++ Coroutines 50

9/25/2015 CppCon 2015 C++ Coroutines 51

MB/s Executable size

Handcrafted Coroutine Handcrafted Coroutine

Original 380 495 30 25

9/25/2015 CppCon 2015 C++ Coroutines 52

9/25/2015 CppCon 2015 C++ Coroutines 54

tcp_reader(int64_t total) : total(total) {

void OnRead(std::error_code ec, int bytesRead) {

9/25/2015 CppCon 2015 C++ Coroutines 55

MB/s Executable size

Windows: WSARecv(fd, ..., OVERLAPPED) Posix aio: aio_read(fd, ..., aiocbp)