Support cpp wrapper code

[jgong5]

Currently wrapper.py generates python code that invokes generated kernels and external kernels. This would incur Python overhead which can be avoided if the wrapper can generate c++ code that invokes these kernels via C++ directly.

cc @ezyang @soumith @msaroufim @wconstab @ngimel @bdhirsh

[voznesenskym]

Currently wrapper.py generates python code that invokes generated kernels and external kernels. This would incur Python overhead which can be avoided if the wrapper can generate c++ code that invokes these kernels via C++ directly.

Yes. It could also run where we don't have access to Python. In fact, this would go great with torchdynamo.export, for a general no Python inductor flow.

Do you plan on working on direct c++ invocation? If not, I can take a look.

[jgong5]

Do you plan on working on direct c++ invocation? If not, I can take a look.

It is in our tentative plan. It's great if you'd like to offer the hand. Feel free to let me know if you need any help!

[jgong5]

@voznesenskym Have you started working on it? If not, we will take over. :-)