SlideShare a Scribd company logo
Friday, June 11, 2010
Scaling Rails on App Engine
             with JRuby and Duby
             Run your apps on Google Servers,
             with access to first-class Java APIs
             John Woodell
             David Masover
             Ryan Brown
             June 9, 2010



               2



Friday, June 11, 2010
Google App Engine
               3



Friday, June 11, 2010
Key Features
             • No need to install or maintain your own stack
             • Use Google scalable services via standard APIs
             • Built-in application management console
             • Pay-as-you-go, with free quota to get started




               4



Friday, June 11, 2010
Key Limitations
             • No native code
             • No threads or sockets
             • No writing to the filesystem
             • No more than 30 seconds per request




               5



Friday, June 11, 2010
Quotas and Billing
                        Resource      Provided Free      Additional Cost
                        CPU time      6.5 hours/day        $0.10/hour


                   Bandwidth In        1GByte/day         $0.10/GByte

                Bandwidth Out          1GByte/day         $0.12/GByte

                   Stored Data            1 GB           $0.005/GB-day

                    Emails sent     2000/day to users    $0.0001/email
                                   50000/day to admins

               6



Friday, June 11, 2010
App Engine Product Roadmap
             • SSL for third-party domains
             • Background servers capable of running for longer than 30s
             • Ability to reserve instances to reduce application loading overhead
             • Ability to select different availability vs. latency options for Datastore
             • Support for mapping operations across datasets
             • Datastore dump and restore facility
             • Raise request/response size limits for some APIs
             • Improved monitoring and alerting of application serving
             • Support for Browser Push (Comet) communication
             • Built-in support for OAuth & OpenID



               7



Friday, June 11, 2010
JRuby on App Engine
               8



Friday, June 11, 2010
Benefits of JRuby
             • Outperforms MRI in many cases... 2x to 10x
             • Gem extensions written in Java (no more segfaults)
             • A wealth of integration options and first-class Java APIs




               9



Friday, June 11, 2010
App Engine JRuby Milestones
             • 2009-04-08   @olabini publishes blog post on YARBL
             • 2009-04-09   @nicksieger publishes warbler demo
             • 2009-05-06   RailsConf (sinatra & merb)
             • 2009-11-02   0.0.5 bundler, precompilation & Duby preview
             • 2009-11-20   RubyConf (Rails 3.0.pre & Duby App)
             • 2009-12-27   @urekat publishes Rails 2.3.5 patches
             • 2010-01-11   @codingforrent published rails/dm gem
             • 2010-01-21   0.0.8 Rails 2.3.5 Primer for DM & TinyDS
             • 2010-01-26   0.0.9 Mechanize and Hpricot demos
             • 2010-02-27   0.0.10 ActionMailer, ImageService, jruby-openssl
             • 2010-04-08   @azazeal blog post on taxster.gr (OpenID)
             • 2010-06-09   0.0.14 JRuby 1.5.1 & app.yaml preview
              10



Friday, June 11, 2010
Current Issues with JRuby on App Engine
             • Several seconds to “spin-up” a new JRuby instance
             • Some gems may need their extensions ported to Java
             • Not officially supported , but you have all that you need




                                        +
              11



Friday, June 11, 2010
Install it Now

                        sudo gem install google-appengine



                          Everything you need installs as gems


              12



Friday, June 11, 2010
App Engine Gems
            • Development Gems
              – appengine-sdk
              – appengine-tools . . . dev_appserver.rb & appcfg.rb
            • Runtime Gems
                   – appengine-rack . . . . jruby-jars & jruby-rack
                   – appengine-apis
            • Related Gems
              – dm-appengine
                   – rails_appengine
                   – rails_dm_datastore
                   – rails_tiny_ds



              13



Friday, June 11, 2010
App Engine JRuby APIs
             • AppEngine::Users
             • AppEngine::Datastore
             • AppEngine::Memcache
             • AppEngine::Mail
             • AppEngine::URLFetch
             • AppEngine::Images
             • AppEngine::Logger
             • AppEngine::XMPP
             • AppEngine::Labs::TaskQueue
             • AppEngine::OAuth
             • AppEngine::Blobstore

              14



Friday, June 11, 2010
dm-appengine
                          David Masover




              15



Friday, June 11, 2010
DataMapper




              16



Friday, June 11, 2010
ActiveRecord contains SQL strings




              17



Friday, June 11, 2010
Use AppEngineResource




              18



Friday, June 11, 2010
Relationships




              19



Friday, June 11, 2010
Simple




              20



Friday, June 11, 2010
Transactions
             • Idempotence
               – "Why can't I click submit more than once?"
             • Transactions on datastore
               – Optimistic locking
               – Atomic
               – Only across entity-groups




              21



Friday, June 11, 2010
Simple case is Simple




              22



Friday, June 11, 2010
Entity-groups




              23



Friday, June 11, 2010
Global transactions
             • Don't do them!
             • Really, you don't need them!
             • They wouldn't scale anyway!
                but sometimes...




              24



Friday, June 11, 2010
Inventory tracking




              25



Friday, June 11, 2010
Shopping Cart




              26



Friday, June 11, 2010
Duby
                        Ryan Brown




Friday, June 11, 2010
Duby’s not Ruby
             • Statically typed
             • No Duby runtime
             • Uses Java’s type system




              28



Friday, June 11, 2010
Duby has Ruby-inspired Syntax

                        def fib(a:int)
                          if a < 2
                            a
                          else
                            fib(a - 1) + fib(a - 2)
                          end
                        end

                        puts fib 10


Friday, June 11, 2010
// Generated from examples/Test.duby

            public class Test extends java.lang.Object {

                   public static void main(String[] argv) {
                     System.out.println(Test.fib(10));
                   }

                   public static int fib(int a) {
                     return (a < 2) ?
                         (a) :
                         ((Test.fib((a - 1)) + Test.fib((a - 2))));
                   }

            }


Friday, June 11, 2010
A Simple Duby App
              import javax.servlet.http.HttpServlet
              import com.google.appengine.ext.duby.db.Model

              class Post < Model
                property title, String
                property body, Text
              end

              class DubyApp < HttpServlet
                def_edb(list, 'com/ribrdb/list.dhtml')

                   def doGet(request, response)
                     @posts = Post.all.run
                     response.getWriter.write(list)
                   end

                def doPost(request, response)
                  post = Post.new
                  post.title = request.getParameter('title')
                  post.body = Text.new(request.getParameter('body'))
                  post.save
                  doGet(request, response)
                end
              end




              31



Friday, June 11, 2010
A Simple Duby App
              import javax.servlet.http.HttpServlet
              import com.google.appengine.ext.duby.db.Model

              class Post < Model
                property title, String
                property body, Text
              end                                          Types
              class DubyApp < HttpServlet           inferred from parent
                def_edb(list, 'com/ribrdb/list.dhtml')
                                                            class
                   def doGet(request, response)
                     @posts = Post.all.run
                     response.getWriter.write(list)
                   end

                def doPost(request, response)
                  post = Post.new
                  post.title = request.getParameter('title')
                  post.body = Text.new(request.getParameter('body'))
                  post.save
                  doGet(request, response)
                end
              end




              32



Friday, June 11, 2010
A Simple Duby App
              import javax.servlet.http.HttpServlet
              import com.google.appengine.ext.duby.db.Model

              class Post < Model
                property title, String
                property body, Text
              end
                                                      Plugins
              class DubyApp < HttpServlet
                def_edb(list, 'com/ribrdb/list.dhtml')

                   def doGet(request, response)
                     @posts = Post.all.run
                     response.getWriter.write(list)
                   end

                def doPost(request, response)
                  post = Post.new
                  post.title = request.getParameter('title')
                  post.body = Text.new(request.getParameter('body'))
                  post.save
                  doGet(request, response)
                end
              end




              33



Friday, June 11, 2010
Duby Supports Plugins
                  Only form of metaprogramming (for now)


              require 'erb'

              Duby::AST.defmacro('def_edb') do |duby, fcall, p|
                name = fcall.args_node.get(0).name
                path = fcall.args_node.get(1).value
                erb = ERB::Compiler.new(nil)
              ...
                src = erb.compile(IO.read(path))
                duby.eval(src, p, “(edb)”)
              end




Friday, June 11, 2010
Duby Can Use erb Templates
                <title>Posts</title>
                <body>
                  <h1>All Posts:</h1>
                  <% for post in @posts %>
                    <h2><%= post.title %></h2>
                    <p><%= post.body.getValue %></p>
                  <% end %>
                  <hr>
                  <h1>New Post:</h1>
                  <form method=post>
                    Title: <input type=text name=title><br>
                    Body: <textarea name=body></textarea><br>
                    <input type=submit>
                  </form>
                </body>



Friday, June 11, 2010
More to Come
             • Open classes
             • Mix ins
             • Macros
             • More




              36



Friday, June 11, 2010
Resources
             • Blog
               – http://jruby-appengine.blogspot.com/
             • Code Site
               – http://code.google.com/p/appengine-jruby/
             • Google Group
                   – http://groups.google.com/group/appengine-jruby


             • Resources
                   – http://rails2010-dm.appspot.com/
                   – http://github.com/masover/rails2010
                   – http://github.com/masover/cart
                   – http://cart-demo.appspot.com/

              37



Friday, June 11, 2010
Friday, June 11, 2010

More Related Content

PDF
PyCon 2011 Scaling Disqus
PDF
MongoDB at Sailthru: Scaling and Schema Design
PDF
Rejectkaigi 2010
PDF
Styles of Applicaton Integration Using Spring
PDF
Playing between the clouds - Better Software 2010
PDF
UCLUG TorqueBox - 03/08/2011
PDF
Web micro-framework BATTLE!
PDF
Tools for Development and Debugging in Python
PyCon 2011 Scaling Disqus
MongoDB at Sailthru: Scaling and Schema Design
Rejectkaigi 2010
Styles of Applicaton Integration Using Spring
Playing between the clouds - Better Software 2010
UCLUG TorqueBox - 03/08/2011
Web micro-framework BATTLE!
Tools for Development and Debugging in Python

Similar to Railsconf 2010 (20)

PDF
Oscon 2010
PDF
App Engine Meetup
PDF
Red Dirt Ruby Conference
PDF
RubyConf 2009
PDF
Rubypalooza 2009
PDF
JRubyConf 2009
PDF
Mirah & Dubious Talk Ruby|Web 2010
PDF
Aloha on-rails-2009
PDF
2011 June - Singapore GTUG presentation. App Engine program update + intro to Go
PDF
2011 june-kuala-lumpur-gtug-hackathon
PDF
AppScale Talk at SBonRails
PDF
What is Google App Engine?
KEY
Google App Engine Java, Groovy and Gaelyk
PDF
App Engine Overview Cloud Futures Publish
PDF
App engine cloud_comp_expo_nyc
PDF
Intro to App Engine - Agency Dev Day NYC 2011
PDF
App Engine Overview @ Google Hackathon SXSW 2010
PDF
App Engine Presentation @ SFJUG Sep 2010
PDF
JRuby and Google App Engine
PDF
TorqueBox - Ultrapassando a fronteira entre Java e Ruby
Oscon 2010
App Engine Meetup
Red Dirt Ruby Conference
RubyConf 2009
Rubypalooza 2009
JRubyConf 2009
Mirah & Dubious Talk Ruby|Web 2010
Aloha on-rails-2009
2011 June - Singapore GTUG presentation. App Engine program update + intro to Go
2011 june-kuala-lumpur-gtug-hackathon
AppScale Talk at SBonRails
What is Google App Engine?
Google App Engine Java, Groovy and Gaelyk
App Engine Overview Cloud Futures Publish
App engine cloud_comp_expo_nyc
Intro to App Engine - Agency Dev Day NYC 2011
App Engine Overview @ Google Hackathon SXSW 2010
App Engine Presentation @ SFJUG Sep 2010
JRuby and Google App Engine
TorqueBox - Ultrapassando a fronteira entre Java e Ruby
Ad

Recently uploaded (20)

PDF
How AI Agents Improve Data Accuracy and Consistency in Due Diligence.pdf
PDF
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
PDF
Top Generative AI Tools for Patent Drafting in 2025.pdf
PDF
Google’s NotebookLM Unveils Video Overviews
PPTX
How to Build Crypto Derivative Exchanges from Scratch.pptx
PPTX
breach-and-attack-simulation-cybersecurity-india-chennai-defenderrabbit-2025....
PDF
Chapter 2 Digital Image Fundamentals.pdf
PDF
CIFDAQ's Teaching Thursday: Moving Averages Made Simple
PPTX
Understanding_Digital_Forensics_Presentation.pptx
PDF
solutions_manual_-_materials___processing_in_manufacturing__demargo_.pdf
PDF
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
PDF
NewMind AI Monthly Chronicles - July 2025
PPTX
CroxyProxy Instagram Access id login.pptx
PDF
CIFDAQ's Market Insight: SEC Turns Pro Crypto
PDF
CIFDAQ's Market Wrap: Ethereum Leads, Bitcoin Lags, Institutions Shift
PDF
Dell Pro 14 Plus: Be better prepared for what’s coming
PDF
A Day in the Life of Location Data - Turning Where into How.pdf
PDF
Event Presentation Google Cloud Next Extended 2025
PPTX
Comunidade Salesforce São Paulo - Desmistificando o Omnistudio (Vlocity)
PDF
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
How AI Agents Improve Data Accuracy and Consistency in Due Diligence.pdf
Cloud-Migration-Best-Practices-A-Practical-Guide-to-AWS-Azure-and-Google-Clou...
Top Generative AI Tools for Patent Drafting in 2025.pdf
Google’s NotebookLM Unveils Video Overviews
How to Build Crypto Derivative Exchanges from Scratch.pptx
breach-and-attack-simulation-cybersecurity-india-chennai-defenderrabbit-2025....
Chapter 2 Digital Image Fundamentals.pdf
CIFDAQ's Teaching Thursday: Moving Averages Made Simple
Understanding_Digital_Forensics_Presentation.pptx
solutions_manual_-_materials___processing_in_manufacturing__demargo_.pdf
How UI/UX Design Impacts User Retention in Mobile Apps.pdf
NewMind AI Monthly Chronicles - July 2025
CroxyProxy Instagram Access id login.pptx
CIFDAQ's Market Insight: SEC Turns Pro Crypto
CIFDAQ's Market Wrap: Ethereum Leads, Bitcoin Lags, Institutions Shift
Dell Pro 14 Plus: Be better prepared for what’s coming
A Day in the Life of Location Data - Turning Where into How.pdf
Event Presentation Google Cloud Next Extended 2025
Comunidade Salesforce São Paulo - Desmistificando o Omnistudio (Vlocity)
Peak of Data & AI Encore- AI for Metadata and Smarter Workflows
Ad

Railsconf 2010

  • 2. Scaling Rails on App Engine with JRuby and Duby Run your apps on Google Servers, with access to first-class Java APIs John Woodell David Masover Ryan Brown June 9, 2010 2 Friday, June 11, 2010
  • 3. Google App Engine 3 Friday, June 11, 2010
  • 4. Key Features • No need to install or maintain your own stack • Use Google scalable services via standard APIs • Built-in application management console • Pay-as-you-go, with free quota to get started 4 Friday, June 11, 2010
  • 5. Key Limitations • No native code • No threads or sockets • No writing to the filesystem • No more than 30 seconds per request 5 Friday, June 11, 2010
  • 6. Quotas and Billing Resource Provided Free Additional Cost CPU time 6.5 hours/day $0.10/hour Bandwidth In 1GByte/day $0.10/GByte Bandwidth Out 1GByte/day $0.12/GByte Stored Data 1 GB $0.005/GB-day Emails sent 2000/day to users $0.0001/email 50000/day to admins 6 Friday, June 11, 2010
  • 7. App Engine Product Roadmap • SSL for third-party domains • Background servers capable of running for longer than 30s • Ability to reserve instances to reduce application loading overhead • Ability to select different availability vs. latency options for Datastore • Support for mapping operations across datasets • Datastore dump and restore facility • Raise request/response size limits for some APIs • Improved monitoring and alerting of application serving • Support for Browser Push (Comet) communication • Built-in support for OAuth & OpenID 7 Friday, June 11, 2010
  • 8. JRuby on App Engine 8 Friday, June 11, 2010
  • 9. Benefits of JRuby • Outperforms MRI in many cases... 2x to 10x • Gem extensions written in Java (no more segfaults) • A wealth of integration options and first-class Java APIs 9 Friday, June 11, 2010
  • 10. App Engine JRuby Milestones • 2009-04-08 @olabini publishes blog post on YARBL • 2009-04-09 @nicksieger publishes warbler demo • 2009-05-06 RailsConf (sinatra & merb) • 2009-11-02 0.0.5 bundler, precompilation & Duby preview • 2009-11-20 RubyConf (Rails 3.0.pre & Duby App) • 2009-12-27 @urekat publishes Rails 2.3.5 patches • 2010-01-11 @codingforrent published rails/dm gem • 2010-01-21 0.0.8 Rails 2.3.5 Primer for DM & TinyDS • 2010-01-26 0.0.9 Mechanize and Hpricot demos • 2010-02-27 0.0.10 ActionMailer, ImageService, jruby-openssl • 2010-04-08 @azazeal blog post on taxster.gr (OpenID) • 2010-06-09 0.0.14 JRuby 1.5.1 & app.yaml preview 10 Friday, June 11, 2010
  • 11. Current Issues with JRuby on App Engine • Several seconds to “spin-up” a new JRuby instance • Some gems may need their extensions ported to Java • Not officially supported , but you have all that you need + 11 Friday, June 11, 2010
  • 12. Install it Now sudo gem install google-appengine Everything you need installs as gems 12 Friday, June 11, 2010
  • 13. App Engine Gems • Development Gems – appengine-sdk – appengine-tools . . . dev_appserver.rb & appcfg.rb • Runtime Gems – appengine-rack . . . . jruby-jars & jruby-rack – appengine-apis • Related Gems – dm-appengine – rails_appengine – rails_dm_datastore – rails_tiny_ds 13 Friday, June 11, 2010
  • 14. App Engine JRuby APIs • AppEngine::Users • AppEngine::Datastore • AppEngine::Memcache • AppEngine::Mail • AppEngine::URLFetch • AppEngine::Images • AppEngine::Logger • AppEngine::XMPP • AppEngine::Labs::TaskQueue • AppEngine::OAuth • AppEngine::Blobstore 14 Friday, June 11, 2010
  • 15. dm-appengine David Masover 15 Friday, June 11, 2010
  • 16. DataMapper 16 Friday, June 11, 2010
  • 17. ActiveRecord contains SQL strings 17 Friday, June 11, 2010
  • 18. Use AppEngineResource 18 Friday, June 11, 2010
  • 19. Relationships 19 Friday, June 11, 2010
  • 20. Simple 20 Friday, June 11, 2010
  • 21. Transactions • Idempotence – "Why can't I click submit more than once?" • Transactions on datastore – Optimistic locking – Atomic – Only across entity-groups 21 Friday, June 11, 2010
  • 22. Simple case is Simple 22 Friday, June 11, 2010
  • 23. Entity-groups 23 Friday, June 11, 2010
  • 24. Global transactions • Don't do them! • Really, you don't need them! • They wouldn't scale anyway! but sometimes... 24 Friday, June 11, 2010
  • 25. Inventory tracking 25 Friday, June 11, 2010
  • 26. Shopping Cart 26 Friday, June 11, 2010
  • 27. Duby Ryan Brown Friday, June 11, 2010
  • 28. Duby’s not Ruby • Statically typed • No Duby runtime • Uses Java’s type system 28 Friday, June 11, 2010
  • 29. Duby has Ruby-inspired Syntax def fib(a:int) if a < 2 a else fib(a - 1) + fib(a - 2) end end puts fib 10 Friday, June 11, 2010
  • 30. // Generated from examples/Test.duby public class Test extends java.lang.Object { public static void main(String[] argv) { System.out.println(Test.fib(10)); } public static int fib(int a) { return (a < 2) ? (a) : ((Test.fib((a - 1)) + Test.fib((a - 2)))); } } Friday, June 11, 2010
  • 31. A Simple Duby App import javax.servlet.http.HttpServlet import com.google.appengine.ext.duby.db.Model class Post < Model property title, String property body, Text end class DubyApp < HttpServlet def_edb(list, 'com/ribrdb/list.dhtml') def doGet(request, response) @posts = Post.all.run response.getWriter.write(list) end def doPost(request, response) post = Post.new post.title = request.getParameter('title') post.body = Text.new(request.getParameter('body')) post.save doGet(request, response) end end 31 Friday, June 11, 2010
  • 32. A Simple Duby App import javax.servlet.http.HttpServlet import com.google.appengine.ext.duby.db.Model class Post < Model property title, String property body, Text end Types class DubyApp < HttpServlet inferred from parent def_edb(list, 'com/ribrdb/list.dhtml') class def doGet(request, response) @posts = Post.all.run response.getWriter.write(list) end def doPost(request, response) post = Post.new post.title = request.getParameter('title') post.body = Text.new(request.getParameter('body')) post.save doGet(request, response) end end 32 Friday, June 11, 2010
  • 33. A Simple Duby App import javax.servlet.http.HttpServlet import com.google.appengine.ext.duby.db.Model class Post < Model property title, String property body, Text end Plugins class DubyApp < HttpServlet def_edb(list, 'com/ribrdb/list.dhtml') def doGet(request, response) @posts = Post.all.run response.getWriter.write(list) end def doPost(request, response) post = Post.new post.title = request.getParameter('title') post.body = Text.new(request.getParameter('body')) post.save doGet(request, response) end end 33 Friday, June 11, 2010
  • 34. Duby Supports Plugins Only form of metaprogramming (for now) require 'erb' Duby::AST.defmacro('def_edb') do |duby, fcall, p| name = fcall.args_node.get(0).name path = fcall.args_node.get(1).value erb = ERB::Compiler.new(nil) ... src = erb.compile(IO.read(path)) duby.eval(src, p, “(edb)”) end Friday, June 11, 2010
  • 35. Duby Can Use erb Templates <title>Posts</title> <body> <h1>All Posts:</h1> <% for post in @posts %> <h2><%= post.title %></h2> <p><%= post.body.getValue %></p> <% end %> <hr> <h1>New Post:</h1> <form method=post> Title: <input type=text name=title><br> Body: <textarea name=body></textarea><br> <input type=submit> </form> </body> Friday, June 11, 2010
  • 36. More to Come • Open classes • Mix ins • Macros • More 36 Friday, June 11, 2010
  • 37. Resources • Blog – http://jruby-appengine.blogspot.com/ • Code Site – http://code.google.com/p/appengine-jruby/ • Google Group – http://groups.google.com/group/appengine-jruby • Resources – http://rails2010-dm.appspot.com/ – http://github.com/masover/rails2010 – http://github.com/masover/cart – http://cart-demo.appspot.com/ 37 Friday, June 11, 2010