Fluentd and PHP
•
13 likes•5,842 views
Chobi_e is the author of the upcoming PECL Sundown package and contributor to other PHP projects involving logging and messaging. He discusses options for collecting log files in PHP applications, including using log file collectors like Fluentd which provide a robust and distributed logging solution. Chobi_e also introduces some Fluentd plugins he has created and potential other plugin ideas, and discusses setting up Fluentd logging in PHP applications.
Fluentd and PHP
- 2. @chobi_e
- 3. chobi_e is: PECL Sundown Author (will be release soon) h>ps://github.com/chobie/php-‐sundown libgit2 PHP Binding Author h>ps://github.com/libgit2/php-‐git phpredis contributor h>ps://github.com/nicolasff/phpredis
- 5. Scaling web servers. basically, just add web server to the array.
- 6. then, how about collecLng log files?
- 8. using log file Are you serious?
- 9. using syslog like middleware
- 10. using syslog like middleware Not Bad.
- 11. using reliable and distributed log collector: Note: fluent-‐logger-‐php does not support output buffering. So local fluentd as a buffer in this case.
- 12. using reliable and distributed log collector: that’s the best soluLon IMHO Note: fluent-‐logger-‐php does not support output buffering. So local fluentd as a buffer in this case.
- 13. fluentd provides robust messaging soluLon
- 14. for Data Mining Data Mining
- 15. for queued job Data Mining Queued job
- 16. fluentd first step with PHP
- 19. # composer.json { "name": "my-‐project", "version": "1.0.0", "require": { "fluent/logger": "master-‐dev" } }
- 20. wget h>p://getcomposer.org/composer.phar php -‐d detect_unicode=0 composer.phar install
- 21. <?php require "vendor/.composer/autoload.php"; use FluentLoggerFluentLogger; $logger = FluentLogger::open( "debug.test", "localhost", "24224” );
- 22. install by copy the tree.
- 23. git clone h>ps://github.com/fluent/fluent-‐logger-‐php.git cp -‐r src/Fluent <path/to/your_project>
- 24. php library which using Fluentd.
- 25. MonologFluent by nrk h>ps://github.com/nrk/monolog-‐fluent.git
- 26. what is Monolog? Monolog by Seldaek. h>ps://github.com/Seldaek/monolog Monolog is: heavily inspired by Python's Logbook library, although most concepts have been adjusted to fit to the PHP world.
- 27. install $ wget h>p://getcomposer.org/composer.phar $ php composer.phar install
- 28. <?php use NrkFluentMonologFluentHandler; $log = new MonologLogger('debug.monolog'); $log-‐>pushHandler(new FluentHandler('h>p://127.0.0.1')); $log-‐>pushHandler(new FluentHandler('tcp://127.0.0.1')); $log-‐>addError("OH NOES!!11!1!");
- 29. introduce my fluent plugin
- 30. fluent-‐plugin-‐delayed -‐ delayed output plugin. h>ps://github.com/chobie/fluent-‐plugin-‐delayed
- 31. fluent-‐plugin-‐delayed -‐ delayed output plugin. h>ps://github.com/chobie/fluent-‐plugin-‐delayed Client event{ Lme: 2011-‐10-‐22 10:00:05, # 5 seconds future ... } delayed plugin : aler 5 seconds. then delayed plugin outputs the data to other output plugin. output
- 32. other Ideas. fluent-‐plugin-‐cooldown -‐ coolodowned outputs when specified key received. fluent-‐plugin-‐sampler -‐ only outputs N % data.
- 33. GitHQ / Kokuban Github / gist clone (sLll under development)
- 34. updaLng ssh key is pain in ass. /home/git/.ssh/authorized_keys
- 35. updaLng SSH Authorized keys only pass cooldowned message. send public key client web server fluentd cooldown exec sending message via fluentdLogger redis update authorized_keys obtain ssh public keys
- 36. Web developer only knows tag for queued job.
- 37. Web developer only knows tag for queued job. Server engineer only implements reliable consumer plugin for Fluentd.
- 38. Sounds good?
- 40. fluentd protocol support ✔ h>p protocol support ✔ composer support ✔ PEAR package support ✔ -‐ but I don’t provide pear channel. message pack support buffering support -‐ does not support as there’s trouble some for using persistent variables for buffer.
- 41. That’s all
- 42. That’s all i need more developer! please feel free to pull req me. h>ps://github.com/chobie