README
¶
Gopa
[狗爬], A Spider Written in Go.
Build Gopa
Mac/Linux: Run make build to build the Gopa
Windows: go with this wiki - How to build GOPA on windows
Download
Start Gopa
After download/build the binary file, run ./gopa to start the Gopa
Run ./gopa -h to get the full list of commandline options
- -log option : logging level,can be set to
trace,debug,info,warn,error,default isinfo - -daemon option : run in background as daemon
- -pprof option : enable and setup pprof/expvar service, eg: localhost:6060 , the endpoint will be: http://localhost:6060/debug/pprof/ and http://localhost:6060/debug/vars
- -cpuprofile option : write cpu profile to this file
- -memprofile option : write memory profile to this file
Stop Gopa
It's safety to press ctrl+c stop the current running Gopa, Gopa will handle the rest,saving the checkpoint,
you may restore the job later,the world is still in your hand.
If you are running Gopa as daemon, you can stop it like this:
kill -QUIT `pgrep gopa`
UI
Visit http://127.0.0.1:9001/ for more details.
License
Released under the Apache License, Version 2.0 .
Documentation
¶
There is no documentation for this package.
Source Files
Directories
¶
| Path | Synopsis |
|---|---|
|
core
|
|
|
config
copied from github.com/elastic/beats
|
copied from github.com/elastic/beats |
|
util
copied from github.com/elastic/beats
|
copied from github.com/elastic/beats |
|
util/file
copied from github.com/elastic/beats
|
copied from github.com/elastic/beats |
|
cluster/discovery/raft
Package store provides a simple distributed key-value store.
|
Package store provides a simple distributed key-value store. |
|
queue/disk_queue
[nsq]: https://github.com/nsqio/nsq Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
|
[nsq]: https://github.com/nsqio/nsq Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. |
Click to show internal directories.
Click to hide internal directories.