如何获得Gearman中特定类型的排队作业数？

Question

I have a number of gearman clients sending a job, say job1.

$client = new GearmanClient();
$client->addServer();
$client->doBackground('job1', 'workload');

It takes, say 10 seconds to process this job. I want to track how many 'job1' jobs are waiting for a worker to work on them at any given time. How can I do that?

Answer 1

For quick checking, I use this bash one-liner:

(echo status ; sleep 0.1) | netcat 127.0.0.1 4730

This opens a connection to a gearman instance running on localhost, and sends the status query. This contains the name and number of jobs on that instance. The information can then be processed with grep / awk / wc etc. for reporting and alerting.

I also do the same with the workers query which shows all connected workers.

(echo workers ; sleep 0.1) | netcat 127.0.0.1 4730

The sleep is to keep the connection open long enough for the reply.

The full list of administrative commands, and what the output means is at http://gearman.org/protocol/ . Just search for "Administrative Protocol".

Answer 2

要扩展d5ve的答案，请添加-w参数以“超时”您的netcat连接，否则，您将永远不会回到命令提示符。

$ (echo status ; sleep 0.1) | sudo netcat 127.0.0.1 4730 -w 1

Answer 3

telnet localhost 4730
status

worker_name total_queue currently_running number_of_workers
job1         1          1                 9

Answer 4

I use gearman_top , which is part of mod-gearman .

Example output from the website:

+-----------------------+--------+-------+-------+---------+
| Name                  | Worker | Avail | Queue | Running |
+-----------------------+--------+-------+-------+---------+
| check_results         | 1      | 1     | 0     | 0       |
| host                  | 3      | 3     | 0     | 0       |
| service               | 3      | 3     | 0     | 0       |
| eventhandler          | 3      | 3     | 0     | 0       |
| servicegroup_jmx4perl | 3      | 3     | 0     | 0       |
| hostgroup_japan       | 3      | 3     | 0     | 0       |
+-----------------------+--------+-------+-------+---------+

Answer 5

It doesn't look like there are any immediate ways to get this information.

Here are a few options. First, if you can grab job handles as you create them (search for "Speaking of checking the status"), you can store them away in some central place and query about them from any client.

Second, you can set your Gearman server to use persistent queues , and then run a query against the queue yourself. This might be the easier and cleaner of the two options.

Answer 6

Gearmand has a telnet interface you can query. (the exact details of the protocol can be found on the gearman website - http://gearman.org/?id=protocol )

I used this code here as a starting point for rolling my own. https://github.com/liorbk/php/blob/master/GearmanTelnet.php (this code is perfectly good by itself and you should be able to drop use it out of the box)

It's a less than pretty solution but until someone improves gearman admin interface so you can talk directly via PHP or writes a plugin for it, you are on your own

Answer 7

On Ubuntu 18.04 I have the gearadmin binary installed by default with the gearman package.

gearadmin --help
gearadmin --status can be used instead of the netcat alternative:

gearadmin --status
queue1    334     10      10

And a one liner:
while :; do gearadmin --status; sleep 1; done