
[英]Dask - Is it possible to use all threads in every worker with custom function?
[英]Possible to display worker names in Dask web UI?
我可以将工作程序添加到dasch-scheduler中,并且它们会出现在Web ui中,但是工作程序是按其IP地址列出的,而不是我给他们提供的名称。
当我创建工作程序(在Python脚本中)时,确实设置了名称:
import dask
import dask.dataframe as dd
from dask.distributed import Client as Dask_Client
from distributed import Worker
dask_client = Dask_Client('192.168.0.162:8786')
loop = IOLoop.current()
t = threading.Thread(target=loop.start, daemon=True)
t.start()
w = Worker('tcp://192.168.0.162:8786', loop=loop, name=socket.gethostname())
w.start()
当我运行print(json.dumps(dask_client.scheduler_info(),sort_keys = True,indent = 4))时,工作人员名称确实出现了-摘录如下:
"tcp://192.168.0.198:39619": {
"host": "192.168.0.198",
"id": "alana1",
"last_seen": 1558707665.9223647,
"local_directory": "[omitted]",
"memory_limit": 8243511296,
"metrics": {
"cpu": 4.0,
"executing": 0,
"in_flight": 0,
"in_memory": 330,
"memory": 245129216,
"num_fds": 26,
"read_bytes": 3020.000227124918,
"ready": 0,
"time": 1558707665.9237077,
"write_bytes": 3484.3077504469734
},
"name": "alana1",
"ncores": 4,
"resources": {},
"services": {
"bokeh": 37993,
"nanny": 35817
},
"type": "Worker"
在上面的示例中,我希望名称“ alana1”将出现在Dask Web UI中,而不是出现的名称:“ tcp://192.168.0.198:39619”
是。 通过更改Dask代码库,这是可能的。
听起来您是在请求功能请求。 我建议提出一个github问题。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.