v3io 内容删除的意外持续时间
[英]Unexpected duration for v3io content delete
问题描述
When I deleted content of NoSqlTarget (key-value storage) in MLRun/v3io via standard command line utility such as:
当我通过标准命令行实用程序删除 MLRun/v3io 中 NoSqlTarget（键值存储）的内容时，例如：
rm -rf /v3io/project/test-featureset/
It took approx.花了大约。 1 hour for 1 million of files and in case of 20 millions of files it was near to one day. 100 万个文件需要 1 小时，而 2000 万个文件则接近一天。
Do you have tips/tricks, how to use faster delete?你有提示/技巧，如何使用更快的删除？
1 个解决方案
解决方案1
1 已采纳 2023-05-02 15:41:12
I got very useful tip for speedup delete process, use this command line:我得到了非常有用的加速删除过程的提示，使用这个命令行：
hdfs dfs -rm -f -r v3io://projects/test-featureset/
The new performance was excellent, 1 million of files per 3 minutes.新性能非常出色，每 3 分钟 100 万个文件。
BTW: the command hdfs dfs is possible to use for speedup other operations such as -ls -cp -find , more information see the link顺便说一句：命令hdfs dfs可以用于加速其他操作，例如-ls -cp -find ，更多信息请参见链接
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.