无法在 ArangoDB 中批量上传日志数据？
[英]Unable to bulk upload log data in ArangoDB?
问题描述
I need to bulk upload the log data in ArangoDB.
我需要在 ArangoDB 中批量上传日志数据。 It is not in JSON and CSV format, its a log data in gz format.它不是 JSON 和 CSV 格式，而是 gz 格式的日志数据。
203.109.94.55 - - [19/Jun/2015:16:02:45 +0000] "GET /origin-cdn.firstcry.com/brainbees/images/products/thumb/506739a.jpg HTTP/1.1" 200 21514 "-" "Mozilla/5.0 (Linux; Android 4.4.4; XT1022 Build/KXC21.5-40) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/34.0.1847.114 Mobile Safari/537.36" "-" 183.87.73.202 - - [19/Jun/2015:16:02:45 +0000] "GET /origin-cdn.firstcry.com/brainbees/images/products/bigthumb/555258a.jpg HTTP/1.1" 200 34903 "-" "Dalvik/2.1.0 (Linux; U; Android 5.0.2; AO5510 Build/LRX22G)" "-" 183.87.73.202 - - [19/Jun/2015:16:02:45 +0000] "GET /origin-cdn.firstcry.com/brainbees/images/products/bigthumb/555401a.jpg HTTP/1.1" 200 32334 "-" "Dalvik/2.1.0 (Linux; U; Android 5.0.2; AO5510 Build/LRX22G)" "-"
Even when we are trying for uploading single file through Arangosh then too it is not uploading and generating error that format is invalid.即使我们尝试通过 Arangosh 上传单个文件，它也不会上传并生成格式无效的错误。 I have daily data of 2 GB to upload and process, how can I do through ArangoDB?我每天有 2 GB 的数据要上传和处理，我该如何通过 ArangoDB 进行处理？ As I have gone through documents of ArangoDB and found the bulk upload for only JSON.由于我浏览了 ArangoDB 的文档，发现只有 JSON 的批量上传。 Any help with how to upload and process the same will be grateful?任何有关如何上传和处理相同内容的帮助将不胜感激？
1 个解决方案
解决方案1
3 2015-07-01 10:39:22
ArangoDB only supports bulk upload of JSON, CSV, or TSV. ArangoDB 仅支持批量上传 JSON、CSV 或 TSV。 Therefore you need to convert the log file.因此，您需要转换日志文件。 I good starting point is google.我很好的起点是谷歌。 For example, there is a project called "log2json":例如，有一个名为“log2json”的项目：
https://github.com/kadnan/logs2json
with some minor tweaks you should be able to generate lines of JSON (the above project creates one large JSON, which is not what you want).通过一些小的调整，您应该能够生成 JSON 行（上述项目创建了一个大型 JSON，这不是您想要的）。
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.