简体繁体 English

从cron调用的scrapy脚本仅调用了构造函数

[英]scrapy script called from cron only constructor called

原文 2011-11-02 17:29:37 2 1 python/ crontab/ scrapy

scrapy crawler is called through a shell script, which is used as the command line in a crontab entry. scrapy搜寻器是通过Shell脚本调用的，该脚本在crontab条目中用作命令行。 The shell script looks like: Shell脚本如下所示：

scrapy crawl targethost.com 抓取抓取targethost.com

when time is due and it did execute, but seems only the constructor is called (I verified with debug output). 时间到了，它确实执行了，但是似乎只调用了构造函数（我用调试输出验证了）。 The problem is solved by re-write the shell script as: 通过将shell脚本重新编写为：

scrapy crawl targethost.com &> cronlog.log 抓取抓取targethost.com＆> cronlog.log

I just don't know why. 我只是不知道为什么。

1 个解决方案

Scrapy executes correctly, but doesn't output all its messages to STDOUT, so the simple pipe ( > ) doesn't redirect everything into your file, only that stuff that goes to STDOUT (which as you say, seems to be the constructor only). Scrapy可以正确执行，但是不会将其所有消息输出到STDOUT，因此简单的管道（ > ）不会将所有内容重定向到您的文件中，而只是将那些内容发送到STDOUT（正如您所说的，它似乎只是构造函数））。

With &> it fetches all messages from scrapy and puts them into your log. 使用&>可以从scrapy中获取所有消息，并将它们放入您的日志中。

下标问题（脚本实例化并从另一个脚本调用）只运行被调用的 function，而不是整个脚本 - Issue with subscript (script instantiated and called from another script) only running the called function, but not the entire script

防止在父构造函数中调用的方法在子构造函数中被调用 - Prevent a method that is called in the parent constructor from being called in the child constructor

为什么 Python 脚本可以从 CLI 运行，但从 cron 作业调用时却不能运行？ - Why does a Python script work from the CLI, but not when called from a cron job?

scrapy：来自信号调用的回调的屈服请求 - scrapy: yield request from callback called by signal

由Cron定期调用的Bash脚本运行时无法执行Python脚本 - Python Script Not Executing When Run By a Bash Script Called Periodically by Cron

Scrapy 解析 function 未调用 - Scrapy parse function not called

未调用解析中的抓取回调 - scrapy callback in parse not called

Scrapy，未调用自定义方法 - Scrapy, custome method not called

通过shell_exec调用的Scrapy脚本无法执行 - Scrapy Script called via shell_exec doesn't perform

如何确保仅在 python 中仅从派生类调用基本构造函数 - How can I make sure that a base constructor is only called from the derived classes only in python

暂无

暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 下标问题（脚本实例化并从另一个脚本调用）只运行被调用的 function，而不是整个脚本 - Issue with subscript (script instantiated and called from another script) only running the called function, but not the entire script 防止在父构造函数中调用的方法在子构造函数中被调用 - Prevent a method that is called in the parent constructor from being called in the child constructor 为什么 Python 脚本可以从 CLI 运行，但从 cron 作业调用时却不能运行？ - Why does a Python script work from the CLI, but not when called from a cron job? scrapy：来自信号调用的回调的屈服请求 - scrapy: yield request from callback called by signal 由Cron定期调用的Bash脚本运行时无法执行Python脚本 - Python Script Not Executing When Run By a Bash Script Called Periodically by Cron Scrapy 解析 function 未调用 - Scrapy parse function not called 未调用解析中的抓取回调 - scrapy callback in parse not called Scrapy，未调用自定义方法 - Scrapy, custome method not called 通过shell_exec调用的Scrapy脚本无法执行 - Scrapy Script called via shell_exec doesn't perform 如何确保仅在 python 中仅从派生类调用基本构造函数 - How can I make sure that a base constructor is only called from the derived classes only in python

相关标签

粤ICP备18138465号 © 2020-2024 STACKOOM.COM