Skip to content

crawlersNoticias
crawlersNoticias
Commit 81ee8b42 authored by Renán Sosa Guillen's avatar Renán Sosa Guillen
Browse files
Options

crawl all

parent 9ff294f8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
crawler_script/crawl_all.py
View file @ 81ee8b42
...@@ -60,6 +60,7 @@ with open(sys.argv[1]) as data_file: ...@@ -60,6 +60,7 @@ with open(sys.argv[1]) as data_file:
mydir = os.getcwd() mydir = os.getcwd()
print mydir print mydir
os.chdir(scrapyDir+s['crawler']) os.chdir(scrapyDir+s['crawler'])
print media
print scrapycommand print scrapycommand
os.system(scrapycommand) os.system(scrapycommand)
fileSize = os.stat(filename).st_size fileSize = os.stat(filename).st_size
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment