Skip to content

crawlersNoticias
crawlersNoticias
Commit 155c0d82 authored by Renán Sosa Guillen's avatar Renán Sosa Guillen
Browse files
Options

crawler backwards

parent 26ccc574
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
crawler_script/crawl_backwards.py
View file @ 155c0d82
...@@ -62,7 +62,7 @@ with open(sys.argv[1]) as data_file: ...@@ -62,7 +62,7 @@ with open(sys.argv[1]) as data_file:
if fileSize <= 3: os.system("rm " + filename) if fileSize <= 3: os.system("rm " + filename)
else: else:
os.chdir(scrapyDir) os.chdir(scrapyDir)
os.system("python3 parse_date_files.py " + s['crawler']) os.system("python3 parse_date_files.py " + s['crawler'] + " " + filename)
os.chdir(media) os.chdir(media)
mediaYears = os.listdir(".") mediaYears = os.listdir(".")
mediaYears.sort() mediaYears.sort()
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment