Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
m3_webInterface
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
m3
m3_webInterface
Commits
5beb5445
Commit
5beb5445
authored
Dec 14, 2024
by
Mario Chirinos
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
bulk upload
parent
9884d8d0
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
9 deletions
+7
-9
loadNews.py
catalog/management/commands/loadNews.py
+7
-9
No files found.
catalog/management/commands/loadNews.py
View file @
5beb5445
...
...
@@ -9,7 +9,7 @@ from django.utils import timezone
import
dateutil.parser
import
itertools
from
datetime
import
date
from
itertools
import
islice
updateRadioStations
=
False
recordingsDir
=
"/home/geoint/M3_NFS/recordings/"
...
...
@@ -122,14 +122,12 @@ class Command(BaseCommand):
news
.
topic_raw
=
json
.
domps
(
topicst
)
# news.save()
objectsList
.
append
(
news
)
from
itertools
import
islice
batch_size
=
100
while
True
:
batch
=
list
(
islice
(
objectsList
,
batch_size
))
if
not
batch
:
break
News
.
objects
.
bulk_create
(
batch
,
batch_size
)
batch_size
=
100
while
True
:
batch
=
list
(
islice
(
objectsList
,
batch_size
))
if
not
batch
:
break
News
.
objects
.
bulk_create
(
batch
,
batch_size
)
except
ValueError
as
e
:
print
(
e
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment