diff options
| author | Mohammad Akhlaghi <mohammad@akhlaghi.org> | 2019-03-27 19:53:18 +0000 |
|---|---|---|
| committer | Mohammad Akhlaghi <mohammad@akhlaghi.org> | 2019-03-28 09:27:41 +0000 |
| commit | 98d31767a965ec75f4920b666f236cbb6baa91ab (patch) | |
| tree | be68dd523f434ad2138abf6f837447099fc240a7 /reproduce/src/make/download.mk | |
| parent | 356d998b87d93cc86dc44642ae95fed7478bc788 (diff) | |
flock is now built in configure, to allow serial downloads
Until now, we were using `flock' (file-lock) for downloading the input
datasets in series. But we couldn't do this when downloading the software
tarballs because `flock' wasn't yet available. Generally, unlike
processing, downloading is much better done in series than in parallel.
To enable serial downloads of the software also, with this commit we are
installing `flock' in the configure script (not in a Makefile). As a
result, besides `flock', we can also benefit from the other good features
of the `reproduce/src/bash/download-multi-try' script *(for example
attempting download again after some time).
Some GNU mirrors may have problems at the time of download, so with this
commit, we are using the main GNU FTP server for GNU programs.
Diffstat (limited to 'reproduce/src/make/download.mk')
| -rw-r--r-- | reproduce/src/make/download.mk | 3 |
1 files changed, 2 insertions, 1 deletions
diff --git a/reproduce/src/make/download.mk b/reproduce/src/make/download.mk index a1efde7..036332b 100644 --- a/reproduce/src/make/download.mk +++ b/reproduce/src/make/download.mk @@ -69,7 +69,8 @@ $(inputdatasets): $(indir)/%.fits: | $(indir) $(lockdir) ln -s $(INDIR)/$$origname $@ else touch $(lockdir)/download - $(downloadwrapper) wget $(lockdir)/download $$url/$$origname $@ + $(downloadwrapper) "wget --no-use-server-timestamps -O" \ + $(lockdir)/download $$url/$$origname $@ fi # Check the md5 sum to see if this is the proper dataset. |