Blogs » Data Distribution Issues

Data Distribution Issues

Contains a listing of each of the separate/numbered issues that is brought up in the data distribution working group.

Find:
Published by ksterne at Fri., July 13, 2018 10:02 AM EDT

See below that there was a file transfer issue with the Longyearbyen data that has been corrected. The list of the corrected files can be found below. Please remove these files from your local repositories and download the corrected versions from the BAS mirror.

Cheers,

-Kevin S.

20180620.2201.00.lyr.rawacf.bz2
20180621.2201.00.lyr.rawacf.bz2
20180622.2201.00.lyr.rawacf.bz2
20180623.2201.00.lyr.rawacf.bz2
20180624.2201.00.lyr.rawacf.bz2
20180625.2201.00.lyr.rawacf.bz2
20180626.2201.00.lyr.rawacf.bz2
20180627.2201.00.lyr.rawacf.bz2
20180628.2201.00.lyr.rawacf.bz2
20180629.2201.00.lyr.rawacf.bz2
20180630.2201.00.lyr.rawacf.bz2
20180701.2201.00.lyr.rawacf.bz2
20180702.2201.00.lyr.rawacf.bz2
20180703.2201.00.lyr.rawacf.bz2
20180704.2201.00.lyr.rawacf.bz2
20180705.2201.00.lyr.rawacf.bz2
20180706.2201.00.lyr.rawacf.bz2
20180707.2201.00.lyr.rawacf.bz2
20180708.2201.00.lyr.rawacf.bz2

Action Items
□ Remove versions of this file that were downloaded prior to or on 20180710
□ Download new versions from BAS mirror
Published by ksterne at Fri., Mar. 09, 2018 01:48 PM EST
Hello DDWG,

We've recently checked all rawacf files on the mirror. While dmap parsing these files, they are checked for integrity.
The following files attached have corrupted size fields for data buffers, which would lead to out of bounds memory access, among other errors of similar severity.
We've blacklisted them here and are removing them from the public facing directories of the mirror. Please do the same with your repositories, as you cannot be certain about the data in these files.

Regards,
Kevin Krieger


Action Items
□ Check your local copy for valid version
□ Blacklist these files from mirrors
□ Remove them from local storage if necessary

Supplemental Materials
files_to_remove.txt

Published by ksterne at Fri., Mar. 09, 2018 01:47 PM EST
Published by ksterne at Fri., Mar. 09, 2018 01:46 PM EST
Published by ksterne at Fri., Mar. 09, 2018 01:45 PM EST
Hello all,

I've identified a Stokkseyri rawacf file which produces segmentation faults when trying to process with make_fit. Keith Kotyk has also examined this file and found that some kind of corruption causes the dmap routines to read past the file boundaries (sorry if I butchered your explanation Keith). The file in question is

20160202.0201.00.sto.rawacf.bz2

I suggest that we blacklist this file immediately on both data mirrors to remove it from the general distribution.

Cheers,
Evan

Action Items
□ Blacklist this file from the mirrors (removed from USask's Globus repo 20170720)
□ Remove these from local repositories and/or distribution
Published by ksterne at Fri., Mar. 09, 2018 01:44 PM EST
Published by ksterne at Fri., Mar. 09, 2018 01:43 PM EST
Published by ksterne at Fri., Mar. 09, 2018 01:42 PM EST
Published by ksterne at Fri., Mar. 09, 2018 01:41 PM EST
Published by ksterne at Fri., Mar. 09, 2018 01:40 PM EST
Page: 1/3 Next Page Last Page
1 2 3