Blogs » Data Distribution Issues

Data Distribution Issues

Contains a listing of each of the separate/numbered issues that is brought up in the data distribution working group.

Find:
Published by ksterne at Mon., Feb. 17, 2020 04:42 PM EST
Sorry this e-mail is a little bit late, but hopefully not too much of this data has been ingested to cause problems. At our Kapuskasing site (kap) we had some power outage issues that caused the data to record strangely. So there are a few days worth of files that need to be removed from distribution as seen in the attached text file. Basically these are anything between 20191208.17* and 20191210.08*.

Cheers,
-Kevin Sterne

Action Items:
□ Remove kap files in the period defined above or in the text file.
□ Reprocess any secondary or higher level data products.

Supplemental Material:
kap_powerout_201912.txt
Published by ksterne at Fri., Jan. 24, 2020 12:51 PM EST
Hello DDWG,

We just arrived back in Saskatoon after installing the new Borealis
system at the Clyde River SuperDARN. We inadvertently let the resulting
Borealis RAWACF files with our naming convention onto the Globus mirror.
They've now been removed (as of 10 minutes ago).

Sorry about any inconvenience this may cause you, they will not be
placed on the mirror again until a resolution is found/agreement is made
upon the naming convention. See attached for the list of files removed.

Regards,
Kevin Krieger

Action Items:
□ Remove mid-January 2020 cly rawacf files.
□ Remove any secondardy data products from these rawacf files.

Supplemental Material:
cly_borealis_202001.txt

Published by ksterne at Fri., Jan. 24, 2020 08:51 AM EST
Published by ksterne at Tue., Oct. 22, 2019 04:28 PM EDT
I've been in contact with John Devlin to bring up a file issue with the Buckland Park radar. There's a file (20190729.0400.00.bpk.rawacf*) that has likely on the mirrors (sorry for not checking here before hand) that needs to be removed. This file has some timing issues where the timestamps for the records start a few hours later than the 04 UTC in the filename. I came across this originally as this file was processing into fitacf and fitex files, but breaking during the fitacf3 processing.

John Devlin has noted to throw this file out as it's likely due to an error in the python ROS at the Buckland Park radar. It is possible there are other files around this one that have inconsistent filename - content times, but I have not looked at this closer. Something to come back to or someone else could look at on this list. Again, motivation for this file is an error when processing into fitacf3 (even though this is a non-standard file type).

-Kevin S.

Action Items:
□ Remove 20190729.0400.00.bpk.rawacf* file from local archives
□ Remove any fit-level data products that may contain erroneous data
□ Reprocess grid and higher data products based on this file
□ Search for other files in this time that may have errors.

Published by ksterne at Tue., Oct. 22, 2019 04:27 PM EDT
Published by ksterne at Tue., Oct. 22, 2019 04:26 PM EDT
Published by ksterne at Tue., Oct. 22, 2019 04:25 PM EDT
Published by ksterne at Tue., Oct. 22, 2019 04:24 PM EDT
Published by ksterne at Tue., Oct. 22, 2019 04:23 PM EDT
Published by ksterne at Tue., Oct. 22, 2019 04:22 PM EDT
Page: 1/4 Next Page Last Page
1 2 3 4