Changes between Initial Version and Version 1 of logJMD

Timestamp:

02/10/14 11:27:44 (10 years ago)

Author:

niles

Comment:

--

logJMD

@@ +1 @@
+
+= JMD Log Files =
+
+As already discussed, a JMD log file will have a name similar to "2014_02_10.NSO.stderrout.log" and will log successful downloads with lines like :
+
+{{{
+Feb 10, 2014 1:12:38 AM org.vso.jmd.Downloader.SCPDownloader call INFO: Th ID:[9254]; SU:[528482910]; RN:[131877503];[aia.lev1];[MIRROR]; Sz:[11275255]; STP:[DONE]; ST:[DONE] [611.72174KB/s] [SAO]
+}}}
+
+Failures will be recorded with lines like :
+
+{{{
+Feb 10, 2014 12:07:25 AM org.vso.jmd.Downloader.SCPDownloader call INFO: Th ID:[9235]; SU:[528417849]; RN:[131843041];[aia.lev1];[MIRROR]; Sz:[7626390]; STP:[SCP]; ST:[FAIL] [N/A] [JSOC]
+}}}
+
+Thus, a simple failure and success counts can be achieved with :
+
+{{{
+grep FAIL 2014_02_10.NSO.stderrout.log | wc -l
+grep DONE 2014_02_10.NSO.stderrout.log | wc -l
+}}}
+
+However, it may be more useful to break the failure/success counts down by site, with a bash script like so :
+
+{{{
+jmdLogDir=/my/jmd/log/dir
+jmdLogFile=`/bin/ls -C1 $jmdLogDir/*.stderrout.log | sort | tail -2 | head -1`
+echo Yesterday\'s JMD downloads according to $jmdLogFile
+grep '\[DONE\]' $jmdLogFile | cut -d\; -f8 | cut -d" " -f4 | sort | uniq -c
+echo Yesterday\'s failed JMD downloads :
+grep '\[FAIL\]' $jmdLogFile | cut -d\; -f8 | cut -d" " -f4 | sort | uniq -c
+echo
+}}}
+
+which will generate output similar to this :
+
+{{{
+Yesterday's JMD downloads according to /opt/JMD/log/2014_02_04.NSO.stderrout.log
+  66564 [JSOC]
+  31356 [SAO]
+Yesterday's failed JMD downloads :
+      1 [JSOC]
+
+}}}