Data News

Effective around 12:00 UTC 10 June the MHS and ATMS input to real-time IMERG suddenly became unavailable due to an unexpected change in NOAA protocols.  While PPS scrambles to remedy the issue, the data content of the Early and Late Runs may be reduced for the next several days, meaning lower Quality Index due to longer morphing of microwave estimates and greater contributions by IR.

Keywords:

Due to a correction to the GPM IMERG algorithm implemented by the GPM science team, PPS will retract and reprocess all IMERG V06A Final Run GPM and TRMM era data including GIS products as IMERG V06B starting on June 05, 2019.  If you have downloaded IMERG V06A Data previously, please discard this data and use the improved IMERG V06B products as they are produced and archived.

A damaged land/ocean mask file (specifically, a several-gridbox shift to the east and south) was discovered in IMERG V06A,which causes mis-identification of surface type along coasts in theKalman filter computation. While simple to correct, the change in the IMERG results requires shifting to a new sub-version. As of May 22, 2019, the IMERG NRT Early and Late Run files were given the corrected land/ocean mask file and labelled V06B.  The adjustment can be seen in the Early and Late data files starting with June 1, 2019 when the next Kalman statistics were computed.

As was done for V06A, PPS will start the V06B reprocessing with the GPM era, June 2014 - current available data.  This reprocessing will include the GIS products. Once the GPM era is completed, we will start the TRMM-era, June 2000 - May 2014. We will issue necessary update messages as our re-processing effort progresses. The schedule for completing all IMERG V06B processing is not currently known, but will need to reflect balancing the reprocessing with other production computing requirements.

The new V06B TRMM/GPM data products will be made available through PPS's "arthurhou" ftp archive:
ftp://arthurhou.pps.eosdis.nasa.gov/

and STORM (PPS's Online Data Ordering Interface):
https://storm.pps.eosdis.nasa.gov
after the products are produced and archived.

NASA requires that all science data users register in order to access these products.  If you haven't registered, please visit the PPS registration portal at:https://registration.pps.eosdis.nasa.gov/registration/

We apologize for any inconvenience this may have caused and thank you for your attention.  Please inform us if you have any questions or concerns.
 

Keywords:

All IMERG V06A Final products will be retracted later today.  

On Wednesday, June 5, PPS will start the V06B reprocessing beginning with the GPM era, June 2014 - current available data.  Once the GPM era is completed, PPS will start the TRMM-era, June 2000 - May 2014.

Due to capacity loads at PPS, there are no firm estimates as to how long this will take. 

V06A is being retracted due to a corrupt surface coverage file in the Kalman statistics computation.  

Please contact us for any questions.

Keywords:

A damaged land/ocean mask file (specifically, a several-gridbox shift to the east and south) has been discovered in IMERG V06A, which causes mis-identification of surface type along coasts in the Kalman filter computation.  While simple to correct, the change in the IMERG results requires shifting to a new sub-version.  As of May 22, the Early and Late Run files have the corrected land/ocean mask file and are labelled V06B.  The adjustment will be seen in the Early and Late data files starting June 1, when the next Kalman statistics are computed.  Final Run retrospective processing for V06B will begin shortly; more information will be forthcoming.

Keywords:

PPS will be updating GPM 1AGMI data from V05A to V05B today, Thursday May 09, 2019 because there was a minor bug in the algorithm.  Only 1AGMI will change versions.

The L1AGMI executable was previously not filling in a missing scan if there was an error in reading or processing the scan data from the instrument.  Nothing was being generated in the GMI 1A product in this case.  The bug fix was to fill in a missing scan and annotate this in the file header.


+-------+----------------+---------------------+-------+
| AlgId | ProductVersion | StopTime            | SeqNo |
+-------+----------------+---------------------+-------+
| 1AGMI | V05A           | 2019-05-09 12:28:13 | 29508 |
+-------+----------------+---------------------+-------+

Data will be updated to V05B starting with:

+-------+----------------+----------------------+-------+
| AlgId | ProductVersion | StartTime            | SeqNo |
+-------+----------------+----------------------+-------+
| 1AGMI | V05B           | 2019-05-09 12:28:14  | 29509 |
+-------+----------------+----------------------+-------+

PPS replaced one  1AGMI file for orbit 29457 (2019-05-06 04:13:43 ->
2019-05-06 05:46:18)  which was retro-processed as a V05B data product.

1A.GPM.GMI.COUNT2016.20190506-S041343-E054618.029457.V05A.HDF5 - V05A
1A.GPM.GMI.COUNT2016.20190506-S041343-E054618.029457.V05B.HDF5 - V05B
 

Keywords:

On 1 May 2019, at approximately 14 UTC, PPS will stop production of IMERG V05 in order to setup and install the new IMERG V06 code for production of early and late products.

This will require an extended period when no IMERG products will be produced or available for users. We estimate an extended period of IMERG unavailability that may last for 5 hours or more.

Upon resumption of IMERG production, V06 will start with data from 1 May
2019 hour 00 UTC. We will reestablish latency of early products to 4 hours, and late products to 14 hours, as soon as possible.

We will also start V06 retro-processing of IMERG early and late products back to the beginning of the GPM mission. These will be available on the server as they are produced.

Please contact us for any questions.
 

Keywords:

An error has been discovered in processing the initial batches of V06 IMERG Final Run months.  A design choice in the code ended up retaining microwave precipitation estimates in the latitude band 60°N-S when there is snow/ice on the surface, rather than masking out the estimates due to low performance in such cases.  [Masking for microwave retrievals over surface snow and ice outside that band is correct.]

All V06A Monthly and Half-hourly IMERG products are being retracted, as shown in this table (Encompassing all IMERG V06A data that had been reprocessed and archived -to date):

----------+----------------+---------------------+---------------------+------------+---------+--------------+ 

| DataType | ProductVersion | Start of Data       | End of Data # 
| Granules | # Empty | Total Size   |
+----------+----------------+---------------------+---------------------+------------+---------+--------------+ 

| 3IMERGHH | V06A           | 2014-06-01 00:00:00 | 2015-12-31 23:59:59
|      27792 |       0 |     273.23 G |
| 3IMERGM  | V06A           | 2014-06-01 00:00:00 | 2015-12-31 23:59:59
|         19 |       0 |       0.93 G |
+----------+----------------+---------------------+---------------------+------------+---------+--------------+ 


Replacements are anticipated to be released the week of March 25, and will continue to be named V06A since the retracted files are considered faulty.

If you have previously obtained any of the data listed above, please discard these and replace this data with the new data once this is available the week of March 25 or later.

We apologize for any confusion or inconvenience that this may have caused and appreciate your continued patience.
 

Keywords:

Starting  this week (Wednesday March 13, 2019 or soon after) PPS will commence GPM IMERG data reprocessing for IMERG V06.  PPS will start reprocessing with the GPM-era data and will make these products available as they are archived.

Thereafter, we will reprocess the TRMM-era data.  The first available products for the GPM-era will start with June 2014. TRMM-era products will span June 2000 - May 2014.   Earlier TRMM-era processing, 1998-01 to 2000-05, will proceed when all required input data have been provided.

We have attached the latest IMERG documentation for your convenience.

Developers and science users should use the latest PPS TKIO Toolkit Version 3.93 https://pps.gsfc.nasa.gov/gpmtoolkit.html
ftp://gpmweb2.pps.eosdis.nasa.gov/pub/PPStoolkit/GPM/tkio-3.93/

These TRMM/GPM data products will be made available through PPS's "arthurhou" ftp archive:
ftp://arthurhou.pps.eosdis.nasa.gov/
and STORM (PPS's Online Data Ordering Interface):
https://storm.pps.eosdis.nasa.gov
after these products are produced and archived.

Please consult the following PPS public web pages for complete
documentation:

https://pps.gsfc.nasa.gov/GPMprelimdocs.html
https://pps.gsfc.nasa.gov/atbd.html

NASA requires that all science data users register in order to access these products.   If you haven't registered, please visit the PPS registration portal at: 
https://registration.pps.eosdis.nasa.gov/registration/

Thank you for your attention.  Please inform us if you have any questions or concerns.
 

Keywords:

Starting early the week of March 04, 2019 or shortly after ; PPS will be doing a limited RETRO-processing of Level 1 - Level 3 F16 SSMIS as Version V05B for the period of April 2015 through January 2018.  Please see the table below for the specific products and dates affected.  
If you have previously obtained any of the data listed below, please discard these and replace this data with the retro-processed data as listed. 
+-------------------------+---------------------+---------------------+----------------+------------+ 
| DataType                | Start of Data       | End of Data         | ProductVersion | # Granules | 
+-------------------------+---------------------+---------------------+----------------+------------+ 
| 1CF16SSMIS              | 2015-04-24 00:24:57 | 2018-01-16 01:27:40 | V05A           |      14102 | 
| 2AGPROFF16SSMIS         | 2015-04-24 00:24:57 | 2018-01-16 01:27:40 | V05A           |      14102 | 
| 2AGPROFF16SSMIS_CLIM    | 2015-04-24 00:24:57 | 2018-01-16 01:27:40 | V05A           |      14102 | 
| 3GPROFF16SSMIS          | 2015-04-01 00:00:00 | 2018-01-31 23:59:59 | V05A           |         33 | 
| 3GPROFF16SSMIS_CLIM     | 2015-04-01 00:00:00 | 2018-01-31 23:59:59 | V05A           |         33 | 
| 3GPROFF16SSMIS_DAY      | 2015-04-24 00:00:00 | 2018-01-15 23:59:59 | V05A           |        998 | 
| 3GPROFF16SSMIS_DAY_CLIM | 2015-04-24 00:00:00 | 2018-01-15 23:59:59 | V05A           |        998 | 
+-------------------------+---------------------+---------------------+----------------+------------+ 

Due to a sensor data issue, the F16 SSMIS L1C product high frequency channels were flagged as bad and Tc values were set to missing starting with 2015-05-01 data for 150GHz and 2013-12-01 for the 183 channels. Later, the X-CAL team re-evaluated the data and found that these channels became usable again after 2015-08-26. In Sep 2017, PPS updated L1C code to stop the flagging of 150 and 183 channels in the F16 SSMIS L1C product and add warning flags to 91V channel (2015-04-24 to 2015-08-26) and 91H channel (2015-04-24 ongoing). However there was no retro-processing at that time. The purpose of this retro-processing is to put the F16 150 and 183 GHz channels data back to the SSMIS L1C product and to add warning flags to the 91 channels for the specified data period.

These TRMM/GPM data products will be made available through the PPS "arthurhou" ftp archive:
ftp://arthurhou.pps.eosdis.nasa.gov/ 
and STORM (PPS's Online Data Ordering Interface):
https://storm.pps.eosdis.nasa.gov
after these products are produced and archived.
NASA requires that all science data users register in order to access these products.   If you haven't registered, please visit the PPS registration portal at: https://registration.pps.eosdis.nasa.gov/registration/
 

Keywords:

PPS will be doing a full reprocessing of Level 2 - Level 3 PRPS MT1 SAPHIR data as V06A for release starting Wednesday March 06, 2019.  In addition to the regular data products there will be a Climatology product as with the current L2-L3 GPROF data products.  The following data will be reprocessed as V06A: 
+-----------------------------------------+-----------------+-------------------+ 
| DataType                                      |Start of Data | End of Data   | 
+-----------------------------------------+-----------------+-------------------+ 
| 2APRPSMT1SAPHIR                   | 2014-02-01  | 2018-12-15   | 
| 3PRPSMT1SAPHIR                     | 2014-02-01   | 2018-12-31  | 
| 3PRPSMT1SAPHIR_DAY            | 2014-02-01   | 2018-12-15  | 
| 2APRPSMT1SAPHIR_CLIM        | 2011-10-13  | 2018-12-15  | 
| 3PRPSMT1SAPHIR_DAY_CLIM | 2011-10-13   | 2018-12-15  | 
| 3PRPSMT1SAPHIR_CLIM          | 2011-10-13   | 2018-12-31  | 
+---------------------------------------- +-------------------+-----------------+ 

PRPS MT1 SAPHIR V06 represents an advance over the PRPS MT1 SAPHIR V05 retrievals through a larger (Long-term) observational database together with constraining the retrievals by the total  precipitable water and 2m temperature (similar to GPROF), resulting in an improvement in estimates in dry regions.
These TRMM/GPM data products will be made available through the PPS "arthurhou" ftp archive:
ftp://arthurhou.pps.eosdis.nasa.gov/ 
and STORM (PPS's Online Data Ordering Interface):
https://storm.pps.eosdis.nasa.gov
after these products are produced and archived.
NASA requires that all science data users register in order to access these products.   If you haven't registered, please visit the PPS registration portal at: https://registration.pps.eosdis.nasa.gov/registration/
 

Keywords:

Pages