How can we help?


'DATA IN THE PAST' Log Entries

Comments

8 comments

  • Avatar
    GHammer

    This seems to be related to the WeatherUnderground service.

    I disabled WU and no longer have the Data In The Past log entries.

     

  • Avatar
    Nicholas

    All observed data is in the past, so that's not an error.

  • Avatar
    GHammer

    If all data is in the past, why did the entries stop when I disabled WU?

    Also, it says it is adding the data with the 00:00 timestamp.

    If this isn't what's going on then it is extremely confusing because it sure does not do the same for all readings.

     

  • Avatar
    Nicholas

    "Data in the past" come from WUnderground, NetAtmo etc and represent  "yesterday" observed data. These are saved with 00:00 as time because the hour and minute dont really matter. Other kind of data is forecast which is "data in the future".  This is also explained here: https://support.rainmachine.com/hc/en-us/articles/360011755813-RainMachine-Weather-Engine

  • Avatar
    GHammer

    Makes little sense that WU is old/yesterday's data.

    13:35:38,667 - INFO  - wunderground-parser:77 - WUnderground: station data retrieved for KMAHOLYO15

    Then 3 & 4 hours later, same log entries.

    2018-10-22 16:55:31,932 - INFO  - rmHTTPResourceApi4Parser:415 - Local Weather API push: 1540241700.0: {'maxtemp': 9.7777777777777791, 'temperature': 8.2564102564102471, 'dewpoint': 0.33542225385155511, 'maxrh': 57.384615384615397, 'rain': 0.0, 'pressure': 102.3470698153087, 'timestamp': 1540241700.0, 'mintemp': -1.653846153846159, 'et': 0.0044095188885508114, 'wind': 1.3892627688417757}
    2018-10-22 17:50:23,934 - INFO  - rmMixer:123 - *** DATA IN THE PAST: 2018-10-21 00:00:00
    2018-10-22 17:50:23,948 - INFO  - rmMixer:124 - *** Received data: ('2018-10-21 00:00:00', temp=3.9/1, minTemp=None/0, maxTemp=None/0, rh=67/1, minRh=None/0, maxRh=None/0, wind=0.56000000000000012/1, solarRad=None/0, skyCover=None/0, rain=1.3/1, et0=None/0, pop=None/0, qpf=None/0, condition=None/0, pressure=101.35/1, dewPoint=-0.8/1, userData=None, minTemp=-0.5/0, maxTemp=8.4/0, minRH=38/0, maxRH=97/0, et0cal=None, et0final=None)
    2018-10-22 17:50:23,990 - INFO  - rmMixer:131 - *** Added Existing data: '2018-10-21 00:00:00', temp=3.91/1, minTemp=None/0, maxTemp=None/0, rh=66/1, minRh=None/0, maxRh=None/0, wind=0.24/1, solarRad=None/0, skyCover=None/0, rain=1.3/1, et0=None/0, pop=12/1, qpf=0.63/1, condition=1/1, pressure=101.51/1, dewPoint=-0.8/1, userData=None, minTemp=-0.5/1, maxTemp=8.4/1, minRH=38/1, maxRH=96/1, et0cal=1.4209495787106201, et0final=1.42
    2018-10-22 17:55:31,940 - INFO  - rmHTTPResourceApi4Parser:415 - Local Weather API push: 1540245300.0: {'maxtemp': 9.7777777777777791, 'temperature': 7.6025641025641024, 'dewpoint': 0.72107889092603016, 'maxrh': 61.692307692307687, 'rain': 0.0, 'pressure': 102.39656318070678, 'timestamp': 1540245300.0, 'mintemp': -1.653846153846159, 'et': 0.0022031338203158373, 'wind': 0.20632615378838253}
    2018-10-22 18:50:42,720 - INFO  - rmMixer:123 - *** DATA IN THE PAST: 2018-10-21 00:00:00

     

    I see nothing about WU, only local weather.

    The way I understand what you say is that no matter how often you get data from WU or locally, you record it as 00:00.
    When I disabled the WU source, the data in the past entries stopped. Local is still enabled.

     

    If you are indeed only recording yesterday's weather, why not pull the weather once, record it once, and be done.
    DATA IN THE PAST looks like it wants to alert me to something unusual as it shouts and is infrequent.

     

  • Avatar
    Nicholas

    To be clear DATA IN THE PAST comes from a parser that sends observed daily data. It might be redundant to have it get it multiple times per day but that's how it works right now

    as for WU for example we also get forecast at the same run.

    Local Push from WeeWX has timestamp at the date of the "push" happened.

     

  • Avatar
    GHammer

    Let's revisit this. On firmware 4.0.975

    I do have a local push source and it works fine.

    The DATA IN THE PAST is not consistent. Meaning sometimes it is marked that way, sometimes it is not. Especially around 00:00.

    It says it is adding data. If it is a once per day thing, why add data for every measurement? Why would data once per day be helpful? Which observation do you decide is 'the' one?

    2019-01-22 00:05:32,431 - INFO  - rmHTTPResourceApi4Parser:416 - Local Weather API push: 1548133500: {'maxtemp': -16.11111111111111, 'temperature': -16.464285714285716, 'dewpoint': -24.882479474075678, 'maxrh': 48.0, 'rain': 0.0, 'pressure': 103.39858220691885, 'timestamp': 1548133500.0, 'mintemp': -16.61111111111111, 'et': 0.00058026573713407373, 'wind': 0.39115999989047527}
    2019-01-22 00:10:40,376 - INFO  - rmMixer:123 - *** DATA IN THE PAST: 2019-01-21 00:00:00
    2019-01-22 00:10:40,393 - INFO  - rmMixer:124 - *** Received data: ('2019-01-21 00:00:00', temp=-355.56999999999994/21, minTemp=None/0, maxTemp=None/0, rh=45/1, minRh=None/0, maxRh=None/0, wind=105.98999999999997/21, solarRad=None/0, skyCover=None/0, rain=None/0, et0=None/0, pop=0/1, qpf=0/20, condition=None/0, pressure=None/0, dewPoint=-493.33999999999988/21, userData=None, minTemp=-18.89/0, maxTemp=-14.44/0, minRH=45/0, maxRH=45/0, et0cal=None, et0final=None)
    2019-01-22 00:10:40,442 - INFO  - rmMixer:131 - *** Added Existing data: '2019-01-21 00:00:00', temp=-16.91/1, minTemp=None/0, maxTemp=None/0, rh=45/1, minRh=None/0, maxRh=None/0, wind=1.956/1, solarRad=None/0, skyCover=None/0, rain=0/1, et0=None/0, pop=0/1, qpf=0/1, condition=24/1, pressure=103.29000000000001/1, dewPoint=-23.57/1, userData=None, minTemp=-19.72/1, maxTemp=-12.83/1, minRH=45/1, maxRH=51.8/1, et0cal=0.44048431142147315, et0final=0.44
    2019-01-22 01:05:32,380 - INFO  - rmHTTPResourceApi4Parser:416 - Local Weather API push: 1548137100: {'maxtemp': -16.11111111111111, 'temperature': -17.383141762452111, 'dewpoint': -24.288162691744477, 'maxrh': 54.724137931034482, 'rain': 0.0, 'pressure': 103.49412086795524, 'timestamp': 1548137100.0, 'mintemp': -17.383141762452111, 'et': 0.00026866405818371576, 'wind': 0.68443365498077273}
    2019-01-22 01:11:02,207 - INFO  - rmMixer:123 - *** DATA IN THE PAST: 2019-01-21 00:00:00
    2019-01-22 01:11:02,220 - INFO  - rmMixer:124 - *** Received data: ('2019-01-21 00:00:00', temp=-355.56999999999994/21, minTemp=None/0, maxTemp=None/0, rh=45/1, minRh=None/0, maxRh=None/0, wind=105.98999999999997/21, solarRad=None/0, skyCover=None/0, rain=None/0, et0=None/0, pop=0/1, qpf=0/20, condition=None/0, pressure=None/0, dewPoint=-493.33999999999988/21, userData=None, minTemp=-18.89/0, maxTemp=-14.44/0, minRH=45/0, maxRH=45/0, et0cal=None, et0final=None)
    2019-01-22 01:11:02,277 - INFO  - rmMixer:131 - *** Added Existing data: '2019-01-21 00:00:00', temp=-16.93/1, minTemp=None/0, maxTemp=None/0, rh=45/1, minRh=None/0, maxRh=None/0, wind=1.9640000000000003/1, solarRad=None/0, skyCover=None/0, rain=0/1, et0=None/0, pop=0/1, qpf=0/1, condition=24/1, pressure=103.29000000000001/1, dewPoint=-23.5/1, userData=None, minTemp=-19.31/1, maxTemp=-13.64/1, minRH=45/1, maxRH=48.4/1, et0cal=0.43832489459410363, et0final=0.44
    2019-01-22 01:34:54,530 - INFO  - rmThreadWatcher:407 - **  Automatic Update: Starting update check as interval to next watering program is bigger than 3600
    2019-01-22 01:34:55,255 - INFO  - rmMainManager:442 - ** Automatic Update: No updates available
    2019-01-22 02:05:32,368 - INFO  - rmHTTPResourceApi4Parser:416 - Local Weather API push: 1548140700: {'maxtemp': -15.277777777777779, 'temperature': -15.277777777777779, 'dewpoint': -23.437312593014148, 'maxrh': 49.51724137931034, 'rain': 0.0, 'pressure': 103.59231875991313, 'timestamp': 1548140700.0, 'mintemp': -17.383141762452111, 'et': 0.00084664136786236107, 'wind': 1.6185931029950696}
    2019-01-22 02:11:02,520 - INFO  - rmMixer:123 - *** DATA IN THE PAST: 2019-01-21 00:00:00
    2019-01-22 02:11:02,563 - INFO  - rmMixer:124 - *** Received data: ('2019-01-21 00:00:00', temp=-355.56999999999994/21, minTemp=None/0, maxTemp=None/0, rh=45/1, minRh=None/0, maxRh=None/0, wind=105.98999999999997/21, solarRad=None/0, skyCover=None/0, rain=None/0, et0=None/0, pop=0/1, qpf=0/20, condition=None/0, pressure=None/0, dewPoint=-493.33999999999988/21, userData=None, minTemp=-18.89/0, maxTemp=-14.44/0, minRH=45/0, maxRH=45/0, et0cal=None, et0final=None)
    2019-01-22 02:11:02,737 - INFO  - rmMixer:131 - *** Added Existing data: '2019-01-21 00:00:00', temp=-16.93/1, minTemp=None/0, maxTemp=None/0, rh=45/1, minRh=None/0, maxRh=None/0, wind=1.9640000000000003/1, solarRad=None/0, skyCover=None/0, rain=0/1, et0=None/0, pop=0/1, qpf=0/1, condition=24/1, pressure=103.29000000000001/1, dewPoint=-23.489999999999997/1, userData=None, minTemp=-19.1/1, maxTemp=-14.04/1, minRH=45/1, maxRH=46.7/1, et0cal=0.43800965814917296, et0final=0.44
    2019-01-22 02:35:17,908 - INFO  - noaa-parser:83 - Fetching Hourly data from https://noaa.rainmachine.com/xml/sample_products/browser_interface/ndfdXMLclient.php
    2019-01-22 02:35:22,729 - INFO  - noaa-parser:87 - Fetching Daily data from https://noaa.rainmachine.com/xml/sample_products/browser_interface/ndfdBrowserClientByDay.php 
    2019-01-22 03:05:32,353 - INFO  - rmHTTPResourceApi4Parser:416 - Local Weather API push: 1548144300: {'maxtemp': -15.277777777777779, 'temperature': -15.722222222222221, 'dewpoint': -23.258895581155443, 'maxrh': 52.206896551724136, 'rain': 0.0, 'pressure': 103.64790915561713, 'timestamp': 1548144300.0, 'mintemp': -17.383141762452111, 'et': 0.00068704879209294999, 'wind': 1.1684700686383449}
    2019-01-22 04:05:32,320 - INFO  - rmHTTPResourceApi4Parser:416 - Local Weather API push: 1548147900: {'maxtemp': -15.277777777777779, 'temperature': -15.542145593869734, 'dewpoint': -22.83412144068484, 'maxrh': 53.413793103448278, 'rain': 0.0, 'pressure': 103.75778823082113, 'timestamp': 1548147900.0, 'mintemp': -17.383141762452111, 'et': 0.00048936436861210269, 'wind': 1.2501704824085735}
    2019-01-22 05:05:32,204 - INFO  - rmHTTPResourceApi4Parser:416 - Local Weather API push: 1548151500: {'maxtemp': -15.277777777777779, 'temperature': -17.080459770114946, 'dewpoint': -22.631549747540224, 'maxrh': 61.862068965517235, 'rain': 0.0, 'pressure': 103.8872701667517, 'timestamp': 1548151500.0, 'mintemp': -17.383141762452111, 'et': 8.129404138110019e-05, 'wind': 0.72451310324541211}
    2019-01-22 06:05:32,328 - INFO  - rmHTTPResourceApi4Parser:416 - Local Weather API push: 1548155100: {'maxtemp': -15.277777777777779, 'temperature': -15.446360153256708, 'dewpoint': -23.068387348013693, 'maxrh': 51.896551724137932, 'rain': 0.0, 'pressure': 104.0528387082348, 'timestamp': 1548155100.0, 'mintemp': -17.495884773662552, 'et': 0.00039649385988895541, 'wind': 1.6463404133321285}
    2019-01-22 07:05:32,227 - INFO  - rmHTTPResourceApi4Parser:416 - Local Weather API push: 1548158700: {'maxtemp': -15.240079365079367, 'temperature': -16.0, 'dewpoint': -23.040248467632052, 'maxrh': 54.482758620689654, 'rain': 0.0, 'pressure': 104.19640047975916, 'timestamp': 1548158700.0, 'mintemp': -17.495884773662552, 'et': 0.00061581092924227357, 'wind': 1.4043222065033418}
    2019-01-22 08:05:32,270 - INFO  - rmHTTPResourceApi4Parser:416 - Local Weather API push: 1548162300: {'maxtemp': -14.88888888888889, 'temperature': -14.88888888888889, 'dewpoint': -23.660302609748098, 'maxrh': 47.0, 'rain': 0.0, 'pressure': 104.27234497459681, 'timestamp': 1548162300.0, 'mintemp': -17.495884773662552, 'et': 0.001437958664517386, 'wind': 2.8595144819579566}
    

     

  • Avatar
    Nicholas

    The last one is considered by RainMachine. You could just feed it once per day (since it's for yesterday data) with same results in irrigation maybe less informative in UI. As for 'data in the past' I see:

    2019-01-22 00:10:40,442 - INFO  - rmMixer:131 - *** Added Existing data: '2019-01-21 00:00:00'

    So your device date is 01-22 and data is for 01-21 so it is in the past. 

Please sign in to leave a comment.