Error in parser 'NOAA Parser'...urlopen error timed out

I have a HD12 with issues fetching weather. I'm on Firmware 4.0.1122

The default NOAA parser never successfully fetches. If i enable Forecast.io, it successfully downloads data from forecast.io, but I would like to use NOAA too. Any fix for NOAA not working?

Side note: the noaa.rainmachine.com must be a direct proxy of NOAA because it gives TLS errors because the url doesn't match the supplied cert. I wonder if that is part of the problem, at least.

Some others have reported periodic problems with NOAA on this forum. Mine is constant. NOAA never updates. If I directly query the weather.gov addresses listed in the log (not from the HD12, mind you), I get XML files with what looks like valid data. It definitely doesn't time out. I'm confused as to the cause.

What makes this even worse is that it seems like the whole device hangs while this timeout is occurring -- almost like it's single-threaded. So it gets periodically unresponsive and then starts working again. Maybe that's just a coincidence.

Dave

> logcat

I/sprinklerDaemonLinux( 78): Login Successful
D/dalvikvm( 466): GC_CONCURRENT freed 620K, 29% free 5739K/8052K, paused 4ms+5ms, total 57ms
I/rainmachine.sh( 77): 2019-09-18 11:46:17,719 - DEBUG - rmMachineDiag:148 - Network gateway (10.18.20.1) up on interface wlan0
I/rainmachine.sh( 77): 2019-09-18 11:46:17,807 - DEBUG - rmMachineDiag:164 - Wireless interface wlan0: up
D/dalvikvm( 466): GC_CONCURRENT freed 627K, 29% free 5728K/8052K, paused 4ms+5ms, total 57ms
I/rainmachine.sh( 77): 2019-09-18 11:47:17,725 - DEBUG - rmMachineDiag:148 - Network gateway (10.18.20.1) up on interface wlan0
I/rainmachine.sh( 77): 2019-09-18 11:47:17,847 - DEBUG - rmMachineDiag:164 - Wireless interface wlan0: up
I/rainmachine.sh( 77): 2019-09-18 11:47:19,021 - ERROR - rmParser:136 - *** Error in parser 'NOAA Parser' while downloading data from https://forecast.rainmachine.com/xml/sample_products/browser_interface/ndfdXMLclient.php?lat=28.4162972&lon=-81.2562284&product=time-series&begin=2019-09-18&Unit=e&maxt=maxt&mint=mint&temp=temp&qpf=qpf&dew=dew&pop12=pop12&wspd=wspd&rh=rh&maxrh=maxrh&minrh=minrh&token=px808345forc, error: <urlopen error timed out>
I/rainmachine.sh( 77): 2019-09-18 11:47:19,023 - INFO - noaa-parser:119 - Fetching Daily data from https://forecast.rainmachine.com/xml/sample_products/browser_interface/ndfdBrowserClientByDay.php
I/rainmachine.sh( 77): 2019-09-18 11:47:19,025 - DEBUG - rmParser:118 - Parser 'NOAA Parser': downloading from https://forecast.rainmachine.com/xml/sample_products/browser_interface/ndfdBrowserClientByDay.php?lat=28.4162972&lon=-81.2562284&startDate=2019-09-18&format=24+hourly&numDays=6&Unit=e&token=px808345forc
D/dalvikvm( 466): GC_CONCURRENT freed 601K, 29% free 5743K/8052K, paused 4ms+5ms, total 68ms
I/sprinklerDaemonLinux( 78): ProxyServerFD closed or error: [0x19]
I/rainmachine.sh( 77): 2019-09-18 11:48:17,681 - DEBUG - rmMachineDiag:148 - Network gateway (10.18.20.1) up on interface wlan0
I/rainmachine.sh( 77): 2019-09-18 11:48:19,735 - DEBUG - rmMachineDiag:164 - Wireless interface wlan0: up
I/sprinklerDaemonLinux( 78): Login Successful
D/dalvikvm( 466): GC_CONCURRENT freed 622K, 29% free 5736K/8052K, paused 5ms+6ms, total 58ms
I/rainmachine.sh( 77): 2019-09-18 11:49:17,726 - DEBUG - rmMachineDiag:148 - Network gateway (10.18.20.1) up on interface wlan0
I/rainmachine.sh( 77): 2019-09-18 11:49:17,798 - DEBUG - rmMachineDiag:164 - Wireless interface wlan0: up
I/rainmachine.sh( 77): 2019-09-18 11:49:19,090 - ERROR - rmParser:136 - *** Error in parser 'NOAA Parser' while downloading data from https://forecast.rainmachine.com/xml/sample_products/browser_interface/ndfdBrowserClientByDay.php?lat=28.4162972&lon=-81.2562284&startDate=2019-09-18&format=24+hourly&numDays=6&Unit=e&token=px808345forc, error: <urlopen error timed out>
I/rainmachine.sh( 77): 2019-09-18 11:49:19,092 - INFO - noaa-parser:115 - Fetching Hourly data from https://graphical.weather.gov/xml/sample_products/browser_interface/ndfdXMLclient.php
I/rainmachine.sh( 77): 2019-09-18 11:49:19,095 - DEBUG - rmParser:118 - Parser 'NOAA Parser': downloading from https://graphical.weather.gov/xml/sample_products/browser_interface/ndfdXMLclient.php?lat=28.4162972&lon=-81.2562284&product=time-series&begin=2019-09-18&Unit=e&maxt=maxt&mint=mint&temp=temp&qpf=qpf&dew=dew&pop12=pop12&wspd=wspd&rh=rh&maxrh=maxrh&minrh=minrh
D/dalvikvm( 466): GC_CONCURRENT freed 623K, 29% free 5728K/8052K, paused 4ms+6ms, total 57ms
I/rainmachine.sh( 77): 2019-09-18 11:50:17,681 - DEBUG - rmMachineDiag:148 - Network gateway (10.18.20.1) up on interface wlan0
I/rainmachine.sh( 77): 2019-09-18 11:50:17,757 - DEBUG - rmMachineDiag:164 - Wireless interface wlan0: up
I/rainmachine.sh( 77): 2019-09-18 11:50:19,103 - ERROR - rmParser:136 - *** Error in parser 'NOAA Parser' while downloading data from https://graphical.weather.gov/xml/sample_products/browser_interface/ndfdXMLclient.php?lat=28.4162972&lon=-81.2562284&product=time-series&begin=2019-09-18&Unit=e&maxt=maxt&mint=mint&temp=temp&qpf=qpf&dew=dew&pop12=pop12&wspd=wspd&rh=rh&maxrh=maxrh&minrh=minrh, error: <urlopen error timed out>
I/rainmachine.sh( 77): 2019-09-18 11:50:19,105 - INFO - noaa-parser:119 - Fetching Daily data from https://graphical.weather.gov/xml/sample_products/browser_interface/ndfdBrowserClientByDay.php
I/rainmachine.sh( 77): 2019-09-18 11:50:19,107 - DEBUG - rmParser:118 - Parser 'NOAA Parser': downloading from https://graphical.weather.gov/xml/sample_products/browser_interface/ndfdBrowserClientByDay.php?lat=28.4162972&lon=-81.2562284&startDate=2019-09-18&format=24+hourly&numDays=6&Unit=e

RainMachine Nicholas October 11, 2019 09:51

This looks like it's related to a local network condition (WIFI?) as the calls timeout. This will probably happen to other weather services. What I can suggest is to check WIFI signal from Settings > System > Network Tools.

BB October 11, 2019 17:28

I had time-out issues related to my router config and I was able isolate the issue by using SSH on my RainMachine Pro.

Once you get in, try pinging the weather server with escalating packet sizes using the ping -s parameter. I found mine would lose packets over 1200 bytes.

ping -s 1200 rainmachine.com

Also, you can carefully use the wget command to download various file sizes to confirm transfer speeds and any timeout issues.

For example, I used the following syntax to download a 5 MB test file. You can download from any valid source but don't download files that are larger than the available space on the RainMachine..

wget http://ipv4.download.thinkbroadband.com/5MB.zip

Once done testing, make sure to remove any downloaded files. Use ls to view a list of files and rm to remove files.

rm 5MB.zip

David Pankros October 12, 2019 14:13

@RainMachine Nicholas - I can see why you would think that and it would make sense, but it's not the case. The rain machine has a semi-dedicated AP (<10ft away) and a high gain antenna to ensure it gets a strong signal as I had problems in the past related to signal-strength because the signal needs to penetrate a cinderblock wall. Now, however, I've not seen any such problems. In fact, network tools shows everything in the green, except the HTTPS call to NOAA (FAIL). The WiFi signal strength is -30 dBm.

@BB I tried pings of different sizes up to my MTU (less overhead) and they all work. Trying the test file at think broadband failed immediately with a "HTTP/1.1 403 Forbidden". Now, there are no proxies on my local network but without a more detailed http trace it's hard to know for sure that the 403 is coming from them, even though it's likely the case. What I wouldn't do to be able to "curl -v" right now so I could at least see the header information. I tried a 16MB test file from another site and it downloaded fine, however. Wget doesn't allow https urls so I'm extremely limited with what I can try.

I'm no android master, though I'd say I'm very linux literate. Most of my goto network tools don't seem to be available so I feel like I have one hand tied behind my back here. Any suggestions on how to get better information?

BB October 14, 2019 17:31

Looks like you can eliminate issues with download speeds from the RainMachine then. I wouldn't worry about the forbidden error if you are able to wget from other sites successfully.

You could try running a continuous ping to the RainMachine from a device on your local network and log it to a file for a day or two. This could reveal short WiFi disconnects or other network issues you wouldn't normally notice.

RainMachine Nicholas October 15, 2019 08:14

Quite strange that all 3 servers are not reachable (forecast.rainmachine, noaa.rainmachine, weather.gov). RainMachine will keep retrying (with some random backoff).

Could you try to enable MET.NO parser to see if it works. The 2 parsers (NOAA, MET.NO) should run sequentially so if there would be a local network issue they might both fail.

How can we help?

Error in parser 'NOAA Parser'...urlopen error timed out

Comments

Didn't find what you were looking for?