WeeWX rain accumulation reporting differs from Netatmo rainfall reporting #12
Comments
|
Hi Franz, Weewx-netatmo driver collects the data from the Netatmo server by using the getstationsdata method provided by the Netatmo API. The behaviour of this method is weird. Indeed, as you said, summing up over one day the rain data reported by the /getstationsdata for each observation period you do not have the same amount of rain given directly by the station for the day (that, by the way is wrong as well but to a minor extent), usually you have a much lower value . The reason for this is that he station sends the rain data to the server every 10 minutes. Each data packet includes the report for 2 five minute observation periods but he /getstationdata method reports the rain for just one of these periods the other is simply dropped. You can see evidence of this in the picture below where I compare the data of my station downloaded from the netatmo.com website as an xls file (that are correct) with those reported by the /getstationsdata (on the right) where each second five minutes data are missed. As you noticed, the error is greater during heavy rain. Indeed, there is no error in some cases, e.g. when during the missed observation period we have no rain at all.
In conclusion, using weewx with our Netatmo weather station is currently impossible. I also understood how to fix the probelm but this would require to deeply modify Matthew Wall's driver and, unfortunately, my software developping skills are not strong enough for this. Regards |
|
Take a look at my answer in issue #18 and feel free to test it out. Regards Jonny |
|
Thanks Jonny!
I will test your version of the Weewx Netatmo driver as soon as possible
(maybe during next weekend when I will have some free time).
After I sent my comment, I better understood the issue and I realized that
using the API "getmeasure" (that I think it is what you did) in place of
the "getstationdata" was the way to fix the problem. As you said,
"getstationdata" just reports what happens during the last 5 minutes of
each 10 minutes observation period. So, depending on when it rains
"getstationdata" could report 0 mm even if it rains a lot or, if you are
lucky, the exact amount of rain, if it rains only during the last 5 minutes
of the 10 minute period.
The original Netatmo driver introduces other errors as well, because I
think it does not check for duplicated data that sometimes are reported by
the "getstationdata".
What it is really surprising me is that apparently a very small number of
people realized that there was an issue with the driver (or indeed with the
weird behavior of the Netatmo API). The issue is very bad for rain because
data has to be accumulated over a period of time, but exists also for the
other parameters that are measured by the station (temperature, pressure,
humidity, wind) because also for these parameters the original driver
misses one out of two measures (so you can miss max and min values, even if
in this case the error can be neglectable).
I will keep you informed about my tests
Best regards
Emilio
…On Mon, Mar 15, 2021 at 1:22 PM jkrasinger ***@***.***> wrote:
Take a look at my answer in issue #18
<#18> and feel free to
test it out.
Regards Jonny
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#12 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ARNIVJOOLKMLPOFPNW6HYQLTDX32DANCNFSM4IS4KM2A>
.
|
|
Hi Emilio, I'm really interested in your tests. I have only tested with weewx 3.9.2 (with python 2), but created the code and made native tests under Python 3. The code "should" work in all weewx Versions. You must use the new Configurations Parameters gm_device_id and gm_node_id in the netatmo section of weewx.conf on the same level as username and password. The cloud mode requires credentials:Best regards |
|
I will try it for sure! I am currently using my very (very) basic code
based on "getmeasure" (meteoappioclaudio.com) and I am missing Weewx that I
have used for years with my previous weather stations.
Take into account that my rain gauge is on the roof of my house and it is
not easy to go there for testing. So after installing the new driver I will
have to wait for rain...
Regards
Emilio
…On Mon, Mar 15, 2021 at 2:36 PM jkrasinger ***@***.***> wrote:
Hi Emilio,
very nice that you will try my code and keep me informed.
I'm really interested in your tests.
I have only tested with weewx 3.9.2 (with python 2), but created the code
and made native tests under Python 3. The code "should" work in all weewx
Versions.
You *must* use the new Configurations Parameters gm_device_id and
gm_node_id in the netatmo section of weewx.conf on the same level as
username and password.
The cloud mode requires credentials:
username = ***@***.***
password = password
client_id = <client id>
client_secret = <client secret>
gm_device_id = xx:xx:xx:xx:xx:xx <- MAC of Base-station
gm_node_id = yy:yy:yy:yy:yy:yy <- MAC of rain Module
Best regards
Jonny
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#12 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ARNIVJK6Z3PA4WJQC5WL67LTDYEOLANCNFSM4IS4KM2A>
.
|
|
Jonny. Thanks a lot, I need some time to set this up. I haven’t worked on it for more than a year. I'll let you know the results asap. I hope it's OK to test it with WeeWX version 3.9.2. Best regards |
|
Hi Franz,
it's definitely OK to test with 3.9.2. I'm currently also running this
Version.
And no hurry, it's nice to hear from you later.
Best regards
Jonny
Am 15.03.21 um 18:12 schrieb FranzStein:
…
Jonny. Thanks a lot,
I need some time to set this up. I haven’t worked on it for more than
a year. I'll let you know the results asap. I hope it's OK to test it
with WeeWX version 3.9.2.
Best regards
Franz
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#12 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AB7ILW3IVHNYWBHSCIZ7SKDTDYIUHANCNFSM4IS4KM2A>.
|
|
Hi Jonny, I updated the driver by following your installation instruction, which means download and install the driver -> stopping weewx -> modifying the weewx.conf file: Looking at the Netatmo configurations I found for the main module: and for the rain sensor: I added gm_device_id = 70:ee:50:27:6c:9c and gm_node_id = 70:ee:50:03:29:40 to the weewx.conf file. I chnaged nothing else. After starting weewx again, the following errors are reported: pi@raspberrypi:~ $ sudo /etc/init.d/weewx stop Not sure what's going wrong. Is there a need do delete the old driver first? I'm little bit out of this topic. It would be nice if you can help me out of this issue. Thanks and regards Franz |
|
Hi Franz,
i'm really sure, that you use the wrong MAC for your rain Sensor. Use debug=1 and take a look on one of the First Log Messages written by weewx-netatmo. This should be a list with all fetched Data from netatmo, but with fieldnames in the Form <Mac>.<moduleid>.<Sensor>. Find the Sensor for 'rain' and use the MAC in the fieldname for gm_node_id.
feel free to contact me again if the problem persists.
Regards Jonny
Pardon me for typing Errors, i've written this from my mobile
FranzStein ***@***.***> schrieb:
Hi Jonny,
I updated the driver by following your installation instruction, which
means download and install the driver -> stopping weewx -> modifying
the weewx.conf file:
Looking at the Netatmo configurations I found for the main module:
Modell: Innenmodul
MAC-Adresse: 70:ee:50:27:6c:9c
Firmware: 178
and for the rain sensor:
Modell: Regenmesser
Seriennummer: k032940
Firmware: 12
I added gm_device_id = 70:ee:50:27:6c:9c and gm_node_id =
70:ee:50:03:29:40 to the weewx.conf file. I chnaged nothing else.
After starting weewx again, the following errors are reported:
***@***.***:~ $ sudo /etc/init.d/weewx stop
[ ok ] Stopping weewx (via systemctl): weewx.service.
***@***.***:~ $ sudo nano /etc/weewx/weewx.conf
***@***.***:~ $ sudo /etc/init.d/weewx start
[ ok ] Starting weewx (via systemctl): weewx.service.
***@***.***:~ $ sudo tail -f /var/log/syslog
…Mar 16 17:53:01 raspberrypi weewx[25747]: restx: WOW: Posting not
enabled.
Mar 16 17:53:01 raspberrypi weewx[25747]: restx: AWEKAS: Posting not
enabled.
Mar 16 17:53:01 raspberrypi weewx[25747]: engine: Starting up weewx
version 3.9.2
Mar 16 17:53:01 raspberrypi weewx[25747]: engine: Starting main packet
loop.
Mar 16 17:53:02 raspberrypi weewx[25747]: netatmo: netatmo-client:
exception in netatmo-client: list index out of range
Mar 16 17:53:02 raspberrypi weewx[25747]: netatmo: netatmo-client:
exception in netatmo-client: list index out of range
Mar 16 17:53:02 raspberrypi weewx[25747]: netatmo: netatmo-client:
exception in netatmo-client: list index out of range
Mar 16 17:53:02 raspberrypi weewx[25747]: netatmo: netatmo-client:
exception in netatmo-client: list index out of range
Mar 16 17:53:02 raspberrypi weewx[25747]: netatmo: netatmo-client:
exception in netatmo-client: list index out of range
Mar 16 17:53:02 raspberrypi weewx[25747]: netatmo: netatmo-client:
failed to get data after 5 attempts
Not sure what's going wrong. Is there a need do delete the old driver
first? I'm little bit out of this topic. It would be nice if you can
help me out of this issue.
Thanks and regards
Franz
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or unsubscribe.
--
Diese Nachricht wurde von meinem Android-Mobiltelefon mit Squeaky Mail gesendet.
|
|
Hi Jonny, Thanks a lot. I have found the correct rain sensor MAC address (05:00:00:03:29:40) and WEEWX reporting is now working. I will monitor the rain data and let you know if there are still any issues. It's still cold here in Germany and more rainy days are forecasted. There is a good chance that I can report results soon. Regards Franz |
|
Hallo Franz
Sehr gute Neuigkeiten / Very good news
I'm really interested in your experience. There is a lot more to do in
my code (e.g. automatic detection of rain sensor MAC's, multiple rain
sensors, some more error checking, ...) and i have planned to do this in
the near future, but first i'm interested in the correct functionality
regarding the rain sensor.
Thank you for spending your time.
Liebe Grüße / Kind regards
Jonny
Am 17.03.21 um 12:43 schrieb FranzStein:
…
Hi Jonny,
Thanks a lot. I have found the correct rain sensor MAC address
(05:00:00:03:29:40) and WEEWX reporting is now working. I will monitor
the rain data and let you know if there are still any issues. It's
still cold here in Germany and more rainy days are forecasted. There
is a good chance that I can report results soon.
Regards
Franz
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#12 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AB7ILWY5XOOF5SUSMOIMK4LTEBTUXANCNFSM4IS4KM2A>.
|
|
Hello Jonny, Battery Status From the debug information it can be seen that the percent values are reported correctly. No hurry, but maybe you have a chance to look at this also. Thanks and regards Franz |
|
Hi Franz, Sorry for this, in the moment i will not check for the reason of the wrong battery state ... BTW: Within the next hour i will release the new code for the netatmo driver which includes the automatic detection of the rain Module, so there is no more need to specify the two additional parameters. They can be left in the configuration file and will be ignored (or you can remove them). Regards Jonny |
|
Hi Franz, The problem with the LOW Battery Status is easy to fix, you must change one line in the skins. If you use the "Seasons" skin, then you must change the File "skins/Seasons/sensors.inc" on line 11: Change "#if $x == 0" to (for example) "#if $x > 50", then you will see OK if the Battery percentage is greater then 50. Regards Jonny |
|
Hi Jonny, Rain was predicted. However, it's not raining till now at my home location. I will let you know about any results from the rain tests ASAP. Regards Franz |
|
Hi Franz,
No hurry and thanks for your time spent.
Also i'm Happy that i could help you.
Regards
Jonny
FranzStein ***@***.***> schrieb:
…Hi Jonny,
thanks a lot. I have updated my WeeWX installation to your new driver
version. No issues found. The battery status is also showing the
correct information now.
Rain was predicted. However, it's not raining till now at my home
location. I will let you know about any results from the rain tests
ASAP.
Regards
Franz
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or unsubscribe.
--
Diese Nachricht wurde von meinem Android-Mobiltelefon mit Squeaky Mail gesendet.
|
|
Hi Jonny, Everything is fine. First results are available now. We have had some snow in the early morning, which was melting away during the day. The rain summaries given on the different web interfaces this evening are as follows:
We have a perfect match for all three rain summaries. Please note that I'm not using WeeWX to send my weather data to Weather Underground. I'm occupied this interface to send the weather data to my OpenSprinkler weather service. Weather Underground is connected with my Netatmo weather station via the Meteoware Plus service. Regards |
|
Hi Franz,
Sounds very good. Hopefully it's usable for you now.
For me it's working also very well. If you are interested my PWS id is ILETAMPO21.
Viel Spaß und bis dann
Jonny
FranzStein ***@***.***> schrieb:
…Hi Jonny,
Everything is fine. First results are available now. We have had some
snow in the early morning, which was melting away during the day. The
rain summaries given on the different web interfaces this evening are
as follows:
Netatmo rain gauge (https://my.netatmo.com/app/station): 2.0 mm today
Weather Underground
(https://www.wunderground.com/dashboard/pws/IFRTH65): PRECIP ACCUM 2.00
mm
WeeWX Current Conditions (http://192.168.178.39/weewx/): Rain Today 2,0
mm
We have a perfect match for all three rain summaries.
Please note that I'm not using WeeWX to send my weather data to Weather
Underground. I'm occupied this interface to send the weather data to my
OpenSprinkler weather service. Weather Underground is connected with my
Netatmo weather station via the Meteoware Plus service.
Regards
Franz
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub, or unsubscribe.
--
Diese Nachricht wurde von meinem Android-Mobiltelefon mit Squeaky Mail gesendet.
|
I use WeeWX together with the WeeWX driver for Netatmo weather stations to control my OpenSprinkler garden watering system. Instead of sending the data to Wunderground the data is forwarded to the OpenSprinkler server process, which uses the same data format as Wunderground.
Additionally, I use Meteoware as the service to push the weather data to Wunderground. The Netatmo weather station and my.netatmo.com site is reporting correct rain accumulation data. Unfortunately, the rain totals reported by WeeWX differ from this and results in less rainfall data.
Below is an extract of the Meteoware data forwarded on August 18th to Wunderground:
There was about 0.1 mm rain falling at 1:40 in the morning followed by a heavy rainfall of 5.3 mm between 18:58 and 20:29 the same day. The total rainfall sums up to 5.4 mm on this day, which can be also found in the Netatmo reports.
If this is compared with the WeeWX Syslog extract between 18:56 and 20:31 on August 18th it can be seen that less rainfall is summarized:
Aug 18 18:56:06 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.749","dewptf":"64.3","humidity":"048","dateutc":"2019-08-18 16:55:00","dailyrainin":"0.01","winddir":"060","tempf":"86.4","windspeedmph":"0.6","windgustmph":"2.5","rainin":"0.00"}
Aug 18 19:01:08 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.749","dewptf":"64.3","humidity":"048","dateutc":"2019-08-18 17:00:00","dailyrainin":"0.01","winddir":"060","tempf":"86.4","windspeedmph":"0.6","windgustmph":"2.5","rainin":"0.00"}
Aug 18 19:06:09 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.804","dewptf":"63.8","humidity":"050","dateutc":"2019-08-18 17:05:00","dailyrainin":"0.02","winddir":"225","tempf":"84.6","windspeedmph":"1.2","windgustmph":"5.6","rainin":"0.01"}
Aug 18 19:11:10 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.804","dewptf":"63.8","humidity":"050","dateutc":"2019-08-18 17:10:00","dailyrainin":"0.03","winddir":"225","tempf":"84.6","windspeedmph":"1.2","windgustmph":"5.6","rainin":"0.02"}
Aug 18 19:16:10 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.795","dewptf":"64.8","humidity":"057","dateutc":"2019-08-18 17:15:00","dailyrainin":"0.04","winddir":"225","tempf":"81.5","windspeedmph":"3.7","windgustmph":"7.5","rainin":"0.03"}
Aug 18 19:21:12 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.795","dewptf":"64.8","humidity":"057","dateutc":"2019-08-18 17:20:00","dailyrainin":"0.05","winddir":"225","tempf":"81.5","windspeedmph":"3.7","windgustmph":"7.5","rainin":"0.04"}
Aug 18 19:26:12 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.793","dewptf":"64.3","humidity":"063","dateutc":"2019-08-18 17:25:00","dailyrainin":"0.05","winddir":"255","tempf":"77.9","windspeedmph":"3.7","windgustmph":"8.7","rainin":"0.04"}
Aug 18 19:31:14 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.793","dewptf":"64.3","humidity":"063","dateutc":"2019-08-18 17:30:00","dailyrainin":"0.06","winddir":"255","tempf":"77.9","windspeedmph":"3.7","windgustmph":"8.7","rainin":"0.05"}
Aug 18 19:36:14 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.814","dewptf":"64.2","humidity":"068","dateutc":"2019-08-18 17:35:00","dailyrainin":"0.06","winddir":"246","tempf":"75.6","windspeedmph":"3.1","windgustmph":"8.7","rainin":"0.05"}
Aug 18 19:41:16 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.814","dewptf":"64.2","humidity":"068","dateutc":"2019-08-18 17:40:00","dailyrainin":"0.06","winddir":"246","tempf":"75.6","windspeedmph":"3.1","windgustmph":"8.7","rainin":"0.05"}
Aug 18 19:46:16 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.814","dewptf":"63.4","humidity":"070","dateutc":"2019-08-18 17:45:00","dailyrainin":"0.06","winddir":"251","tempf":"73.8","windspeedmph":"3.7","windgustmph":"8.7","rainin":"0.05"}
Aug 18 19:51:18 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.814","dewptf":"63.4","humidity":"070","dateutc":"2019-08-18 17:50:00","dailyrainin":"0.06","winddir":"251","tempf":"73.8","windspeedmph":"3.7","windgustmph":"8.7","rainin":"0.05"}
Aug 18 19:56:18 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.826","dewptf":"62.8","humidity":"072","dateutc":"2019-08-18 17:55:00","dailyrainin":"0.06","winddir":"283","tempf":"72.3","windspeedmph":"3.7","windgustmph":"8.7","rainin":"0.05"}
Aug 18 20:01:20 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.826","dewptf":"62.8","humidity":"072","dateutc":"2019-08-18 18:00:00","dailyrainin":"0.06","winddir":"283","tempf":"72.3","windspeedmph":"3.7","windgustmph":"8.7","rainin":"0.05"}
Aug 18 20:06:20 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.826","dewptf":"62.2","humidity":"074","dateutc":"2019-08-18 18:05:00","dailyrainin":"0.06","winddir":"253","tempf":"70.9","windspeedmph":"3.1","windgustmph":"8.7","rainin":"0.04"}
Aug 18 20:16:22 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.825","dewptf":"61.9","humidity":"075","dateutc":"2019-08-18 18:15:00","dailyrainin":"0.06","winddir":"240","tempf":"70.2","windspeedmph":"3.1","windgustmph":"6.8","rainin":"0.02"}
Aug 18 20:21:24 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.825","dewptf":"61.9","humidity":"075","dateutc":"2019-08-18 18:20:00","dailyrainin":"0.06","winddir":"240","tempf":"70.2","windspeedmph":"3.1","windgustmph":"6.8","rainin":"0.01"}
Aug 18 20:26:24 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.829","dewptf":"61.9","humidity":"077","dateutc":"2019-08-18 18:25:00","dailyrainin":"0.06","winddir":"238","tempf":"69.4","windspeedmph":"3.1","windgustmph":"7.5","rainin":"0.00"}
Aug 18 20:31:26 raspberrypi npm[31824]: OpenSprinkler Weather Observation: {"action":"updateraw","ID":"anyText","PASSWORD":"anyText","softwaretype":"weewx-3.9.1","baromin":"29.829","dewptf":"61.9","humidity":"077","dateutc":"2019-08-18 18:30:00","dailyrainin":"0.06","winddir":"238","tempf":"69.4","windspeedmph":"3.1","windgustmph":"7.5","rainin":"0.00"}
The daily rainfall in inch sums up to only 0.06 inch = 1.5 mm for this day, which seems to be not Ok!
I have seen this error mostly if there is a heavy rainfall in a short period of time. Any idea what goes wrong or need to be changed! A correct total rainfall reporting is very important for me, as this data will be used for calculating the time the sprinkler will be running.
The text was updated successfully, but these errors were encountered: