{"id":583,"date":"2022-02-27T14:35:32","date_gmt":"2022-02-27T14:35:32","guid":{"rendered":"https:\/\/www.dabbler.dk\/?p=583"},"modified":"2022-02-28T07:20:38","modified_gmt":"2022-02-28T07:20:38","slug":"guest-writer-echelon-nes-smart-meters-nes-echelon-electrical-meter-connect-to-mqtt-home-assistant-via-ir","status":"publish","type":"post","link":"https:\/\/www.dabbler.dk\/index.php\/2022\/02\/27\/guest-writer-echelon-nes-smart-meters-nes-echelon-electrical-meter-connect-to-mqtt-home-assistant-via-ir\/","title":{"rendered":"(Guest writer) Echelon\/NES Smart Meters \u2013 NES\/ECHELON electrical meter connect to MQTT (Home Assistant) via IR"},"content":{"rendered":"\n

This is another bonus entry on our blog in the Echelon\/NES Smart Meters series. As we have mentioned before, it is sometimes hard to find time besides our regular jobs to dabble with this project. We have had a lot of interest in using the IR (Infrared) port on the Echelon\/NES Smart Meters, and there have been (at least with N1<\/a>) some confusion about if it was encrypted or not.<\/p>\n\n\n\n

We know that someone at Sommerhack 2021<\/a> had been told by N1 that they should be able to use the IR port and that the key was the same as the MBK used for the MEP communication. We have not tried that ourselves as we have chosen to focus our limited time on the MEP integration. And to our knowledge – nobody else have tried the IR approach – that is – until now :-).<\/p>\n\n\n\n

Our fellow tinkere Ulrik was faced with the challenge that his power supplying company Konstant<\/a>, does not allow him to use the MEP-port on his Echelon meter. They are simply following another approach compared to N1, and suggests that their customers should use the IR-port.<\/p>\n\n\n\n

Overall\/political speaking this is actually really good news. Because if N1 can allow us to use the MEP port in a safe way, why should Konstant be against it for security reasons? Why should they not agree to allow it sometime in the future if they are pushed?
Also – if Konstant can allow their customers to use the IR port in a safe way, why should N1 be against it for security reasons? Why should they not agree to allow it sometime in the future (if not already?) if we push them?<\/p>\n\n\n\n

Some have been dreaming of being able to interface with the Echelon\/NES meters for years – but it was not possible due to a lot of “red tape”. Maybe we now have or will get TWO separate interfaces for interfacing with Echelon\/NES Meters?<\/p>\n\n\n\n

Enough dabbling with words from dabbler.dk – let’s hand over this scene to Ulrik and let us hear what he was actually able to do with the IR port:<\/p>\n\n\n\n

\n\n\n\n

First of all, I would like to say thank (and sorry) to Gert and Graves for letting me \u2018spam\u2019 them with my thoughts, questions and discoveries. And of cause for helping me out from time to time :-).<\/p>\n\n\n\n

INFO:<\/strong>
My name is Ulrik and I work as an Automation technician. I started out as an electrician and was fascinated by all the technical stuff you could do. I have around 30 Years of technical background. I build my own house in year 2000 where I put in a PLC to control the house. All lightning, heating, ventilation and alarmsystem is run from that.
Well… Back on the track\u2026 I started out collecting the pulses from my main meter by using the S0 pulses. Worked great, until I got solarpanels installed and the meter now send out pulses whenever a watt was produced or consumed, so not that usefull :-(. Then I started looking at other ways and stumbled over a lot of options, among this was the IR port. So here\u2019s a story of how I got this to work :-).
I have a NES 83334 meter. I also use Home Assistant.<\/p>\n\n\n\n

I have very little knowledge of Python and NODE RED, so ‘Google was my friend’ \ud83d\ude42
I also know that this setup could be much more \u2018smart\u2019. But for now, it just might get people started to get data from the meters \ud83d\ude09<\/p>\n\n\n\n

My supply area is KONSTANT<\/a> and they will send you the decryptkey if you contact them at info@konstant.dk<\/a><\/p>\n\n\n\n

They also send me a draft version of Optical Port Programmer\u2019s Guide with some info tables in the meter.<\/p>\n\n\n\n

KONSTANT also told me that the meters they are using (ECHELON \/ NES) have the MEP port disabled<\/strong>, so I was unable to use that. So I went the optical IR eye way\u2026<\/p>\n\n\n\n

Communication parameter that I use:
9600, 8, 1, none<\/p>\n\n\n\n

LINKS:<\/strong>
Install a RAM disk (to prevent destroying the SD card.)
https:\/\/www.hellojona.com\/2017\/06\/create-a-ram-disk-tmpfs-in-raspberry-pi-3\/<\/a><\/p>\n\n\n\n

ANSI C1218 protocol description:
https:\/\/kupdf.net\/download\/ansi-c1218_598ceccadc0d606c4b300d1a_pdf<\/a><\/p>\n\n\n\n

ANSI C1219 Protocol description:
https:\/\/kupdf.net\/download\/ansi-c12-19-2008_5af9fdd5e2b6f501147de395_pdf<\/a><\/p>\n\n\n\n

Open Smart Grid Protocol (OSGP)
https:\/\/www.etsi.org\/deliver\/etsi_gs\/osg\/001_099\/001\/01.01.01_60\/gs_osg001v010101p.pdf<\/a><\/p>\n\n\n\n

Termineter (Framework for reading data from smartmeters)
https:\/\/github.com\/rsmusllp\/termineter<\/a><\/p>\n\n\n\n

<\/p>\n\n\n\n

HARDWARE USED:<\/strong><\/p>\n\n\n\n

IR Probe:<\/strong>
I bought mine from Weidmann Elektronik
https:\/\/www.weidmann-elektronik.de\/Produkt_IR-Kopf.html<\/a><\/p>\n\n\n\n

1.00 x IR Schreib\/Lesekopf USB (Optokopf), ART0027, EUR 44,99<\/p>\n\n\n\n

I have not tried other probes, but I figured at the start of this project, I did not want to have trouble with my hardware. I know it\u2019s kind of expensive but it works \ud83d\ude42<\/p>\n\n\n\n

Raspberry Pi 3 model B+ with 8 gb SD card<\/strong>:
(I used Raspberry Pi Imager and installed Raspberry Pi OS)
Activate VNC and SSH (Raspberry PI configuration \u2013 Interfaces)<\/p>\n\n\n\n

<\/p>\n\n\n\n

SOFTWARE:<\/strong><\/p>\n\n\n\n

Install SAMBA<\/strong><\/p>\n\n\n\n

sudo apt install samba samba-common-bin<\/pre>\n\n\n\n
Edit the config file:<\/p>\n\n\n\n
sudo nano \/etc\/samba\/smb.conf\n\n[pi]\npath=home\/pi\nread only = no\nwriteable = yes\nbrowseable = yes\nguest ok = yes\ncreate mask = 0755\ndirectory mask = 0755\n\nPress CTRL-o and CTRL-x to save and exit<\/pre>\n\n\n\n
Install a RAM disk (to prevent destroying the SD card.)<\/strong>
Link: https:\/\/www.hellojona.com\/2017\/06\/create-a-ram-disk-tmpfs-in-raspberry-pi-3\/<\/a><\/p>\n\n\n\n
mkdir \/var\/tmp<\/pre>\n\n\n\n
Edit the fstab file.<\/p>\n\n\n\n
sudo nano \/etc\/fstab<\/pre>\n\n\n\n
Add the following line to \/etc\/fstab to create a 400MB RAM Disk<\/p>\n\n\n\n
tmpfs \/var\/tmp tmpfs nodev,nosuid,size=400M 0 0<\/pre>\n\n\n\n
Execute the following command to mount the newly created RAM Disk<\/p>\n\n\n\n
mount -a<\/pre>\n\n\n\n
To verify the RAM Disk is created and mounted successfully, execute the following command<\/p>\n\n\n\n
df -h<\/pre>\n\n\n\n
Temporary files can now be written\/read to\/from \/var\/tmp partition.<\/p>\n\n\n\n
<\/p>\n\n\n\n
PYTHON 3.9 (I think that it is installed on the Raspberry by default)<\/strong>.<\/p>\n\n\n\n
<\/p>\n\n\n\n
Install NODE-RED<\/strong>
I think I installed it from the Rasberry Pi ‘recommended software’ via the GUI.<\/p>\n\n\n\n
Autostart Nodered: (run from a terminal \/ SSH)<\/p>\n\n\n\n
sudo systemctl enable nodered.service<\/pre>\n\n\n\n
<\/p>\n\n\n\n
Install Temineter (Python program to communicate C1218 and C1219 protocol)<\/strong>
Start a terminal and install it.<\/p>\n\n\n\n
git clone https:\/\/github.com\/securestate\/termineter.git<\/pre>\n\n\n\n
Change permissions on directory<\/p>\n\n\n\n
sudo chmod 777 termineter -R<\/pre>\n\n\n\n
I edited a some of files (I use Visual Studio Code through the SAMBA share) to get this to work.
You can use the files from the attached zip<\/a> of use them as inspiration to copy\/waste.<\/p>\n\n\n\n
Changed files:
lib\/c1228\/connection.py
lib\/termineter\/core.py
lib\/termineter\/modules\/get_data.py
lib\/termineter\/modules\/read_part.py<\/p>\n\n\n\n
<\/p>\n\n\n\n
TERMINETER program changes<\/strong>
lib\\termineter\\core.py:
*** Section around ‘Setup end configure options’<\/p>\n\n\n\n
self.options.add_string('SERIAL_CONNECTION', 'serial connection string',default='\/dev\/ttyUSB0<\/strong>')\nself.options.add_string('PASSWORD', 'serial c12.18 password', default='<your decryptkey here!><\/strong>')\nself.advanced_options.add_integer('C1218_PACKET_SIZE', 'c12.18 maximum packet size', default=64<\/strong>)<\/pre>\n\n\n\n
Run the program:<\/p>\n\n\n\n
python .\/termineter<\/strong>\n\nTermineter<\/em>\n <[ termineter v1.0.5\n <[ model: T-1000\n <[ loaded modules: 19\n\ntermineter ><\/pre>\n\n\n\n
Run the module to start getting data:<\/p>\n\n\n\n
termineter > run get_data<\/strong><\/pre>\n\n\n\n
Hopefully the program starte to get data (and save it in the \/var\/tmp folder)<\/p>\n\n\n\n
[+] Successfully connected and the device is responding\n[*] Read 8 bytes\n0000 74 40 05 00 9f 1d 00 00                         t@......\n[*] Read 40 bytes\n0000 96 0a 00 00 00 00 00 00 00 00 00 00 39 02 00 00 ............9...\n0010 f8 0c 00 00 dc 0c 00 00 90 19 00 00 27 70 03 00 ............'p..\n0020 ef 6f 03 00 76 70 03 00                         .o..vp..<\/pre>\n\n\n\n
Instead of (or additional) to make the program changes, you can use a ‘resource file’ (look at
https:\/\/github.com\/rsmusllp\/termineter\/wiki\/GettingStarted<\/a> at the bottom)<\/p>\n\n\n\n
If you use a resource file, you can \u2018autostart\u2019 the program.<\/p>\n\n\n\n
Errorhandling still needs to be taken care of \ud83d\ude09<\/p>\n\n\n\n
<\/p>\n\n\n\n
NODE-RED Program:<\/strong>
The data from termineter is stored in \/var\/tmp BT23 and BT28 and is updated every 10 sec-ish.
I use NODE-RED to handle the data (and send them to HomeAssistant via MQTT)
Install the ‘Bufferparser\u2019. (Manage palette and search for ‘node-red-contrib-buffer-parser’)
The Bufferparser<\/em> handles and changes the data from the files in \/var\/tmp and makes the data ready.
Afterwards the data is made ready in a function<\/em> and finally sent by MQTT.<\/p>\n\n\n\n
I also tried to make some ‘autodiscovery sensors’ for HomeAssistant.<\/p>\n\n\n\n
Screendump of the Flow:<\/p>\n\n\n\n
\"HomeAssistant
HomeAssistant – Screendump of the Flow<\/figcaption><\/figure>\n\n\n\n
1. Timestamp runs every 10 secs.<\/p>\n\n\n\n
2. Function \/var\/tmp\/BT23:<\/p>\n\n\n\n
\"HomeAssistant
HomeAssistant – Function<\/figcaption><\/figure>\n\n\n\n
3. BufferParser BT23:<\/p>\n\n\n\n
\"HomeAssistant
HomeAssistant – Buffer-parser<\/figcaption><\/figure>\n\n\n\n
4. Change node ‘fwd_total’:<\/p>\n\n\n\n
\"HomeAssistant
HomeAssistant – Fwd_total<\/figcaption><\/figure>\n\n\n\n
5. MQTT: Setup according to your MQTT broker settings.<\/p>\n\n\n\n
6. Discovery settings for HomeAssistant<\/p>\n\n\n\n
\"HomeAssistant
HomeAssistant – Discovery settings<\/figcaption><\/figure>\n\n\n\n
<\/p>\n\n\n\n
Screenshot from HomeAssistant:<\/p>\n\n\n\n
\"HomeAssistant
HomeAssistant – Screenshot<\/figcaption><\/figure>\n\n\n\n
<\/p>\n\n\n\n
Hope this can inspire other to get data from ECHELON\/NES meters via IR eye.<\/p>\n\n\n\n
\ud83d\ude42 Ulrik, email: u_dabbler[AT]dumac.dk<\/p>\n","protected":false},"excerpt":{"rendered":"
This is another bonus entry on our blog in the Echelon\/NES Smart Meters series. As we have mentioned before, it is sometimes hard to find time besides our regular jobs to dabble with this project. We have had a lot of interest in using the IR (Infrared) port on the Echelon\/NES Smart Meters, and there … <\/p>\n
Continue reading “(Guest writer) Echelon\/NES Smart Meters \u2013 NES\/ECHELON electrical meter connect to MQTT (Home Assistant) via IR”<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":599,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6,55,53,5],"tags":[49,52,57,56,54,50],"class_list":["post-583","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-hardware","category-home-automation","category-raspberry-pi","category-software","tag-electronics","tag-guest-writer","tag-infrared","tag-mqtt","tag-raspberry-pi","tag-smart-meter"],"_links":{"self":[{"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/posts\/583","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/comments?post=583"}],"version-history":[{"count":11,"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/posts\/583\/revisions"}],"predecessor-version":[{"id":603,"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/posts\/583\/revisions\/603"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/media\/599"}],"wp:attachment":[{"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/media?parent=583"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/categories?post=583"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dabbler.dk\/index.php\/wp-json\/wp\/v2\/tags?post=583"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}