Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Indexer-Dashboard testing under OpenSearch 2.18.0 #547

Closed
4 tasks done
AlexRuiz7 opened this issue Nov 12, 2024 · 2 comments
Closed
4 tasks done

Indexer-Dashboard testing under OpenSearch 2.18.0 #547

AlexRuiz7 opened this issue Nov 12, 2024 · 2 comments
Assignees
Labels
level/task Task issue request/operational Operational requests type/test Test issue

Comments

@AlexRuiz7
Copy link
Member

AlexRuiz7 commented Nov 12, 2024

Description

We need to ensure our components work under the new version of OpenSearch. The goal of this issue is to test our packages, their lifecycle and the main correct communication of Indexer and Dashboard.

For that, we need to:

Tests must be performed following the official documentation under RHEL 9 and Ubuntu 22.04 operating systems, or newer versions if available and supported.

Issues

  • List here the detected issues
@AlexRuiz7 AlexRuiz7 added level/task Task issue request/operational Operational requests type/test Test issue labels Nov 12, 2024
@AlexRuiz7 AlexRuiz7 self-assigned this Nov 12, 2024
@wazuhci wazuhci moved this to Backlog in Release 5.0.0 Nov 12, 2024
@AlexRuiz7
Copy link
Member Author

AlexRuiz7 commented Nov 20, 2024

Note

Upgrade process is not tested as master (5.0.0) is a major release.

wazuh-indexer

RPM 🟢

Package: https://github.com/wazuh/wazuh-indexer/actions/runs/11933942402

  • Package installs
  • Package upgrades (not tested as this is a major release)
install

[root@node-1 scripts]# yum install wazuh-indexer_5.0.0-0_x86_64_11a6a33a-ae65d4a-f86dcf2.rpm
Last metadata expiration check: 0:00:28 ago on Wed 20 Nov 2024 03:37:41 PM UTC.
Dependencies resolved.
=====================================================================================================================================================================================================================
 Package                                                Architecture                                    Version                                          Repository                                             Size
=====================================================================================================================================================================================================================
Installing:
 wazuh-indexer                                          x86_64                                          5.0.0-0                                          @commandline                                          842 M

Transaction Summary
=====================================================================================================================================================================================================================
Install  1 Package

Total size: 842 M
Installed size: 1.0 G
Is this ok [y/N]: y
Downloading Packages:
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                                                                                                                                                             1/1 
  Running scriptlet: wazuh-indexer-5.0.0-0.x86_64                                                                                                                                                                1/1 
  Installing       : wazuh-indexer-5.0.0-0.x86_64                                                                                                                                                                1/1 
  Running scriptlet: wazuh-indexer-5.0.0-0.x86_64                                                                                                                                                                1/1 
### NOT starting on installation, please execute the following statements to configure wazuh-indexer service to start automatically using systemd
 sudo systemctl daemon-reload
 sudo systemctl enable wazuh-indexer.service
### You can start wazuh-indexer service by executing
 sudo systemctl start wazuh-indexer.service

Couldn't write '64' to 'kernel/random/read_wakeup_threshold', ignoring: No such file or directory

  Verifying        : wazuh-indexer-5.0.0-0.x86_64                                                                                                                                                                1/1 

Installed:
  wazuh-indexer-5.0.0-0.x86_64                                                                                                                                                                                       

Complete!

systemctl status

[root@node-1 scripts]# systemctl daemon-reload
[root@node-1 scripts]# systemctl enable wazuh-indexer
[root@node-1 scripts]# systemctl start wazuh-indexer
[root@node-1 scripts]# systemctl status wazuh-indexer
● wazuh-indexer.service - wazuh-indexer
     Loaded: loaded (/usr/lib/systemd/system/wazuh-indexer.service; enabled; preset: disabled)
     Active: active (running) since Wed 2024-11-20 15:39:41 UTC; 6s ago
       Docs: https://documentation.wazuh.com
   Main PID: 4027 (java)
      Tasks: 82 (limit: 24731)
     Memory: 1.4G
        CPU: 15.001s
     CGroup: /system.slice/wazuh-indexer.service
             └─4027 /usr/share/wazuh-indexer/jdk/bin/java -Xshare:auto -Dopensearch.networkaddress.cache.ttl=60 -Dopensearch.networkaddress.cache.negative.ttl=10 -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=tru>

Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.OpenSearch (file:/usr/share/wazuh-indexer/lib/opensearch-2.18.0.jar)
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: System::setSecurityManager will be removed in a future release
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: Nov 20, 2024 3:39:36 PM sun.util.locale.provider.LocaleProviderAdapter <clinit>
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: COMPAT locale provider will be removed in a future release
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: A terminally deprecated method in java.lang.System has been called
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.Security (file:/usr/share/wazuh-indexer/lib/opensearch-2.18.0.jar)
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.Security
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: System::setSecurityManager will be removed in a future release
Nov 20 15:39:41 node-1 systemd[1]: Started wazuh-indexer.
lines 1-21...skipping...
● wazuh-indexer.service - wazuh-indexer
     Loaded: loaded (/usr/lib/systemd/system/wazuh-indexer.service; enabled; preset: disabled)
     Active: active (running) since Wed 2024-11-20 15:39:41 UTC; 6s ago
       Docs: https://documentation.wazuh.com
   Main PID: 4027 (java)
      Tasks: 82 (limit: 24731)
     Memory: 1.4G
        CPU: 15.001s
     CGroup: /system.slice/wazuh-indexer.service
             └─4027 /usr/share/wazuh-indexer/jdk/bin/java -Xshare:auto -Dopensearch.networkaddress.cache.ttl=60 -Dopensearch.networkaddress.cache.negative.ttl=10 -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=tru>

Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.OpenSearch (file:/usr/share/wazuh-indexer/lib/opensearch-2.18.0.jar)
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: System::setSecurityManager will be removed in a future release
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: Nov 20, 2024 3:39:36 PM sun.util.locale.provider.LocaleProviderAdapter <clinit>
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: COMPAT locale provider will be removed in a future release
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: A terminally deprecated method in java.lang.System has been called
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.Security (file:/usr/share/wazuh-indexer/lib/opensearch-2.18.0.jar)
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.Security
Nov 20 15:39:36 node-1 systemd-entrypoint[4027]: WARNING: System::setSecurityManager will be removed in a future release
Nov 20 15:39:41 node-1 systemd[1]: Started wazuh-indexer.
~

DEB 🟢

Package: https://github.com/wazuh/wazuh-indexer/actions/runs/11933942402

  • Package installs
  • Package upgrades
systemctl status

root@node-2:/home/vagrant/scripts# vi /etc/wazuh-indexer/opensearch.yml 
root@node-2:/home/vagrant/scripts# systemctl restart wazuh-indexer
root@node-2:/home/vagrant/scripts# systemctl status wazuh-indexer
● wazuh-indexer.service - wazuh-indexer
     Loaded: loaded (/lib/systemd/system/wazuh-indexer.service; enabled; vendor preset: enabled)
     Active: active (running) since Wed 2024-11-20 15:44:34 UTC; 1min 8s ago
       Docs: https://documentation.wazuh.com
   Main PID: 2471 (java)
      Tasks: 64 (limit: 4557)
     Memory: 1.3G
        CPU: 22.345s
     CGroup: /system.slice/wazuh-indexer.service
             └─2471 /usr/share/wazuh-indexer/jdk/bin/java -Xshare:auto -Dopensearch.networkaddress.cache.ttl=60 -Dopensearch.networkaddress.cache.negative.ttl=10 -XX:+AlwaysPreTouch -Xss1m -Djava.awt.headless=tru>

Nov 20 15:44:17 node-2 systemd-entrypoint[2471]: WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.OpenSearch (file:/usr/share/wazuh-indexer/lib/opensearch-2.18.0.jar)
Nov 20 15:44:17 node-2 systemd-entrypoint[2471]: WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.OpenSearch
Nov 20 15:44:17 node-2 systemd-entrypoint[2471]: WARNING: System::setSecurityManager will be removed in a future release
Nov 20 15:44:18 node-2 systemd-entrypoint[2471]: Nov 20, 2024 3:44:18 PM sun.util.locale.provider.LocaleProviderAdapter <clinit>
Nov 20 15:44:18 node-2 systemd-entrypoint[2471]: WARNING: COMPAT locale provider will be removed in a future release
Nov 20 15:44:18 node-2 systemd-entrypoint[2471]: WARNING: A terminally deprecated method in java.lang.System has been called
Nov 20 15:44:18 node-2 systemd-entrypoint[2471]: WARNING: System::setSecurityManager has been called by org.opensearch.bootstrap.Security (file:/usr/share/wazuh-indexer/lib/opensearch-2.18.0.jar)
Nov 20 15:44:18 node-2 systemd-entrypoint[2471]: WARNING: Please consider reporting this to the maintainers of org.opensearch.bootstrap.Security
Nov 20 15:44:18 node-2 systemd-entrypoint[2471]: WARNING: System::setSecurityManager will be removed in a future release
Nov 20 15:44:34 node-2 systemd[1]: Started wazuh-indexer.

Cluster formed:

[root@node-1 scripts]# bash 04_initialize_cluster.sh 
Initializing wazuh-indexer cluster...
Checking cluster status...
Indexer Status:
  Node Name: node-1
  Cluster Name: wazuh-cluster
  Version Number: 2.18.0
Verifying the Wazuh indexer nodes...
Nodes:
ip            heap.percent ram.percent cpu load_1m load_5m load_15m node.role node.roles                                        cluster_manager name
192.168.56.11           53          97   3    0.14    0.05     0.02 dimr      cluster_manager,data,ingest,remote_cluster_client -               node-1
192.168.56.10           18          92   5    0.10    0.06     0.01 dimr      cluster_manager,data,ingest,remote_cluster_client *               node-1
Initialization completed successfully.

wazuh-dashboard

RPM 🟢

Package: https://github.com/wazuh/wazuh-dashboard/actions/runs/11940637119

  • Package installs
  • Package upgrades
install

[root@node-1 vagrant]# yum install ./wazuh-dashboard_5.0.0-0_x86_64_3fbbe6c-c73193ec5-c47ba9b-75616d2.rpm 
Extra Packages for Enterprise Linux 9 - x86_64                                                                                54 kB/s |  14 kB     00:00    
Extra Packages for Enterprise Linux 9 - x86_64                                                                                17 MB/s |  23 MB     00:01    
Last metadata expiration check: 0:00:04 ago on Thu 21 Nov 2024 09:39:49 AM UTC.
Dependencies resolved.
=============================================================================================================================================================
 Package                                   Architecture                     Version                             Repository                              Size
=============================================================================================================================================================
Installing:
 wazuh-dashboard                           x86_64                           5.0.0-0                             @commandline                           269 M

Transaction Summary
=============================================================================================================================================================
Install  1 Package

Total size: 269 M
Installed size: 888 M
Is this ok [y/N]: y
Downloading Packages:
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                                                                                                     1/1 
  Running scriptlet: wazuh-dashboard-5.0.0-0.x86_64                                                                                                      1/1 
  Installing       : wazuh-dashboard-5.0.0-0.x86_64                                                                                                      1/1 
  Running scriptlet: wazuh-dashboard-5.0.0-0.x86_64                                                                                                      1/1 
Removing wazuh...
Plugin removal complete

  Verifying        : wazuh-dashboard-5.0.0-0.x86_64                                                                                                      1/1 

Installed:
  wazuh-dashboard-5.0.0-0.x86_64                                                                                                                             

Complete!

systemctl status

[root@node-1 vagrant]# mkdir /etc/wazuh-dashboard/certs
[root@node-1 vagrant]# ls
scripts  wazuh-certificates.tar  wazuh-dashboard_5.0.0-0_x86_64_3fbbe6c-c73193ec5-c47ba9b-75616d2.rpm
[root@node-1 vagrant]# tar -xf ./wazuh-certificates.tar -C /etc/wazuh-dashboard/certs/
[root@node-1 vagrant]# ls /etc/wazuh-dashboard/certs/
admin-key.pem  admin.pem  node-1-key.pem  node-1.pem  node-2-key.pem  node-2.pem  root-ca.key  root-ca.pem
[root@node-1 vagrant]# vi /etc/wazuh-dashboard/opensearch_dashboards.yml
[root@node-1 vagrant]# chmod 500 /etc/wazuh-dashboard/certs
chmod 400 /etc/wazuh-dashboard/certs/*
chown -R wazuh-dashboard:wazuh-dashboard /etc/wazuh-dashboard/certs
[root@node-1 vagrant]# systemctl daemon-reload
systemctl enable wazuh-dashboard
systemctl start wazuh-dashboard
Created symlink /etc/systemd/system/multi-user.target.wants/wazuh-dashboard.service → /etc/systemd/system/wazuh-dashboard.service.
[root@node-1 vagrant]# systemctl status wazuh-dashboard
● wazuh-dashboard.service - wazuh-dashboard
     Loaded: loaded (/etc/systemd/system/wazuh-dashboard.service; enabled; preset: disabled)
     Active: active (running) since Thu 2024-11-21 09:44:12 UTC; 6s ago
   Main PID: 3007 (node)
      Tasks: 11 (limit: 24731)
     Memory: 244.0M
        CPU: 2.451s
     CGroup: /system.slice/wazuh-dashboard.service
             └─3007 /usr/share/wazuh-dashboard/node/bin/node /usr/share/wazuh-dashboard/src/cli/dist

Nov 21 09:44:14 node-1 opensearch-dashboards[3007]: {"type":"log","@timestamp":"2024-11-21T09:44:14Z","tags":["info","savedobjects-service"],"pid":3007,"mes>
Nov 21 09:44:14 node-1 opensearch-dashboards[3007]: {"type":"log","@timestamp":"2024-11-21T09:44:14Z","tags":["info","savedobjects-service"],"pid":3007,"mes>
Nov 21 09:44:14 node-1 opensearch-dashboards[3007]: {"type":"log","@timestamp":"2024-11-21T09:44:14Z","tags":["info","savedobjects-service"],"pid":3007,"mes>
Nov 21 09:44:15 node-1 opensearch-dashboards[3007]: {"type":"log","@timestamp":"2024-11-21T09:44:15Z","tags":["info","savedobjects-service"],"pid":3007,"mes>
Nov 21 09:44:15 node-1 opensearch-dashboards[3007]: {"type":"log","@timestamp":"2024-11-21T09:44:15Z","tags":["info","savedobjects-service"],"pid":3007,"mes>
Nov 21 09:44:15 node-1 opensearch-dashboards[3007]: {"type":"log","@timestamp":"2024-11-21T09:44:15Z","tags":["warning","cross-compatibility-service"],"pid">
Nov 21 09:44:15 node-1 opensearch-dashboards[3007]: {"type":"log","@timestamp":"2024-11-21T09:44:15Z","tags":["info","plugins-system"],"pid":3007,"message":>
Nov 21 09:44:15 node-1 opensearch-dashboards[3007]: {"type":"log","@timestamp":"2024-11-21T09:44:15Z","tags":["info","plugins","wazuhCore","configuration-st>
Nov 21 09:44:15 node-1 opensearch-dashboards[3007]: {"type":"log","@timestamp":"2024-11-21T09:44:15Z","tags":["listening","info"],"pid":3007,"message":"Serv>
Nov 21 09:44:15 node-1 opensearch-dashboards[3007]: {"type":"log","@timestamp":"2024-11-21T09:44:15Z","tags":["info","http","server","OpenSearchDashboards"]>
[root@node-1 vagrant]# 

DEB 🟢

Package: https://github.com/wazuh/wazuh-dashboard/actions/runs/11937105897

  • Package installs
  • Package upgrades
install

root@node-2:/home/vagrant# apt install -y ./wazuh-dashboard_5.0.0-0_amd64_a537e76-c73193ec5-c47ba9b-75616d2.deb 
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Note, selecting 'wazuh-dashboard' instead of './wazuh-dashboard_5.0.0-0_amd64_a537e76-c73193ec5-c47ba9b-75616d2.deb'
The following NEW packages will be installed:
  wazuh-dashboard
0 upgraded, 1 newly installed, 0 to remove and 2 not upgraded.
Need to get 0 B/181 MB of archives.
After this operation, 969 MB of additional disk space will be used.
Get:1 /home/vagrant/wazuh-dashboard_5.0.0-0_amd64_a537e76-c73193ec5-c47ba9b-75616d2.deb wazuh-dashboard amd64 5.0.0-0 [181 MB]
Selecting previously unselected package wazuh-dashboard.
(Reading database ... 77456 files and directories currently installed.)
Preparing to unpack .../wazuh-dashboard_5.0.0-0_amd64_a537e76-c73193ec5-c47ba9b-75616d2.deb ...
Creating wazuh-dashboard group... OK
Creating wazuh-dashboard user... OK
Unpacking wazuh-dashboard (5.0.0-0) ...
Setting up wazuh-dashboard (5.0.0-0) ...
Scanning processes...                                                                                                                                        
Scanning linux images...                                                                                                                                     

Running kernel seems to be up-to-date.

No services need to be restarted.

No containers need to be restarted.

No user sessions are running outdated binaries.

No VM guests are running outdated hypervisor (qemu) binaries on this host.
N: Download is performed unsandboxed as root as file '/home/vagrant/wazuh-dashboard_5.0.0-0_amd64_a537e76-c73193ec5-c47ba9b-75616d2.deb' couldn't be accessed by user '_apt'. - pkgAcquire::Run (13: Permission denied)

systemctl status

root@node-2:/home/vagrant# mkdir /etc/wazuh-dashboard/certs
root@node-2:/home/vagrant# tar -xf ./wazuh-certificates.tar -C /etc/wazuh-dashboard/certs/
root@node-2:/home/vagrant# NODE_NAME=node-2
root@node-2:/home/vagrant# mv -n /etc/wazuh-dashboard/certs/$NODE_NAME.pem /etc/wazuh-dashboard/certs/dashboard.pem
root@node-2:/home/vagrant# mv -n /etc/wazuh-dashboard/certs/$NODE_NAME-key.pem /etc/wazuh-dashboard/certs/dashboard-key.pem
root@node-2:/home/vagrant# chmod 500 /etc/wazuh-dashboard/certs
root@node-2:/home/vagrant# chmod 400 /etc/wazuh-dashboard/certs/*
root@node-2:/home/vagrant# chown -R wazuh-dashboard:wazuh-dashboard /etc/wazuh-dashboard/certs
root@node-2:/home/vagrant# systemctl daemon-reload
root@node-2:/home/vagrant# systemctl enable wazuh-dashboard
Created symlink /etc/systemd/system/multi-user.target.wants/wazuh-dashboard.service → /etc/systemd/system/wazuh-dashboard.service.
root@node-2:/home/vagrant# systemctl start wazuh-dashboard
root@node-2:/home/vagrant# systemctl status wazuh-dashboard
● wazuh-dashboard.service - wazuh-dashboard
     Loaded: loaded (/etc/systemd/system/wazuh-dashboard.service; enabled; vendor preset: enabled)
     Active: active (running) since Thu 2024-11-21 09:57:13 UTC; 5s ago
   Main PID: 1986 (node)
      Tasks: 11 (limit: 4557)
     Memory: 246.9M
        CPU: 2.440s
     CGroup: /system.slice/wazuh-dashboard.service
             └─1986 /usr/share/wazuh-dashboard/node/bin/node /usr/share/wazuh-dashboard/src/cli/dist

Nov 21 09:57:14 node-2 opensearch-dashboards[1986]: [agentkeepalive:deprecated] options.freeSocketKeepAliveTimeout is deprecated, please use options.freeSoc>
Nov 21 09:57:14 node-2 opensearch-dashboards[1986]: {"type":"log","@timestamp":"2024-11-21T09:57:14Z","tags":["info","dynamic-config-service"],"pid":1986,"m>
Nov 21 09:57:14 node-2 opensearch-dashboards[1986]: {"type":"log","@timestamp":"2024-11-21T09:57:14Z","tags":["info","dynamic-config-service"],"pid":1986,"m>
Nov 21 09:57:14 node-2 opensearch-dashboards[1986]: {"type":"log","@timestamp":"2024-11-21T09:57:14Z","tags":["info","savedobjects-service"],"pid":1986,"mes>
Nov 21 09:57:15 node-2 opensearch-dashboards[1986]: {"type":"log","@timestamp":"2024-11-21T09:57:15Z","tags":["info","savedobjects-service"],"pid":1986,"mes>
Nov 21 09:57:15 node-2 opensearch-dashboards[1986]: {"type":"log","@timestamp":"2024-11-21T09:57:15Z","tags":["warning","cross-compatibility-service"],"pid">
Nov 21 09:57:15 node-2 opensearch-dashboards[1986]: {"type":"log","@timestamp":"2024-11-21T09:57:15Z","tags":["info","plugins-system"],"pid":1986,"message":>
Nov 21 09:57:15 node-2 opensearch-dashboards[1986]: {"type":"log","@timestamp":"2024-11-21T09:57:15Z","tags":["info","plugins","wazuhCore","configuration-st>
Nov 21 09:57:15 node-2 opensearch-dashboards[1986]: {"type":"log","@timestamp":"2024-11-21T09:57:15Z","tags":["listening","info"],"pid":1986,"message":"Serv>
Nov 21 09:57:15 node-2 opensearch-dashboards[1986]: {"type":"log","@timestamp":"2024-11-21T09:57:15Z","tags":["info","http","server","OpenSearchDashboards"]>

Indexer-Dashboard communication

RPM 🟢

image

DEB 🟢

image

@wazuhci wazuhci moved this from Backlog to In progress in Release 5.0.0 Nov 20, 2024
@wazuhci wazuhci moved this from In progress to Pending final review in Release 5.0.0 Nov 21, 2024
@asteriscos
Copy link
Member

LGTM ✔️

@wazuhci wazuhci moved this from Pending final review to Done in Release 5.0.0 Nov 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
level/task Task issue request/operational Operational requests type/test Test issue
Projects
Status: Done
Development

No branches or pull requests

2 participants