Code

Malcolm v23.12.0#307

Code

Merged

mmguero merged 84 commits intomainidaholab/Malcolm:mainfrom v23.12.0_merge_idaholabidaholab/Malcolm:v23.12.0_merge_idaholabCopy head branch name to clipboardDec 5, 2023

+3,077-1,664

Commits

Commits on Oct 26, 2023

• bump for v23.11.0 development

  mmguero

  committed
  fa17a78

  Copy full SHA for fa17a78

• add option to auto-create catch-all netbox IPAM prefixes for private IP space (#279)

  mmguero

  committed
  308a1b0

  Copy full SHA for 308a1b0

• add option to auto-create catch-all netbox IPAM prefixes for private IP space (#279)

  mmguero

  committed
  e20983c

  Copy full SHA for e20983c

• reduce verbosity of netbox

  mmguero

  committed
  edd49a1

  Copy full SHA for edd49a1

• add option to auto-create catch-all netbox IPAM prefixes for private IP space (#279)

  mmguero

  committed
  94e8f76

  Copy full SHA for 94e8f76

• address issues with NetBox database and Logstash's NetBox cache (#259); work in progress, almost certainly broken in this state

  mmguero

  committed
  cab66bd

  Copy full SHA for cab66bd

Commits on Oct 27, 2023

• work in pgoress for address issues with NetBox database and Logstash's NetBox cache (#259)

  mmguero

  committed
  8831476

  Copy full SHA for 8831476

• work in pgoress for address issues with NetBox database and Logstash's NetBox cache, should fix locking issues (#259)

  mmguero

  committed
  20a89d5

  Copy full SHA for 20a89d5

• specify lru_redux in the gemspec

  mmguero

  committed
  16d5053

  Copy full SHA for 16d5053

• address issues with NetBox database and Logstash's NetBox cache (#259); restore caching for performance reasons, but decrease TTL significantly and allow it to be specified via environment variable

  mmguero

  committed
  92b4b34

  Copy full SHA for 92b4b34

• bump Werkzeug to v3.0.1 as patch for DoS 'High resource usage when parsing multipart/form-data containing a large part with CR/LF character at the beginning'

  mmguero

  committed
  12b4f57

  Copy full SHA for 12b4f57

• allow specifying capture parameters when orchmode is kubernetes

  mmguero

  committed
  86a41d0

  Copy full SHA for 86a41d0

Commits on Oct 30, 2023

• Update Zeek to v6.1.0

  mmguero

  committed
  b4f8d44

  Copy full SHA for b4f8d44

• point downstream to mmguero-dev/icsnpp-modbus until cisagov/icsnpp-modbus#8 is pulled

  mmguero

  committed
  ed99af5

  Copy full SHA for ed99af5

Commits on Oct 31, 2023

• Working on zeek v6.1.0 build

  mmguero

  committed
  da45848

  Copy full SHA for da45848

• update some of the documentation for docker compose (v2) as a plugin rather than a standalone script

  mmguero

  committed
  70c7773

  Copy full SHA for 70c7773

• update some of the documentation for docker compose (v2) as a plugin rather than a standalone script

  mmguero

  committed
  c9742bb

  Copy full SHA for c9742bb

• fix zeek build

  mmguero

  committed
  be6a9df

  Copy full SHA for be6a9df

• use spicy disable protocol analyzer for LDAP

  mmguero

  committed
  3aa72fc

  Copy full SHA for 3aa72fc

• point back upstream for a few of the plugins

  mmguero

  committed
  30a05d9

  Copy full SHA for 30a05d9

• use prefix.description instead of VRF for identifying subnets in NetBox (#280); needs testing

  mmguero

  committed
  2a804c6

  Copy full SHA for 2a804c6

Commits on Nov 1, 2023

• use docker compose as a plugin rather than docker-compose when possible

  mmguero

  committed
  69ce77c

  Copy full SHA for 69ce77c

• fix issue with logs

  mmguero

  committed
  4be0d17

  Copy full SHA for 4be0d17

• fix issue parsing dns.ip

  mmguero

  committed
  fd69cad

  Copy full SHA for fd69cad

• make sure preloaded prefixes get populated with default site name (#279)

  mmguero

  committed
  e518880

  Copy full SHA for e518880

• fix start not stopping log display

  mmguero

  committed
  c2f043e

  Copy full SHA for c2f043e

• fix issue with prefix name not being used for segments correctly (#280)

  mmguero

  committed
  570fce9

  Copy full SHA for 570fce9

Commits on Nov 8, 2023

• update logstash (https://www.elastic.co/guide/en/logstash/current/logstash-8-11-0.html) and beats (https://www.elastic.co/guide/en/beats/libbeat/current/release-notes-8.11.0.html) to v8.11.0

  mmguero

  committed
  326b8f6

  Copy full SHA for 326b8f6

Commits on Nov 9, 2023

• Fluent-bit to v2.2.0 (https://github.com/fluent/fluent-bit/releases/tag/v2.2.0)

  mmguero

  committed
  5dbb346

  Copy full SHA for 5dbb346

Commits on Nov 10, 2023

• various updates for v23.11.0 development:

  Show description for 0a6565d
  mmguero

  committed
  0a6565d

  Copy full SHA for 0a6565d

• Fix logstash parser issues with ldap (#289)

  mmguero

  committed
  61e3b6e

  Copy full SHA for 61e3b6e

Commits on Nov 13, 2023

• elasticsearch python libraries to 8.11.0

  mmguero

  committed
  3934eae

  Copy full SHA for 3934eae

• #275, integrate suricata version of nsacyber ELITEWOLF rules

  mmguero

  committed
  baebc49

  Copy full SHA for baebc49

• added https://github.com/reversinglabs/reversinglabs-yara-rules yara rule set

  mmguero

  committed
  b0826dd

  Copy full SHA for b0826dd

• update logstash and beats to 8.11.1

  mmguero

  committed
  99afed6

  Copy full SHA for 99afed6

• Work in progress for #287

  mmguero

  committed
  9b1253a

  Copy full SHA for 9b1253a

• better startup for netbox restore

  mmguero

  committed
  de41962

  Copy full SHA for de41962

• fix #287; fix issue with SUPERUSER_API_TOKEN not being set correctly after netbox-restore

  mmguero

  committed
  48bca91

  Copy full SHA for 48bca91

Commits on Nov 14, 2023

• #286, strip out broken Arkime and NetBox links from dashboards for Kibana import

  mmguero

  committed
  fd6d050

  Copy full SHA for fd6d050

• #285, allow customizing Arkime's freeSpaceG setting (for PCAP deletion) in an environment variable

  mmguero

  committed
  b7133e3

  Copy full SHA for b7133e3

• fix file type validation not working for upload from (some?) windows browsers (#292) by removig front-end validation and just relying on the backend to do it

  mmguero

  committed
  684d69f

  Copy full SHA for 684d69f

• improve error messages for PCAP/artifact processing beyond just icons, #276

  mmguero

  committed
  f3c9872

  Copy full SHA for f3c9872

• #147, replace kbn_sankey with vega

  mmguero

  committed
  a0dc39a

  Copy full SHA for a0dc39a

Commits on Nov 15, 2023

• allow netbox to restore database from preload directory if it exists

  mmguero

  committed
  1ceddc7

  Copy full SHA for 1ceddc7

• documentation tweak for #294

  mmguero

  committed
  ea76ffb

  Copy full SHA for ea76ffb

• #294, put netbox restore database functionality inside container (still need to test K8s)

  mmguero

  committed
  d111631

  Copy full SHA for d111631

• bump opensearch-py to v2.4.0

  mmguero

  committed
  cdaf056

  Copy full SHA for cdaf056

• Revert "bump opensearch-py to v2.4.0"

  Show description for ecf5599
  mmguero

  committed
  ecf5599

  Copy full SHA for ecf5599

Commits on Nov 16, 2023

• opensearch-py to 2.4.1

  mmguero

  committed
  9d8861c

  Copy full SHA for 9d8861c

• #294, fix a minor bug when preload gz is not specified

  mmguero

  committed
  cba9dc9

  Copy full SHA for cba9dc9

• for #280, on restore of an older database migrate ipam_vrf.name to ipam_prefix.description

  mmguero

  committed
  c2e6008

  Copy full SHA for c2e6008

• for #280, on restore of an older database migrate ipam_vrf.name to ipam_prefix.description (todo, need to do it in regular startup)

  mmguero

  committed
  b22ea96

  Copy full SHA for b22ea96

Commits on Nov 20, 2023

• bump opensearch-py to v2.4.2

  mmguero

  committed
  379054f

  Copy full SHA for 379054f

• #295, specify local networks via ZEEK_LOCAL_NETS environment variable

  mmguero

  committed
  54d7c15

  Copy full SHA for 54d7c15

Commits on Nov 21, 2023

• fix #294, put netbox restore database functionality inside container for kubernetes

  mmguero

  committed
  301b2a7

  Copy full SHA for 301b2a7

• restore kubernetes image names in prep for release

  mmguero

  committed
  95b3c2a

  Copy full SHA for 95b3c2a

• for #299, fix a vim and libx11 vulnerability in a few packages (by removing those dependencies which we don't really need)

  mmguero

  committed
  103da34

  Copy full SHA for 103da34

Commits on Nov 22, 2023

• #280, update existing prefixes to VRF on startup for backwards compatibility

  mmguero

  committed
  e5405bb

  Copy full SHA for e5405bb

• rework y axis of results visualization

  mmguero

  committed
  2bd9578

  Copy full SHA for 2bd9578

Commits on Nov 27, 2023

• update supercronic to v0.2.28 (https://github.com/aptible/supercronic/releases/tag/v0.2.28)

  mmguero

  committed
  2808618

  Copy full SHA for 2808618

• update supercronic to v0.2.28 (https://github.com/aptible/supercronic/releases/tag/v0.2.28)

  mmguero

  committed
  ff81092

  Copy full SHA for ff81092

Commits on Nov 28, 2023

• flesh out automatic config for virter

  mmguero

  committed
  0a1bf36

  Copy full SHA for 0a1bf36

• one minor tweak to #147, allow vega visualizations to import for elasticsearch

  mmguero

  committed
  9059cf2

  Copy full SHA for 9059cf2

• #301, allow configuration of docker's logging driver to prevent disk-exhaustion

  mmguero

  committed
  2331293

  Copy full SHA for 2331293

Commits on Nov 29, 2023

• #302, allow user to include other suricata config YML files

  mmguero

  committed
  70684fb

  Copy full SHA for 70684fb

• #303, allow user to include custom zeek config

  mmguero

  committed
  7338264

  Copy full SHA for 7338264

• #303, allow user to include custom zeek config

  mmguero

  committed
  1a199dc

  Copy full SHA for 1a199dc

• #303, allow user to include custom zeek config

  mmguero

  committed
  3684c75

  Copy full SHA for 3684c75

Commits on Nov 30, 2023

• httpupdate netbox to v3.6.6 (https://github.com/netbox-community/netbox/releases/tag/v3.6.6)

  mmguero

  committed
  6861469

  Copy full SHA for 6861469

• as it's Nov 30th and the fix for #298 isn't out yet, renaming the release to v23.12.0

  mmguero

  committed
  b499390

  Copy full SHA for b499390

• documentation updates for #302 and #303, custom configuration for Suricata and Zeek

  mmguero

  committed
  e46b8d6

  Copy full SHA for e46b8d6

• allow suricata config to tune max-pending-packets with SURICATA_MAX_PENDING_PACKETS variable

  mmguero

  committed
  33c655c

  Copy full SHA for 33c655c

Commits on Dec 1, 2023

• #298, bump opensearch to v2.11.1

  mmguero

  committed
  ad937ed

  Copy full SHA for ad937ed

Commits on Dec 4, 2023

• update branding/logos

  mmguero

  committed
  f96a922

  Copy full SHA for f96a922

• update/fix branding for v2.11.1

  mmguero

  committed
  5ae973e

  Copy full SHA for 5ae973e

• update documentation SHA sums

  mmguero

  committed
  36af1c1

  Copy full SHA for 36af1c1

• fix issue with image name for kubernetes

  mmguero

  committed
  da0886d

  Copy full SHA for da0886d

• Merge branch 'development' of https://github.com/mmguero-dev/Malcolm into v23.12.0_merge_idaholab

  mmguero

  committed
  73f95a7

  Copy full SHA for 73f95a7

• issue with K8s with zeek custom/intel

  mmguero

  committed
  14970bd

  Copy full SHA for 14970bd

• fix issue loading zeek intel on startup

  mmguero

  committed
  7cc9e10

  Copy full SHA for 7cc9e10

• fix issue loading zeek intel on startup

  mmguero

  committed
  acbe2d3

  Copy full SHA for acbe2d3

• fix issue loading zeek intel on startup

  mmguero

  committed
  39bdbd5

  Copy full SHA for 39bdbd5

• sha1sum update

  mmguero

  committed
  eca0c86

  Copy full SHA for eca0c86

• Merge branch 'development' of https://github.com/mmguero-dev/Malcolm into v23.12.0_merge_idaholab

  mmguero

  committed
  64cba5e

  Copy full SHA for 64cba5e