CHANGELOG.md

Morpheus 24.10.01 (22 Nov 2024)

🐛 Bug Fixes

• Pin mlflow version to avoid breaking changes in v2.18 (#2067) @dagardner-nv
• Execute CI on the main branch (#2064) @dagardner-nv

📖 Documentation

• Remove references to pipeline-ae in docs (#2063) @dagardner-nv
• Document location of third party source repository (#2059) @dagardner-nv
• Update DFP class and file paths (#2052) @dagardner-nv

Morpheus 24.10.00 (01 Nov 2024)

🚨 Breaking Changes

• Support LLM pipelines in CPU-only mode (#1906) @dagardner-nv
• Remove Starter Digital Fingerprinting (DFP) (#1903) @efajardo-nv
• Finalize removing MultiMessage from Morpheus (#1886) @yczhang-nv
• Add support for a CPU-only Mode (#1851) @dagardner-nv
• Removing support for MultiMessage from stages (#1803) @yczhang-nv

🐛 Bug Fixes

• Pin boto3 and s3fs to compatible versions to resolve access denied errors (#2039) @dagardner-nv
• Fix phishing Python API example to match CLI example (#2037) @dagardner-nv
• Model updates and cleanup following upgrade to to triton 24.09 (#2036) @AnuradhaKaruppiah
• Copy data files needed by root_cause_analysis to examples/data (#2032) @AnuradhaKaruppiah
• Fix for duplicate row IDs in log_parsing output (#2031) @dagardner-nv
• Fix log_parsing example pipeline null output issue (#2024) @yczhang-nv
• Fixup file paths in the modular digital fingerprinting documentation. (#2016) @AnuradhaKaruppiah
• Fix DeserializeStage to ensure output messages correctly contain the correct rows for each batch (#2015) @dagardner-nv
• Fix offset calculation when taking a slice of a SlicedMessageMeta (#2006) @dagardner-nv
• Fix CUDF's Column.from_column_view by copying it and adjusting. (#2004) @cwharris
• Fix up file paths in the DFP README (#2003) @AnuradhaKaruppiah
• Fix AttributeError: 'int' object has no attribute 'item' (#1995) @dagardner-nv
• Fix utilities submodule commit (#1987) @cwharris
• Update val-run-all.sh to run cpp pipeline only (#1986) @yczhang-nv
• Fix onnx-to-trt utility (#1984) @dagardner-nv
• Update Utilities submodule and fix compilation with latest build of MRC (#1981) @mdemoret-nv
• Fix missing dependency in DFP Grafana example (#1977) @efajardo-nv
• Populate all the LFS data needed for running examples within the release container (#1976) @AnuradhaKaruppiah
• Ensure timestamps are copied in LLMEngineStage (#1975) @dagardner-nv
• Install sentence-transformers via pip to avoid CPU-torch conda dependencies (#1974) @efajardo-nv
• Add **kwargs back to NVFoundationLLMClient.generate_batch() and generate_batch_async() (#1967) @ashsong-nv
• Benchmark updates/fixes (#1958) @efajardo-nv
• Improve test performance (#1953) @dagardner-nv
• Adopt updated utilities fix in-place Python installs (#1952) @dagardner-nv
• Update cuda version for docker containers (#1941) @dagardner-nv
• Multiple fixes related to SharedProcessPool & MultiProcessingStage (#1940) @yczhang-nv
• Fix dask error in DFP Integrated training pipeline (#1931) @dagardner-nv
• Remove SharedProcessPool.terminate() related tests to avoid stack traces and blocking remote-ci (#1929) @yczhang-nv
• Provide a timeout to the queue.get call in HttpServerSourceStage to avoid spinlocking (#1928) @dagardner-nv
• Ensure that pytest is able to run without optional dependencies (#1927) @dagardner-nv
• Better handle exceptions generated in the LLMEngine to not show the stoul error (#1922) @mdemoret-nv
• Fixing the docker build when Morpheus is a submodule (#1914) @mdemoret-nv
• Build morpheus_llm by default (#1911) @AnuradhaKaruppiah
• Fix conda path for missing llm packages (#1907) @dagardner-nv
• Update WriteToVectorDBStage to re-raise errors from the underlying database (#1905) @dagardner-nv
• Avoid memory leak warnings from pypdfium2 (#1902) @dagardner-nv
• Remove redundant copy of the load_labels_file method (#1901) @dagardner-nv
• Fix Can't find 'action.yml' CI error (#1896) @dagardner-nv
• Fix DFP integrated training Azure pipeline (#1894) @yczhang-nv
• Drop 'CI Pipeline / Check' dependency from the 'package-core' job (#1885) @AnuradhaKaruppiah
• Python source stages now optionally receive a reference to mrc.Subscription (#1881) @dagardner-nv
• Fix Unregistered type : mrc::pymrc::coro::BoostFibersMainPyAwaitable error (#1869) @dagardner-nv
• Revert PR_1736 "Always run the PR builder step even if others are cancelled" (#1860) @AnuradhaKaruppiah
• ensure columns are strings before concatenation (#1857) @cwharris
• Update Kafka DL script to 2.13-3.8.0 (#1856) @cwharris
• Update isort settings file path in fix_all.sh (#1855) @yczhang-nv
• Move isort settings into pyproject.toml (#1854) @dagardner-nv
• Update location of morpheus setup and data files in VS settings (#1843) @AnuradhaKaruppiah
• Fix isort config marking _utils as known first party (#1842) @dagardner-nv
• Fix usage of the C++ impl of write_df_to_file (#1840) @dagardner-nv
• Fix shutdown on Ctrl+C for Python source stages (#1839) @dagardner-nv
• Improved type-hints for stage and source decorators (#1831) @dagardner-nv
• Add tests to confirm that a mis-configured MultiPortModulesStage will raise an exception rather than segfaulting (#1829) @dagardner-nv
• Ensure proper initialization of CMAKE_INSTALL_PREFIX if needed (#1815) @dagardner-nv
• Fix merging of CLI args and Yaml configs in vdb_upload example (#1813) @dagardner-nv
• Fix log parsing undefined variable and duplicate sequence id errors (#1809) @dagardner-nv
• Remove obsolete version string from compose yamls (#1808) @dagardner-nv
• Ensure the release container does not contain any unintended files (#1807) @dagardner-nv
• Update ci/release/update-version.sh to include missed files (#1801) @dagardner-nv

📖 Documentation

• Add known issue for dask shutdown (#2027) @cwharris
• Set the version in the conda packages docs (#2017) @AnuradhaKaruppiah
• Fix mis-leading deserialize stage comments (#2009) @dagardner-nv
• Update Morpheus docs to use cuda 12.5 (#2008) @yczhang-nv
• Fix minor issues with LLM example documentation (#1992) @dagardner-nv
• Incorporate review comments in the conda packages documentation (#1982) @AnuradhaKaruppiah
• Add CPU-only documentation (#1969) @dagardner-nv
• Document each of the Conda environment files (#1932) @dagardner-nv
• Update documentation to reflect CPU-only execution mode (#1924) @dagardner-nv
• Remove TODO statements from documentation (#1879) @dagardner-nv
• Remove automock for merlin as we no longer have/use merlin (#1830) @dagardner-nv
• Add documentation checks to CI (#1821) @dagardner-nv
• Fix documentation links to work in both source repo and documentation builds (#1814) @dagardner-nv
• Update documentation for vdb_upload to use realistic source data with the --file_source flag (#1800) @dagardner-nv

🚀 New Features

• Install morpheus-dfp conda package in the DFP container (#1971) @AnuradhaKaruppiah
• Morpheus docs update post compartmentalization (#1964) @AnuradhaKaruppiah
• Adding implementation of Router Nodes (#1963) @mdemoret-nv
• Include requirements files in the morpheus packages (#1957) @AnuradhaKaruppiah
• Unit tests for the namespace update script (#1954) @AnuradhaKaruppiah
• Script for updating the namespace due to compartmentalization changes (#1946) @AnuradhaKaruppiah
• Move tests/common to tests/morpheus/common (#1942) @AnuradhaKaruppiah
• Refactor Morpheus unit tests and plugin to the conda recipe for per-lib testing (#1933) @AnuradhaKaruppiah
• Remove debug log in HttpServerSourceStage when the queue is empty (#1921) @dagardner-nv
• Refactor digital_fingerprinting stages and add morpheus-split conda recipe (core, dfp, llm) (#1897) @AnuradhaKaruppiah
• Move vector db stages to morpheus-llm (#1889) @AnuradhaKaruppiah
• Scripts for building and uploading the morpheus-core conda package (#1883) @AnuradhaKaruppiah
• Implement MultiProcessingStage (#1878) @yczhang-nv
• Update to RAPIDS 24.10 (#1874) @cwharris
• Add support for a CPU-only Mode (#1851) @dagardner-nv
• [morpheus-refactor] Move morpheus source to python/morpheus (#1836) @AnuradhaKaruppiah
• Support for ControlMessage as an output type for HttpServerSourceStage and HttpClientSourceStage (#1834) @dagardner-nv
• Remove NVTabular (#1825) @cwharris
• Create a Docker image for Morpheus models (#1804) @dagardner-nv
• Add unique column to output of the log_parsing pipeline (#1795) @dagardner-nv

🛠️ Improvements

• Update to Triton Inference Server container version 24.09 (#2001) @dagardner-nv
• Remove temporary DFP todo list (#1998) @AnuradhaKaruppiah
• devcontainer: replace VAULT_HOST with AWS_ROLE_ARN (#1962) @jjacobelli
• Reduce the number of warnings emitted (#1947) @dagardner-nv
• Set lower CPU usage for test_shared_process_pool.py to avoid slowing down the test (#1935) @yczhang-nv
• Remove unused pymysql dependency from DFP mlflow container (#1930) @dagardner-nv
• Support LLM pipelines in CPU-only mode (#1906) @dagardner-nv
• Remove Starter Digital Fingerprinting (DFP) (#1903) @efajardo-nv
• Finalize removing MultiMessage from Morpheus (#1886) @yczhang-nv
• Run pre-commit on all files, not just python (#1880) @cwharris
• Prefer len(os.sched_getaffinity(0)) over os.cpu_count() (#1866) @cwharris
• Remove cloudtrail debug log from autoencoder source stage (#1865) @cwharris
• Run yapf, flake8, isort as part of pre-commit (#1859) @cwharris
• Warn when Config's pipeline_batch_size < model_max_batch_size (#1858) @cwharris
• Breakout morpheus_llm (#1853) @AnuradhaKaruppiah
• Install built documentation into release container (#1806) @dagardner-nv
• Removing support for MultiMessage from stages (#1803) @yczhang-nv
• Batch incoming DOCA raw packet data (#1731) @dagardner-nv

Morpheus 24.06.01 (23 Aug 2024)

🛠️ Improvements

• Replace pdf parsing libs (#1861) @dagardner-nv

Morpheus 24.06.00 (03 Jul 2024)

🚨 Breaking Changes

• Introduce multi-endpoint servers and health check endpoints to HttpServerSourceStage (#1734) @jadu-nv
• Update devcontainer to use latest build utils (#1658) @cwharris
• Update CI to install DOCA and build Morpheus DOCA components. (#1622) @cwharris
• Support non-json serializable objects in LLMContext (#1589) @dagardner-nv

🐛 Bug Fixes

• Fix LLM Agents Kafka pipeline (#1793) @dagardner-nv
• Add fetch data command in build_container_release.sh (#1787) @ifengw-nv
• Add cuda and cudf to link targets for C++ examples (#1777) @dagardner-nv
• Release container fixes (#1766) @dagardner-nv
• Remove setting of prog_name, this implies that an executable named morpheus_llm exists (#1759) @dagardner-nv
• Provide a default set of questions for the standalone RAG pipeline (#1758) @dagardner-nv
• Disable shared memory by default, and fix --stop_after flag for vdb_upload example (#1755) @dagardner-nv
• Fix conda errors in release container (#1750) @dagardner-nv
• Fixes for C++ impl for DeserializeStage and add missing get_info overloads to SlicedMessageMeta (#1749) @dagardner-nv
• Add GIT_CLONE_PROTECTION_ACTIVE env config to fix build script (#1748) @jadu-nv
• Fix triton multi threading when using the C++ stage (#1739) @mdemoret-nv
• resolve rapids-dependency-file-generator warning (#1735) @jameslamb
• Updating all uses of the secrets.PROJECT_MANAGEMENT_PAT to use a registered Github App (#1730) @mdemoret-nv
• DOCA: fix optional deps + remove PreallocatorMixin from source stage (#1729) @e-ago
• Remove pyarrow_hotfix import from __init__.py (#1692) @efajardo-nv
• Support the filter_null parameter in the C++ impl of the FileSourceStage (#1689) @dagardner-nv
• Enable C++ mode for abp_pcap_detection example (#1687) @dagardner-nv
• Strip HTML & XML tags from RSS feed input (#1670) @dagardner-nv
• Truncate strings exceeding max_length when inserting to Milvus (#1665) @dagardner-nv
• Fix a typo in the devcontainer base image (#1638) @cwharris
• Fix tests to detect issue #1626 (#1629) @dagardner-nv
• Fix cupy_to_tensor to also infer uint8 and int8 dtypes (#1621) @efajardo-nv
• Add struct column support to cudf_helpers (#1538) @efajardo-nv

📖 Documentation

• Cleanup docs so that each as a single H1 title (#1794) @dagardner-nv
• Mark the LLM Agents Kafka pipeline as broken (#1792) @dagardner-nv
• Document supported environments for each example (#1786) @dagardner-nv
• Removes unused environment variables from Morpheus build docs (#1784) @yczhang-nv
• Remove documentation for yaml config files in vdb_upload pipeline until #1752 is resolved (#1778) @dagardner-nv
• Remove out of date instructions from contributing.md (#1774) @dagardner-nv
• Add troubleshooting reference for unsuccessful documentation builds (#1768) @ifengw-nv
• Remove pre-built container section from getting_started.md (#1764) @yczhang-nv
• Clarify Documentation: Run fetch_data.py Outside Docker Container (#1762) @ifengw-nv
• Add function return documentation for LLMService (#1721) @acaklovic-nv
• Fix description for cache_mode option of DFP Rolling Window module (#1707) @efajardo-nv
• Update root-cause-analysis-model-card.md (#1684) @HesAnEasyCoder
• Update abp-model-card.md (#1683) @HesAnEasyCoder
• Update dfp-model-card.md (#1682) @HesAnEasyCoder
• Update gnn-fsi-model-card.md (#1681) @HesAnEasyCoder
• Update phishing-model-card.md (#1680) @HesAnEasyCoder
• Update examples to execute from the root of the repo (#1674) @dagardner-nv
• Update dfp-model-card.md (#1644) @HesAnEasyCoder

🚀 New Features

• Add ransomware model to devcontainer (#1785) @yczhang-nv
• Introduce multi-endpoint servers and health check endpoints to HttpServerSourceStage (#1734) @jadu-nv
• Support ControlMessage for Preprocess and PostProcess stages (#1623) @yczhang-nv
• Update CI to install DOCA and build Morpheus DOCA components. (#1622) @cwharris
• DOCA stage split: source + convert (#1617) @e-ago
• ControlMessage support in TritonInferenceStage and PreallocatorMixin (#1610) @cwharris

🛠️ Improvements

• Merge Agent Morpheus changes (#1760) @dagardner-nv
• Fix RabbitMQ output path (#1756) @yczhang-nv
• Misc improvements for sid_visualization example (#1751) @dagardner-nv
• Auditing the dependencies and syncing dependencies.yaml with meta.yaml (#1743) @mdemoret-nv
• Always run the PR builder step even if others are cancelled (#1736) @mdemoret-nv
• Enable Python install by default in compile.sh (#1724) @dagardner-nv
• Generate deprecation warning for MultiMessage (#1719) @yczhang-nv
• Improve the logging tests and add support for resetting the logger (#1716) @mdemoret-nv
• Allow passing metadata to LangChainAgentNode._run_single (#1710) @dagardner-nv
• Support passing a custom parser to HttpServerSourceStage and HttpClientSourceStage stages (#1705) @dagardner-nv
• Use EnvConfigValue for passing env-configured arguments to services (#1704) @cwharris
• Remove unused MLflow client arg from DFP inference implementations (#1700) @efajardo-nv
• Add group by column stage (#1699) @dagardner-nv
• Fix non-deterministic output of gnn sampler (#1677) @tzemicheal
• Ensuring consistent use of the export macro MORPHEUS_EXPORT (#1672) @aserGarcia
• Update devcontainer to use latest build utils (#1658) @cwharris
• Update ControlMessage to hold arbitrary Python objects & update MessageMeta to copy & slice (#1637) @yczhang-nv
• Use conda env create --yes instead of --force (#1636) @efajardo-nv
• Misc CI improvements (#1618) @dagardner-nv
• Support non-json serializable objects in LLMContext (#1589) @dagardner-nv

Morpheus 24.03.02 (24 Apr 2024)

🐛 Bug Fixes

• Don't set pe_count for the C++ impl of the TritonInferenceStage (#1640) @dagardner-nv
• Fix vdb_upload runtime error (#1643) @dagardner-nv

📖 Documentation

• Document current known issues in 24.03.02 (#1656) @dagardner-nv
• Fix documentation for building examples (#1659) @dagardner-nv
• Fix type-o in documentation (#1662) @dagardner-nv
• Fix mis-spelling of examples (#1664) @dagardner-nv

Morpheus 24.03.01 (10 Apr 2024)

🚨 Breaking Changes

• Move MemoryDescriptor to the morpheus namespace (#1602) @dagardner-nv

🐛 Bug Fixes

• Switch to kafka 3.5.2 (#1612) @dagardner-nv
• Update mlflow to avoid CVE-2024-27132 and CVE-2024-27133 (#1609) @dagardner-nv
• Fix for databricks_cli import error (#1604) @dagardner-nv
• Move MemoryDescriptor to the morpheus namespace (#1602) @dagardner-nv

Morpheus 24.03.00 (7 Apr 2024)

🚨 Breaking Changes

• Updating nlohman_json to 3.11 to match MRC (#1596) @mdemoret-nv
• Add retry logic and proxy support to the NeMo LLM Service (#1544) @mdemoret-nv
• Upgrade openai version to 1.13 and langchain to version 0.1.9 (#1529) @mdemoret-nv
• Make start_async() available to source stages (#1523) @efajardo-nv
• RAPIDS 24.02 Upgrade (#1468) @cwharris
• Decouple TritonInferenceStage from pipeline mode (#1402) @dagardner-nv

🐛 Bug Fixes

• Serialize datetime objects into the module config (#1592) @dagardner-nv
• Remove the defaults channel from dependencies.yml (#1584) @mdemoret-nv
• Fix iso_date_regex_pattern config in file_batcher module and allow override (#1580) @efajardo-nv
• Update DFP MLflow ModelManager to handle model retrieval using file URI (#1578) @efajardo-nv
• Fix configure_logging in DFP benchmarks (#1553) @efajardo-nv
• Catch langchain agent errors (#1539) @dagardner-nv
• Adding missing dependency on pydantic (#1535) @yuchenz427
• Fix memory leak in the mutable dataframe checkout/checkin code (#1534) @dagardner-nv
• Fix pathlib.Path support for FileSourceStage (#1531) @dagardner-nv
• Make start_async() available to source stages (#1523) @efajardo-nv
• Update CI Containers (#1521) @cwharris
• Fix intermittent segfault on interpreter shutdown (#1513) @dagardner-nv
• Adopt updated builds of CI runners (#1503) @dagardner-nv
• Update mlflow plugin version for deployments fix (#1499) @pdmack
• Add runtime environment output to fix building the release container (#1496) @cwharris
• Fix logging of sleep time (#1493) @dagardner-nv
• Pin pytest to <8 (#1485) @dagardner-nv
• Improve pipeline stop logic to ensure join is called exactly once for all stages (#1479) @efajardo-nv
• Fix expected JSON config file extension in logger (#1471) @efajardo-nv
• Fix Loss Function to Improve Model Convergence for AutoEncoder (#1460) @hsin-c
• GNN fraud detection notebook fix (#1450) @efajardo-nv
• Eliminate Redundant Fetches in RSS Controller (#1442) @bsuryadevara
• Updating the workspace settings to remove deprecated python options (#1440) @mdemoret-nv
• Improve camouflage startup issues (#1436) @dagardner-nv
• Fixes to modular DFP examples and benchmarks (#1429) @efajardo-nv

📖 Documentation

• Update minimum compute requirements to Volta (#1594) @dagardner-nv
• Fix broken link in getting started with Morpheus doc (#1494) @edknv
• Update abp-model-card.md (#1439) @drobison00
• Update gnn-fsi-model-card.md (#1438) @drobison00
• Update phishing-model-card.md (#1437) @drobison00
• Document incompatible mlflow models issue (#1434) @dagardner-nv

🚀 New Features

• Adding retry logic to the TritonInferenceStage to allow recovering from errors (#1548) @cwharris
• Create a base mixin class for ingress & egress stages (#1473) @dagardner-nv
• RAPIDS 24.02 Upgrade (#1468) @cwharris
• Install headers & morpheus-config.cmake (#1448) @dagardner-nv

🛠️ Improvements

• Updating nlohman_json to 3.11 to match MRC (#1596) @mdemoret-nv
• DOCA 2.6 from public repo (#1588) @e-ago
• Support ControlMessage for PreProcessNLPStage PreProcessFILStage AddScoreStageBase (#1573) @yuchenz427
• Update MLflow in Production DFP example to use Python 3.10 (#1572) @efajardo-nv
• Fix environment yaml paths (#1551) @efajardo-nv
• Add retry logic and proxy support to the NeMo LLM Service (#1544) @mdemoret-nv
• Update to match new MRC function sig for AsyncioRunnable::on_data (#1541) @dagardner-nv
• Expose max_retries parameter to OpenAIChatService & OpenAIChatClient (#1536) @dagardner-nv
• Upgrade openai version to 1.13 and langchain to version 0.1.9 (#1529) @mdemoret-nv
• Update ops-bot.yaml (#1528) @AyodeAwe
• Add the ability to attach Tensor objects and timestamps to ControlMessage (#1511) @drobison00
• Fix or silence warnings emitted during tests (#1501) @dagardner-nv
• Support ControlMessage output in the C++ impl of DeserializeStage (#1478) @dagardner-nv
• DOCA Source Stage improvements (#1475) @e-ago
• Update copyright headers for 2024 (#1474) @efajardo-nv
• Add conda builds to CI (#1466) @dagardner-nv
• Grafana log monitoring and error alerting example (#1463) @efajardo-nv
• Misc Conda Improvements (#1462) @dagardner-nv
• Simplification of the streaming RAG ingest example to improve usability (#1454) @drobison00
• Replace GPUtil with pynvml for benchmark reports (#1451) @efajardo-nv
• Misc test improvements (#1447) @dagardner-nv
• Add a --manual_seed flag to the CLI (#1445) @dagardner-nv
• Optionally skip ci based on a label in the pr (#1444) @dagardner-nv
• Refactor verification of optional dependencies (#1443) @dagardner-nv
• Use dependencies.yaml as source-of-truth for environment files. (#1441) @cwharris
• Add mocked test & benchmark for LLM agents pipeline (#1424) @dagardner-nv
• Add benchmarks for stand-alone RAG & vdb upload pipelines (#1421) @dagardner-nv
• Add benchmark for completion pipeline (#1414) @dagardner-nv
• Decouple TritonInferenceStage from pipeline mode (#1402) @dagardner-nv

Morpheus 23.11.01 (7 Dec 2023)

🐛 Bug Fixes

• Convert models/ransomware-models/ransomw-model-short-rf-20220126.sav to LFS (#1408) @mdemoret-nv

📖 Documentation

• Cloud deployment guide fixes (#1406) @dagardner-nv

Morpheus 23.11.00 (30 Nov 2023)

🚨 Breaking Changes

• Separate Pipeline type inference/checking & MRC pipeline construction (#1233) @dagardner-nv
• Remove multiprocess download option (#1189) @efajardo-nv

🐛 Bug Fixes

• CVE-2023-47248 Mitigation (#1399) @mdemoret-nv
• Fixing the hammah and phishing validation pipelines (#1398) @mdemoret-nv
• Fix the SID Viz workflow shutdown process with the new pipeline shutdown process (#1392) @mdemoret-nv
• Fix race condition in the C++ impl for the pre-process fil stage (#1390) @dagardner-nv
• Fixing the conda-build with DOCA enabled and upgrading to CMake 3.25 (#1386) @mdemoret-nv
• Add missing milvus marker (#1385) @dagardner-nv
• Register DataBricksDeltaLakeSourceStage with the CLI (#1384) @dagardner-nv
• Guard optional dependencies in try/except blocks (#1382) @dagardner-nv
• Fix test_vdb_upload_pipe (#1381) @dagardner-nv
• DFP container updates (#1347) @efajardo-nv
• Removed Mutex Related Milvus Tests (#1325) @bsuryadevara
• Pin cuda-python to 11.8.2 as a work around for 11.8.3 incompatibility. (#1320) @drobison00
• Forward-merge branch-23.07 to branch-23.11 [resolved conflicts] (#1246) @dagardner-nv
• Fix tests to support mlflow v2.7 (#1220) @dagardner-nv
• Update DFP training model_kwargs (#1216) @efajardo-nv
• Fix Kafka offset checking test (#1212) @dagardner-nv
• Add review_requested as a trigger & increased timeouts for camouflage (#1200) @dagardner-nv
• Remove multiprocess download option (#1189) @efajardo-nv
• Update feature length for test_abp_fil_e2e benchmark (#1188) @dagardner-nv
• Make manual_seed an autouse fixture for gnn_fraud_detection_pipeline tests (#1165) @dagardner-nv
• Update Downloader utility class to use static dask cluster (#1161) @efajardo-nv
• Update to handle GitHub CLI not installed (#1157) @efajardo-nv
• Update TimeSeries stage to also work with Production DFP (#1121) @efajardo-nv
• Fix issue where DFPFileToDataFrameStage logs messages about S3 even when S3 is not in use (#1120) @dagardner-nv
• Fix Tests broken by Test Reorganization (#1118) @cwharris
• Break circular reference issue causing a memory leak (#1115) @dagardner-nv
• Fix intermittent failures in test_dfencoder_distributed_e2e test (#1113) @dagardner-nv
• Resolve forward merger conflices for branch-23.11 (#1092) @mdemoret-nv
• Fix local CI building from a specific commit (#1083) @dagardner-nv

📖 Documentation

• Grafana example readme update (#1393) @efajardo-nv
• Align model card requirements (#1388) @drobison00
• Docs update to indicate use of conda-merge to generate install files (#1387) @drobison00
• Stage documentation improvements (#1362) @dagardner-nv
• Documentation patch for Examples (#1357) @pranavm7
• Update developer documentation to reflect new compute_schema changes (#1341) @dagardner-nv
• Create LICENSE.psycopg2 (#1295) @exactlyallan
• Fix documentation for morpheus.loaders.sql_loader (#1264) @dagardner-nv
• Phishing example fix (#1215) @efajardo-nv
• ABP PCAP detection readme update (#1205) @efajardo-nv
• Command line examples for module-based DFP pipelines (#1154) @efajardo-nv
• Update DFP E2E Benchmarks README to use dev container (#1125) @efajardo-nv
• Less intrusive doc builds (#1060) @dagardner-nv

🚀 New Features

• Add source & stage decorators (#1364) @dagardner-nv
• Add a Vector Database Service to allow stages to read and write to VDBs (#1225) @bsuryadevara
• CI test stage no longer depends on build stage (#1219) @dagardner-nv
• Updates for MRC/Morpheus to build in the same RAPIDS devcontainer environment (#1171) @cwharris
• KafkaSourceStage OAuth Callback Support (#1169) @cwharris
• GitHub Project Automation and Infra Updates (#1168) @jarmak-nv
• Elasticsearch Sink Module (#1163) @bsuryadevara
• RSS Source Stage for Reading RSS Feeds (#1149) @bsuryadevara
• Add parser_kwargs to FileSourceStage to support json files (#1137) @cwharris
• Add a --viz_direction flag to CLI (#1119) @dagardner-nv
• Adds support to read and write to Databricks delta tables (#630) @pthalasta

🛠️ Improvements

• LLM C++ test and doc updates (#1379) @efajardo-nv
• Merge fea-sherlock feature branch into branch-23.11 (#1359) @drobison00
• Make dfp_azure_pipeline inference output file configurable. (#1290) @drobison00
• Loosen nodejs version restriction (#1262) @dagardner-nv
• Use conda environment yaml's for training-tuning-scripts (#1256) @efajardo-nv
• Cherry pick to pull in august DFP enhancements (#1248) @drobison00
• [DRAFT] Add model and experiment template 'click' options to dfp example pipelines, and make model names Databricks compatible. (#1245) @drobison00
• Separate Pipeline type inference/checking & MRC pipeline construction (#1233) @dagardner-nv
• Adopt updated camouflage-server & fix test_dfp_mlflow_model_writer (#1195) @dagardner-nv
• Add development deps to dependencies.yaml (#1193) @cwharris
• Update to clang-16 & boost-1.82 (#1186) @dagardner-nv
• Scope Zookeeper & Kafka fixtures to session (#1160) @dagardner-nv
• Use copy-pr-bot (#1159) @ajschmidt8
• Update dfp_training stage to support ControlMessages or MultiDFPMessages (#1155) @drobison00
• Prefer conda package over pip dependencies (#1135) @cwharris
• Add tasks and metadata properties to python ControlMessage (#1134) @cwharris
• Eliminate redundant code blocks in modules and stages (#1123) @bsuryadevara
• update devcontainer base to 23.10 (#1116) @cwharris
• Slimmed down CI runners and published artifact urls (#1112) @dagardner-nv
• Updating tests to force .pyi files to be committed into the repo (#1111) @mdemoret-nv
• ABP nvsmi sample data generation (#1108) @efajardo-nv
• Reorganize C++ Tests (#1095) @cwharris
• Improve gitutils.py by using the Github CLI when available (#1088) @mdemoret-nv
• Fixing linting errors which could not be resolved in 23.07 (#1082) @mdemoret-nv
• Move testing utilities into tests/_utils (#1065) @dagardner-nv
• Update Versions for v23.11.00 (#1059) @mdemoret-nv
• Update GNN stellargraph with DGL (#1032) @tzemicheal
• Implement rest data loader (#986) @yuchenz427
• Adding HTTP sources & sinks (#977) @dagardner-nv

Morpheus 23.07.03 (11 Oct 2023)

🐛 Bug Fixes

• Add pinned libwebp to resolve CVE (#1236) @drobison00
• Add libwebp to meta.yaml for CVE 2307 (#1242) @drobison00
• [BUG] Fix Control Message Utils & SQL Max Connections Exhaust (#1243) @bsuryadevara

Morpheus 23.07.02 (25 Jul 2023)

🐛 Bug Fixes

• Move data dir to models (#1099) @dagardner-nv

Morpheus 23.07.01 (21 Jul 2023)

🐛 Bug Fixes

• Fixing submodules commit ID which got messed up in merge (#1086) @mdemoret-nv

Morpheus 23.07.00 (20 Jul 2023)

🚨 Breaking Changes

• Use size_t for element counts & byte sizes (#1007) @dagardner-nv
• Fix logging of wrong feature_columns in CLI and exception in auto-complete (#983) @dagardner-nv
• Use new cudf C++ json writer (#888) @dagardner-nv
• Python 3.10 support (#887) @cwharris
• Update to CuDF 23.02 and MRC 23.07 (#848) @cwharris

🐛 Bug Fixes

• Fix fetch_example_data.py to work with s3fs v2303.6 (#1053) @dagardner-nv
• Fix models scripts/notebooks (#1051) @tzemicheal
• DFP visualization updates/fixes (#1043) @efajardo-nv
• Remove loop from several asyncio API calls (#1033) @mdemoret-nv
• Fix release and dev container builds (#1027) @cwharris
• Adopt s3fs 2023.6 per #1022 (#1023) @dagardner-nv
• Move hard-coded path in E2E benchmarks to config json (#1011) @efajardo-nv
• Use size_t for element counts & byte sizes (#1007) @dagardner-nv
• Fix pybind11 link errors (#1003) @cwharris
• Fixing build with MRC breaking changes (#998) @mdemoret-nv
• Use cuda-toolkit in release container build (#997) @efajardo-nv
• Fix "No module named 'versioneer'" error (#990) @cwharris
• Warn and cast to cudf, when the C++ impl for MessageMeta receives a pandas DF (#985) @dagardner-nv
• Fix logging of wrong feature_columns in CLI and exception in auto-complete (#983) @dagardner-nv
• Remove duplicate log message in output when using pre-allocation (#981) @dagardner-nv
• Update to cuda-toolkit in release container build (#974) @efajardo-nv
• Add override for count method in SlicedMessageMeta (#972) @dagardner-nv
• Update .bashrc in container to activate morpheus conda environment (#969) @efajardo-nv
• Fix build issues & tests (#966) @dagardner-nv
• Remove/update tests which mock MRC builder objects (#955) @dagardner-nv
• Remove problematic test causing segfaults (#954) @dagardner-nv
• Fixing multi-sender stage configurations (#951) @mdemoret-nv
• Add support for fsspec.core.OpenFile instances to the MonitorStage (#942) @dagardner-nv
• Fix race condition in CompareDataFrameStage (#935) @dagardner-nv
• remove unnecessary quotes from CMAKE_ARGS expression (#930) @cwharris
• Enforce dtype for ColumnInfo and RenameColumn (#923) @dagardner-nv
• Fix early stopping code in dfencoder to use average loss of batches in validation set (#908) @hsin-c
• Fix get_anomaly_score_losses in dfencoder to work without categorical features (#893) @hsin-c
• Update gnn_fraud_detection_pipeline & ransomware_detection examples to use the same version of dask (#891) @dagardner-nv

📖 Documentation

• Add note about needing docker-compose v1.28+ for DFP (#1054) @dagardner-nv
• Clean up CLX references in docstring (#1049) @efajardo-nv
• Update docs to use docker compose (#1040) @efajardo-nv
• Fix documentation builds (#1039) @dagardner-nv
• GNN FSI modelcard++ (#1010) @tzemicheal
• DFP Model Card ++ (#1006) @hsin-c
• Document how to build the examples (#992) @dagardner-nv
• Documentation review edits (#911) @dagardner-nv
• Add PyTorch to ONNX section to training notebooks (#903) @efajardo-nv
• Update E2E Benchmarks README (#880) @efajardo-nv

🚀 New Features

• Update to CUDF 23.06 (#1020) @cwharris
• Grafana DFP dashboard (#989) @efajardo-nv
• DFP MultiFileSource optionally poll for file updates (#978) @dagardner-nv
• Migrate generic components from azure-ad workflow (#939) @bsuryadevara
• Migrate CLX parsers (#894) @efajardo-nv
• Python 3.10 support (#887) @cwharris
• GPUNetIO Integration (#879) @cwharris
• Update to CuDF 23.02 and MRC 23.07 (#848) @cwharris

🛠️ Improvements

• Support building the Morpheus containers when Morpheus is a submodule (#1057) @mdemoret-nv
• Changing GRPC requirement from grpc-cpp to libgrpc (#1056) @mdemoret-nv
• Merge morpheus core spear phishing components. (#1044) @drobison00
• Example Documentation Updates (#1038) @cwharris
• Update docs and examples to use Triton 23.06 (#1037) @efajardo-nv
• SID visualization updates (#1035) @efajardo-nv
• New CI images with rapids 23.06 (#1030) @dagardner-nv
• Remove conda's base pip (CVE) (#1024) @pdmack
• Remove PIP_FIND_LINKS for torch from setup.py (#1019) @efajardo-nv
• Upgrade to pytorch 2.0.1 conda package (#1015) @efajardo-nv
• Model card ++ for ABP, Phishing, Root cause analysis (#1014) @gbatmaz
• Bring forward some CVE fixes from 23.03 release (#1002) @pdmack
• Remove patch from pybind11 (#1001) @dagardner-nv
• Install pytest-kafka via pip/pypi (#988) @dagardner-nv
• Adopt MatX 0.4.1 (#971) @dagardner-nv
• fix_contrib_instructions (#959) @yuchenz427
• Multi-class Sequence Classifier (#952) @efajardo-nv
• Add Pylint to CI (#950) @dagardner-nv
• Helper scripts for running CI locally (#949) @dagardner-nv
• Adopt updated utilities to pickup MatX 0.4.0 (#947) @dagardner-nv
• Add COLLABORATOR to exclusion in label-external-issues.yml (#946) @jarmak-nv
• Multiple Input Kafka Topics Support (#944) @bsuryadevara
• Tests for stages in DFP Production Example (#940) @dagardner-nv
• Integrate NVTabular into Morpheus Core and replace existing column_info based workflows. (#938) @drobison00
• Auto-Comment on External Issues (#926) @jarmak-nv
• DFP Integrated Training Updates (Stress Testing/Benchmarks) (#924) @bsuryadevara
• Add CONTRIBUTOR to triage label exception (#918) @jarmak-nv
• Improve DFP period functionality to allow for better sampling and ignoring period (#912) @mdemoret-nv
• Tests for gnn_fraud_detection_pipeline & ransomware_detection (#904) @dagardner-nv
• [ENH] Change external labeler to use the GH CLI for fine-grained token support (#899) @jarmak-nv
• [ENH] Label External Issues: Update secret, add discussions (#897) @jarmak-nv
• Use new cudf C++ json writer (#888) @dagardner-nv
• Create tests for examples with custom stages (#885) @dagardner-nv
• Use ARC V2 self-hosted runners for GPU jobs (#878) @jjacobelli
• Removing explicit driver install from CI runner (#877) @mdemoret-nv
• Adding an update-version.sh script and CI check to keep versions up to date (#875) @mdemoret-nv
• Add DFP Viz dependencies to DFP container (#873) @efajardo-nv
• Use eval_batch_size for AutoEncoder loss stats (#861) @efajardo-nv
• GitHub Infra Update -Delete QST Issue Template in Favor of Discussions, Remove Add to Project Action (#860) @jarmak-nv
• Add dataset fixture to ease fetching DataFrames for tests (#847) @dagardner-nv
• Add DataManager object to morpheus/io (#846) @drobison00
• Suppress volatile warning when building code generated by Cython (#844) @dagardner-nv
• Replace usage of PreprocessLogParsingStage with PreprocessNLPStage (#842) @dagardner-nv
• Replace deprecated usage of make_node and make_node_full (#839) @dagardner-nv
• Bump version to 23.07 and version of MRC dep (#834) @dagardner-nv
• Update .gitignore to include some common temporary files that shouldn't be tracked by git (#829) @dagardner-nv
• Pre-allocate needed columns in abp_pcap_detection example (#820) @dagardner-nv
• Use ARC V2 self-hosted runners for CPU jobs (#806) @jjacobelli

Morpheus 23.03.01 (04 Apr 2023)

📖 Documentation

• Misc Documentation fixes for 23.03 (#840) @dagardner-nv

Morpheus 23.03.00 (30 Mar 2023)

🚨 Breaking Changes

• Migrate dfencoder to morpheus repo (#763) @dagardner-nv
• Improve the python CMake functionality to speed up the configure step (#754) @mdemoret-nv
• Consolidate size types 684 (#747) @dagardner-nv
• Deprecate ResponseMemoryProbs & MultiResponseProbsMessage (#711) @dagardner-nv
• Add Pytest 'testpaths' (#677) @bsuryadevara
• DFP benchmark related pytest error (#673) @bsuryadevara
• Control MonitorStage output with the log-level (#659) @dagardner-nv
• Fix Python bindings for TensorMemory (#655) @dagardner-nv
• Table locking & column preallocation (#586) @dagardner-nv

🐛 Bug Fixes

• Add Node.js install instructions to DFP Viz readme (#828) @efajardo-nv
• Fix handling of message offsets in ae pre-processing and timeseries stage (#821) @dagardner-nv
• Set default DFP container version to 23.03 (#813) @dagardner-nv
• Fix debug log message caused by breaking the long string (#812) @dagardner-nv
• Fix for log_parsing and ransomware_detection examples (#802) @dagardner-nv
• Fix abp_pcap_detection example (#792) @dagardner-nv
• Fix the conda build (#783) @cwharris
• Fix calls to MultiAEMessage constructor (#781) @efajardo-nv
• Fix MultiAEMessage constructor (#780) @efajardo-nv
• Change userid_column_name to match the command line equivelants (#778) @dagardner-nv
• Fix for TritonInferenceStage memory leak (#776) @cwharris
• Fix intermittent test failure in tests/test_message_meta.py (#772) @dagardner-nv
• Fix absolute depfile causing python package to reinstall each build (#769) @mdemoret-nv
• Adopt fixed mrc version (#768) @dagardner-nv
• Have conda-build test cuml installation (#764) @cwharris
• Document adding cuML and fix the gnn_fraud_detection_pipeline example (#758) @dagardner-nv
• Add write permission to triage labeler action (#750) @jarmak-nv
• Replace soon to be deprecated docker base gpuci/miniforge-cuda (#718) @dagardner-nv
• Fix detecting index column when reading from CSV in C++ (#714) @dagardner-nv
• Add unittest to ensure the kafka source is respecting the pipeline batch size (#710) @dagardner-nv
• Fix DFPTraining validation set option (#709) @efajardo-nv
• fix incorrect line and byte count benchmarks (#695) @bsuryadevara
• Warn & replace dataframes with non-unique indexes (#691) @dagardner-nv
• Update DFPRollingWindowStage to emit correct window (#683) @efajardo-nv
• Add Pytest 'testpaths' (#677) @bsuryadevara
• DFP benchmark related pytest error (#673) @bsuryadevara
• Checking out a specific commit, requires a non-shallow checkout (#662) @dagardner-nv
• Fix Python bindings for TensorMemory (#655) @dagardner-nv

📖 Documentation

• Fix source code links from docs (#774) @dagardner-nv
• Updated and fixed model docs and examples. (#685) @shawn-davis
• Update contributing.md (#671) @efajardo-nv
• Silence build warnings when building rabbitmq example (#658) @dagardner-nv

🚀 New Features

• Integrated training: Framework updates and Modular DFP pipeline implementation (#760) @drobison00
• Add support for Parquet file input (#770) @efajardo-nv
• Add InMemorySinkStage (#752) @dagardner-nv
• Create a PR template (#751) @jarmak-nv
• Update to CUDA 11.8 (#748) @cwharris
• Devcontainer work for #702, #703 (#717) @cwharris
• Training/Inference Module DFP Production (#669) @bsuryadevara
• Benchmarks for DFP Production Pipeline (#664) @bsuryadevara
• Table locking & column preallocation (#586) @dagardner-nv

🛠️ Improvements

• Convert MonitorStage to a component (#805) @mdemoret-nv
• Update mlflow base image and python versions for CVE (#789) @pdmack
• Cleanup all uses of import morpheus._lib.common (#787) @mdemoret-nv
• End-to-end dfencoder test (#777) @dagardner-nv
• Add multi-gpu and dataloader support for dfencoder (#775) @hsin-c
• Migrate dfencoder to morpheus repo (#763) @dagardner-nv
• Updating to driver 525 (#755) @jjacobelli
• Improve the python CMake functionality to speed up the configure step (#754) @mdemoret-nv
• Make use of new MRC_PTR_CAST (#749) @dagardner-nv
• Consolidate size types 684 (#747) @dagardner-nv
• Update workflow permissions block (#745) @ajschmidt8
• Use AWS OIDC to get AWS creds (#742) @jjacobelli
• : External issue label (#739) @jarmak-nv
• Create types.hpp (#737) @dagardner-nv
• New base test class that invokes an embedded Python interpreter (#734) @dagardner-nv
• Fix code style and re-enabled IWYU (#731) @mdemoret-nv
• Avoid copy of source data in AddClassificationsStage and FilterDetectionsStage (#730) @dagardner-nv
• Run clang-format on entire repo (#719) @efajardo-nv
• Deprecate ResponseMemoryProbs & MultiResponseProbsMessage (#711) @dagardner-nv
• Update sccache bucket (#693) @ajschmidt8
• Move duplicated one-liner to TensorUtils (#682) @dagardner-nv
• Adopt v0.12.0 of rabbitmq-c and return to using a shallow checkout (#679) @dagardner-nv
• Adopt matx v0.3.0 (#667) @dagardner-nv
• WriteToFileStage optionally emit a flush on each message received (#663) @dagardner-nv
• Clean up use of find/delete for CVE (#661) @pdmack
• Control MonitorStage output with the log-level (#659) @dagardner-nv

Morpheus 23.01.00 (30 Jan 2023)

🚨 Breaking Changes

• Add missing docstrings (#628) @dagardner-nv
• Remove unused cudf_kwargs constructor argument from FileSourceStage & NLPVizFileSource (#602) @dagardner-nv
• DFP: Exclude unwanted columns (#583) @dagardner-nv
• Morpheus refactor to MRC (#530) @drobison00
• Add C++ API docs to documentation builds (#414) @dagardner-nv

🐛 Bug Fixes

• Updated gitignore (#633) @bsuryadevara
• Update meta.yaml (#621) @pdmack
• Remove hard-coded keys from production DFP (#607) @efajardo-nv
• Remove unused cudf_kwargs constructor argument from FileSourceStage & NLPVizFileSource (#602) @dagardner-nv
• Update container version to 23.01 in DFP docker-compose (#578) @dagardner-nv
• rm inadvertent kafka-docker add (#518) @pdmack
• Fix ambiguous segfault for test requiring MORPHEUS_ROOT (#514) @cwharris
• Fix offset attr in inference messages (#513) @dagardner-nv

📖 Documentation

• Fix docstring for InferenceMemoryAE (#653) @dagardner-nv
• 23.01 doc fixes (#652) @dagardner-nv
• Update NGC version references (#642) @pdmack
• Updating Code of Conduct (#640) @mdemoret-nv
• Split up the DFP guide (#637) @dagardner-nv
• Add md & rst files to copyright.py checks and Fix copyright year in Sphinx footer (#635) @dagardner-nv
• Add missing docstrings (#628) @dagardner-nv
• Model and dataset documentation update (#612) @shawn-davis
• Fix production DFP pipeline run commands (#608) @efajardo-nv
• Update copyright headers for 2023 (#599) @efajardo-nv
• Ensure Kafka & Triton deps are documented when used (#598) @dagardner-nv
• Typo(fix): missing equal operator in --load_model (#596) @tanmoyio
• Stated explicitly regarding helm chart names (#592) @bsuryadevara
• Fix spelling mistakes & bad copy/paste (#590) @dagardner-nv
• Removed outdated comments (#585) @bsuryadevara
• Document DFP output fields (#581) @dagardner-nv
• 566 doc source basics overviewrst (#580) @bsuryadevara
• Small updates to examples/basic_usage/README.md (#575) @dagardner-nv
• Misc updates for README.md (#574) @bsuryadevara
• Add a glossary to docs (#573) @dagardner-nv
• Remove search link from index.rst (#572) @efajardo-nv
• getting_started.md: Goto is two words. (#571) @dagardner-nv
• Minor fixes/updates to abp_pcap_detection example (#570) @dagardner-nv
• More documentation fixes (#560) @dagardner-nv
• Misc documentation fixes (#547) @dagardner-nv
• Update cloud deployment guide and fix doc build instructions. (#546) @cwharris
• Move DFP Viz screenshot to LFS (#537) @efajardo-nv
• Restructure the getting started guide (#536) @dagardner-nv
• Morpheus not "Morpheus SDK" (#534) @dagardner-nv
• 525 doc images in docs/source/basics/img should be moved to LFS (#532) @bsuryadevara
• 524 doc remove usage of buffer stage from examples.rst (#528) @bsuryadevara
• Rename morpheus_quickstart_guide to cloud_deployment_guide (#526) @cwharris
• Reorg docs (#522) @dagardner-nv
• Documentation updates (#519) @dagardner-nv
• Remove fork references (#511) @efajardo-nv
• Typo fixes (#502) @pdmack
• Add C++ API docs to documentation builds (#414) @dagardner-nv

🚀 New Features

• Add GitHub CLI support to devcontainer (#629) @cwharris
• DFP pipeline module (#510) @bsuryadevara

🛠️ Improvements

• Update protobuf to 3.20.2 (#648) @pdmack
• Update torch to 1.13.1+cu116 (#645) @pdmack
• Update morpheus-visualizations submodule (#639) @efajardo-nv
• Updating the CI image to use Driver 520 (#634) @mdemoret-nv
• Update Rapids version to 22.10 (#617) @efajardo-nv
• Update DFPMLFlowModelWriterStage to no longer save mean and std metrics (#605) @efajardo-nv
• Log parsing model training for split logs and smaller models (#597) @raykallen
• Ensure that the mlflow logger is uses at the same level as the morpheus logger (#594) @dagardner-nv
• DFP: Exclude unwanted columns (#583) @dagardner-nv
• Add validation set option to DFP training (#579) @efajardo-nv
• Updating CI runner image for MRC and C++20 (#556) @mdemoret-nv
• Add Morpheus devcontainer (#535) @cwharris
• Morpheus changes related to utility consolidation (#531) @drobison00
• Morpheus refactor to MRC (#530) @drobison00
• Update to PyTorch 1.12 (#523) @efajardo-nv

Morpheus 22.11.00 (18 Nov 2022)

🐛 Bug Fixes

• Set ver of mlflow client to match that of the server (#484) @dagardner-nv
• Improve Morpheus Shutdown Behavior On Exception (#478) @mdemoret-nv
• update for numpy array results on ABP notebook (#468) @gbatmaz
• Remove warning about tests not having a return value (#457) @dagardner-nv
• DFPFileBatcherStage: Sort only by timestamp (#450) @dagardner-nv
• Fix unittests (#444) @dagardner-nv
• Ensure Camouflage is shutdown after every test (#436) @mdemoret-nv
• Properly calculate the offset of the column_view & apply offsets in copy_meta_ranges (#423) @dagardner-nv
• Remove buildx from docker command causes issues with docker 20.10.5 (#417) @dagardner-nv
• Pin camouflage to v0.9 and ensure pytest-benchmark>=4 (#416) @dagardner-nv
• Set a default value for --columns_file and populate the help string (#405) @dagardner-nv
• Add missing import (#402) @dagardner-nv
• Move to srf-22.11 alpha (#399) @dagardner-nv

📖 Documentation

• Use tritonserver 22.06 for the phishing example (#477) @dagardner-nv
• Add datasets readme, change lfs tracking (#474) @raykallen
• Documentation Updates (#458) @bsuryadevara
• Set channels and versions to ensure we get a good version of tensorflow (#429) @dagardner-nv
• Clarifications and improvements to Kafka manual testing documentation (#422) @dagardner-nv
• Add documentation to LinearBoundary stages (#418) @drobison00
• Update Quickstart Guide (#398) @bsuryadevara
• Add more details to E2E benchmarks README (#395) @efajardo-nv

🚀 New Features

• Phishing model and data updates (#462) @raykallen
• Root cause analysis example pipeline (#460) @efajardo-nv
• Root cause use case scripts (#452) @gbatmaz
• DFP Visualization Example (#439) @efajardo-nv
• : Replacing md issue templates with yml forms (#407) @jarmak-nv
• Create action to add issues/prs to the project (#326) @jarmak-nv

🛠️ Improvements

• Update External Repo to Single Directory (#479) @mdemoret-nv
• Root cause analysis datasets (#470) @efajardo-nv
• Various Dockerfile-based updates for 22.11 (#466) @pdmack
• ABP change the arg name in the comment and update req (#455) @gbatmaz
• Forward Merge branch-22.09 into branch-22.09 (#448) @mdemoret-nv
• Avoid unnecessary copy in add-scores stage (#438) @dagardner-nv
• MultiInferenceMessage & MultiResponseMessage share a new base class (#419) @dagardner-nv
• Add dockerfile for CI runner (#408) @dagardner-nv
• remove work-around for pytest-kafka issue #10 (#392) @dagardner-nv
• Switch to Github Actions (#389) @dagardner-nv
• Simplify Python impl for KafkaSourceStage (#300) @dagardner-nv

Morpheus 22.09.01 (9 Nov 2022)

🐛 Bug Fixes

• 426 bug msg keyerror data (#428) @bsuryadevara

Morpheus 22.09.00 (30 Sep 2022)

🚨 Breaking Changes

• Adjustments for docker build inclusion of morpheus-visualization (#366) @pdmack
• Add pluggy to docker build for CLI; fixes 357 (#358) @pdmack
• kafka integration tests (#308) @dagardner-nv

🐛 Bug Fixes

• Pin numba version (#387) @pdmack
• Training and validation script and notebook fixes. (#386) @shawn-davis
• Add websockets dependency for viz (#383) @efajardo-nv
• updating the filenames in the paths and adding the missing file for abp (#378) @gbatmaz
• Ransomware models need update for Triton 22.08 (#377) @bsuryadevara
• Adjustments for docker build inclusion of morpheus-visualization (#366) @pdmack
• Removing grpcio-channelz (#360) @mdemoret-nv
• Add pluggy to docker build for CLI; fixes 357 (#358) @pdmack
• Branch 22.09 merge 22.08 (#336) @mdemoret-nv

📖 Documentation

• Update Quickstart Guide for 22.09 (#382) @pdmack
• Starter DFP docstring updates (#370) @efajardo-nv
• Wholesale updates for tritonserver version (#369) @pdmack
• Misc DFP Documentation & fixes (#368) @dagardner-nv
• Fix broken developer guide code examples (#333) @dagardner-nv
• Clarification of known issue in QSG (#328) @pdmack
• Initial example readme (#304) @cwharris

🚀 New Features

• Bump Versions 22.09 (#361) @mdemoret-nv
• Demo notebook for DFP feature selection with toy dataset (#359) @hsin-c
• SID Visualization Example (#354) @efajardo-nv
• Add DFP Production Example Workflow (#352) @mdemoret-nv
• Digital Fingerprinting 2.0 Pipelines (#315) @efajardo-nv
• Add CLI Extensions to Allow Running Custom Stages with the Morpheus CLI (#312) @mdemoret-nv

🛠️ Improvements

• Update HAMMAH E2E benchmark test to DFP 2.0 (#380) @efajardo-nv
• Resolves #350 -- Adds support for segmenting LinearPipelines (#374) @drobison00
• Add jupyter to the main Dockerfile (NGC) (#373) @pdmack
• Use libcudacxx from NVIDIA repo (#372) @pdmack
• DFP Updates to enable example workflows (#371) @drobison00
• Mlflow update 2209 (#367) @pdmack
• Update Dockerfile (#353) @pdmack
• kafka integration tests (#308) @dagardner-nv
• IWYU CI integration for Morpheus (#287) @dagardner-nv

Known Issues

• The GNN example workflow cannot be run due to incompatible dependencies between cuML 22.08 and SRF 22.09. See issue #390

Morpheus 22.08.00 (7 Sep 2022)

🐛 Bug Fixes

• Fixing compilation with SRF 22.08a (#332) @mdemoret-nv
• Update Ransomware Models (#295) @bsuryadevara
• Bump numpy from 1.19.5 to 1.22.0 in /models/validation-inference-scripts/fraud-detection-models (#175) @dependabot[bot]
• Bump numpy from 1.19.5 to 1.22.0 in /models/training-tuning-scripts/fraud-detection-models (#174) @dependabot[bot]
• Bump numpy from 1.20.3 to 1.22.0 in /models/validation-inference-scripts/phishing-models (#173) @dependabot[bot]
• Bump numpy from 1.20.3 to 1.22.0 in /models/validation-inference-scripts/hammah-models (#172) @dependabot[bot]

📖 Documentation

• Add Azure known issue to QSG (#323) @pdmack
• QSG updates for data dir (#302) @pdmack
• Manual testing of Morpheus with Kafka & Validation improvements (#290) @dagardner-nv
• Updates README.md to include instructions for launching Triton (#289) @dagardner-nv
• Update NLP SI example readme (#284) @pdmack
• Update GNN example readme (#283) @pdmack

🚀 New Features

• E2E benchmark tests (#269) @efajardo-nv
• Use SRF Logging (#266) @mdemoret-nv

🛠️ Improvements

• Fixes issues with NLP pipelines when data is not truncated (#316) @dagardner-nv
• Update include ordering and style (#277) @dagardner-nv
• MonitorStage add a blank space between the rate and the unit description (#275) @dagardner-nv
• Ensure TableInfo only appears in one lib (#273) @dagardner-nv
• copy multiple ranges for MultiMessage (#231) @dagardner-nv
• GPU not needed for build & documentation CI stages (#181) @dagardner-nv

Morpheus 22.06.01 (15 Jul 2022)

🐛 Bug Fixes

• Fix pandas version in runtime container (#270) @efajardo-nv

Morpheus 22.06.00 (5 Jul 2022)

🚨 Breaking Changes

• Update Morpheus to Use SRF 22.06 (#152) @mdemoret-nv
• update cudf to 22.04, cuda to 11.5 (#148) @cwharris
• Fixes Timestamp Nodes When Running with --debug (#145) @mdemoret-nv
• Dockerfile COPY section needs update (#141) @pdmack
• Reorganize the python package files (#98) @mdemoret-nv

🐛 Bug Fixes

• Fixing Python Kafka Source with Multiple Threads (#262) @mdemoret-nv
• Fixing the from-kafka stage (#257) @mdemoret-nv
• Pin Conda Package cuda-python <=11.7.0 to Fix Conda Build (#252) @mdemoret-nv
• Fixing to-kafka Stage by Converting to a Pass Through Node (#245) @mdemoret-nv
• Move Morpheus Data Files Out of LFS (#242) @mdemoret-nv
• Missing 'supports_cpp_node' impl function (#239) @bsuryadevara
• Revert ransomware feature config changes (#234) @bsuryadevara
• Use git version 2.35.3 in release build (#224) @mdemoret-nv
• Rollback CI images and fix dev container (#191) @cwharris
• Update cuda11.5_dev.yml (#167) @pdmack
• Adding in pybind11-stubgen to the conda package (#163) @mdemoret-nv
• Fixes Timestamp Nodes When Running with --debug (#145) @mdemoret-nv
• Dockerfile COPY section needs update (#141) @pdmack
• Add pybind11-stubgen to conda environment yaml. (#109) @drobison00
• Update hammah-inference.py (#90) @pdmack
• Install new apt key in docker (#72) @dagardner-nv
• Ensure default path values in morpheus.cli are no longer relative (#62) @dagardner-nv
• Fix the nlp_si_detection example (#61) @dagardner-nv

📖 Documentation

• Fix GNN example and update installation instructions (#189) @cwharris
• Documentation fixes (#147) @dagardner-nv
• Update morpheus_quickstart_guide.md (#142) @pdmack
• Split data dir, moving large files into examples/data (#130) @dagardner-nv
• Update morpheus_quickstart_guide.md (#127) @bsuryadevara
• Update morpheus_quickstart_guide.md (#106) @pdmack
• Apply enterprise sphinx html theme to docs (#97) @efajardo-nv
• Updates to developer_guide for clarity. (#96) @lobotmcj
• Updates to README.md for clarity (#91) @BartleyR
• Update README.md (#76) @pdmack
• Fix typos in README.md & Change GitLab-style reference in CONTRIBUTING.md (#74) @lobotmcj
• Updated README with documentation links and banner image (#71) @BartleyR

🚀 New Features

• Fix 22.06 style checks (#249) @mdemoret-nv
• Add CLI Relative Path Fallback (#232) @mdemoret-nv
• Adding new SRF cmake variables (#198) @mdemoret-nv
• ransomware ds requirements (#196) @raykallen
• Update to rapids 22.06 (#180) @cwharris
• Fix for CI check script (#158) @dagardner-nv
• Update Morpheus to Use SRF 22.06 (#152) @mdemoret-nv
• Ransomware detection pipeline (#149) @bsuryadevara
• update cudf to 22.04, cuda to 11.5 (#148) @cwharris
• Limit which lfs assets are pulled by default (#139) @dagardner-nv
• AppShieldSource stage (#136) @bsuryadevara
• Include C++ Unittests in CI (#135) @dagardner-nv
• Set Python3_FIND_STRATEGY=Location (#131) @dagardner-nv
• Migrate Neo's tensor code directly into Morpheus (#129) @dagardner-nv
• Updating CODEOWNERS for New Organization (#118) @mdemoret-nv
• Add pybind11/cython stubs to Morpheus package (#100) @mdemoret-nv
• Reorganize the python package files (#98) @mdemoret-nv
• Update morpheus dev container to support flag for building with debug python build + source files. (#81) @drobison00

🛠️ Improvements

• Fixing Outstanding Style Errors (#261) @mdemoret-nv
• Pin cuda-python to 11.7.0 (#246) @dagardner-nv
• Fixes Pipeline.visualize (#203) @dagardner-nv
• nlp_si_detection example improvements (#193) @dagardner-nv
• Update GNN FSI pipeline example & notebook. (#182) @tzemicheal
• Add missing git-lfs package to docker container (#179) @dagardner-nv
• release container build fixes (#164) @cwharris
• remove ssh instructions from CONTRIBUTING guide (#162) @cwharris
• Update mlflow-env.yml (#146) @pdmack
• Add script to capture triton config (#116) @pdmack
• Update mlflow-env.yml (#113) @pdmack
• Jenkins improvememts (#107) @dagardner-nv
• Rename mlflow conda env file (#82) @pdmack
• Jenkins integration (#80) @dagardner-nv
• Revert "Install new apt key" (#79) @dagardner-nv
• Clear log handlers after each test (#66) @dagardner-nv
• Fix type-o in log parsing example & small formatting fix (#58) @dagardner-nv

⚠️ Known Issues

• Triton 22.04 can crash under heavy load from Morpheus+Kafka (#259)

Morpheus 22.04.00 (27 Apr 2022)

Initial Public Release

Morpheus is being provided as OSS and is now generally available on GitHub as well as NGC (NVIDIA GPU Cloud). Morpheus is still early software and a work in progress. Breaking changes (including breaking API changes) are to be expected

Highlights

• GNN (Graph Neural Networking) based workflow for fraud detection
• Transformer based workflow for log parsing
• Updated Morpheus to use the features for pipeline development

🐛 Bug Fixes

• Fix default DOCKER_IMAGE_TAG to match that of build_container_release.sh (#33) @dagardner-nv
• fix incorrect bert vocab and hash in training-tuning-scripts/log-parsing/resources (#32) @raykallen
• Removing no_args_is_help from CLI commands (#29) @mdemoret-nv
• Log parsing example updates (#28) @efajardo-nv
• fix to_file "overwrite" option for cli (#15) @cwharris

📖 Documentation

Documentation is provided in the Morpheus GitHub repo (https://github.com/NVIDIA/Morpheus/tree/branch-22.04/docs)

• Update CONTRIBUTING.md & fix file ownership (#27) @dagardner-nv
• README updates to provide NGC links (#25) @BartleyR
• Move model card info to readme and model-information.csv (#20) @raykallen

🛠️ Improvements

• TensorRT installation warning for onnx_to_trt (#23) @cwharris

⚠️ Known Issues

• No known issues