Skip to content

Releases: evidentlyai/evidently

Fix: dependency on PyYaml version 6.0

25 Nov 16:37
Compare
Choose a tag to compare
Pre-release

Removed PyYAML~=6.0 from the dependencies

Code Style and Object Types Checks

21 Nov 20:39
Compare
Choose a tag to compare
Pre-release
  • Added flake8 for code style checks
  • Added mypy for object types checks
  • Improved code style
  • Added contribution guide

Support for widget visualization in Colab, Pylab, Kaggle, Deepnote

12 Nov 15:16
Compare
Choose a tag to compare
  1. Supported dashboard visualization in Google Colab
  2. Supported dashboard visualization in python Pylab
  3. Added a parameter mode for dashboard.show(), which can take the following options:
  • auto - the default option. Ideally, you will not need to specify the value for mode and use the default. But, if it does not work (in case we failed to determine the environment automatically), consider setting the correct value explicitly.
  • nbextention - to show the UI using nbextension. Use this option to display dashboards in jupyter notebooks (should work automatically).
  • inline - to insert the UI directly into the cell. Use this option for Google Colab, Kaggle Kernels and Deepnote. For Google Colab this should work automatically, for Kaggle Kernels and Deepnote option should be specified explicitly.

Support for widget visualization in Colab and Pylab

10 Nov 17:43
Compare
Choose a tag to compare
  • Supported dashboard visualization in Google Colab
  • Supported dashboard visualization in python Pylab
  • Added a parameter to switch on pylab visualization model: dashboard.show(mode='pylab')

Data Drift Monitoring with Grafana

13 Oct 19:43
Compare
Choose a tag to compare
Pre-release
  • Added a way to calculate metrics with moving window
  • Added metrics logging to Prometheus
  • Added an example of Data Drift Monitoring with Prometheus and Grafana
  • Added a config for Data drift dashboard at Grafana

Fix: Regression Performance Dashboard

06 Oct 15:26
Compare
Choose a tag to compare
Pre-release

Fix for #61

UI and architecture update

24 Sep 15:40
Compare
Choose a tag to compare
Pre-release
  • Added the source code for the UI (now it can be built from the source)
  • Created utils.py with helper functions
  • Added config for Pylint
  • Added some unit tests

Dataset Drift and Customised Bins

06 Sep 15:53
Compare
Choose a tag to compare
Pre-release

Added the following options to configure data drift report:

  • 'drift_conf_level' confidence level for the individual features (default value = 0.95)
  • 'drift_features_share' - share of the drifted features to detect dataset drift (default value = 0.5)
  • 'xbins' - the custom bins to plot in the datadrift table
  • 'nbinsx' - the custom number of bins to plot in the datadrift table

If share of the features drifted at the 'drift_conf_level' confidence level is higher than the 'drift_features_share' threshold, than Dataset drift will be detected. Otherwise Dataset drift will not be detected.

Telemetry for CLI

02 Aug 11:48
Compare
Choose a tag to compare
Telemetry for CLI Pre-release
Pre-release
  • When you use Evidently in the command-line interface, we collect basic telemetry. It includes data on the environment (e.g. Python version) and usage (type of report or profile generated).
  • Our telemetry is intentionally limited in scope. We DO NOT collect any sensitive information and never see the data, its structure, or column names.
  • You can read more about what we collect here.
  • You can opt-out from telemetry collection by setting the environment variable EVIDENTLY_DISABLE_TELEMETRY=1

Proportion Difference Test

20 Jul 13:45
Compare
Choose a tag to compare
Pre-release
  • Added proportion difference test for binary categorical target/prediction drift
  • Added proportion difference test for data drift (categorical features)