Skip to content

Releases: evidentlyai/evidently

Support for Tests Criticality

22 Aug 23:41
Compare
Choose a tag to compare

Support for both percentages and absolute values ​​in histograms

10 Aug 13:34
Compare
Choose a tag to compare

UI Service

26 Jul 15:41
Compare
Choose a tag to compare

Updates:
#631
#634
#633
#668
#672
#677
#684
#687
#690

Fixes:
#641
#651
#665

Breaking Changes:
#644

Text Comment and Text Descriptors

12 Jun 18:23
Compare
Choose a tag to compare

Updates:
#619
#622
#628
#629

Experimental:
#600

Breaking Changes:
Renamed parameter lemmatisize -> lemmatize in TriggerWordsPresence text descriptor

Fixes:
#607
#611
#613
#615
#618
#617
#623
#624
#625
#626
#630

Aggregated metrics visualization

19 May 15:44
Compare
Choose a tag to compare

Breaking Changes:
#601
Since this version, the following metrics will render aggregated plots instead of raw data plots:

  • ColumnDriftMetric
  • DataDriftTable
  • ColumnValuePlot
  • TextDescriptorsDriftMetric
  • ColumnSummaryMetric
  • RegressionPredictedVsActualScatter
  • RegressionPredictedVsActualPlot
  • RegressionErrorPlot
  • RegressionAbsPercentageErrorPlot
  • RegressionErrorNormality
  • RegressionTopErrorMetric
  • ClassificationClassSeparationPlot
  • ClassificationQualityByFeatureTable
  • RegressionErrorBiasTable
  • TargetByFeaturesTable

To return raw data plots use render option :

  • On a metric level:
report = Report(
	metrics=[
	RegressionPredictedVsActualScatter(options={"render": {"raw_data": True}}),
])

  • On a report level:
report = Report(
    metrics=[
      RegressionQualityMetric(),
      RegressionPredictedVsActualScatter(),
    ],
    options={"render": {"raw_data": True}}
  )

Updates:
#588
#589
#597

Fixes:
#593

Support for Text Descriptors in Column Tests and Embedding Drift Test

27 Apr 10:42
Compare
Choose a tag to compare

Breaking Changes:
#585
Drift detection method
text_content_drift was renamed to perc_text_content_drift
This happened because an additional text data drift detection method was added: abs_text_content_drift. This drift detection technique works more efficiently with large datasets.

Updates:
#562
#564
#566
#567
#569
#570
#587

Fixes:
#568
#572
#573
#574
#575
#579
#580
#582
#583
#586

Dashboards API is no longer supported! JSON output customisation & Embeddings Drift Metric

12 Apr 10:48
Compare
Choose a tag to compare

Breaking Changes:
Old API is no longer supported! There are no more Dashboards, Model Profiles, Tabs, and Profile Sections!
#550

Updates:
JSON output customisation:
#543
#545
#548

Text descriptors support in column metrics and tests:
#542
#546
#553
#557

Embeddings Drift Metric
#558

Fixes:
#560

New Examples:
How to customize JSON output for Reports and TestSuites?
How to calculate drift for embeddings?
How to apply column metrics for text descriptors?

Fix for reports json generation

29 Mar 22:12
Compare
Choose a tag to compare

MetricResult structuring (to be used for JSON adjustment later)

22 Mar 16:21
Compare
Choose a tag to compare

Text Descriptors Customisation for Text-specific Metrics and Preset

03 Mar 18:01
Compare
Choose a tag to compare

Updates:

  1. Added text descriptor TriggerWordsPresence
  2. Added an option to specify which text descriptors should be used in the following metrics:
  • TextDescriptorsDriftMetric
  • TextDescriptorsDistribution
  • TextDescriptorsCorrelationMetric
  1. Added an option to specify which text descriptors should be used in the TextOverviewPreset

Fixes:
#512
#519
#520
#521
#522