Releases: evidentlyai/evidently
Support for Tests Criticality
Support for both percentages and absolute values in histograms
UI Service
Text Comment and Text Descriptors
Aggregated metrics visualization
Breaking Changes:
#601
Since this version, the following metrics will render aggregated plots instead of raw data plots:
- ColumnDriftMetric
- DataDriftTable
- ColumnValuePlot
- TextDescriptorsDriftMetric
- ColumnSummaryMetric
- RegressionPredictedVsActualScatter
- RegressionPredictedVsActualPlot
- RegressionErrorPlot
- RegressionAbsPercentageErrorPlot
- RegressionErrorNormality
- RegressionTopErrorMetric
- ClassificationClassSeparationPlot
- ClassificationQualityByFeatureTable
- RegressionErrorBiasTable
- TargetByFeaturesTable
To return raw data plots use render option :
- On a metric level:
report = Report(
metrics=[
RegressionPredictedVsActualScatter(options={"render": {"raw_data": True}}),
])
- On a report level:
report = Report(
metrics=[
RegressionQualityMetric(),
RegressionPredictedVsActualScatter(),
],
options={"render": {"raw_data": True}}
)
Fixes:
#593
Support for Text Descriptors in Column Tests and Embedding Drift Test
Breaking Changes:
#585
Drift detection method
text_content_drift
was renamed to perc_text_content_drift
This happened because an additional text data drift detection method was added: abs_text_content_drift
. This drift detection technique works more efficiently with large datasets.
Dashboards API is no longer supported! JSON output customisation & Embeddings Drift Metric
Breaking Changes:
Old API is no longer supported! There are no more Dashboards, Model Profiles, Tabs, and Profile Sections!
#550
Updates:
JSON output customisation:
#543
#545
#548
Text descriptors support in column metrics and tests:
#542
#546
#553
#557
Embeddings Drift Metric
#558
Fixes:
#560
New Examples:
How to customize JSON output for Reports and TestSuites?
How to calculate drift for embeddings?
How to apply column metrics for text descriptors?
Fix for reports json generation
MetricResult structuring (to be used for JSON adjustment later)
Text Descriptors Customisation for Text-specific Metrics and Preset
Updates:
- Added text descriptor
TriggerWordsPresence
- Added an option to specify which text descriptors should be used in the following metrics:
TextDescriptorsDriftMetric
TextDescriptorsDistribution
TextDescriptorsCorrelationMetric
- Added an option to specify which text descriptors should be used in the
TextOverviewPreset