Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: Renumics/spotlight
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v1.6.5
Choose a base ref
...
head repository: Renumics/spotlight
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Choose a head ref

Commits on Dec 21, 2023

  1. use mel scale for frequencies

    Tarek committed Dec 21, 2023
    Copy the full SHA
    ba5de2b View commit details

Commits on Feb 6, 2024

  1. create mel scale from d3 scale

    Tarek committed Feb 6, 2024
    Copy the full SHA
    2d2fe03 View commit details

Commits on Feb 15, 2024

  1. Copy the full SHA
    e14f298 View commit details
  2. Merge pull request #424 from Renumics/feature/report-datasource-type

    add ds to exception where possible
    neindochoh authored Feb 15, 2024
    Copy the full SHA
    abbd8d3 View commit details

Commits on Feb 16, 2024

  1. Copy the full SHA
    f9408b2 View commit details
  2. Merge pull request #425 from Renumics/chore/update-actions-to-node20

    Bump `LanceMcCarthy/Action-AzureBlobUpload` action to version 3
    druzsan authored Feb 16, 2024
    Copy the full SHA
    290448d View commit details

Commits on Feb 19, 2024

  1. Copy the full SHA
    c8c0e15 View commit details
  2. Copy the full SHA
    fb4df70 View commit details
  3. Merge pull request #426 from Renumics/feature/support-pathlib-path-in-df

    add conversion from Path to various binary types
    neindochoh authored Feb 19, 2024
    Copy the full SHA
    04dd723 View commit details
  4. Copy the full SHA
    39cf0ee View commit details
  5. Copy the full SHA
    6438101 View commit details
  6. Copy the full SHA
    ae3b4c2 View commit details
  7. Merge pull request #427 from Renumics/fix/missing-fill-in-bbox-title

    set fill for text in bbox title
    neindochoh authored Feb 19, 2024
    Copy the full SHA
    1d36190 View commit details
  8. Copy the full SHA
    26baf96 View commit details
  9. Copy the full SHA
    b1825a1 View commit details
  10. Merge pull request #428 from Renumics/feature/allow-strings-as-bbox-l…

    …abels
    
    feat: allow string as label in bbox lens
    neindochoh authored Feb 19, 2024
    Copy the full SHA
    39a2983 View commit details

Commits on Feb 20, 2024

  1. Copy the full SHA
    29c1f0a View commit details
  2. Merge pull request #429 from Renumics/fix/bbox-lens-fails-without-label

    use empty labels in bbox lens without a label column
    neindochoh authored Feb 20, 2024
    Copy the full SHA
    6c9c954 View commit details
  3. Copy the full SHA
    6bfd09a View commit details
  4. Copy the full SHA
    6406c3c View commit details
  5. Copy the full SHA
    bfd23aa View commit details
  6. Merge pull request #430 from Renumics/feature/infer-categories-of-seq…

    …uences
    
    Feature/infer categories of sequences
    neindochoh authored Feb 20, 2024
    Copy the full SHA
    8466957 View commit details
  7. Copy the full SHA
    14656ee View commit details
  8. Adjust BB lens docstring

    druzsan committed Feb 20, 2024
    Copy the full SHA
    cea913c View commit details
  9. Merge pull request #431 from Renumics/feature/show-without-dataset

    feat: better handle spotlight.show() without a dataset
    neindochoh authored Feb 20, 2024
    Copy the full SHA
    4500d42 View commit details
  10. Merge pull request #432 from Renumics/feature/add-bbox-lens-to-python

    Feature/add bbox lens to python
    neindochoh authored Feb 20, 2024
    Copy the full SHA
    eaea03f View commit details

Commits on Feb 21, 2024

  1. Change name of the databases package extra from aiosqlite to `sql…

    …ite` since existed longer
    druzsan committed Feb 21, 2024
    Copy the full SHA
    1b9bca6 View commit details
  2. Merge pull request #433 from Renumics/chore/databases-extras

    Chore/databases extras
    druzsan authored Feb 21, 2024
    Copy the full SHA
    dd479c2 View commit details

Commits on Feb 22, 2024

  1. Copy the full SHA
    930c26c View commit details

Commits on Feb 23, 2024

  1. Merge pull request #434 from Renumics/feature/hf-images-in-arrow-data…

    …set-source
    
    support hf metadata for images in arrow source
    neindochoh authored Feb 23, 2024
    Copy the full SHA
    2c8619c View commit details
  2. Copy the full SHA
    1a20fff View commit details
  3. Merge pull request #435 from Renumics/feature/read-ray-arrays-from-ar…

    …row-source
    
    support ray arrays in arrow dataset source
    neindochoh authored Feb 23, 2024
    Copy the full SHA
    19cb4ca View commit details

Commits on Feb 26, 2024

  1. Copy the full SHA
    6cc7216 View commit details
  2. Copy the full SHA
    95e9c6c View commit details
  3. Merge pull request #437 from Renumics/fix/bbox-is-default-str-lens

    reorder lenses to prioritize normal text lens
    neindochoh authored Feb 26, 2024
    Copy the full SHA
    64f9340 View commit details
  4. Merge pull request #438 from Renumics/feature/allow-lenses-to-handle-…

    …null
    
    feat: optional handlesNull attribute for lenses
    neindochoh authored Feb 26, 2024
    Copy the full SHA
    a06e2bb View commit details
  5. Start Spotlight with TLS

    druzsan committed Feb 26, 2024
    Copy the full SHA
    13f8207 View commit details
  6. Remove debug message

    druzsan committed Feb 26, 2024
    Copy the full SHA
    b7f2a5f View commit details
  7. Copy the full SHA
    abaaf04 View commit details
  8. Copy the full SHA
    2cbcaae View commit details
  9. Copy the full SHA
    75be158 View commit details
  10. Copy the full SHA
    670a809 View commit details
  11. Merge pull request #441 from Renumics/chore/bump-setup-matrix-action

    Bump `setup-matrix` action to v2
    druzsan authored Feb 26, 2024
    Copy the full SHA
    294e576 View commit details

Commits on Feb 27, 2024

  1. Merge pull request #439 from Renumics/feature/start-with-tls

    Feature/start with tls
    druzsan authored Feb 27, 2024
    Copy the full SHA
    4a78a95 View commit details
  2. Merge pull request #440 from Renumics/fix/no-colors-on-filtered-simmap

    fix computation of filtered values in color tf factory
    neindochoh authored Feb 27, 2024
    Copy the full SHA
    53c03aa View commit details

Commits on Feb 29, 2024

  1. Bump orjson from 3.9.14 to 3.9.15

    Bumps [orjson](https://github.com/ijl/orjson) from 3.9.14 to 3.9.15.
    - [Release notes](https://github.com/ijl/orjson/releases)
    - [Changelog](https://github.com/ijl/orjson/blob/master/CHANGELOG.md)
    - [Commits](ijl/orjson@3.9.14...3.9.15)
    
    ---
    updated-dependencies:
    - dependency-name: orjson
      dependency-type: direct:production
    ...
    
    Signed-off-by: dependabot[bot] <support@github.com>
    dependabot[bot] authored Feb 29, 2024
    Copy the full SHA
    ae5b245 View commit details
  2. Merge pull request #442 from Renumics/dependabot/pip/orjson-3.9.15

    Bump orjson from 3.9.14 to 3.9.15
    neindochoh authored Feb 29, 2024
    Copy the full SHA
    2e867e9 View commit details

Commits on Mar 8, 2024

  1. fix mel scale

    Tarek committed Mar 8, 2024
    Copy the full SHA
    acaf159 View commit details
  2. use mel scale for frequencies

    Tarek committed Mar 8, 2024
    Copy the full SHA
    6e29859 View commit details
  3. Copy the full SHA
    9e5ba88 View commit details
Showing with 10,183 additions and 8,272 deletions.
  1. +1 −1 .github/actions/setup-poetry/action.yml
  2. +18 −16 .github/workflows/ci.yml
  3. +3 −2 Makefile
  4. +1 −1 README-PyPI.md
  5. +2 −2 README.md
  6. +0 −9 license-checker-template.json
  7. +3 −2 package.json
  8. +5,666 −4,438 pnpm-lock.yaml
  9. +3,503 −3,334 poetry.lock
  10. +23 −15 pyproject.toml
  11. +71 −68 renumics/spotlight/analysis/analyzers/cleanlab.py
  12. +114 −110 renumics/spotlight/analysis/analyzers/cleanvision.py
  13. +7 −7 renumics/spotlight/app.py
  14. +29 −0 renumics/spotlight/cli.py
  15. +50 −15 renumics/spotlight/data_store.py
  16. +45 −0 renumics/spotlight/dtypes/conversion.py
  17. +2 −2 renumics/spotlight/embeddings/embedders/gte.py
  18. +3 −2 renumics/spotlight/embeddings/preprocessors.py
  19. +33 −10 renumics/spotlight/io/audio.py
  20. +19 −0 renumics/spotlight/layout/lenses.py
  21. +1 −1 renumics/spotlight/layout/widgets.py
  22. +3 −2 renumics/spotlight/media/mesh.py
  23. +1 −1 renumics/spotlight/reporting.py
  24. +46 −3 renumics/spotlight/server.py
  25. +43 −6 renumics/spotlight/viewer.py
  26. +7 −23 renumics/spotlight/webbrowser.py
  27. +12 −8 renumics/spotlight_plugins/core/api/table.py
  28. +88 −9 renumics/spotlight_plugins/core/arrow_dataset_source.py
  29. +0 −1 renumics/spotlight_plugins/core/huggingface_datasource.py
  30. +9 −3 src/components/shared/AudioViewer/index.tsx
  31. +1 −1 src/components/ui/Select/Select.tsx
  32. +22 −5 src/hooks/useCell.ts
  33. +15 −2 src/hooks/useColorTransferFunction.ts
  34. +27 −14 src/lenses/BoundingBoxLens/BBox.tsx
  35. +134 −92 src/lenses/BoundingBoxLens/index.tsx
  36. +12 −17 src/lenses/LensFactory.tsx
  37. +68 −0 src/lenses/SpectrogramLens/MelScale.tsx
  38. +57 −31 src/lenses/SpectrogramLens/index.tsx
  39. +2 −2 src/lenses/index.ts
  40. +1 −1 src/lib.ts
  41. +8 −2 src/stores/dataset/colorTransferFunctionFactory.tsx
  42. +14 −12 src/stores/dataset/dataset.ts
  43. +1 −0 src/types/lenses.ts
  44. +10 −0 tests/ui/test_startpage.py
  45. +8 −2 tests/unit/dtypes/test_conversion.py
2 changes: 1 addition & 1 deletion .github/actions/setup-poetry/action.yml
Original file line number Diff line number Diff line change
@@ -5,7 +5,7 @@ description: |
inputs:
python-version:
description: Python version to use
default: '3.8'
default: '3.10'
install-dependencies:
description: Whether to install and cache/restore dependencies
default: 'true'
34 changes: 18 additions & 16 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
@@ -103,35 +103,37 @@ jobs:
uses: actions/checkout@v4
- name: '🧱 Build test matrix for pull request'
if: needs.check-pr.outputs.is-pr == 'true'
uses: druzsan/setup-matrix@v1
uses: druzsan/setup-matrix@v2
with:
matrix: |
os: ubuntu-latest,
python-version: 3.8 3.9 3.10 3.11
os: [ubuntu-latest]
python-version: [3.8, 3.9, 3.10, 3.11, 3.12]
- name: '🧱 Build test matrix for release'
if: env.MATRIX == '' && startsWith(github.ref, 'refs/tags/v')
uses: druzsan/setup-matrix@v1
uses: druzsan/setup-matrix@v2
with:
matrix: |
os: ubuntu-latest windows-latest macos-latest,
python-version: 3.8 3.9 3.10 3.11
os: [ubuntu-latest, windows-latest, macos-latest]
python-version: [3.8, 3.9, 3.10, 3.11, 3.12]
- name: '🧱 Build test matrix for main branch'
if: env.MATRIX == '' && github.ref == 'refs/heads/main'
uses: druzsan/setup-matrix@v1
uses: druzsan/setup-matrix@v2
with:
matrix: |
os: ubuntu-latest,
python-version: 3.8 3.9 3.10 3.11
include: |
os: windows-latest python-version: 3.8,
os: macos-latest python-version: 3.8
os: [ubuntu-latest]
python-version: [3.8, 3.9, 3.10, 3.11, 3.12]
include:
- os: windows-latest
python-version: 3.10
- os: macos-latest
python-version: 3.10
- name: '🧱 Build test matrix for development branch'
if: env.MATRIX == ''
uses: druzsan/setup-matrix@v1
uses: druzsan/setup-matrix@v2
with:
matrix: |
os: ubuntu-latest,
python-version: 3.8
os: [ubuntu-latest]
python-version: [3.10]
- name: Print matrix
run: echo "$MATRIX" | yq -P '{"matrix":.}'
- name: Set output
@@ -357,7 +359,7 @@ jobs:
&& github.event.pull_request.head.repo.full_name == 'Renumics/spotlight'
)
)
uses: LanceMcCarthy/Action-AzureBlobUpload@v2
uses: LanceMcCarthy/Action-AzureBlobUpload@v3
with:
connection_string: ${{ secrets.AZURE_CONNECTION_STRING }}
container_name: github-public
5 changes: 3 additions & 2 deletions Makefile
Original file line number Diff line number Diff line change
@@ -26,8 +26,9 @@ clean: ## clean project

.PHONY: audit
audit: ## Audit project dependencies
poetry export --without-hashes | poetry run safety check --full-report --stdin \
--ignore 61496 --ignore 51668
poetry export --without-hashes --all-extras --without dev --without playbook \
| poetry run safety check --full-report --stdin \
--ignore 61496 --ignore 70612 --ignore 71596 --ignore 73323
pnpm audit --prod

.PHONY: check-format
2 changes: 1 addition & 1 deletion README-PyPI.md
Original file line number Diff line number Diff line change
@@ -12,7 +12,7 @@ Get started by installing Spotlight and loading your first dataset.

#### What you'll need

- [Python](https://www.python.org/downloads/) version 3.8-3.11
- [Python](https://www.python.org/downloads/) version 3.8-3.12

#### Install Spotlight via [pip](https://packaging.python.org/en/latest/key_projects/#pip)

4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -10,7 +10,7 @@

<h3 align="center">
<a href="https://spotlight.renumics.com"><b>Documentation</b></a> &bull;
<a href="https://renumics.com/docs/playbook"><b>Playbook</b></a> &bull;
<a href="https://renumics.com/docs/data-centric-ai/playbook"><b>Playbook</b></a> &bull;
<a href="https://renumics.com/blog/"><b>Blog</b></a> &bull;
<a href="https://renumics.com/api/spotlight/"><b>API Reference</b></a>
</h3>
@@ -98,7 +98,7 @@ Get started by installing Spotlight and loading your first dataset.

#### What you'll need

- [Python](https://www.python.org/downloads/) version 3.8-3.11
- [Python](https://www.python.org/downloads/) version 3.8-3.12

#### Install Spotlight via [pip](https://packaging.python.org/en/latest/key_projects/#pip)

9 changes: 0 additions & 9 deletions license-checker-template.json

This file was deleted.

5 changes: 3 additions & 2 deletions package.json
Original file line number Diff line number Diff line change
@@ -27,7 +27,7 @@
},
"types": "index.d.ts",
"dependencies": {
"@dnd-kit/core": "^6.0.8",
"@dnd-kit/core": "^6.1.0",
"@floating-ui/react": "^0.19.2",
"@react-hook/resize-observer": "^1.2.6",
"@react-three/drei": "^9.56.25",
@@ -53,14 +53,15 @@
"d3-time-format": "^4.1.0",
"d3-zoom": "^3.0.0",
"detect-gpu": "^5.0.12",
"dompurify": "^3.0.3",
"dompurify": "^3.1.3",
"fast-levenshtein": "^3.0.0",
"file-saver": "^2.0.5",
"flexlayout-react": "^0.7.6",
"fuse.js": "^6.6.2",
"immer": "^9.0.19",
"localforage": "^1.10.0",
"lodash": "^4.17.21",
"micromatch": "4.0.8",
"moment": "^2.29.4",
"numbro": "^2.3.6",
"prop-types": "^15.8.1",
Loading