v0.3.0

What's Changed

• Support simd functions dispatch at runtime by @yangzq50 in #1473
• Add Qdrant benchmark on sparse embedding of SPLADE by @Ami11111 in #1478
• Update simd support for aarch64 by @yangzq50 in #1481
• Fix document error by @JinHai-CN in #1483
• Update performance image by @JinHai-CN in #1482
• Update performance information by @JinHai-CN in #1487
• Refactor document by @JinHai-CN in #1488
• VFS first phrase by @yuzhichang in #1485
• Refactor examples by @JinHai-CN in #1489
• Memidx refactor by @small-turtle-1 in #1484
• Add Milvus benchmark on sparse embedding of SPLADE by @Ami11111 in #1491
• Add: const column vector. by @small-turtle-1 in #1486
• Add Milvus benchmark on dataset sift by @Ami11111 in #1494
• Add symbolic links to large files in vfs by @Ma-cat in #1495
• Initial updates to tensor_search.py by @writinwaters in #1499
• Add asking user beforing downloading dataset and add support for precision calculation for Qdrant by @Ami11111 in #1498
• Support float16 type and bfloat16 type for column data type by @yangzq50 in #1503
• Add Qdrant sparse vector support for benchmark framework by @Ami11111 in #1504
• Initial updates to filter_data.py by @writinwaters in #1505
• Initial updates to hybrid_search.py by @writinwaters in #1507
• Add infinity sparse vector support for benchmark framework by @Ami11111 in #1506
• Fix: support tensor insert for local infinity in python sdk by @yangzq50 in #1502
• Support basic import/export for parquet format. by @Ognimalf in #1446
• Fix: python api error detect. by @small-turtle-1 in #1508
• Update version info and document by @JinHai-CN in #1511
• Updare benchmark framework README by @Ami11111 in #1513
• Update the identifier to lower case when the request is from API but not SQL by @JinHai-CN in #1514
• Add test case for upper and lower cases when creating a database, table or index from python api. by @Ami11111 in #1517
• Updated export_data API reference by @writinwaters in #1518
• Fix bug: upper case column name, type and parameter are not cast to lower case. by @JinHai-CN in #1519
• Add SNAPPY as the third_party by @JinHai-CN in #1520
• Added zstd, bzip2 and brotli to builder image by @yuzhichang in #1523
• Parquet import/export by @small-turtle-1 in #1521
• Refactored Python API reference. by @writinwaters in #1522
• Add insert row limit and change chunk size to 64K again by @JinHai-CN in #1526
• Supports cleaning up vfs by @Ma-cat in #1529
• Simplified python code example by @writinwaters in #1531
• Fix mem leak by @small-turtle-1 in #1532
• Support int8 embedding and uint8 embedding by @yangzq50 in #1527
• Add test cases for tensor in test_knn.py by @Ami11111 in #1528
• Fix compact by @small-turtle-1 in #1537
• Updated setuptools by @yuzhichang in #1524
• Fix corruption if no outputs from analyzer by @yingfeng in #1539
• Add knn test cases for tensor and sparse vector by @Ami11111 in #1536
• Editorial updates to python API by @writinwaters in #1538
• Fix bool column default value for python sdk by @yangzq50 in #1543
• Fix: delta ckp commit ts. by @small-turtle-1 in #1548
• Limit the embedding dimension to 65536 by @JinHai-CN in #1547
• Standard analyzer could output unicode tokens by @yingfeng in #1541
• Fix creating fulltext index oom in debug mode by @Ma-cat in #1550
• Fix: cleanup block when import/compact fail. by @small-turtle-1 in #1551
• Refactor conflictcheck by @small-turtle-1 in #1552
• Refactor WAL Manager by @JinHai-CN in #1553
• Support VFS for fulltext index. by @Ognimalf in #1546
• Merge programs under cases folder and internal folder together by @Ami11111 in #1540
• Editorial updates to Python API reference by @writinwaters in #1557
• Fix: compact with delete bug. by @small-turtle-1 in #1558
• Refactor the txn commit and rollback by @JinHai-CN in #1555
• Editorial updates to the API by @writinwaters in #1560
• Fix bug by @small-turtle-1 in #1559
• Updated return values by @writinwaters in #1564
• Minor editorial updates. by @writinwaters in #1566
• Fix: get cleanup ts by @small-turtle-1 in #1567
• Add http api test cases support for the test framework by @Ami11111 in #1562
• add diskann create_index api by @YReddice in #1556
• Obtains the path to the environment variable in the documentation by @YReddice in #1568
• Add bvecs file import support and fix its bug by @Ami11111 in #1572
• Updated create_index by @writinwaters in #1571
• Fix memory index multiple bugs when using vfs by @Ma-cat in #1561
• Enable wal and ckp unit tests for VFS by @Ognimalf in #1570
• Support float16 and bfloat16 embedding data type by @yangzq50 in #1579
• Fix http api bug that create and drop table with invalid conflict type will not raise exception by @Ami11111 in #1576
• Enable http api delete with empty filter by @Ami11111 in #1577
• Show SIMD support in welcome info by @yangzq50 in #1585
• Update version info of 0.3.0.dev3 by @JinHai-CN in #1584
• Updated example codes by @writinwaters in #1581
• Add debug/admin mode by @JinHai-CN in #1573
• Memidx quota1 by @small-turtle-1 in #1580
• Remove redundant test cases by @JinHai-CN in #1586
• Updated index-related apis by @writinwaters in #1590
• Fix bvecs import use int8 rather than uint8 by @Ami11111 in #1574
• Fix bug and add python test for float16 and bfloat16 embedding type by @yangzq50 in #1588
• Minor editorial udpates. by @writinwaters in #1594
• Update http_adapter to create table with non-empty default field by @Ami11111 in #1593
• Update python SDK by @JinHai-CN in #1592
• delete and update api updates by @writinwaters in #1597
• Fix http adapter and http api bug and add fvecs file export support for http api by @Ami11111 in #1595
• User can set background operation interval by @JinHai-CN in #1596
• minor by @writinwaters in #1600
• Fix error reporting in CMake by @Smertig in #1599
• Fix http adapter bug and update some test cases by @Ami11111 in #1598
• Add list_indexes for embedded python SDK by @JinHai-CN in #1602
• Fixed inconsistent behavior between local and remote on fusion by @Ma-cat in #1603
• Enable http api create table with spares, tensor, tensorarray column type by @Ami11111 in #1604
• Fix: can't connect other local directory by @JinHai-CN in #1610
• Fix http api bug that creating and droping index with invalid conflict type will not return error by @Ami11111 in #1608
• Updated filter and update methods by @writinwaters in #1611
• Restart test 1 by @small-turtle-1 in #1591
• Update version info to 0.3.0.dev4 by @JinHai-CN in #1612
• Drop created database after function test by @JinHai-CN in #1614
• Refactor fulltext search by @yuzhichang in #1613
• Minor editorial updates by @writinwaters in #1616
• Enable http api to insert sparce vector by @Ami11111 in #1618
• Updated knn by @writinwaters in #1626
• Fix some vfs bugs and implement vfs related unit tests by @Ma-cat in #1617
• Enable http api insert tensor and tensorarray by @Ami11111 in #1621
• Enable http api to output _row_id, _distance, _similarity, _score by @Ami11111 in #1623
• Fix: fulltext optimize bug. by @small-turtle-1 in #1619
• minor editorial updates by @writinwaters in #1629
• Add show statement for persistent files by @JinHai-CN in #1624
• Add "operator" option for fulltext query by @yangzq50 in #1622
• Support function expression when filter data. by @JinHai-CN in #1630
• Enable match_sparse in http api by @Ami11111 in #1633
• Refactor varchar1 by @small-turtle-1 in #1632
• Updated match_sparse by @writinwaters in #1631
• Refactor create index interface by @JinHai-CN in #1634
• Enable "match_tensor" fusion method in http api by @Ami11111 in #1635
• Use new index parameter by @JinHai-CN in #1638
• Add multiple datatype support and enable match tensor array for http api by @Ami11111 in #1639
• Add: new varchar storage. by @small-turtle-1 in #1637
• Fix update bug and remove column type validation when inserting multipe data in http api by @Ami11111 in #1641
• Miscellaneous updates by @writinwaters in #1640
• Enable mutiple fusion in http api by @Ami11111 in #1642
• Allow user to give index name to search dense vector or ignore index to search dense vector by @JinHai-CN in #1643
• Add test cases for given index name and ignore index by @Ami11111 in #1648
• Fix: compact wal. by @small-turtle-1 in #1645
• Add sqllogictest for given index name and ignore index by @Ami11111 in #1650
• Sort results by rowid if they have the same distance result by @yangzq50 in #1651
• pass arguments to infinity inside docker by @yuzhichang in #1653
• Refactor sparse by @small-turtle-1 in #1649
• Rename and move http adapter and update python benchmark by @Ami11111 in #1654
• Update version info by @JinHai-CN in #1652
• Updated match_tensor by @writinwaters in #1644
• Parallelize pysdk and http api test by @Ami11111 in #1656
• add test cases of test_show in http_test by @zjbpaul1317 in #1659
• Update python interface for fusion operator by @yangzq50 in #1657
• Updated fusion() by @writinwaters in #1660
• Add pysdk and http api test for vfs by @Ami11111 in #1658
• Refactor tensor by @small-turtle-1 in #1663
• Enable explain in http api by @Ami11111 in #1666
• Fix: persistent manager write adv. by @small-turtle-1 in #1668
• Fix mem leak bug of http api update by @Ami11111 in #1669
• Update python interface for match_text, match_sparse and match_dense by @yangzq50 in #1667
• Updates Python API reference by @writinwaters in #1671
• Fix file worker dir for secondary index by @yangzq50 in #1672
• Refactor: knn api & Recover sqllogic test. by @small-turtle-1 in #1664
• Column prune on delete operation and refactor some code by @JinHai-CN in #1673
• Refactor code by @JinHai-CN in #1677
• Initial updates to the REST APIs by @writinwaters in #1682
• Update doc by @JinHai-CN in #1683
• Fix vfs by @yuzhichang in #1674
• Support MultiVector data type: part 1 by @yangzq50 in #1680
• Fix insert by @small-turtle-1 in #1675
• Update version info to 0.3.0.dev6 by @JinHai-CN in #1678
• Fix wal size by @small-turtle-1 in #1686
• Add: restart test by @small-turtle-1 in #1681
• Refactor UT by @JinHai-CN in #1684
• Update python doc by @yangzq50 in #1690
• Add code coverage option for unit test by @Ami11111 in #1688
• Support MultiVector data type: part 2 by @yangzq50 in #1692
• Opt unit test by @small-turtle-1 in #1693
• Fix: paramter check in match sparse expression. by @small-turtle-1 in #1695
• Update doc for function test by @Ami11111 in #1696
• Ensure MemIndexRecover actually done by @yuzhichang in #1698
• Benchmark vs golden by @yuzhichang in #1685
• Update LogicalType enum and EmbeddingDataType enum by @yangzq50 in #1699
• Fix: unordered_map memory not release by @small-turtle-1 in #1700
• Support MultiVector data type: part 3 by @yangzq50 in #1701
• Fix memory leak by @JinHai-CN in #1704
• Remove unused code. by @small-turtle-1 in #1705
• Fix sparse search vector example by @JinHai-CN in #1710
• Update examples by @JinHai-CN in #1711
• add doc for configuration files by @vsian in #1708
• updated create_index syntax by @writinwaters in #1712
• Support MultiVector data type: part 4 by @yangzq50 in #1707
• Updates to RESTful APIs by @writinwaters in #1697
• Update python doc for MultiVector data type by @yangzq50 in #1713
• Fix: var buffer. by @small-turtle-1 in #1714
• Update version info to 0.3.0-dev7 by @JinHai-CN in #1716
• Add UDF python tokenizer and term weight by @JinHai-CN in #1717
• Fix bug by @small-turtle-1 in #1719
• Add configuration file unit test by @vsian in #1715
• Update test script by @yangzq50 in #1722
• Make Infinity compilable for Mac by @yingfeng in #1721
• Miscellaneous updates by @writinwaters in #1723
• Update fulltext query by @yangzq50 in #1724
• Add test cases for unit test by @Ami11111 in #1725
• Fix: close bgtask when running unittest. by @small-turtle-1 in #1727
• Fixed a docusaurus display issue by @writinwaters in #1732
• Disable python script supporting by @JinHai-CN in #1730
• Fix mem tracer by @small-turtle-1 in #1731
• Update the syntax of HTTP request create_table by @Ami11111 in #1737
• Update fulltext index by @yangzq50 in #1734
• Enable system info for Mac by @yingfeng in #1735
• Fix show tables error by @JinHai-CN in #1733
• Add storage/io unit tests by @vsian in #1736
• Miscellaneous updates by @writinwaters in #1743
• HTTP API: refactor list tables by @JinHai-CN in #1744
• Add test cases for unit test by @Ami11111 in #1741
• Fix admin mode by @JinHai-CN in #1745
• Enable thread affinity for Mac by @yingfeng in #1746
• Add restart test by @small-turtle-1 in #1703
• Add check for unused parameters in match_tensor() by @yangzq50 in #1742
• Add test cases for unit test by @Ami11111 in #1747
• Update python interface for update by @yangzq50 in #1740
• Fix sql command SHOW DATABASE by @yangzq50 in #1751
• Add table_meta and table_index_meta test cases for unit test by @Ami11111 in #1752
• Issue error use thrift / http in maintenance mode by @JinHai-CN in #1753
• Add db_entry and table entry test cases for unit test by @Ami11111 in #1754
• Updated example code of RESTful APIs by @writinwaters in #1755
• HTTP API: remove some show statements by @JinHai-CN in #1758
• add test cases by @zjbpaul1317 in #1760
• Fix bugs: http only listen on localhost by @JinHai-CN in #1759
• Add pip3 source images by @JinHai-CN in #1764
• Fix vfs varchar by @small-turtle-1 in #1750
• Add table_entry test cases for unit test by @Ami11111 in #1763
• Fix: add lvq avg interface. by @small-turtle-1 in #1765
• Fix default value for http api by @yangzq50 in #1762
• miscellaneous updates by @writinwaters in #1768
• Add table_entry and table_index_entry test cases for unit test by @Ami11111 in #1767
• Add testcases for storage/io by @vsian in #1769
• Update HTTP interface and fix memory leak by @JinHai-CN in #1766
• Miscellaneous updates to the RESTful APIs by @writinwaters in #1771
• Add segment_entry test cases for unit test by @Ami11111 in #1772
• Update python test check_data by @yangzq50 in #1773
• Enable vfs by default by @yuzhichang in #1726
• Add segment_index_entry and table_index_entry test cases for unit test by @Ami11111 in #1774
• Fix ShowTable by @yangzq50 in #1775
• Updated RESTful sample code by @writinwaters in #1777
• Add test2 by @small-turtle-1 in #1776
• Introduced base_test.cppm by @yuzhichang in #1781
• Fix restart test by @small-turtle-1 in #1783
• Disallow absolute path in wal by @yuzhichang in #1784
• Support admin mode. by @JinHai-CN in #1770
• Update version info of 0.3.0.dev8 by @JinHai-CN in #1779
• Fix: move dump index wal to background task. by @small-turtle-1 in #1791
• Add block_version test cases for unit test by @Ami11111 in #1778
• Updated search method by @writinwaters in #1794
• Fix: check batch insert value count by @yangzq50 in #1790
• Update show configs by @JinHai-CN in #1795
• Avoid to persist empty files by @yuzhichang in #1797
• add : unittest for existing date type by @vsian in #1796
• Updated search api by @writinwaters in #1800
• Update restful api by @yangzq50 in #1799
• Added index type settings. by @writinwaters in #1802
• Update version info to 0.3.0 by @JinHai-CN in #1798

New Contributors

• @Smertig made their first contribution in #1599

Full Changelog: v0.2.1...v0.3.0