[BUG] 直写表配置了向量索引却没写入对应向量字段的时候引擎会反复重新加载

[dyuyang]

No description provided.

[dyuyang]

1. 当aitheta发现用户插入的向量数据格式不正确或者缺字段，且schema里面没有配置ignore_invalid_doc=true时，首先会抛出错误
   

   havenask/aios/storage/indexlib/index/ann/aitheta2/AithetaMemIndexer.cpp

   Lines 290 to 309 in 1c4d5e2

   	Status AithetaMemIndexer::AddDocument(indexlib::document::IndexDocument* indexDoc)
   	{
   	IndexFields fieldData;
   	IndexFieldParser::ParseStatus parseStatus = _fieldParser->Parse(indexDoc, fieldData);
   	Status status = Status::OK();
   	if (IndexFieldParser::ParseStatus::PS_OK == parseStatus) {
   	if (!_segmentBuilder->Build(fieldData)) {
   	status = Status::InternalError("build document failed");
   	}
   	} else if (IndexFieldParser::ParseStatus::PS_FAIL == parseStatus) {
   	status = Status::InternalError("parse document fields failed");
   	}
   	if (status.IsOK()) {
   	_docCount++;
   	} else if (_aithetaIndexConfig.buildConfig.ignoreInvalidDoc) {
   	_invalidDocCount++;
   	status = Status::OK();
   	}
   	return status;

2. 然后引发直写表停止构建，不能再commit
   

   havenask/aios/suez/table/DirectBuilder.cpp

   Lines 321 to 323 in 1c4d5e2

   	if (builder->hasFatalError()) {
   	AUTIL_LOG(WARN, "%s: fatal error happens, stop build and reload", _pid.ShortDebugString().c_str());
   	_needReload = true;

havenask/aios/suez/table/DirectBuilder.cpp

Lines 185 to 188 in 1c4d5e2

	std::pair<bool, TableVersion> DirectBuilder::commit() {
	AUTIL_LOG(INFO, "%s begin commit", _pid.ShortDebugString().c_str());
	if (_needReload) {
	return {false, TableVersion()};

3. 进而引发直写表管理类释放当前searcher的leader地位
   

   havenask/aios/suez/table/ReadWriteTableManager.cpp

   Lines 133 to 136 in 1c4d5e2

   	} else if (!result.first) {
   	AUTIL_LOG(WARN, "partition[%s] commit version failed, release leader", FastToJsonString(pid, true).c_str());
   	_leaderElectionMgr->releaseLeader(pid);
   	}

4. 可以从suez中的状态机看到，无论之前是什么状态，一旦触发放弃leader事件，都会引发searcher的对应事件
   

   havenask/aios/suez/table/LoadDecisionMaker.cpp

   Lines 156 to 166 in 1c4d5e2

   	// no longer leader
   	_stateMachine.add(TS_UNKNOWN, LT_NO_LONGER_LEADER, OP_INIT);
   	_stateMachine.add(TS_UNLOADED, LT_NO_LONGER_LEADER, OP_NO_LONGER_LEADER);
   	_stateMachine.add(TS_LOADED, LT_NO_LONGER_LEADER, OP_NO_LONGER_LEADER);
   	_stateMachine.add(TS_FORCE_RELOAD, LT_NO_LONGER_LEADER, OP_NO_LONGER_LEADER);
   	_stateMachine.add(TS_PRELOAD_FAILED, LT_NO_LONGER_LEADER, OP_NO_LONGER_LEADER);
   	_stateMachine.add(TS_PRELOAD_FORCE_RELOAD, LT_NO_LONGER_LEADER, OP_NO_LONGER_LEADER);
   	_stateMachine.add(TS_ERROR_LACK_MEM, LT_NO_LONGER_LEADER, OP_NO_LONGER_LEADER);
   	_stateMachine.add(TS_ERROR_CONFIG, LT_NO_LONGER_LEADER, OP_NO_LONGER_LEADER);
   	_stateMachine.add(TS_ERROR_UNKNOWN, LT_NO_LONGER_LEADER, OP_NO_LONGER_LEADER);
   	_stateMachine.add(TS_COMMIT_ERROR, LT_NO_LONGER_LEADER, OP_NO_LONGER_LEADER);