Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Difference response for same API request #408

Open
serversteam opened this issue Jun 14, 2022 · 2 comments
Open

Difference response for same API request #408

serversteam opened this issue Jun 14, 2022 · 2 comments

Comments

@serversteam
Copy link

serversteam commented Jun 14, 2022 •
edited
Loading

I have upgraded Elassandra from 6.2.3 to 6.8.4 due to bug of difference response for same API request from different nodes in cluster.

But still we are facing same with 6.8.4 version.

We have 9 nodes in cluster with NetworkTopologyStrategy. After creating indices we are changing search strategy to RandomSearchStrategy. But still same issue persist.

I have repaired all nodes.
nodetool repair --full
and rebuilded indices with new prefix
nodetool rebuild_index date depot elastic_depot_idx

Elassandra version: 6.8.4.3

JVM version (java -version): openjdk version "1.8.0_312"

OS version (uname -a if on a Unix-like system): Ubuntu

  • elassandra logs (logs/system.logs or /var/lib/cassandra/system.log)

2022-06-14 13:30:45,927 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:45,927 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:45,928 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:45,928 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:45,928 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:45,928 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:45,928 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:45,928 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:45,928 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:45,928 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:45,928 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_21] for metadata.version=11, not indexed
2022-06-14 13:30:53,716 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,716 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,716 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,716 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,717 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,717 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,717 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,717 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,717 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,717 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,718 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:30:53,718 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_09] for metadata.version=57, not indexed
2022-06-14 13:32:07,687 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,687 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,688 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,688 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,688 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,688 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,688 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,688 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,688 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,688 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,688 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:07,688 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:32:19,281 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,281 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,281 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,281 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,281 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,282 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,282 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,282 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,282 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,282 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,282 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,282 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=96, not indexed
2022-06-14 13:32:19,283 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,283 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,284 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,284 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,284 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,284 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,284 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,284 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,284 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,284 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,284 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:19,284 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_29] for metadata.version=3, not indexed
2022-06-14 13:32:30,371 INFO [Service Thread] GCInspector.java:285 handleNotification G1 Young Generation GC in 226ms. G1 Eden Space: 369098752 -> 0; G1 Old Gen: 8579249208 -> 8315008080; G1 Survivor Space: 50331648 -> 58720256;
2022-06-14 13:32:30,957 INFO [Service Thread] GCInspector.java:285 handleNotification G1 Young Generation GC in 217ms. G1 Eden Space: 360710144 -> 0; G1 Old Gen: 8315008080 -> 8277259320;
2022-06-14 13:33:26,191 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,192 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,192 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,192 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,192 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,192 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,192 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,192 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,193 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,193 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,193 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,193 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=127, not indexed
2022-06-14 13:33:26,195 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,195 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,195 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,195 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,196 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,196 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,196 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,196 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,196 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,196 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,196 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:33:26,196 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_01] for metadata.version=31, not indexed
2022-06-14 13:34:23,488 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:34:23,488 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:34:23,488 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:34:23,488 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:34:23,488 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:34:23,489 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:34:23,489 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:34:23,489 ERROR [MutationStage-2] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:34:43,070 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_17] for metadata.version=15, not indexed
2022-06-14 13:34:43,070 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_17] for metadata.version=15, not indexed
2022-06-14 13:34:43,072 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_17] for metadata.version=108, not indexed
2022-06-14 13:34:43,072 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_17] for metadata.version=108, not indexed
2022-06-14 13:35:20,621 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:20,621 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:20,622 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:20,622 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:20,622 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:20,622 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:20,622 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:20,622 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:20,622 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:20,622 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:20,623 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:20,624 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:20,624 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:20,624 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:20,624 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:20,624 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:20,624 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:20,624 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:20,624 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:20,624 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:33,101 ERROR [MutationStage-15] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:33,101 ERROR [MutationStage-15] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=7, not indexed
2022-06-14 13:35:33,103 ERROR [MutationStage-15] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:35:33,103 ERROR [MutationStage-15] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_25] for metadata.version=100, not indexed
2022-06-14 13:36:22,584 INFO [Service Thread] GCInspector.java:285 handleNotification G1 Young Generation GC in 228ms. G1 Eden Space: 369098752 -> 0; G1 Old Gen: 8678251528 -> 8411192360;
2022-06-14 13:37:24,581 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:37:24,581 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:37:24,581 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:37:24,581 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_06] for metadata.version=60, not indexed
2022-06-14 13:37:30,931 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,931 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,932 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,932 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,932 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,932 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,933 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,933 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,933 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,933 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,933 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:37:30,934 ERROR [MutationStage-13] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_08] for metadata.version=58, not indexed
2022-06-14 13:38:12,471 INFO [Service Thread] GCInspector.java:285 handleNotification G1 Young Generation GC in 248ms. G1 Eden Space: 360710144 -> 0; G1 Old Gen: 8644458560 -> 8285647944;
2022-06-14 13:38:12,992 INFO [Service Thread] GCInspector.java:285 handleNotification G1 Young Generation GC in 280ms. G1 Eden Space: 360710144 -> 0; G1 Old Gen: 8285647944 -> 8300750776; G1 Survivor Space: 58720256 -> 33554432;
2022-06-14 13:38:13,020 WARN [elasticsearch[192.168.20.104][scheduler][T#1]] JvmGcMonitorService.java:317 logGcOverhead [gc][1393304] overhead, spent [636ms] collecting in the last [1.2s]
2022-06-14 13:38:21,842 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_17] for metadata.version=15, not indexed
2022-06-14 13:38:21,843 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_17] for metadata.version=15, not indexed
2022-06-14 13:38:21,843 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_17] for metadata.version=15, not indexed
2022-06-14 13:38:21,843 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_17] for metadata.version=15, not indexed
2022-06-14 13:38:21,845 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_17] for metadata.version=108, not indexed
2022-06-14 13:38:21,845 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_17] for metadata.version=108, not indexed
2022-06-14 13:38:21,845 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_17] for metadata.version=108, not indexed
2022-06-14 13:38:21,845 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_17] for metadata.version=108, not indexed
2022-06-14 13:38:38,455 INFO [MutationStage-3] NoSpamLogger.java:91 log Maximum memory usage reached (536870912), cannot allocate chunk of 1048576
2022-06-14 13:39:34,070 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_20] for metadata.version=12, not indexed
2022-06-14 13:39:34,071 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_20] for metadata.version=12, not indexed
2022-06-14 13:39:34,071 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_20] for metadata.version=12, not indexed
2022-06-14 13:39:34,071 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_20] for metadata.version=12, not indexed
2022-06-14 13:39:34,071 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_20] for metadata.version=12, not indexed
2022-06-14 13:39:34,071 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_20] for metadata.version=12, not indexed
2022-06-14 13:39:34,072 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_20] for metadata.version=105, not indexed
2022-06-14 13:39:34,073 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_20] for metadata.version=105, not indexed
2022-06-14 13:39:34,073 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_20] for metadata.version=105, not indexed
2022-06-14 13:39:34,073 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_20] for metadata.version=105, not indexed
2022-06-14 13:39:34,073 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_20] for metadata.version=105, not indexed
2022-06-14 13:39:34,073 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_20] for metadata.version=105, not indexed
2022-06-14 13:39:54,378 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,378 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,378 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,379 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,379 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,379 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,379 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,379 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,379 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,379 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,379 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,379 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=106, not indexed
2022-06-14 13:39:54,381 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,381 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,381 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,381 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,381 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,381 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,381 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,382 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,382 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,382 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,382 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:39:54,382 ERROR [MutationStage-16] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_19] for metadata.version=13, not indexed
2022-06-14 13:40:06,715 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_24] for metadata.version=8, not indexed
2022-06-14 13:40:06,715 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_24] for metadata.version=8, not indexed
2022-06-14 13:40:06,716 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_24] for metadata.version=101, not indexed
2022-06-14 13:40:06,716 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_24] for metadata.version=101, not indexed
2022-06-14 13:40:08,451 INFO [Service Thread] GCInspector.java:285 handleNotification G1 Young Generation GC in 228ms. G1 Eden Space: 369098752 -> 0; G1 Old Gen: 8731153984 -> 8533853256; G1 Survivor Space: 50331648 -> 58720256;
2022-06-14 13:40:09,093 INFO [Service Thread] GCInspector.java:285 handleNotification G1 Young Generation GC in 287ms. G1 Eden Space: 360710144 -> 0; G1 Old Gen: 8533853256 -> 8499557456;
2022-06-14 13:40:26,588 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,588 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,588 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,589 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,589 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,589 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,589 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,589 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,589 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,589 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,589 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,589 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=95, not indexed
2022-06-14 13:40:26,591 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,591 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,591 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,592 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,592 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,592 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,592 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,592 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,592 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,593 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,593 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:40:26,593 ERROR [MutationStage-1] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_31] for metadata.version=2, not indexed
2022-06-14 13:41:53,255 INFO [Service Thread] GCInspector.java:285 handleNotification G1 Young Generation GC in 242ms. G1 Eden Space: 360710144 -> 0; G1 Old Gen: 8515047992 -> 8252872760; G1 Survivor Space: 58720256 -> 50331648;
2022-06-14 13:42:03,671 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,671 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,671 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,671 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,671 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,672 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,672 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,672 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,672 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,672 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,672 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:42:03,672 ERROR [MutationStage-4] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_06_07] for metadata.version=59, not indexed
2022-06-14 13:43:39,525 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:39,526 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:39,526 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:39,526 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:39,526 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:39,527 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:39,529 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:39,529 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:39,529 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:39,529 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:39,529 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:39,530 ERROR [MutationStage-3] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:39,842 INFO [Service Thread] GCInspector.java:285 handleNotification G1 Young Generation GC in 210ms. G1 Eden Space: 360710144 -> 0; G1 Old Gen: 8560833176 -> 8226927688;
2022-06-14 13:43:59,700 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:59,701 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:59,701 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:59,701 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:59,701 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:59,702 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=99, not indexed
2022-06-14 13:43:59,703 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:59,704 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:59,704 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:59,704 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:59,704 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:43:59,705 ERROR [Native-Transport-Requests-17] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_26] for metadata.version=6, not indexed
2022-06-14 13:44:19,793 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,794 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,794 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,794 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,794 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,795 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,795 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,795 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,795 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,795 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,796 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,796 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=109, not indexed
2022-06-14 13:44:19,798 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,798 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,798 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,798 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,798 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,799 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,799 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,799 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,799 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,799 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,799 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [numerator] in index [date_2022_05_16] for metadata.version=16, not indexed
2022-06-14 13:44:19,800 ERROR [MutationStage-5] ElasticSecondaryIndex.java:490 addField submapper not found for nested field [denominator] in index [date_2022_05_16] for metadata.version=16, not indexed

Thanks in advance
@serversteam
Copy link
Author

Index mapping
'{
"depot": {
"properties": {
"analyst_rating": {
"type": "boolean",
"cql_collection": "singleton"
},
"author_followers_count": {
"type": "integer",
"cql_collection": "singleton"
},
"author_id": {
"type": "integer",
"cql_collection": "singleton"
},
"author_image_url": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false,
"index": false
},
"author_name": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false,
"index": false
},
"author_screen_name": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false,
"index": false
},
"category": {
"type": "integer",
"cql_collection": "singleton"
},
"computed_score": {
"type": "integer",
"cql_collection": "singleton"
},
"sentiment": {
"type": "float",
"cql_collection": "singleton"
},
"domain_cached_logo_url": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false,
"index": false
},
"domain_host": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false,
"index": false
},
"domain_id": {
"type": "integer",
"cql_collection": "singleton"
},
"domain_name": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false,
"index": false
},
"domain_paywall": {
"type": "boolean",
"cql_collection": "singleton"
},
"domain_registration_required": {
"type": "boolean",
"cql_collection": "singleton"
},
"duplicates_count": {
"type": "integer",
"cql_collection": "singleton"
},
"expanded_url": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false,
"index": false
},
"groups": {
"type": "keyword",
"norms": false,
"index": false
},
"id": {
"type": "integer",
"cql_collection": "singleton"
},
"images": {
"type": "keyword",
"norms": false,
"index": false
},
"lang": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false
},
"name": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false,
"index": false
},
"origin_id": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false,
"index": false
},
"original_info_item_id": {
"type": "integer",
"cql_collection": "singleton",
"index": false
},
"publish_date": {
"type": "date",
"cql_collection": "singleton"
},
"read_count": {
"type": "integer",
"cql_collection": "singleton"
},
"scrape_description": {
"type": "text",
"cql_collection": "singleton"
},
"scrape_title": {
"type": "text",
"cql_collection": "singleton"
},
"topic_ids": {
"type": "integer"
},
"type": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false
},
"uuid": {
"type": "keyword",
"cql_collection": "singleton",
"cql_partition_key": true,
"cql_primary_key_order": 0,
"norms": false
},
"x_frame_options": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false,
"index": false
},
"related_groups": {
"type": "nested",
"cql_collection": "list",
"cql_struct": "udt",
"cql_udt_name": "group",
"properties": {
"group_type": {
"type": "keyword",
"norms": false,
"cql_collection": "singleton"
},
"group_name": {
"type": "keyword",
"norms": false,
"cql_collection": "singleton"
},
"group_level": {
"type": "integer",
"cql_collection": "singleton"
}
}
},
"full_text": {
"type": "text",
"cql_collection": "singleton"
},
"datasource_id": {
"type": "integer",
"cql_collection": "singleton"
},
"premium_plan_level": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false
},
"visibility": {
"type": "keyword",
"cql_collection": "singleton",
"norms": false
},
"limited_content": {
"type": "keyword",
"cql_collection": "list",
"norms": false
},
"cost": {
"type": "integer",
"cql_collection": "singleton"
},
"translations": {
"type": "nested",
"cql_collection": "list",
"cql_struct": "udt",
"cql_udt_name": "translation",
"properties": {
"language": {
"type": "keyword",
"norms": false,
"cql_collection": "singleton"
},
"title": {
"type": "text",
"cql_collection": "singleton"
},
"description": {
"type": "text",
"cql_collection": "singleton"
},
"full_text": {
"type": "text",
"cql_collection": "singleton"
}
}
},
"sentiment_groups": {
"type": "nested",
"cql_collection": "list",
"cql_struct": "udt",
"cql_udt_name": "sentiment_group",
"properties": {
"group_type": {
"type": "keyword",
"norms": false,
"cql_collection": "singleton"
},
"group_name": {
"type": "keyword",
"norms": false,
"cql_collection": "singleton"
},
"group_level": {
"type": "integer",
"cql_collection": "singleton",
"index": false
},
"sentiment": {
"type": "float",
"cql_collection": "singleton"
}
}
},
"dynamic_cfscore": {
"type": "nested",
"cql_collection": "list",
"cql_struct": "udt",
"cql_udt_name": "dynamic_cfscore_record",
"properties": {
"time_point": {
"type": "long",
"cql_collection": "singleton"
},
"value": {
"type": "float",
"cql_collection": "singleton"
}
}
},
"entities_dynamic_cfscore": {
"type": "nested",
"cql_collection": "list",
"cql_struct": "udt",
"cql_udt_name": "entities_dynamic_cfscore_record",
"properties": {
"group_type": {
"type": "keyword",
"norms": false,
"cql_collection": "singleton"
},
"group_name": {
"type": "keyword",
"norms": false,
"cql_collection": "singleton"
},
"group_level": {
"type": "integer",
"cql_collection": "singleton",
"index": false
},
"time_point": {
"type": "long",
"cql_collection": "singleton"
},
"value": {
"type": "float",
"cql_collection": "singleton"
}
}
}
}
}
}'

@serversteam
Copy link
Author 

  {
    "_index": "date_2022_06_09",
    "_type": "depot",
    "_id": "29c6aef3-8fcc-43ad-97f9-e69087a36223",
    "_score": 1,
    "_source": {
      "sentiment": -14,
      "domain_paywall": false,
      "dynamic_cfscore": [
        {
          "time_point": 1654808128,
          "value": 33.69
        },
        {
          "time_point": 1654836928,
          "value": 30.63
        },
        {
          "time_point": 1654894528,
          "value": 28.07
        },
        {
          "time_point": 1655412928,
          "value": 22.46
        },
        {
          "time_point": 1657486528,
          "value": 11.22
        }
      ],
      "domain_registration_required": false,
      "origin_id": "https://*************.com/blogs/?p=180668",
      "type": "Story",
      "uuid": "29c6aef3-8fcc-43ad-97f9-e69087a36223",
      "domain_id": 44,
      "related_groups": [
        {
          "group_level": 0,
          "group_name": "india",
          "group_type": "LocationTag"
        },
        {
          "group_level": 0,
          "group_name": "hindu",
          "group_type": "LocationTag"
        },
        {
          "group_level": 0,
          "group_name": "hindu-muslim",
          "group_type": "LocationTag"
        },
        {
          "group_level": 0,
          "group_name": "army",
          "group_type": "FinancialTopicTag"
        },
        {
          "group_level": 0,
          "group_name": "population control law",
          "group_type": "FinancialTopicTag"
        },
        {
          "group_level": 0,
          "group_name": "minorities",
          "group_type": "FinancialTopicTag"
        },
        {
          "group_level": 0,
          "group_name": "hijab",
          "group_type": "FinancialTopicTag"
        },
        {
          "group_level": 0,
          "group_name": "iftar",
          "group_type": "FinancialTopicTag"
        }
      ],
      "domain_name": "The Times of India",
      "analyst_rating": false,
      "id": 1475257888,
      "lang": "en",
      "scrape_description": "Calls for a Hindu nation, campaigns against halal, objections to hijab, demand for a population control law, support for ‘Romeo squad’, questioning of the army’s Iftar, slapping an elderly man on a suspicion of being...",
      "computed_score": 47,
      "read_count": 0,
      "datasource_id": 22258,
      "images": "https://*******.com/03/Rohit-Pix.jpg",
      "duplicates_count": 1,
      "scrape_title": "Hindu-Muslim: Facts vs fear: Logic, data belie scaremongering on minorities. Let India be the safe space it’s always been",
      "domain_host": "******.com",
      "sentiment_groups": [
        {
          "group_level": 0,
          "sentiment": 7,
          "group_name": "india",
          "group_type": "LocationTag"
        },
        {
          "group_level": 0,
          "sentiment": 7,
          "group_name": "india",
          "group_type": "LocationTag"
        },
        {
          "group_level": 0,
          "sentiment": -98,
          "group_name": "army",
          "group_type": "FinancialTopicTag"
        },
        {
          "group_level": 0,
          "sentiment": 0,
          "group_name": "minorities",
          "group_type": "FinancialTopicTag"
        },
        {
          "group_level": 0,
          "sentiment": 0,
          "group_name": "hindu",
          "group_type": "LocationTag"
        },
        {
          "group_level": 0,
          "sentiment": -98,
          "group_name": "hijab",
          "group_type": "FinancialTopicTag"
        },
        {
          "group_level": 0,
          "sentiment": -98,
          "group_name": "population control law",
          "group_type": "FinancialTopicTag"
        },
        {
          "group_level": 0,
          "sentiment": -98,
          "group_name": "iftar",
          "group_type": "FinancialTopicTag"
        },
        {
          "group_level": 0,
          "sentiment": 0,
          "group_name": "hindu-muslim",
          "group_type": "LocationTag"
        },
        {
          "group_level": 0,
          "sentiment": 7,
          "group_name": "india",
          "group_type": "LocationTag"
        }
      ],
      "expanded_url": "https://********************.com/e-scaremongering-on-minorities-let-india-be-the-safe-space-its-always-been/",
      "name": "Hindu-Muslim: Facts vs fear: Logic, data belie scaremongering on minorities. Let India be the safe space it’s always been",
      "domain_cached_logo_url": "https://******************.com/i/?1523018449",
      "category": 1,
      "publish_date": "2022-06-09T20:55:28.000Z"
    }
  },

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@serversteam