iServer发布ES服务查询设置最大返回数量

作者&＃xff1a;lly

一、问题详情

当我们发布ES服务为数据服务&＃xff0c;进行查询时&＃xff0c;发现当查询的返回的结果超过1W条时&＃xff0c;会查询失败&＃xff0c;报错“all shards failed”。

二、错误排查

1.通过对错误的排查&＃xff0c;发现和iServer的关联不大&＃xff0c;而是ES本身的限制&＃xff0c;当用elasticsearch进行深度分页查询时的size-from大于10000的时候&＃xff0c;就会报错“org.elasticsearch.search.query.QueryPhaseExecutionException”

Caused by: org.elasticsearch.search.query.QueryPhaseExecutionException: Result window is too large, from &＃43; size must be less than or equal to: [10000] but was [19998]. See the scroll api for a more efficient way to request large data sets. This limit can be set by changing the [index.max_result_window] index level setting.at org.elasticsearch.search.DefaultSearchContext.preProcess(DefaultSearchContext.java:206) ~[elasticsearch-6.1.1.jar!/:6.1.1]at org.elasticsearch.search.query.QueryPhase.preProcess(QueryPhase.java:90) ~[elasticsearch-6.1.1.jar!/:6.1.1]at org.elasticsearch.search.SearchService.createContext(SearchService.java:564) ~[elasticsearch-6.1.1.jar!/:6.1.1]at org.elasticsearch.search.SearchService.createAndPutContext(SearchService.java:528) ~[elasticsearch-6.1.1.jar!/:6.1.1]at org.elasticsearch.search.SearchService.executeQueryPhase(SearchService.java:324) ~[elasticsearch-6.1.1.jar!/:6.1.1]at org.elasticsearch.search.SearchService$2.onResponse(SearchService.java:310) ~[elasticsearch-6.1.1.jar!/:6.1.1]... 9 common frames omitted


2.根据报错&＃xff0c;我们发现是需要去设置index.max_result_window参数去调大能返回的最大值&＃xff0c;我们可以通过一下请求&＃xff0c;来对ES所有索引进行设置

var settings &＃61; {"url": "127.0.0.1:9200/_settings","method": "PUT","timeout": 0,"headers": {"Content-Type": "application/json"},"data": JSON.stringify({"index.max_result_window": "2000000000"}),
};$.ajax(settings).done(function (response) {console.log(response);
});


3.设置完成后&＃xff0c;我们访问http://172.16.15.124:9200/huawei1/_settings?pretty,可以看到已成功设置&＃xff0c;再次查询即可成功返回。

三、注意事项

index.max_result_window参数是integer类型&＃xff0c;不能设置得无限大。