{"id":176,"date":"2026-05-28T11:09:59","date_gmt":"2026-05-28T03:09:59","guid":{"rendered":"https:\/\/www.sretalk.com\/?p=176"},"modified":"2026-05-28T11:10:00","modified_gmt":"2026-05-28T03:10:00","slug":"elasticsearch-cpu-%e4%bd%bf%e7%94%a8%e7%8e%87%e9%ab%98%e7%9a%84%e6%8e%92%e6%9f%a5%e6%80%9d%e8%b7%af","status":"publish","type":"post","link":"https:\/\/www.sretalk.com\/?p=176","title":{"rendered":"ElasticSearch CPU \u4f7f\u7528\u7387\u9ad8\u7684\u6392\u67e5\u601d\u8def"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">\u4e00\u3001\u5224\u65ad\u6838\u5fc3\u73b0\u8c61<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u6d41\u5f0f\u4efb\u52a1\uff08Blink\/Flink\uff09\u6301\u7eed\u5411 ES \u6279\u91cf\u5199\u5165\uff0c<strong>\u91cd\u542f\u4efb\u52a1 = \u6e05\u7a7a\u5185\u5b58\u5806\u79ef\u3001\u91cd\u7f6e\u8fde\u63a5 \/ \u6279\u6b21<\/strong>\uff0c\u6240\u4ee5 CPU \u77ed\u6682\u56de\u843d\uff1b\u8fd0\u884c\u4e00\u6bb5\u65f6\u95f4\u540e\u8d1f\u8f7d\u590d\u73b0\uff0c\u57fa\u672c\u9501\u5b9a\u8fd9\u51e0\u7c7b\u95ee\u9898\uff1a<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u5199\u5165\u538b\u529b\u4e0d\u5e73\u7a33\u3001\u6279\u6b21 \/ \u5e76\u53d1\u4e0d\u5408\u7406<\/li>\n\n\n\n<li>ES \u5206\u7247 \/ \u5237\u65b0 \/ \u6bb5\u5408\u5e76\u538b\u529b\u5927<\/li>\n\n\n\n<li>\u6587\u6863\u7ed3\u6784\u3001\u67e5\u8be2 \/ \u805a\u5408\u540e\u53f0\u4efb\u52a1\u62d6 CPU<\/li>\n\n\n\n<li>Blink \u4fa7\u5199\u5165\u53c2\u6570\u3001\u53cd\u538b\u3001\u91cd\u8bd5\u903b\u8f91\u5f02\u5e38<\/li>\n\n\n\n<li>ES JVM \/ \u7ebf\u7a0b\u6c60\u914d\u7f6e\u4e0d\u5408\u7406<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">\u4e8c\u3001\u73b0\u573a\u5feb\u901f\u6392\u67e5<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">1. \u5148\u770b ES \u8282\u70b9\u7684\u70ed\u70b9\u6307\u6807<\/h3>\n\n\n\n<h4 class=\"wp-block-heading\">1.1 \u8282\u70b9\u7ef4\u5ea6<\/h4>\n\n\n\n<pre class=\"wp-block-code language=bash\"><code># \u67e5\u770b\u5404\u8282\u70b9CPU\u3001\u8d1f\u8f7d\u3001\u7ebf\u7a0b\u6c60\nGET _cat\/nodes?v&amp;h=name,cpu,load_1m,heapPercent,ramPercent\n\n# \u67e5\u770bES \u5199\u5165\u7ebf\u7a0b\u6c60\u3001\u961f\u5217\u3001\u62d2\u7edd\uff08\u5173\u952e\uff01\u5199\u5165\u74f6\u9888\u7b2c\u4e00\u770b\u8fd9\u4e2a\uff09\nGET _cat\/thread_pool\/write?v&amp;h=node,name,active,queue,rejected\nGET _cat\/thread_pool\/bulk?v&amp;h=node,name,active,queue,rejected<\/code><\/pre>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<ol class=\"wp-block-list\">\n<li><code>bulk\/write<\/code> \u961f\u5217\u5806\u79ef\u3001<code>rejected &gt; 0<\/code>\uff1a\u5199\u5165\u8fc7\u8f7d<\/li>\n\n\n\n<li>active \u957f\u671f\u6253\u6ee1\uff1a\u7ebf\u7a0b\u6c60\u4e0d\u591f\u6216\u5355\u8bf7\u6c42\u592a\u91cd<\/li>\n<\/ol>\n<\/blockquote>\n\n\n\n<h4 class=\"wp-block-heading\">1.2 \u7d22\u5f15\u7ef4\u5ea6\uff08\u5199\u5165\u76ee\u6807\u7d22\u5f15\uff09<\/h4>\n\n\n\n<pre class=\"wp-block-code language=bash\"><code># \u7d22\u5f15\u5199\u5165TPS\u3001\u6bb5\u5408\u5e76\u3001\u5237\u65b0\u9891\u7387\nGET _cat\/indices?v&amp;h=index,docs.count,docs.deleted,store,pri,rep,segments.count\n\n# \u5b9e\u65f6\u7d22\u5f15\u7edf\u8ba1\uff08\u5237\u65b0\u3001\u5408\u5e76\u3001bulk\u8017\u65f6\uff09\nGET _stats\/indexing,merges,refresh<\/code><\/pre>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">\u91cd\u70b9\u89c2\u5bdf\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><code>refresh<\/code> \u9891\u7387\u6781\u9ad8\uff08\u9ed8\u8ba4 1s\uff09\uff1a\u5c0f\u5237\u65b0\u9891\u7e41\u89e6\u53d1 CPU <\/li>\n\n\n\n<li><code>merges<\/code> \u6301\u7eed\u9ad8\uff1a\u5c0f\u5206\u7247 \/ \u5c0f\u6587\u4ef6\u592a\u591a\uff0c\u540e\u53f0\u6bb5\u5408\u5e76\u5403\u6ee1 CPU <\/li>\n\n\n\n<li><code>bulk \u8017\u65f6\u6301\u7eed\u8d70\u9ad8<\/code>\uff1a\u5355\u6279\u6b21\u6570\u636e\u8fc7\u5927 \/ \u6587\u6863\u5b57\u6bb5\u8fc7\u591a<\/li>\n<\/ul>\n<\/blockquote>\n\n\n\n<h4 class=\"wp-block-heading\">1.3 \u67e5\u770b\u6162\u65e5\u5fd7 &amp; \u70ed\u70b9\u64cd\u4f5c<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">\u5f00\u542f \/ \u67e5\u770b <strong>slowlog<\/strong>\uff0c\u786e\u8ba4\u662f<code>bulk\u5199\u5165\u6162<\/code>\u8fd8\u662f<code>\u67e5\u8be2\/\u805a\u5408\u6162<\/code>\uff1a<br><\/p>\n\n\n\n<pre class=\"wp-block-code language=bash\"><code># \u67e5\u770b\u5f53\u524d\u6162\u65e5\u5fd7\u914d\u7f6e\nGET _settings\/index.slowlog\n<\/code><\/pre>\n\n\n\n<p class=\"wp-block-paragraph\">\u5982\u679c\u5927\u91cf <code>bulk<\/code> \u6162\u65e5\u5fd7 \u2192 \u5199\u5165\u4fa7\u95ee\u9898\uff1b\u5927\u91cf<code>search\/agg<\/code> \u2192 \u4e1a\u52a1\u67e5\u8be2\u62d6 CPU\u3002<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">2. Blink\/Flink \u4efb\u52a1\u4fa7\u6392\u67e5<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>\u662f\u5426\u5b58\u5728\u53cd\u538b<\/strong>\uff1aFlink UI \u770b Task \u53cd\u538b\u3001SubTask \u5806\u79ef\uff0c\u53cd\u538b\u4f1a\u5bfc\u81f4\u6279\u6b21\u7d2f\u79ef\u3001\u6279\u91cf\u5199\u5165\u66b4\u6da8\u3002 <\/li>\n\n\n\n<li><strong>\u5e76\u53d1\u5ea6<\/strong>\uff1a\u5199\u5165\u5e76\u53d1\u662f\u5426\u8fdc\u5927\u4e8e ES \u627f\u8f7d\u80fd\u529b\u3002 <\/li>\n\n\n\n<li><strong>\u6279\u91cf\u5927\u5c0f<\/strong>\uff1a<code>bulk.flush.max.actions<\/code> \/ <code>bulk.flush.max.size<\/code> \u914d\u7f6e\u662f\u5426\u4e0d\u5408\u7406\u3002 <\/li>\n\n\n\n<li><strong>\u91cd\u8bd5\u673a\u5236<\/strong>\uff1aES \u8fd4\u56de 429 \/ \u8d85\u65f6\u540e\uff0cBlink \u65e0\u9650\u91cd\u8bd5 \u2192 \u98ce\u66b4\u5f0f\u5199\u5165\uff0cCPU \u6301\u7eed\u62c9\u9ad8\u3002<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<h3 class=\"wp-block-heading\">\u4e09\u3001\u5206\u573a\u666f\u89e3\u51b3<\/h3>\n\n\n\n<h4 class=\"wp-block-heading\">\u573a\u666f1\uff1a\u6d41\u5f0f\u5199\u5165 + \u9891\u7e41 Refresh + \u6bb5\u5408\u5e76\u7206\u70b8<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u3010\u73b0\u8c61\u7279\u5f81\u3011<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u91cd\u542f\u4efb\u52a1\u540e\u77ed\u65f6\u5e73\u7a33\uff0c\u8fd0\u884c\u51e0\u5c0f\u65f6 CPU \u9010\u6b65\u4e0a\u6da8\uff1bES <code>segments.count<\/code> \u6301\u7eed\u53d8\u591a\uff0c<code>merges<\/code> \u7ebf\u7a0b\u7e41\u5fd9\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u3010\u4f18\u5316\u64cd\u4f5c\u3011<\/strong><\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u8c03\u5927\u7d22\u5f15 refresh \u95f4\u9694<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-code\"><code># \u6d41\u5f0f\u6570\u636e\u5b9e\u65f6\u6027\u8981\u6c42\u4e0d\u6781\u81f4\u7684\u76f4\u63a5\u6539\uff1a\nPUT \u4f60\u7684\u7d22\u5f15\/_settings\n{\n  \"index.refresh_interval\": \"30s\"   \/\/ \u4ece1s\u6539\u621010~30s\uff0c\u6839\u636e\u4e1a\u52a1\u5bb9\u5fcd\u5ea6\u8c03\u6574\n}\n<\/code><\/pre>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">\u4f5c\u7528\uff1a\u51cf\u5c11\u5185\u5b58\u5237\u76d8\u3001\u6bb5\u751f\u6210\uff0c\u5927\u5e45\u964d\u4f4e CPU<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">2. \u5173\u95ed\u7d22\u5f15\u81ea\u52a8\u5237\u65b0<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code># \u7eaf\u79bb\u7ebf \/ \u51c6\u65f6\u95f4\u6d41\uff1a\n{\n  \"index.refresh_interval\": \"-1\"\n}<\/code><\/pre>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">\u53ef\u5728\u51cc\u6668\u4f4e\u5cf0\u624b\u52a8 <code>POST \u7d22\u5f15\/_refresh<\/code><\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">3. \u9650\u5236\u6bb5\u5408\u5e76\u5e76\u53d1<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code># \u9632\u6b62\u5408\u5e76\u6253\u6ee1 CPU\uff1a\nPUT _cluster\/settings\n{\n  \"persistent\": {\n    \"indices.store.throttle.max_bytes_per_sec\": \"100mb\",\n    \"indices.merge.scheduler.max_thread_count\": 2\n  }\n}<\/code><\/pre>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<h4 class=\"wp-block-heading\">\u573a\u666f2\uff1aBlink\/Flink \u6279\u91cf\u5199\u5165\u4e0d\u5408\u7406\uff0c\u5e76\u53d1\u9ad8\uff0c\u91cd\u8bd5\u98ce\u66b4<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u3010\u73b0\u8c61\u7279\u5f81\u3011<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">bulk \u961f\u5217\u7ecf\u5e38\u5806\u79ef\uff0c\u6709 rejected \u62d2\u7edd\uff1bFlink \u4efb\u52a1\u65e0\u53cd\u538b\uff0c\u4f46\u5199\u5165 TPS \u6ce2\u52a8\u5927\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Blink \u4fa7\u53c2\u6570\u4f18\u5316\uff08Flink ES Connector\uff09<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">1\u3001\u63a7\u5236 Bulk \u6279\u6b21\u5927\u5c0f<\/p>\n\n\n\n<ol class=\"wp-block-list\"><\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">\u63a8\u8350\u7ec4\u5408\uff08\u901a\u7528\u7a33\u59a5\u503c\uff09\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>bulkFlushMaxActions\uff1a<strong>1000~2000<\/strong><\/li>\n\n\n\n<li>bulkFlushMaxSizeInBytes\uff1a<strong>5~10MB<\/strong><\/li>\n\n\n\n<li>bulkFlushInterval\uff1a<strong>1000~3000 ms<\/strong>\u4e0d\u8981\u5355\u6279\u6b21\u8fc7\u5927\uff08>20MB \u6781\u6613 GC \/ \u9501\u7ade\u4e89\u62c9\u9ad8 CPU\uff09<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">2\u3001\u964d\u4f4e\u5199\u5165\u5e76\u53d1<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Blink \u5199\u5165 SubTask \u5e76\u53d1 > ES \u8282\u70b9\u6570 * 2 \u57fa\u672c\u8fc7\u8f7d\uff0c\u9010\u6b65\u964d\u5e76\u53d1\u89c2\u5bdf CPU\u3002<br><br>3\u3001\u4f18\u5316\u91cd\u8bd5\u548c\u8d85\u65f6<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5173\u95ed\u65e0\u9650\u91cd\u8bd5\uff0c\u589e\u52a0\u9000\u907f\u7b56\u7565\uff1a<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u91cd\u8bd5\u6b21\u6570\uff1a3~5 \u6b21<\/li>\n\n\n\n<li>\u91cd\u8bd5\u5ef6\u8fdf\uff1a500ms~2s \u6307\u6570\u9000\u907f<\/li>\n\n\n\n<li>\u8fde\u63a5\u8d85\u65f6 \/ Socket \u8d85\u65f6 \u9002\u5f53\u8c03\u9ad8\uff0c\u907f\u514d\u9891\u7e41\u65ad\u5f00\u91cd\u8fde<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">4\u3001\u5f00\u542f\u672c\u5730\u6512\u6279\uff0c\u907f\u514d\u5355\u6761\u4e0b\u53d1<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u7981\u6b62\u9010\u6761\u5199\u5165 ES\uff0c\u6d41\u5f0f\u5fc5\u987b\u8d70 Bulk\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\"><\/ol>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<h4 class=\"wp-block-heading\">\u573a\u666f3\uff1a\u7d22\u5f15\u5206\u7247\u4e0d\u5408\u7406<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">\u3010\u73b0\u8c61\u7279\u5f81\u3011<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5206\u7247\u6570\u8fc7\u591a\uff0csegments \u66b4\u589e\uff0c\u6bb5\u5408\u5e76\u6c38\u4e0d\u505c\u6b47\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>\u5355\u5206\u7247\u6570\u636e\u91cf\u5efa\u8bae<\/strong>\uff1a\u5355\u5206\u7247 20~50GB \u6700\u4f18<\/li>\n\n\n\n<li><strong>\u5206\u7247\u6570\u539f\u5219<\/strong>\uff1a\n<ul class=\"wp-block-list\">\n<li>\u4e3b\u5206\u7247\u6570 <strong>\u4e0d\u8981\u8d85\u8fc7 ES \u6570\u636e\u8282\u70b9\u6570<\/strong><\/li>\n\n\n\n<li>\u5199\u5165\u6d41\u7d22\u5f15\uff1a<strong>\u4e3b\u5206\u7247 = \u6570\u636e\u8282\u70b9\u6570<\/strong>\uff0c\u526f\u672c 1\uff08\u9ad8\u5cf0\u53ef\u4e34\u65f6\u5173\u526f\u672c\u964d\u8d1f\u8f7d\uff09<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>\u4e34\u65f6\u964d\u8d1f\u8f7d\uff08\u7d27\u6025\uff09\uff1a<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-code\"><code>PUT \u7d22\u5f15\/_settings\n{\n  \"index.number_of_replicas\": 0\n}\n# \u4f4e\u5cf0\u518d\u6539\u56de 1\u3002<\/code><\/pre>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<h4 class=\"wp-block-heading\">\u573a\u666f4\uff1a\u6587\u6863\u672c\u8eab\u95ee\u9898\uff08\u5b57\u6bb5\u591a\u3001\u5927\u5b57\u6bb5\u3001\u52a8\u6001\u6620\u5c04\uff09<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">1\u3001<strong>\u7981\u7528\u52a8\u6001\u6620\u5c04<\/strong>\uff0c\u63d0\u524d\u5efa\u597d Mapping<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u81ea\u52a8\u521b\u5efa\u5b57\u6bb5\u4f1a\u9891\u7e41\u66f4\u65b0\u5143\u6570\u636e\u3001\u5237\u65b0\u7d22\u5f15\uff0c\u6301\u7eed\u5403 CPU\u3002 <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">2\u3001<strong>\u5254\u9664\u65e0\u7528\u5927\u5b57\u6bb5<\/strong>\uff08\u957f\u6587\u672c\u3001\u4e8c\u8fdb\u5236\u3001\u8d85\u5927\u6570\u7ec4\uff09<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u5199\u5165\u3001\u89e3\u6790\u3001\u7d22\u5f15\u90fd\u4f1a\u62c9\u9ad8 CPU\u3002 <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">3\u3001\u5173\u95ed <code>_source<\/code> \u538b\u7f29 \/ \u8c03\u6574\u5b57\u6bb5\u7c7b\u578b\uff0c\u51cf\u5c11\u89e3\u6790\u5f00\u9500\u3002<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<h4 class=\"wp-block-heading\">\u573a\u666f5\uff1aES JVM &amp; \u7cfb\u7edf\u5c42\u914d\u7f6e<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">1\u3001JVM \u5806\u5efa\u8bae\uff1a<strong>\u4e0d\u8d85\u8fc7 31G<\/strong>\uff0c\u751f\u4ea7\u5e38\u7528 16G\/24G<\/p>\n\n\n\n<ol class=\"wp-block-list\"><\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">\u5806\u8fc7\u5927 \u2192 GC \u5361\u987f\u3001CPU \u6bdb\u523a\u3002 <\/p>\n\n\n\n<p class=\"wp-block-paragraph\">2\u3001\u7cfb\u7edf\u5c42\u9762\uff1a<\/p>\n\n\n\n<ol class=\"wp-block-list\"><\/ol>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u6253\u5f00 ES \u5185\u5b58\u9501\u5b9a <code>bootstrap.memory_lock: true<\/code><\/li>\n\n\n\n<li>\u8c03\u5927\u6587\u4ef6\u53e5\u67c4\u3001\u7ebf\u7a0b\u6570\uff08\u6d41\u5f0f\u5199\u5165\u5fc5\u5907\uff09<\/li>\n<\/ul>\n\n\n\n<ol class=\"wp-block-list\"><\/ol>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u56db\u3001\u4e34\u65f6\u5e94\u6025\u65b9\u6848<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u5982\u679c\u73b0\u5728 CPU \u5df2\u7ecf\u5f88\u9ad8\uff0c\u5148\u505a\u8fd9\u51e0\u6b65\u5feb\u901f\u6b62\u8840\uff1a<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u5bf9\u5e94\u7d22\u5f15 <code>index.refresh_interval<\/code> \u6539\u4e3a <code>30s<\/code><\/li>\n\n\n\n<li>\u4e34\u65f6\u628a\u7d22\u5f15\u526f\u672c\u8bbe\u4e3a 0<\/li>\n\n\n\n<li>Blink \u5199\u5165\u4efb\u52a1\uff1a<strong>\u964d\u4f4e 1\/3 \u5e76\u53d1<\/strong> + \u8c03\u5927 bulk \u95f4\u9694<\/li>\n\n\n\n<li>\u624b\u52a8\u89e6\u53d1\u4e00\u6b21\u6bb5\u5408\u5e76\u6574\u7406\uff08\u4f4e\u5cf0\u64cd\u4f5c\uff09\uff1a<\/li>\n<\/ol>\n\n\n\n<pre class=\"wp-block-code\"><code>POST \u7d22\u5f15\/_forcemerge?max_num_segments=1<\/code><\/pre>\n\n\n\n<h2 class=\"wp-block-heading\">\u4e94\u3001\u957f\u6548\u8fd0\u7ef4\u5efa\u8bae<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">1\u3001<strong>\u6309\u5929 \/ \u6309\u5c0f\u65f6\u62c6\u5206\u7d22\u5f15<\/strong>\uff08\u65f6\u5e8f\u6d41\u5f0f\u6570\u636e\u9996\u9009\uff09<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u7528 <code>\u6eda\u52a8\u7d22\u5f15\/\u65e5\u671f\u7d22\u5f15<\/code>\uff0c\u65e7\u7d22\u5f15\u53ea\u8bfb\uff0c\u4e0d\u518d\u4ea7\u751f\u5408\u5e76 \/ \u5237\u65b0\u538b\u529b\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">2\u3001\u505a<strong>\u6d41\u91cf\u524a\u5cf0<\/strong>\uff1aBlink \u4fa7\u52a0\u7f13\u51b2\uff0c\u5e73\u6ed1\u5199\u5165 TPS\uff0c\u907f\u514d\u7a81\u523a\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">3\u3001\u76d1\u63a7\u770b\u677f\u91cd\u70b9\u52a0\uff1a<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ES CPU\u3001bulk \u961f\u5217\u3001\u6bb5\u6570\u91cf\u3001refresh \u6b21\u6570\u3001Flink \u5199\u5165\u5e76\u53d1 \/ \u6279\u6b21\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">4\u3001\u5b9a\u65f6\u8fd0\u7ef4\uff1a\u51cc\u6668\u4f4e\u5cf0\u6267\u884c forcemerge + refresh \u6574\u7406\u788e\u7247\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u8865\u5145\u4e00\uff1a\u5feb\u901f\u5b9a\u4f4d<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>\u961f\u5217\u5806\u79ef\u3001rejected \u2192 <strong>\u5199\u5165\u5e76\u53d1 \/ \u6279\u6b21\u592a\u5927\uff0c\u964d\u5e76\u53d1\u3001\u8c03 bulk<\/strong> <\/li>\n\n\n\n<li>segments \u591a\u3001merges \u5fd9 \u2192 <strong>\u5206\u7247\u591a\u3001\u5237\u65b0\u592a\u52e4\uff0c\u6539 refresh\u3001\u5408\u5206\u7247<\/strong> <\/li>\n\n\n\n<li>\u91cd\u542f\u5c31\u597d\u3001\u8d8a\u8dd1\u8d8a\u5361 \u2192 <strong>\u5185\u5b58 \/ \u6279\u6b21\u7d2f\u79ef + \u540e\u53f0\u5408\u5e76\u6301\u7eed\u8fd0\u884c<\/strong><\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u8865\u5145\u4e8c\uff1a\u4fe1\u606f\u6536\u96c6\u547d\u4ee4\uff08\u5148\u6536\u96c6\u540e\u5206\u6790\uff09<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">1. \u96c6\u7fa4&amp;\u8282\u70b9\u57fa\u7840\u4fe1\u606f<\/h3>\n\n\n\n<pre class=\"wp-block-code\"><code># \u6240\u6709\u8282\u70b9\u6982\u89c8\uff1aCPU\u3001\u8d1f\u8f7d\u3001\u5806\u5185\u5b58\u3001\u7269\u7406\u5185\u5b58\nGET _cat\/nodes?v&amp;h=name,ip,cpu,load_1m,load_5m,heapPercent,ramPercent,diskUsedPercent,node.role\n\n# \u96c6\u7fa4\u6574\u4f53\u5065\u5eb7\u3001\u5206\u7247\u5206\u914d\u72b6\u6001\nGET _cat\/health?v\n\n# \u67e5\u770b\u8282\u70b9JVM\u914d\u7f6e\u3001\u5806\u5927\u5c0f\u3001GC\u60c5\u51b5\nGET _nodes\/jvm?pretty<\/code><\/pre>\n\n\n\n<h3 class=\"wp-block-heading\">2. \u5199\u5165\u6838\u5fc3\u7ebf\u7a0b\u6c60<\/h3>\n\n\n\n<pre class=\"wp-block-code\"><code># bulk \u7ebf\u7a0b\u6c60\uff08\u6d41\u5f0f\u5199\u5165\u6700\u5173\u952e\uff09\nGET _cat\/thread_pool\/bulk?v&amp;h=node,name,active,queue,queue_size,rejected,completed\n\n# write \u7ebf\u7a0b\u6c60\nGET _cat\/thread_pool\/write?v&amp;h=node,name,active,queue,queue_size,rejected,completed\n\n# \u5168\u90e8\u7ebf\u7a0b\u6c60\uff08\u515c\u5e95\u67e5\u770b\u5176\u4ed6\u963b\u585e\uff09\nGET _cat\/thread_pool?v<\/code><\/pre>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\"><strong>\u5173\u6ce8\u5b57\u6bb5<\/strong>\uff1a<code>rejected > 0<\/code> \u4ee3\u8868\u5199\u5165\u8fc7\u8f7d\u62d2\u7edd\uff1b<code>queue<\/code> \u6301\u7eed\u4e0a\u6da8\u4ee3\u8868\u5806\u79ef\u3002<\/p>\n<\/blockquote>\n\n\n\n<h3 class=\"wp-block-heading\">3. \u76ee\u6807\u4e1a\u52a1\u7d22\u5f15\u4fe1\u606f<\/h3>\n\n\n\n<pre class=\"wp-block-code\"><code># \u7d22\u5f15\u57fa\u7840\uff1a\u5206\u7247\u3001\u6587\u6863\u6570\u3001\u5b58\u50a8\u3001\u5220\u9664\u6587\u6863\u6570\nGET _cat\/indices?index=\u4f60\u7684\u7d22\u5f15\u540d*&amp;v&amp;h=index,pri,rep,docs.count,docs.deleted,store,segments.count\n\n# \u7d22\u5f15\u5168\u5c40\u7edf\u8ba1\uff1a\u5199\u5165\u3001\u5237\u65b0\u3001\u6bb5\u5408\u5e76\u8017\u65f6\/\u6b21\u6570\nGET \u4f60\u7684\u7d22\u5f15\u540d*\/_stats\/indexing,refresh,merges,search?pretty<\/code><\/pre>\n\n\n\n<h3 class=\"wp-block-heading\">4. \u6bb5\u5408\u5e76 &amp; \u5237\u65b0\u8be6\u60c5<\/h3>\n\n\n\n<pre class=\"wp-block-code\"><code># \u67e5\u770b\u6b63\u5728\u6267\u884c\u7684\u6bb5\u5408\u5e76\u4efb\u52a1\nGET _cat\/segments?index=\u4f60\u7684\u7d22\u5f15\u540d*&amp;v\n\n# \u67e5\u770b\u540e\u53f0\u5408\u5e76\u8c03\u5ea6\u3001\u9650\u6d41\u914d\u7f6e\nGET _cluster\/settings?include_defaults=true&amp;pretty\n\n# \u67e5\u770b\u7d22\u5f15\u5f53\u524d refresh \u95f4\u9694\u3001\u526f\u672c\u6570\u7b49\u8bbe\u7f6e\nGET \u4f60\u7684\u7d22\u5f15\u540d*\/_settings?pretty<\/code><\/pre>\n\n\n\n<h3 class=\"wp-block-heading\">5. \u6162\u67e5\u8be2 \/ \u6162\u5199\u5165\u65e5\u5fd7<\/h3>\n\n\n\n<pre class=\"wp-block-code\"><code># \u67e5\u770b\u5f53\u524d\u6162\u65e5\u5fd7\u9608\u503c\u914d\u7f6e\nGET \u4f60\u7684\u7d22\u5f15\u540d*\/_settings\/index.slowlog?pretty\n\n# \u67e5\u770b\u6700\u8fd1\u6162\u65e5\u5fd7\uff08ES7+\/8+ \u5185\u7f6e\u65e5\u5fd7\u68c0\u7d22\uff0c\u4e5f\u53ef\u76f4\u63a5\u770b\u670d\u52a1\u5668\u65e5\u5fd7\u6587\u4ef6\uff09\nGET _search\n{\n  \"query\": {\n    \"match_all\": {}\n  },\n  \"sort\": &#91;{\"@timestamp\": \"desc\"}],\n  \"size\": 100\n}<\/code><\/pre>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">\u82e5\u670d\u52a1\u5668\u6709\u65e5\u5fd7\u6587\u4ef6\uff0c\u989d\u5916\u6536\u96c6\uff1a<code>elasticsearch\/logs\/<\/code> \u4e0b\u7684 <code>*.log<\/code>\u3001<code>sloglog<\/code> \u65e5\u5fd7<\/p>\n<\/blockquote>\n\n\n\n<h3 class=\"wp-block-heading\">6. \u5206\u7247&amp;\u5206\u7247\u5206\u914d\u60c5\u51b5<\/h3>\n\n\n\n<pre class=\"wp-block-code\"><code># \u67e5\u770b\u6bcf\u4e2a\u5206\u7247\u5206\u5e03\u3001\u5927\u5c0f\u3001\u72b6\u6001\nGET _cat\/shards?index=\u4f60\u7684\u7d22\u5f15\u540d*&amp;v&amp;h=index,prirep,shard,pnode,store,docs\n\n# \u67e5\u770b\u672a\u5206\u914d\u5206\u7247\uff08\u5982\u6709\u5f02\u5e38\u5206\u7247\u4e5f\u4f1a\u62c9\u9ad8\u8d1f\u8f7d\uff09\nGET _cat\/shards?v&amp;h=index,prirep,shard,state,node<\/code><\/pre>\n\n\n\n<h3 class=\"wp-block-heading\">7. \u6279\u91cf\u8bf7\u6c42 &amp; \u961f\u5217\u5806\u79ef\u8865\u5145<\/h3>\n\n\n\n<pre class=\"wp-block-code\"><code># \u67e5\u770b\u5f53\u524d\u6d3b\u8dc3\u7684\u6279\u91cf\u8bf7\u6c42\nGET _cat\/pending_tasks?v\n\n# \u96c6\u7fa4pending\u4efb\u52a1\uff08\u5143\u6570\u636e\u3001\u5206\u7247\u8fc1\u79fb\u3001\u4efb\u52a1\u6392\u961f\uff09\nGET _cat\/tasks?v&amp;actions=*bulk*,*index*<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"<p>\u4e00\u3001\u5224\u65ad\u6838\u5fc3\u73b0\u8c61 \u6d41\u5f0f\u4efb\u52a1\uff08Blink\/Flink\uff09\u6301\u7eed\u5411 ES \u6279\u91cf\u5199\u5165\uff0c\u91cd\u542f\u4efb\u52a1 = \u6e05\u7a7a\u5185\u5b58\u5806\u79ef\u3001\u91cd\u7f6e\u8fde [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[],"class_list":["post-176","post","type-post","status-publish","format-standard","hentry","category-elasticsearch"],"_links":{"self":[{"href":"https:\/\/www.sretalk.com\/index.php?rest_route=\/wp\/v2\/posts\/176","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.sretalk.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.sretalk.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.sretalk.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.sretalk.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=176"}],"version-history":[{"count":16,"href":"https:\/\/www.sretalk.com\/index.php?rest_route=\/wp\/v2\/posts\/176\/revisions"}],"predecessor-version":[{"id":193,"href":"https:\/\/www.sretalk.com\/index.php?rest_route=\/wp\/v2\/posts\/176\/revisions\/193"}],"wp:attachment":[{"href":"https:\/\/www.sretalk.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=176"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.sretalk.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=176"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.sretalk.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}