Cowboy Denny Posted September 1, 2022 Share Posted September 1, 2022 I'm running BIG-IQ 8.1.0.2 and this was the solution for me. I don't take any ownership of results (unless they are good results). Are you getting errors in /var/log/tokumon/current that look like this 2022-09-01_20:54:04.78495 [SEVERE] es: _index:global command:index status:400 _id:https://localhost/mgmt/cm/global/tasks/log-pool-mgmt/2bb36182-7020-401c-86a1-168bf5b6cce1 error:{"type":"illegal_argument_exception","reason":"Limit of total fields [5000] in index [global] has been exceeded"} see searchd log for complete error NOTE: Limit of total fields [5000] Also if you run the following command and only see a result up to 40% then the solution below will probably fix your issue grep percent /var/log/tokumon/* @400000006310f8c91883eeac.s:2022-09-01_18:19:52.10333 [INFO] postgres_configurator: sendFind: percentComplete: 0. Progress: [ ] @400000006310f8c91883eeac.s:2022-09-01_18:20:56.48001 [INFO] postgres_configurator: sendFind: percentComplete: 3. Progress: [= ] @400000006310f8c91883eeac.s:2022-09-01_18:21:31.13141 [INFO] postgres_configurator: sendFind: percentComplete: 7. Progress: [=== ] @400000006310f8c91883eeac.s:2022-09-01_18:22:10.25619 [INFO] postgres_configurator: sendFind: percentComplete:10. Progress: [===== ] @400000006310f8c91883eeac.s:2022-09-01_18:22:33.34480 [INFO] postgres_configurator: sendFind: percentComplete:14. Progress: [======= ] @400000006310f8c91883eeac.s:2022-09-01_18:22:36.36273 [INFO] postgres_configurator: sendFind: percentComplete:18. Progress: [========= ] @400000006310fe092f593934.s:2022-09-01_18:25:19.65314 [INFO] postgres_configurator: sendFind: percentComplete:21. Progress: [========== ] @400000006310fe092f593934.s:2022-09-01_18:25:35.79095 [INFO] postgres_configurator: sendFind: percentComplete:25. Progress: [============ ] @400000006310fe092f593934.s:2022-09-01_18:25:39.21993 [INFO] postgres_configurator: sendFind: percentComplete:29. Progress: [============== ] @400000006310fe092f593934.s:2022-09-01_18:25:40.50506 [INFO] postgres_configurator: sendFind: percentComplete:32. Progress: [================ ] @400000006310fe092f593934.s:2022-09-01_18:25:43.14887 [INFO] postgres_configurator: sendFind: percentComplete:36. Progress: [================== ] @400000006310fe092f593934.s:2022-09-01_18:25:44.20091 [INFO] postgres_configurator: sendFind: percentComplete:40. Progress: [==================== ] @4000000063110a5e23ef1e9c.s:2022-09-01_19:36:20.30337 [INFO] postgres_configurator: sendFind: percentComplete: 0. Progress: [ ] @4000000063110a5e23ef1e9c.s:2022-09-01_19:38:16.74310 [INFO] postgres_configurator: sendFind: percentComplete: 3. Progress: [= ] @4000000063110a5e23ef1e9c.s:2022-09-01_19:38:59.11996 [INFO] postgres_configurator: sendFind: percentComplete: 7. Progress: [=== ] @40000000631110a61bd8884c.s:2022-09-01_19:39:44.35119 [INFO] postgres_configurator: sendFind: percentComplete:10. Progress: [===== ] @40000000631110a61bd8884c.s:2022-09-01_19:40:12.92306 [INFO] postgres_configurator: sendFind: percentComplete:14. Progress: [======= ] @40000000631110a61bd8884c.s:2022-09-01_19:40:16.42442 [INFO] postgres_configurator: sendFind: percentComplete:18. Progress: [========= ] @40000000631110a61bd8884c.s:2022-09-01_19:43:31.32524 [INFO] postgres_configurator: sendFind: percentComplete:21. Progress: [========== ] @40000000631110a61bd8884c.s:2022-09-01_19:43:48.55782 [INFO] postgres_configurator: sendFind: percentComplete:25. Progress: [============ ] @40000000631110a61bd8884c.s:2022-09-01_19:43:52.53171 [INFO] postgres_configurator: sendFind: percentComplete:29. Progress: [============== ] @40000000631110a61bd8884c.s:2022-09-01_19:43:54.13572 [INFO] postgres_configurator: sendFind: percentComplete:32. Progress: [================ ] @40000000631110a61bd8884c.s:2022-09-01_19:43:57.11501 [INFO] postgres_configurator: sendFind: percentComplete:36. Progress: [================== ] @40000000631110a61bd8884c.s:2022-09-01_19:43:58.33266 [INFO] postgres_configurator: sendFind: percentComplete:40. Progress: [==================== ] SOLUTION You need to do a slight modification (at least that's what I needed to do) with guidance from support. mount -o rw,remount /usr vi /usr/share/rest/tokumon/config/modules/global.js 'use strict'; exports.GLOBAL = { indexName: 'global', settings: { "index" : { "mapping" : { "total_fields" : { "limit" : "5000" } } } }, mappings: { "properties": { "_value": { "type": "object", "properties": { "resources": { "enabled": false }, "appSvcsDeclaration": { "enabled": false }, "declaration": { "enabled": false }, "body": { "enabled": false } } } } } }; this is adding the body statement at the end. Since you can easily make a syntax error, I suggest copying the entire thing and remove and replace but its your call as long as the body statement is in and looks like and ends like above. mount -o ro,remount /usr bigstart kill tokumond tailf /var/log/tokumon/current | grep percentComplet current:2022-09-01_20:56:31.67153 [INFO] postgres_configurator: sendFind: percentComplete: 0. Progress: [ ] current:2022-09-01_20:57:52.16058 [INFO] postgres_configurator: sendFind: percentComplete: 3. Progress: [= ] current:2022-09-01_20:58:30.72284 [INFO] postgres_configurator: sendFind: percentComplete: 7. Progress: [=== ] current:2022-09-01_20:59:15.10986 [INFO] postgres_configurator: sendFind: percentComplete:10. Progress: [===== ] current:2022-09-01_20:59:42.15947 [INFO] postgres_configurator: sendFind: percentComplete:14. Progress: [======= ] current:2022-09-01_20:59:45.78599 [INFO] postgres_configurator: sendFind: percentComplete:18. Progress: [========= ] current:2022-09-01_20:59:50.53854 [INFO] postgres_configurator: sendFind: percentComplete:21. Progress: [========== ] current:2022-09-01_21:00:08.61312 [INFO] postgres_configurator: sendFind: percentComplete:25. Progress: [============ ] current:2022-09-01_21:00:12.70932 [INFO] postgres_configurator: sendFind: percentComplete:29. Progress: [============== ] current:2022-09-01_21:00:13.98724 [INFO] postgres_configurator: sendFind: percentComplete:32. Progress: [================ ] current:2022-09-01_21:00:17.42414 [INFO] postgres_configurator: sendFind: percentComplete:36. Progress: [================== ] current:2022-09-01_21:00:18.71053 [INFO] postgres_configurator: sendFind: percentComplete:40. Progress: [==================== ] current:2022-09-01_21:01:37.20488 [INFO] postgres_configurator: sendFind: percentComplete:43. Progress: [===================== ] current:2022-09-01_21:01:39.13140 [INFO] postgres_configurator: sendFind: percentComplete:47. Progress: [======================= ] current:2022-09-01_21:01:39.85294 [INFO] postgres_configurator: sendFind: percentComplete:51. Progress: [========================= ] current:2022-09-01_21:01:41.70705 [INFO] postgres_configurator: sendFind: percentComplete:54. Progress: [=========================== ] current:2022-09-01_21:01:44.29766 [INFO] postgres_configurator: sendFind: percentComplete:58. Progress: [============================= ] current:2022-09-01_21:02:22.88336 [INFO] postgres_configurator: sendFind: percentComplete:62. Progress: [=============================== ] current:2022-09-01_21:02:58.75886 [INFO] postgres_configurator: sendFind: percentComplete:65. Progress: [================================ ] current:2022-09-01_21:03:14.11242 [INFO] postgres_configurator: sendFind: percentComplete:69. Progress: [================================== ] current:2022-09-01_21:03:32.98830 [INFO] postgres_configurator: sendFind: percentComplete:73. Progress: [==================================== ] current:2022-09-01_21:03:37.45466 [INFO] postgres_configurator: sendFind: percentComplete:76. Progress: [====================================== ] current:2022-09-01_21:03:39.60386 [INFO] postgres_configurator: sendFind: percentComplete:80. Progress: [======================================== ] current:2022-09-01_21:03:40.86741 [INFO] postgres_configurator: sendFind: percentComplete:84. Progress: [========================================== ] current:2022-09-01_21:03:41.29606 [INFO] postgres_configurator: sendFind: percentComplete:87. Progress: [=========================================== ] current:2022-09-01_21:03:41.82372 [INFO] postgres_configurator: sendFind: percentComplete:91. Progress: [============================================= ] current:2022-09-01_21:03:42.43096 [INFO] postgres_configurator: sendFind: percentComplete:95. Progress: [=============================================== ] current:2022-09-01_21:03:42.87142 [INFO] postgres_configurator: sendFind: percentComplete:98. Progress: [================================================= ] Now it gets past 40% and completes (even though it just ends at 98 but it does complete). Now try and log into the GUI and hopefully this helped fix you as it did myself. Link to comment Share on other sites More sharing options...
Recommended Posts