Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Old bookkeeper logs don't get cleared by GC #4047

Open
stanbog opened this issue Aug 11, 2023 · 1 comment
Open

Old bookkeeper logs don't get cleared by GC #4047

stanbog opened this issue Aug 11, 2023 · 1 comment
Labels
type/bug

Comments

@stanbog
Copy link

stanbog commented Aug 11, 2023 •
edited
Loading

BUG REPORT
Old bookkeeper logs don't get cleared by GC thus filling up the disk

Describe the bug
We have a 3 node bookkeeper cluster. Right now, the ledgers log files are like this:

[root@sveverdpulsar02 current]# ls -lart |grep '.log'
-rw-r--r--   1 bookkeeper bookkeeper   38437853 Jun 14  2022 258.log
-rw-r--r--   1 bookkeeper bookkeeper   23635501 Aug 10  2022 2d2.log
-rw-r--r--   1 bookkeeper bookkeeper    8208247 Sep 13  2022 32d.log
-rw-r--r--   1 bookkeeper bookkeeper    5935767 Sep 28  2022 35c.log
-rw-r--r--   1 bookkeeper bookkeeper    1202917 Nov  9  2022 3ea.log
-rw-r--r--   1 bookkeeper bookkeeper       7626 Nov  9  2022 3ee.log
-rw-r--r--   1 bookkeeper bookkeeper     752286 Jan  5  2023 496.log
-rw-r--r--   1 bookkeeper bookkeeper     886070 Mar 14 10:39 59e.log
-rw-r--r--   1 bookkeeper bookkeeper     330423 Apr 15 03:53 61c.log
-rw-r--r--   1 bookkeeper bookkeeper    1249211 May 17 15:56 6f6.log
-rw-r--r--   1 bookkeeper bookkeeper     800008 Jun 14 00:14 78e.log
-rw-r--r--   1 bookkeeper bookkeeper    8426498 Jul 28 19:39 837.log
-rw-r--r--   1 bookkeeper bookkeeper   36920151 Jul 31 20:15 841.log
-rw-r--r--   1 bookkeeper bookkeeper     390258 Aug  2 08:17 845.log
-rw-r--r--   1 bookkeeper bookkeeper    2805604 Aug  2 14:44 847.log
-rw-r--r--   1 bookkeeper bookkeeper 1076737783 Aug  2 16:00 848.log
-rw-r--r--   1 bookkeeper bookkeeper    2805604 Aug  2 16:00 849.log
-rw-r--r--   1 bookkeeper bookkeeper   10658332 Aug  2 16:00 84a.log
-rw-r--r--   1 bookkeeper bookkeeper    1683791 Aug  2 16:00 84b.log
-rw-r--r--   1 bookkeeper bookkeeper 1076759414 Aug  2 17:35 84c.log
-rw-r--r--   1 bookkeeper bookkeeper    2366725 Aug  2 17:35 84d.log
-rw-r--r--   1 bookkeeper bookkeeper     165532 Aug  2 17:35 84e.log
-rw-r--r--   1 bookkeeper bookkeeper 1078204815 Aug  2 19:25 84f.log
-rw-r--r--   1 bookkeeper bookkeeper    2805604 Aug  2 19:25 850.log
-rw-r--r--   1 bookkeeper bookkeeper 1077842716 Aug  2 21:01 851.log
-rw-r--r--   1 bookkeeper bookkeeper      98945 Aug  2 21:01 852.log
-rw-r--r--   1 bookkeeper bookkeeper 1077564366 Aug  2 22:32 853.log
-rw-r--r--   1 bookkeeper bookkeeper      78019 Aug  2 22:32 854.log
-rw-r--r--   1 bookkeeper bookkeeper 1076724962 Aug  2 23:56 855.log
-rw-r--r--   1 bookkeeper bookkeeper    2244700 Aug  2 23:56 856.log
-rw-r--r--   1 bookkeeper bookkeeper 1077386999 Aug  3 01:19 857.log
-rw-r--r--   1 bookkeeper bookkeeper    3927420 Aug  3 01:19 858.log
-rw-r--r--   1 bookkeeper bookkeeper 1077829196 Aug  3 02:45 859.log
-rw-r--r--   1 bookkeeper bookkeeper      12693 Aug  3 02:45 85a.log
-rw-r--r--   1 bookkeeper bookkeeper 1077187950 Aug  3 04:15 85b.log
-rw-r--r--   1 bookkeeper bookkeeper    3927434 Aug  3 04:15 85c.log
-rw-r--r--   1 bookkeeper bookkeeper    7853804 Aug  3 04:15 85d.log
-rw-r--r--   1 bookkeeper bookkeeper    1683794 Aug  3 04:15 85e.log
-rw-r--r--   1 bookkeeper bookkeeper 1077190259 Aug  3 06:13 85f.log
-rw-r--r--   1 bookkeeper bookkeeper    3927433 Aug  3 06:13 860.log
-rw-r--r--   1 bookkeeper bookkeeper 1073822627 Aug  3 10:40 861.log
-rw-r--r--   1 bookkeeper bookkeeper   37874880 Aug  3 10:40 862.log
-rw-r--r--   1 bookkeeper bookkeeper   69395147 Aug  3 11:53 865.log
-rw-r--r--   1 bookkeeper bookkeeper 1131850184 Aug  3 15:41 866.log
-rw-r--r--   1 bookkeeper bookkeeper    2805609 Aug  3 15:41 867.log
-rw-r--r--   1 bookkeeper bookkeeper 1076121185 Aug  3 17:27 868.log
-rw-r--r--   1 bookkeeper bookkeeper    2805614 Aug  3 17:27 869.log
-rw-r--r--   1 bookkeeper bookkeeper 1076893206 Aug  3 18:58 86a.log
-rw-r--r--   1 bookkeeper bookkeeper       8714 Aug  3 18:58 86b.log
-rw-r--r--   1 bookkeeper bookkeeper 1077210314 Aug  3 20:31 86c.log
-rw-r--r--   1 bookkeeper bookkeeper    2805609 Aug  3 20:31 86d.log
-rw-r--r--   1 bookkeeper bookkeeper 1076580122 Aug  3 22:41 86e.log
-rw-r--r--   1 bookkeeper bookkeeper      19675 Aug  3 22:41 86f.log
-rw-r--r--   1 bookkeeper bookkeeper 1076085599 Aug  4 02:17 870.log
-rw-r--r--   1 bookkeeper bookkeeper    3366517 Aug  4 02:17 871.log
-rw-r--r--   1 bookkeeper bookkeeper   16002661 Aug  4 02:17 872.log
-rw-r--r--   1 bookkeeper bookkeeper     156749 Aug  4 02:17 873.log
-rw-r--r--   1 bookkeeper bookkeeper 1078175603 Aug  4 03:49 874.log
-rw-r--r--   1 bookkeeper bookkeeper    2805603 Aug  4 03:49 875.log
-rw-r--r--   1 bookkeeper bookkeeper 1075730414 Aug  4 05:28 876.log
-rw-r--r--   1 bookkeeper bookkeeper      79102 Aug  4 05:28 877.log
-rw-r--r--   1 bookkeeper bookkeeper 1075798843 Aug  4 07:00 878.log
-rw-r--r--   1 bookkeeper bookkeeper     717824 Aug  4 07:00 879.log
-rw-r--r--   1 bookkeeper bookkeeper 1076304110 Aug  4 08:15 87a.log
-rw-r--r--   1 bookkeeper bookkeeper    2805614 Aug  4 08:15 87b.log
-rw-r--r--   1 bookkeeper bookkeeper 1077279484 Aug  4 09:48 87c.log
-rw-r--r--   1 bookkeeper bookkeeper     103041 Aug  4 09:48 87d.log
-rw-r--r--   1 bookkeeper bookkeeper     143446 Aug  4 11:02 87f.log
-rw-r--r--   1 bookkeeper bookkeeper    1549250 Aug  4 11:03 880.log
-rw-r--r--   1 bookkeeper bookkeeper 1076715452 Aug  4 14:27 881.log
-rw-r--r--   1 bookkeeper bookkeeper     160268 Aug  4 14:27 882.log
-rw-r--r--   1 bookkeeper bookkeeper 1076565104 Aug  4 15:31 883.log
-rw-r--r--   1 bookkeeper bookkeeper      78413 Aug  4 15:31 884.log
-rw-r--r--   1 bookkeeper bookkeeper 1076405841 Aug  4 17:15 885.log
-rw-r--r--   1 bookkeeper bookkeeper      15746 Aug  4 17:15 886.log
-rw-r--r--   1 bookkeeper bookkeeper 1076883639 Aug  4 18:35 887.log
-rw-r--r--   1 bookkeeper bookkeeper    2623902 Aug  4 18:35 888.log
-rw-r--r--   1 bookkeeper bookkeeper 1075713190 Aug  4 20:07 889.log
-rw-r--r--   1 bookkeeper bookkeeper    1222249 Aug  4 20:07 88a.log
-rw-r--r--   1 bookkeeper bookkeeper 1077985606 Aug  4 21:44 88b.log
-rw-r--r--   1 bookkeeper bookkeeper    2767373 Aug  4 21:44 88c.log
-rw-r--r--   1 bookkeeper bookkeeper 1076920925 Aug  4 23:22 88d.log
-rw-r--r--   1 bookkeeper bookkeeper    3366524 Aug  4 23:22 88e.log
-rw-r--r--   1 bookkeeper bookkeeper 1077376240 Aug  5 01:05 88f.log
-rw-r--r--   1 bookkeeper bookkeeper    3366518 Aug  5 01:05 890.log
-rw-r--r--   1 bookkeeper bookkeeper 1077128620 Aug  5 02:44 891.log
-rw-r--r--   1 bookkeeper bookkeeper      14883 Aug  5 02:44 892.log
-rw-r--r--   1 bookkeeper bookkeeper 1076976644 Aug  5 04:16 893.log
-rw-r--r--   1 bookkeeper bookkeeper    3366524 Aug  5 04:16 894.log
-rw-r--r--   1 bookkeeper bookkeeper 1077045143 Aug  5 05:54 895.log
-rw-r--r--   1 bookkeeper bookkeeper    2805614 Aug  5 05:54 896.log
-rw-r--r--   1 bookkeeper bookkeeper 1077398901 Aug  5 07:19 897.log
-rw-r--r--   1 bookkeeper bookkeeper      20379 Aug  5 07:19 898.log
-rw-r--r--   1 bookkeeper bookkeeper 1076979500 Aug  5 08:59 899.log
-rw-r--r--   1 bookkeeper bookkeeper     154457 Aug  5 08:59 89a.log
-rw-r--r--   1 bookkeeper bookkeeper  674643607 Aug  5 10:06 89b.log
-rw-r--r--   1 bookkeeper bookkeeper   67151896 Aug  5 10:06 89c.log
-rw-r--r--   1 bookkeeper bookkeeper     100984 Aug  5 10:06 89d.log
-rw-r--r--   1 bookkeeper bookkeeper  202302720 Aug  5 10:36 89e.log
-rw-r--r--   1 bookkeeper bookkeeper   67280785 Aug  5 10:36 89f.log
-rw-r--r--   1 bookkeeper bookkeeper   25402854 Aug  5 10:36 8a0.log
-rw-r--r--   1 bookkeeper bookkeeper     173830 Aug  5 10:36 8a1.log
-rw-r--r--   1 bookkeeper bookkeeper   67678120 Aug  5 10:54 8a2.log
-rw-r--r--   1 bookkeeper bookkeeper   67354114 Aug  5 10:54 8a3.log
-rw-r--r--   1 bookkeeper bookkeeper   29149475 Aug  5 10:54 8a4.log
-rw-r--r--   1 bookkeeper bookkeeper   67276678 Aug  5 11:00 8a6.log
-rw-r--r--   1 bookkeeper bookkeeper   19286512 Aug  5 11:00 8a7.log
-rw-r--r--   1 bookkeeper bookkeeper   67695427 Aug  5 11:13 8a9.log
-rw-r--r--   1 bookkeeper bookkeeper   19633266 Aug  5 11:13 8aa.log
-rw-r--r--   1 bookkeeper bookkeeper   17045811 Aug  5 11:13 8ac.log
-rw-r--r--   1 bookkeeper bookkeeper      85083 Aug  5 11:13 8ad.log
-rw-r--r--   1 bookkeeper bookkeeper   67661056 Aug  5 11:24 8af.log
-rw-r--r--   1 bookkeeper bookkeeper   34416994 Aug  5 11:24 8b0.log
-rw-r--r--   1 bookkeeper bookkeeper     608184 Aug  5 11:24 8b1.log
-rw-r--r--   1 bookkeeper bookkeeper   67185777 Aug  5 11:36 8b3.log
-rw-r--r--   1 bookkeeper bookkeeper   37844188 Aug  5 11:36 8b4.log
-rw-r--r--   1 bookkeeper bookkeeper   68198840 Aug  5 11:42 8b6.log
-rw-r--r--   1 bookkeeper bookkeeper   67163881 Aug  5 11:54 8b9.log
-rw-r--r--   1 bookkeeper bookkeeper   32322915 Aug  5 11:54 8ba.log
-rw-r--r--   1 bookkeeper bookkeeper   67571753 Aug  5 12:00 8bc.log
-rw-r--r--   1 bookkeeper bookkeeper    7495698 Aug  5 12:00 8bd.log
-rw-r--r--   1 bookkeeper bookkeeper   67692190 Aug  5 12:12 8bf.log
-rw-r--r--   1 bookkeeper bookkeeper   21315999 Aug  5 12:12 8c0.log
-rw-r--r--   1 bookkeeper bookkeeper   67572695 Aug  5 12:18 8c2.log
-rw-r--r--   1 bookkeeper bookkeeper    4647302 Aug  5 12:18 8c3.log
-rw-r--r--   1 bookkeeper bookkeeper   67158946 Aug  5 12:26 8c5.log
-rw-r--r--   1 bookkeeper bookkeeper     630942 Aug  5 12:26 8c6.log
-rw-r--r--   1 bookkeeper bookkeeper   67136696 Aug  5 12:32 8c8.log
-rw-r--r--   1 bookkeeper bookkeeper      94033 Aug  5 12:32 8c9.log
-rw-r--r--   1 bookkeeper bookkeeper   18569862 Aug  5 12:33 8cb.log
-rw-r--r--   1 bookkeeper bookkeeper   67169095 Aug  5 12:38 8cd.log
-rw-r--r--   1 bookkeeper bookkeeper    1470222 Aug  5 12:38 8ce.log
-rw-r--r--   1 bookkeeper bookkeeper    2791026 Aug  5 12:38 8cf.log
-rw-r--r--   1 bookkeeper bookkeeper     790804 Aug  5 12:38 8d0.log
-rw-r--r--   1 bookkeeper bookkeeper   67171775 Aug  5 12:44 8d2.log
-rw-r--r--   1 bookkeeper bookkeeper    1519690 Aug  5 12:44 8d3.log
-rw-r--r--   1 bookkeeper bookkeeper   67625755 Aug  5 12:55 8d5.log
-rw-r--r--   1 bookkeeper bookkeeper   27486005 Aug  5 12:55 8d6.log
-rw-r--r--   1 bookkeeper bookkeeper   67360072 Aug  5 13:01 8d8.log
-rw-r--r--   1 bookkeeper bookkeeper   14758179 Aug  5 13:01 8d9.log
-rw-r--r--   1 bookkeeper bookkeeper     279959 Aug  5 13:01 8da.log
-rw-r--r--   1 bookkeeper bookkeeper   67176407 Aug  5 13:08 8dc.log
-rw-r--r--   1 bookkeeper bookkeeper    1596527 Aug  5 13:08 8dd.log
-rw-r--r--   1 bookkeeper bookkeeper   67130917 Aug  5 13:14 8df.log
-rw-r--r--   1 bookkeeper bookkeeper     133812 Aug  5 13:14 8e0.log
-rw-r--r--   1 bookkeeper bookkeeper   67198996 Aug  5 13:20 8e2.log
-rw-r--r--   1 bookkeeper bookkeeper    1232470 Aug  5 13:20 8e3.log
-rw-r--r--   1 bookkeeper bookkeeper   67501608 Aug  5 13:26 8e5.log
-rw-r--r--   1 bookkeeper bookkeeper    4698779 Aug  5 13:26 8e6.log
-rw-r--r--   1 bookkeeper bookkeeper     244623 Aug  5 13:26 8e7.log
-rw-r--r--   1 bookkeeper bookkeeper   67510611 Aug  5 13:32 8e9.log
-rw-r--r--   1 bookkeeper bookkeeper    4695571 Aug  5 13:32 8ea.log
-rw-r--r--   1 bookkeeper bookkeeper   67486072 Aug  5 13:44 8ec.log
-rw-r--r--   1 bookkeeper bookkeeper   31412179 Aug  5 13:44 8ed.log
-rw-r--r--   1 bookkeeper bookkeeper    8047355 Aug  5 13:44 8ee.log
-rw-r--r--   1 bookkeeper bookkeeper      79773 Aug  5 13:44 8ef.log
-rw-r--r--   1 bookkeeper bookkeeper   67295906 Aug  5 13:56 8f1.log
-rw-r--r--   1 bookkeeper bookkeeper   33031165 Aug  5 13:56 8f2.log
-rw-r--r--   1 bookkeeper bookkeeper   10301870 Aug  5 13:56 8f3.log
-rw-r--r--   1 bookkeeper bookkeeper      71416 Aug  5 13:56 8f4.log
-rw-r--r--   1 bookkeeper bookkeeper   67168114 Aug  5 14:08 8f6.log
-rw-r--r--   1 bookkeeper bookkeeper     537046 Aug  5 14:08 8f8.log
-rw-r--r--   1 bookkeeper bookkeeper   67227822 Aug  5 14:32 8fa.log
-rw-r--r--   1 bookkeeper bookkeeper    1608232 Aug  5 14:32 8fc.log
-rw-r--r--   1 bookkeeper bookkeeper    3790762 Aug  5 14:32 8fd.log
-rw-r--r--   1 bookkeeper bookkeeper     816041 Aug  5 14:33 8fe.log
-rw-r--r--   1 bookkeeper bookkeeper   67240319 Aug  5 14:57 900.log
-rw-r--r--   1 bookkeeper bookkeeper    2431575 Aug  5 14:57 901.log
-rw-r--r--   1 bookkeeper bookkeeper   67197596 Aug  5 15:03 903.log
-rw-r--r--   1 bookkeeper bookkeeper    1627396 Aug  5 15:03 904.log
-rw-r--r--   1 bookkeeper bookkeeper   67263020 Aug  5 15:27 906.log
-rw-r--r--   1 bookkeeper bookkeeper     270154 Aug  5 15:27 907.log
-rw-r--r--   1 bookkeeper bookkeeper   67205587 Aug  5 15:39 909.log
-rw-r--r--   1 bookkeeper bookkeeper     174120 Aug  5 15:39 90a.log
-rw-r--r--   1 bookkeeper bookkeeper     485644 Aug  5 15:39 90b.log
-rw-r--r--   1 bookkeeper bookkeeper   67493921 Aug  5 15:56 90d.log
-rw-r--r--   1 bookkeeper bookkeeper    9218550 Aug  5 15:56 90e.log
-rw-r--r--   1 bookkeeper bookkeeper     304761 Aug  5 15:56 90f.log
-rw-r--r--   1 bookkeeper bookkeeper   67654681 Aug  5 16:02 911.log
-rw-r--r--   1 bookkeeper bookkeeper   17019376 Aug  5 16:02 912.log
-rw-r--r--   1 bookkeeper bookkeeper     235100 Aug  5 16:02 913.log
-rw-r--r--   1 bookkeeper bookkeeper   67180868 Aug  5 16:08 915.log
-rw-r--r--   1 bookkeeper bookkeeper     250427 Aug  5 16:08 916.log
-rw-r--r--   1 bookkeeper bookkeeper   67263894 Aug  5 16:14 918.log
-rw-r--r--   1 bookkeeper bookkeeper    5781783 Aug  5 16:14 91a.log
-rw-r--r--   1 bookkeeper bookkeeper   67337285 Aug  7 12:15 91f.log
-rw-r--r--   1 bookkeeper bookkeeper 1076481815 Aug  7 15:57 922.log
-rw-r--r--   1 bookkeeper bookkeeper    2805594 Aug  7 15:57 923.log
-rw-r--r--   1 bookkeeper bookkeeper 1089263657 Aug  7 17:06 924.log
-rw-r--r--   1 bookkeeper bookkeeper    3366506 Aug  7 17:06 925.log
-rw-r--r--   1 bookkeeper bookkeeper 1076669584 Aug  7 18:28 926.log
-rw-r--r--   1 bookkeeper bookkeeper      16580 Aug  7 18:28 927.log
-rw-r--r--   1 bookkeeper bookkeeper 1076473326 Aug  7 20:07 928.log
-rw-r--r--   1 bookkeeper bookkeeper    3366518 Aug  7 20:07 929.log
-rw-r--r--   1 bookkeeper bookkeeper 1076611420 Aug  7 22:11 92a.log
-rw-r--r--   1 bookkeeper bookkeeper    2805604 Aug  7 22:11 92b.log
-rw-r--r--   1 bookkeeper bookkeeper 1076666608 Aug  8 00:48 92c.log
-rw-r--r--   1 bookkeeper bookkeeper     125419 Aug  8 00:48 92d.log
-rw-r--r--   1 bookkeeper bookkeeper     280225 Aug  8 00:48 92e.log
-rw-r--r--   1 bookkeeper bookkeeper 1075718795 Aug  8 06:14 92f.log
-rw-r--r--   1 bookkeeper bookkeeper     229163 Aug  8 06:14 930.log
-rw-r--r--   1 bookkeeper bookkeeper 1077285184 Aug  8 09:17 931.log
-rw-r--r--   1 bookkeeper bookkeeper    3366512 Aug  8 09:17 932.log
-rw-r--r--   1 bookkeeper bookkeeper    8975861 Aug  8 09:17 933.log
-rw-r--r--   1 bookkeeper bookkeeper 1076798272 Aug  8 10:45 934.log
-rw-r--r--   1 bookkeeper bookkeeper    3366518 Aug  8 10:45 935.log
-rw-r--r--   1 bookkeeper bookkeeper   14024055 Aug  8 10:45 936.log
-rw-r--r--   1 bookkeeper bookkeeper     561974 Aug  8 10:45 937.log
-rw-r--r--   1 bookkeeper bookkeeper 1077709627 Aug  8 12:07 938.log
-rw-r--r--   1 bookkeeper bookkeeper    2805801 Aug  8 12:07 939.log
-rw-r--r--   1 bookkeeper bookkeeper 1075421169 Aug  8 12:26 93a.log
-rw-r--r--   1 bookkeeper bookkeeper   62486837 Aug  8 12:26 93b.log
-rw-r--r--   1 bookkeeper bookkeeper 1074356215 Aug  8 12:33 93c.log
-rw-r--r--   1 bookkeeper bookkeeper    7671624 Aug  8 12:33 93d.log
-rw-r--r--   1 bookkeeper bookkeeper    4843242 Aug  8 12:34 93e.log
-rw-r--r--   1 bookkeeper bookkeeper    1779335 Aug  8 12:34 93f.log
-rw-r--r--   1 bookkeeper bookkeeper 1111347147 Aug  8 13:42 940.log
-rw-r--r--   1 bookkeeper bookkeeper    3366518 Aug  8 13:42 941.log
-rw-r--r--   1 bookkeeper bookkeeper 1076619164 Aug  8 15:09 942.log
-rw-r--r--   1 bookkeeper bookkeeper    2805672 Aug  8 15:09 943.log
-rw-r--r--   1 bookkeeper bookkeeper 1076534287 Aug  8 19:11 944.log
-rw-r--r--   1 bookkeeper bookkeeper      79483 Aug  8 19:11 945.log
-rw-r--r--   1 bookkeeper bookkeeper 1078471388 Aug  8 21:26 946.log
-rw-r--r--   1 bookkeeper bookkeeper    2805609 Aug  8 21:26 947.log
-rw-r--r--   1 bookkeeper bookkeeper 1078659715 Aug  8 22:59 948.log
-rw-r--r--   1 bookkeeper bookkeeper    2805614 Aug  8 22:59 949.log
-rw-r--r--   1 bookkeeper bookkeeper 1078213392 Aug  9 00:31 94a.log
-rw-r--r--   1 bookkeeper bookkeeper      16362 Aug  9 00:31 94b.log
-rw-r--r--   1 bookkeeper bookkeeper 1076611540 Aug  9 02:15 94c.log
-rw-r--r--   1 bookkeeper bookkeeper    2805609 Aug  9 02:15 94d.log
-rw-r--r--   1 bookkeeper bookkeeper 1077159168 Aug  9 04:12 94e.log
-rw-r--r--   1 bookkeeper bookkeeper    3366518 Aug  9 04:12 94f.log
-rw-r--r--   1 bookkeeper bookkeeper   21165966 Aug  9 04:12 950.log
-rw-r--r--   1 bookkeeper bookkeeper     147576 Aug  9 04:12 951.log
-rw-r--r--   1 bookkeeper bookkeeper  606102392 Aug  9 05:08 952.log
-rw-r--r--   1 bookkeeper bookkeeper   67196904 Aug  9 05:08 953.log
-rw-r--r--   1 bookkeeper bookkeeper   10451743 Aug  9 05:08 954.log
-rw-r--r--   1 bookkeeper bookkeeper     544351 Aug  9 05:08 955.log
-rw-r--r--   1 bookkeeper bookkeeper  202184496 Aug  9 05:28 956.log
-rw-r--r--   1 bookkeeper bookkeeper   67187130 Aug  9 05:28 957.log
-rw-r--r--   1 bookkeeper bookkeeper    3072620 Aug  9 05:28 958.log
-rw-r--r--   1 bookkeeper bookkeeper    5896063 Aug  9 05:28 959.log
-rw-r--r--   1 bookkeeper bookkeeper    2725784 Aug  9 05:28 95a.log
-rw-r--r--   1 bookkeeper bookkeeper   67181386 Aug  9 05:40 95b.log
-rw-r--r--   1 bookkeeper bookkeeper   67183122 Aug  9 05:40 95c.log
-rw-r--r--   1 bookkeeper bookkeeper    3149520 Aug  9 05:40 95d.log
-rw-r--r--   1 bookkeeper bookkeeper     549684 Aug  9 05:40 95e.log
-rw-r--r--   1 bookkeeper bookkeeper   67177426 Aug  9 05:46 960.log
-rw-r--r--   1 bookkeeper bookkeeper     342126 Aug  9 05:46 961.log
-rw-r--r--   1 bookkeeper bookkeeper    2260061 Aug  9 05:46 962.log
-rw-r--r--   1 bookkeeper bookkeeper    2591249 Aug  9 05:46 964.log
-rw-r--r--   1 bookkeeper bookkeeper   67128228 Aug  9 05:52 966.log
-rw-r--r--   1 bookkeeper bookkeeper     317633 Aug  9 05:52 967.log
-rw-r--r--   1 bookkeeper bookkeeper   67667597 Aug  9 05:58 969.log
-rw-r--r--   1 bookkeeper bookkeeper   13791467 Aug  9 05:58 96a.log
-rw-r--r--   1 bookkeeper bookkeeper     506314 Aug  9 05:58 96b.log
-rw-r--r--   1 bookkeeper bookkeeper   67308532 Aug  9 06:05 96d.log
-rw-r--r--   1 bookkeeper bookkeeper   17130171 Aug  9 06:05 96e.log
-rw-r--r--   1 bookkeeper bookkeeper     534131 Aug  9 06:05 96f.log
-rw-r--r--   1 bookkeeper bookkeeper   67177495 Aug  9 06:11 971.log
-rw-r--r--   1 bookkeeper bookkeeper     354141 Aug  9 06:11 972.log
-rw-r--r--   1 bookkeeper bookkeeper   67537208 Aug  9 06:17 974.log
-rw-r--r--   1 bookkeeper bookkeeper    2632159 Aug  9 06:17 975.log
-rw-r--r--   1 bookkeeper bookkeeper   67178013 Aug  9 06:23 977.log
-rw-r--r--   1 bookkeeper bookkeeper     393594 Aug  9 06:23 978.log
-rw-r--r--   1 bookkeeper bookkeeper   67426132 Aug  9 06:28 97a.log
-rw-r--r--   1 bookkeeper bookkeeper    2641719 Aug  9 06:29 97b.log
-rw-r--r--   1 bookkeeper bookkeeper   67652211 Aug  9 06:35 97d.log
-rw-r--r--   1 bookkeeper bookkeeper   16562704 Aug  9 06:35 97e.log
-rw-r--r--   1 bookkeeper bookkeeper     568578 Aug  9 06:35 97f.log
-rw-r--r--   1 bookkeeper bookkeeper   67299695 Aug  9 06:41 981.log
-rw-r--r--   1 bookkeeper bookkeeper   16593366 Aug  9 06:41 982.log
-rw-r--r--   1 bookkeeper bookkeeper     527079 Aug  9 06:41 983.log
-rw-r--r--   1 bookkeeper bookkeeper   67466818 Aug  9 06:47 985.log
-rw-r--r--   1 bookkeeper bookkeeper    6969148 Aug  9 06:47 986.log
-rw-r--r--   1 bookkeeper bookkeeper     369152 Aug  9 06:47 987.log
-rw-r--r--   1 bookkeeper bookkeeper     184900 Aug  9 06:47 988.log
-rw-r--r--   1 bookkeeper bookkeeper   67267735 Aug  9 06:54 98a.log
-rw-r--r--   1 bookkeeper bookkeeper    4741577 Aug  9 06:54 98b.log
-rw-r--r--   1 bookkeeper bookkeeper     350121 Aug  9 06:54 98c.log
-rw-r--r--   1 bookkeeper bookkeeper   67249277 Aug  9 07:06 98e.log
-rw-r--r--   1 bookkeeper bookkeeper   40159630 Aug  9 07:06 98f.log
-rw-r--r--   1 bookkeeper bookkeeper     673831 Aug  9 07:06 990.log
-rw-r--r--   1 bookkeeper bookkeeper   67174354 Aug  9 07:12 992.log
-rw-r--r--   1 bookkeeper bookkeeper    2289079 Aug  9 07:12 993.log
-rw-r--r--   1 bookkeeper bookkeeper   67153071 Aug  9 07:18 995.log
-rw-r--r--   1 bookkeeper bookkeeper    2196094 Aug  9 07:19 996.log
-rw-r--r--   1 bookkeeper bookkeeper   67147884 Aug  9 07:25 998.log
-rw-r--r--   1 bookkeeper bookkeeper     238682 Aug  9 07:25 99a.log
-rw-r--r--   1 bookkeeper bookkeeper     401426 Aug  9 07:25 99b.log
-rw-r--r--   1 bookkeeper bookkeeper   67136956 Aug  9 07:31 99d.log
-rw-r--r--   1 bookkeeper bookkeeper     113464 Aug  9 07:31 99e.log
-rw-r--r--   1 bookkeeper bookkeeper   67652794 Aug  9 07:37 9a0.log
-rw-r--r--   1 bookkeeper bookkeeper     663025 Aug  9 07:37 9a1.log
-rw-r--r--   1 bookkeeper bookkeeper   67342642 Aug  9 07:43 9a3.log
-rw-r--r--   1 bookkeeper bookkeeper    4726982 Aug  9 07:43 9a5.log
-rw-r--r--   1 bookkeeper bookkeeper     568885 Aug  9 07:43 9a6.log
-rw-r--r--   1 bookkeeper bookkeeper   67302416 Aug  9 07:55 9a8.log
-rw-r--r--   1 bookkeeper bookkeeper   36853185 Aug  9 07:55 9a9.log
-rw-r--r--   1 bookkeeper bookkeeper    1710837 Aug  9 07:55 9aa.log
-rw-r--r--   1 bookkeeper bookkeeper     221196 Aug  9 07:55 9ab.log
-rw-r--r--   1 bookkeeper bookkeeper   67189789 Aug  9 08:02 9ad.log
-rw-r--r--   1 bookkeeper bookkeeper    2093748 Aug  9 08:02 9ae.log
-rw-r--r--   1 bookkeeper bookkeeper   67306153 Aug  9 08:13 9b0.log
-rw-r--r--   1 bookkeeper bookkeeper   33474066 Aug  9 08:13 9b1.log
-rw-r--r--   1 bookkeeper bookkeeper   10024200 Aug  9 08:13 9b2.log
-rw-r--r--   1 bookkeeper bookkeeper     221654 Aug  9 08:13 9b3.log
-rw-r--r--   1 bookkeeper bookkeeper   67166238 Aug  9 08:20 9b5.log
-rw-r--r--   1 bookkeeper bookkeeper     239693 Aug  9 08:20 9b6.log
-rw-r--r--   1 bookkeeper bookkeeper   67128925 Aug  9 08:25 9b8.log
-rw-r--r--   1 bookkeeper bookkeeper     216329 Aug  9 08:25 9b9.log
-rw-r--r--   1 bookkeeper bookkeeper     353122 Aug  9 08:25 9ba.log
-rw-r--r--   1 bookkeeper bookkeeper   67179825 Aug  9 08:37 9bc.log
-rw-r--r--   1 bookkeeper bookkeeper   35696235 Aug  9 08:38 9bd.log
-rw-r--r--   1 bookkeeper bookkeeper   67138742 Aug  9 08:44 9bf.log
-rw-r--r--   1 bookkeeper bookkeeper     218149 Aug  9 08:44 9c0.log
-rw-r--r--   1 bookkeeper bookkeeper   67176680 Aug  9 08:50 9c2.log
-rw-r--r--   1 bookkeeper bookkeeper    1684490 Aug  9 08:50 9c3.log
-rw-r--r--   1 bookkeeper bookkeeper   67380010 Aug  9 09:02 9c5.log
-rw-r--r--   1 bookkeeper bookkeeper   41781196 Aug  9 09:02 9c6.log
-rw-r--r--   1 bookkeeper bookkeeper     332435 Aug  9 09:02 9c7.log
-rw-r--r--   1 bookkeeper bookkeeper   67651319 Aug  9 09:08 9c9.log
-rw-r--r--   1 bookkeeper bookkeeper   13282482 Aug  9 09:08 9cb.log
-rw-r--r--   1 bookkeeper bookkeeper   67413820 Aug  9 09:15 9cd.log
-rw-r--r--   1 bookkeeper bookkeeper    4306984 Aug  9 09:15 9ce.log
-rw-r--r--   1 bookkeeper bookkeeper   67605668 Aug  9 09:21 9d0.log
-rw-r--r--   1 bookkeeper bookkeeper    3743964 Aug  9 09:21 9d2.log
-rw-r--r--   1 bookkeeper bookkeeper     528747 Aug  9 09:21 9d3.log
-rw-r--r--   1 bookkeeper bookkeeper     191735 Aug  9 09:21 9d4.log
-rw-r--r--   1 bookkeeper bookkeeper     171575 Aug  9 09:21 9d5.log
-rw-r--r--   1 bookkeeper bookkeeper   67218819 Aug  9 09:27 9d7.log
-rw-r--r--   1 bookkeeper bookkeeper    3745994 Aug  9 09:27 9d8.log
-rw-r--r--   1 bookkeeper bookkeeper   67710050 Aug  9 09:34 9da.log
-rw-r--r--   1 bookkeeper bookkeeper    3746292 Aug  9 09:34 9db.log
-rw-r--r--   1 bookkeeper bookkeeper   67552295 Aug  9 09:46 9dd.log
-rw-r--r--   1 bookkeeper bookkeeper   33656013 Aug  9 09:46 9de.log
-rw-r--r--   1 bookkeeper bookkeeper   67176740 Aug  9 09:52 9e0.log
-rw-r--r--   1 bookkeeper bookkeeper    2195888 Aug  9 09:52 9e1.log
-rw-r--r--   1 bookkeeper bookkeeper    3821702 Aug  9 09:52 9e3.log
-rw-r--r--   1 bookkeeper bookkeeper    3664543 Aug  9 09:52 9e4.log
-rw-r--r--   1 bookkeeper bookkeeper   67641309 Aug  9 10:04 9e6.log
-rw-r--r--   1 bookkeeper bookkeeper   36675320 Aug  9 10:04 9e7.log
-rw-r--r--   1 bookkeeper bookkeeper     337684 Aug  9 10:04 9e8.log
-rw-r--r--   1 bookkeeper bookkeeper   67172900 Aug  9 10:10 9ea.log
-rw-r--r--   1 bookkeeper bookkeeper    1811703 Aug  9 10:10 9eb.log
-rw-r--r--   1 bookkeeper bookkeeper   67187261 Aug  9 10:22 9ed.log
-rw-r--r--   1 bookkeeper bookkeeper   14727329 Aug  9 10:22 9ee.log
-rw-r--r--   1 bookkeeper bookkeeper   33474980 Aug  9 10:22 9ef.log
-rw-r--r--   1 bookkeeper bookkeeper   67493803 Aug  9 10:34 9f1.log
-rw-r--r--   1 bookkeeper bookkeeper   39494207 Aug  9 10:34 9f2.log
-rw-r--r--   1 bookkeeper bookkeeper     336759 Aug  9 10:34 9f3.log
-rw-r--r--   1 bookkeeper bookkeeper   26102480 Aug  9 10:46 9f7.log
-rw-r--r--   1 bookkeeper bookkeeper   67331305 Aug  9 10:46 9f8.log
-rw-r--r--   1 bookkeeper bookkeeper    3366710 Aug  9 10:46 9f9.log
-rw-r--r--   1 bookkeeper bookkeeper   67347748 Aug  9 10:52 9fb.log
-rw-r--r--   1 bookkeeper bookkeeper    6171063 Aug  9 10:52 9fc.log
-rw-r--r--   1 bookkeeper bookkeeper   67366460 Aug  9 10:58 9fe.log
-rw-r--r--   1 bookkeeper bookkeeper    7853932 Aug  9 10:58 9ff.log
-rw-r--r--   1 bookkeeper bookkeeper     562102 Aug  9 10:58 a00.log
-rw-r--r--   1 bookkeeper bookkeeper   67170411 Aug  9 11:04 a02.log
-rw-r--r--   1 bookkeeper bookkeeper      37796 Aug  9 11:04 a03.log
-rw-r--r--   1 bookkeeper bookkeeper   67454558 Aug  9 11:15 a05.log
-rw-r--r--   1 bookkeeper bookkeeper    2510028 Aug  9 11:15 a06.log
-rw-r--r--   1 bookkeeper bookkeeper   67154725 Aug  9 11:22 a08.log
-rw-r--r--   1 bookkeeper bookkeeper      77186 Aug  9 11:22 a09.log
-rw-r--r--   1 bookkeeper bookkeeper   67169174 Aug  9 11:23 a0b.log
-rw-r--r--   1 bookkeeper bookkeeper     257120 Aug  9 11:23 a0c.log
-rw-r--r--   1 bookkeeper bookkeeper   67135168 Aug  9 11:29 a0e.log
-rw-r--r--   1 bookkeeper bookkeeper      43223 Aug  9 11:29 a0f.log
-rw-r--r--   1 bookkeeper bookkeeper   67633499 Aug  9 12:13 a11.log
-rw-r--r--   1 bookkeeper bookkeeper    6171063 Aug  9 12:13 a12.log
-rw-r--r--   1 bookkeeper bookkeeper  243275982 Aug  9 12:43 a13.log
-rw-r--r--   1 bookkeeper bookkeeper   67289605 Aug  9 12:49 a15.log
-rw-r--r--   1 bookkeeper bookkeeper    1685160 Aug  9 12:49 a16.log
-rw-r--r--   1 bookkeeper bookkeeper 1078740385 Aug  9 14:30 a17.log
-rw-r--r--   1 bookkeeper bookkeeper    2805609 Aug  9 14:30 a18.log
-rw-r--r--   1 bookkeeper bookkeeper 1077503773 Aug  9 15:57 a19.log
-rw-r--r--   1 bookkeeper bookkeeper     155665 Aug  9 15:57 a1a.log
-rw-r--r--   1 bookkeeper bookkeeper 1076484993 Aug  9 17:23 a1b.log
-rw-r--r--   1 bookkeeper bookkeeper      11715 Aug  9 17:23 a1c.log
-rw-r--r--   1 bookkeeper bookkeeper 1076873393 Aug  9 18:56 a1d.log
-rw-r--r--   1 bookkeeper bookkeeper    2805614 Aug  9 18:56 a1e.log
-rw-r--r--   1 bookkeeper bookkeeper 1077197736 Aug  9 20:52 a1f.log
-rw-r--r--   1 bookkeeper bookkeeper    3745490 Aug  9 20:52 a20.log
-rw-r--r--   1 bookkeeper bookkeeper 1077016211 Aug  9 22:37 a21.log
-rw-r--r--   1 bookkeeper bookkeeper    2805801 Aug  9 22:37 a22.log
-rw-r--r--   1 bookkeeper bookkeeper 1076963578 Aug 10 00:48 a23.log
-rw-r--r--   1 bookkeeper bookkeeper      20808 Aug 10 00:48 a24.log
-rw-r--r--   1 bookkeeper bookkeeper 1076117861 Aug 10 05:13 a25.log
-rw-r--r--   1 bookkeeper bookkeeper    3927427 Aug 10 05:13 a26.log
-rw-r--r--   1 bookkeeper bookkeeper    3366523 Aug 10 05:13 a27.log
-rw-r--r--   1 bookkeeper bookkeeper 1078148167 Aug 10 07:09 a28.log
-rw-r--r--   1 bookkeeper bookkeeper    2244700 Aug 10 07:09 a29.log
-rw-r--r--   1 bookkeeper bookkeeper    1683791 Aug 10 07:09 a2a.log
-rw-r--r--   1 bookkeeper bookkeeper 1078074018 Aug 10 08:56 a2b.log
-rw-r--r--   1 bookkeeper bookkeeper    2786678 Aug 10 08:56 a2c.log
-rw-r--r--   1 bookkeeper bookkeeper    4488336 Aug 10 08:56 a2d.log
-rw-r--r--   1 bookkeeper bookkeeper 1077910979 Aug 10 10:29 a2e.log
-rw-r--r--   1 bookkeeper bookkeeper    3366984 Aug 10 10:29 a2f.log
-rw-r--r--   1 bookkeeper bookkeeper 1077417237 Aug 10 11:46 a30.log
-rw-r--r--   1 bookkeeper bookkeeper     140865 Aug 10 11:46 a31.log
-rw-r--r--   1 bookkeeper bookkeeper 1076164274 Aug 10 11:53 a32.log
-rw-r--r--   1 bookkeeper bookkeeper     126078 Aug 10 11:53 a33.log
-rw-r--r--   1 bookkeeper bookkeeper   67152546 Aug 10 11:55 a34.log
-rw-r--r--   1 bookkeeper bookkeeper   67169645 Aug 10 11:55 a35.log
-rw-r--r--   1 bookkeeper bookkeeper     131243 Aug 10 11:55 a36.log
-rw-r--r--   1 bookkeeper bookkeeper  470977935 Aug 10 11:58 a37.log
-rw-r--r--   1 bookkeeper bookkeeper   67390108 Aug 10 11:58 a38.log
-rw-r--r--   1 bookkeeper bookkeeper     595215 Aug 10 11:58 a39.log
-rw-r--r--   1 bookkeeper bookkeeper  201898801 Aug 10 12:00 a3a.log
-rw-r--r--   1 bookkeeper bookkeeper   67170262 Aug 10 12:00 a3b.log
-rw-r--r--   1 bookkeeper bookkeeper     569154 Aug 10 12:00 a3c.log
-rw-r--r--   1 bookkeeper bookkeeper   67148421 Aug 10 12:01 a3d.log
-rw-r--r--   1 bookkeeper bookkeeper   67204049 Aug 10 12:01 a3e.log
-rw-r--r--   1 bookkeeper bookkeeper     137802 Aug 10 12:01 a3f.log
-rw-r--r--   1 bookkeeper bookkeeper   67159539 Aug 10 12:01 a41.log
-rw-r--r--   1 bookkeeper bookkeeper     144818 Aug 10 12:01 a42.log
-rw-r--r--   1 bookkeeper bookkeeper   67192516 Aug 10 12:02 a44.log
-rw-r--r--   1 bookkeeper bookkeeper    2814944 Aug 10 12:02 a45.log
-rw-r--r--   1 bookkeeper bookkeeper     969196 Aug 10 12:02 a46.log
-rw-r--r--   1 bookkeeper bookkeeper   67244555 Aug 10 12:02 a48.log
-rw-r--r--   1 bookkeeper bookkeeper     510567 Aug 10 12:02 a49.log
-rw-r--r--   1 bookkeeper bookkeeper   67148364 Aug 10 12:02 a4b.log
-rw-r--r--   1 bookkeeper bookkeeper     656496 Aug 10 12:02 a4c.log
-rw-r--r--   1 bookkeeper bookkeeper      78740 Aug 10 12:02 a4d.log
-rw-r--r--   1 bookkeeper bookkeeper   67155646 Aug 10 12:03 a4f.log
-rw-r--r--   1 bookkeeper bookkeeper      49913 Aug 10 12:03 a50.log
-rw-r--r--   1 bookkeeper bookkeeper   67268202 Aug 10 12:03 a52.log
-rw-r--r--   1 bookkeeper bookkeeper     126369 Aug 10 12:03 a53.log
-rw-r--r--   1 bookkeeper bookkeeper   67191172 Aug 10 12:04 a55.log
-rw-r--r--   1 bookkeeper bookkeeper     327133 Aug 10 12:04 a56.log
-rw-r--r--   1 bookkeeper bookkeeper   67430875 Aug 10 12:04 a58.log
-rw-r--r--   1 bookkeeper bookkeeper     467691 Aug 10 12:04 a59.log
-rw-r--r--   1 bookkeeper bookkeeper   67298712 Aug 10 12:05 a5b.log
-rw-r--r--   1 bookkeeper bookkeeper     579168 Aug 10 12:05 a5c.log
-rw-r--r--   1 bookkeeper bookkeeper   67126947 Aug 10 12:05 a5e.log
-rw-r--r--   1 bookkeeper bookkeeper      17522 Aug 10 12:05 a5f.log
-rw-r--r--   1 bookkeeper bookkeeper   67126854 Aug 10 12:06 a61.log
-rw-r--r--   1 bookkeeper bookkeeper     368798 Aug 10 12:06 a62.log
-rw-r--r--   1 bookkeeper bookkeeper   67191557 Aug 10 12:06 a64.log
-rw-r--r--   1 bookkeeper bookkeeper      72072 Aug 10 12:06 a65.log
-rw-r--r--   1 bookkeeper bookkeeper   67154841 Aug 10 12:07 a67.log
-rw-r--r--   1 bookkeeper bookkeeper     565994 Aug 10 12:07 a68.log
-rw-r--r--   1 bookkeeper bookkeeper       4803 Aug 10 12:07 a69.log
-rw-r--r--   1 bookkeeper bookkeeper   67378918 Aug 10 12:07 a6b.log
-rw-r--r--   1 bookkeeper bookkeeper     259434 Aug 10 12:07 a6c.log
-rw-r--r--   1 bookkeeper bookkeeper   67413608 Aug 10 12:08 a6e.log
-rw-r--r--   1 bookkeeper bookkeeper     132753 Aug 10 12:08 a6f.log
-rw-r--r--   1 bookkeeper bookkeeper   67231789 Aug 10 12:08 a71.log
-rw-r--r--   1 bookkeeper bookkeeper    2888232 Aug 10 12:08 a72.log
-rw-r--r--   1 bookkeeper bookkeeper   67404578 Aug 10 12:09 a74.log
-rw-r--r--   1 bookkeeper bookkeeper     173282 Aug 10 12:09 a75.log
-rw-r--r--   1 bookkeeper bookkeeper   67293639 Aug 10 12:09 a77.log
-rw-r--r--   1 bookkeeper bookkeeper     143145 Aug 10 12:09 a78.log
-rw-r--r--   1 bookkeeper bookkeeper   67275392 Aug 10 12:10 a7a.log
-rw-r--r--   1 bookkeeper bookkeeper     122339 Aug 10 12:10 a7b.log
-rw-r--r--   1 bookkeeper bookkeeper   67408460 Aug 10 12:11 a7d.log
-rw-r--r--   1 bookkeeper bookkeeper   67125928 Aug 10 12:15 a80.log
-rw-r--r--   1 bookkeeper bookkeeper    3366518 Aug 10 12:15 a81.log
-rw-r--r--   1 bookkeeper bookkeeper   67501321 Aug 10 12:20 a83.log
-rw-r--r--   1 bookkeeper bookkeeper    7293150 Aug 10 12:20 a84.log
-rw-r--r--   1 bookkeeper bookkeeper   67603547 Aug 10 12:27 a86.log
-rw-r--r--   1 bookkeeper bookkeeper    1961391 Aug 10 12:27 a87.log
-rw-r--r--   1 bookkeeper bookkeeper   67167086 Aug 10 12:34 a89.log
-rw-r--r--   1 bookkeeper bookkeeper     101821 Aug 10 12:34 a8a.log
-rw-r--r--   1 bookkeeper bookkeeper   67669892 Aug 10 12:46 a8c.log
-rw-r--r--   1 bookkeeper bookkeeper    6732100 Aug 10 12:46 a8d.log
-rw-r--r--   1 bookkeeper bookkeeper   67238223 Aug 10 12:52 a8f.log
-rw-r--r--   1 bookkeeper bookkeeper    7292894 Aug 10 12:52 a90.log
-rw-r--r--   1 bookkeeper bookkeeper    1122884 Aug 10 12:52 a91.log
-rw-r--r--   1 bookkeeper bookkeeper   67693707 Aug 10 12:58 a93.log
-rw-r--r--   1 bookkeeper bookkeeper    2009363 Aug 10 12:58 a94.log
-rw-r--r--   1 bookkeeper bookkeeper      13212 Aug 10 12:58 a95.log
-rw-r--r--   1 bookkeeper bookkeeper   67212849 Aug 10 13:11 a97.log
-rw-r--r--   1 bookkeeper bookkeeper    3290460 Aug 10 13:11 a98.log
-rw-r--r--   1 bookkeeper bookkeeper   67506933 Aug 10 13:17 a9a.log
-rw-r--r--   1 bookkeeper bookkeeper    6171063 Aug 10 13:17 a9b.log
-rw-r--r--   1 bookkeeper bookkeeper     561974 Aug 10 13:17 a9c.log
-rw-r--r--   1 bookkeeper bookkeeper   67326108 Aug 10 13:23 a9e.log
-rw-r--r--   1 bookkeeper bookkeeper    5049313 Aug 10 13:23 a9f.log
-rw-r--r--   1 bookkeeper bookkeeper   67188620 Aug 10 13:29 aa1.log
-rw-r--r--   1 bookkeeper bookkeeper    1874900 Aug 10 13:29 aa2.log
-rw-r--r--   1 bookkeeper bookkeeper   67398365 Aug 10 13:35 aa4.log
-rw-r--r--   1 bookkeeper bookkeeper    5610164 Aug 10 13:35 aa5.log
-rw-r--r--   1 bookkeeper bookkeeper   67415394 Aug 10 13:41 aa7.log
-rw-r--r--   1 bookkeeper bookkeeper    1582584 Aug 10 13:41 aa8.log
-rw-r--r--   1 bookkeeper bookkeeper   70974312 Aug 10 13:48 aaa.log
-rw-r--r--   1 bookkeeper bookkeeper   67172981 Aug 10 13:54 aad.log
-rw-r--r--   1 bookkeeper bookkeeper    1961266 Aug 10 13:54 aae.log
-rw-r--r--   1 bookkeeper bookkeeper   67227512 Aug 10 14:00 ab0.log
-rw-r--r--   1 bookkeeper bookkeeper    5610164 Aug 10 14:00 ab1.log
-rw-r--r--   1 bookkeeper bookkeeper   67704527 Aug 10 14:07 ab3.log
-rw-r--r--   1 bookkeeper bookkeeper    7292881 Aug 10 14:07 ab4.log
-rw-r--r--   1 bookkeeper bookkeeper   67498170 Aug 10 14:13 ab6.log
-rw-r--r--   1 bookkeeper bookkeeper    9354836 Aug 10 14:13 ab7.log
-rw-r--r--   1 bookkeeper bookkeeper   67644051 Aug 10 14:19 ab9.log
-rw-r--r--   1 bookkeeper bookkeeper    6731972 Aug 10 14:19 aba.log
-rw-r--r--   1 bookkeeper bookkeeper   67296551 Aug 10 14:25 abc.log
-rw-r--r--   1 bookkeeper bookkeeper    6171074 Aug 10 14:25 abd.log
-rw-r--r--   1 bookkeeper bookkeeper   67359048 Aug 10 14:31 abf.log
-rw-r--r--   1 bookkeeper bookkeeper    1540950 Aug 10 14:31 ac0.log
-rw-r--r--   1 bookkeeper bookkeeper   67485522 Aug 10 14:43 ac2.log
-rw-r--r--   1 bookkeeper bookkeeper    6990724 Aug 10 14:43 ac3.log
-rw-r--r--   1 bookkeeper bookkeeper   67172735 Aug 10 14:44 ac5.log
-rw-r--r--   1 bookkeeper bookkeeper     354698 Aug 10 14:44 ac6.log
-rw-r--r--   1 bookkeeper bookkeeper   67160596 Aug 10 14:50 ac8.log
-rw-r--r--   1 bookkeeper bookkeeper      43202 Aug 10 14:50 ac9.log
-rw-r--r--   1 bookkeeper bookkeeper       7326 Aug 10 14:50 aca.log
-rw-r--r--   1 bookkeeper bookkeeper       4053 Aug 10 14:50 acb.log
-rw-r--r--   1 bookkeeper bookkeeper   67133140 Aug 10 14:56 acd.log
-rw-r--r--   1 bookkeeper bookkeeper      19305 Aug 10 14:56 ace.log
-rw-r--r--   1 bookkeeper bookkeeper   67229656 Aug 10 15:02 ad0.log
-rw-r--r--   1 bookkeeper bookkeeper     825156 Aug 10 15:02 ad1.log
-rw-r--r--   1 bookkeeper bookkeeper   67524420 Aug 10 15:08 ad3.log
-rw-r--r--   1 bookkeeper bookkeeper    4679172 Aug 10 15:08 ad4.log
-rw-r--r--   1 bookkeeper bookkeeper      32781 Aug 10 15:08 ad5.log
-rw-r--r--   1 bookkeeper bookkeeper   67505427 Aug 10 15:15 ad7.log
-rw-r--r--   1 bookkeeper bookkeeper    5174048 Aug 10 15:15 ad8.log
-rw-r--r--   1 bookkeeper bookkeeper      67098 Aug 10 15:15 ad9.log
-rw-r--r--   1 bookkeeper bookkeeper   67167432 Aug 10 15:21 adb.log
-rw-r--r--   1 bookkeeper bookkeeper     356083 Aug 10 15:21 adc.log
-rw-r--r--   1 bookkeeper bookkeeper   67423350 Aug 10 15:27 ade.log
-rw-r--r--   1 bookkeeper bookkeeper    5240082 Aug 10 15:27 adf.log
-rw-r--r--   1 bookkeeper bookkeeper      32781 Aug 10 15:27 ae0.log
-rw-r--r--   1 bookkeeper bookkeeper   67641693 Aug 10 15:33 ae2.log
-rw-r--r--   1 bookkeeper bookkeeper    4703099 Aug 10 15:33 ae3.log
-rw-r--r--   1 bookkeeper bookkeeper   67186092 Aug 10 15:40 ae5.log
-rw-r--r--   1 bookkeeper bookkeeper     255314 Aug 10 15:40 ae6.log
-rw-r--r--   1 bookkeeper bookkeeper   67456702 Aug 10 15:49 ae8.log
-rw-r--r--   1 bookkeeper bookkeeper   67162245 Aug 10 15:52 aeb.log
-rw-r--r--   1 bookkeeper bookkeeper     255775 Aug 10 15:52 aec.log
-rw-r--r--   1 bookkeeper bookkeeper   67360617 Aug 10 16:03 aee.log
-rw-r--r--   1 bookkeeper bookkeeper    8793927 Aug 10 16:03 aef.log
-rw-r--r--   1 bookkeeper bookkeeper    1683791 Aug 10 16:03 af0.log
-rw-r--r--   1 bookkeeper bookkeeper   67368274 Aug 10 16:09 af2.log
-rw-r--r--   1 bookkeeper bookkeeper    7853796 Aug 10 16:09 af3.log
-rw-r--r--   1 bookkeeper bookkeeper   67212484 Aug 10 16:47 af5.log
-rw-r--r--   1 bookkeeper bookkeeper     180993 Aug 10 16:47 af6.log
-rw-r--r--   1 bookkeeper bookkeeper   67189055 Aug 10 17:23 af8.log
-rw-r--r--   1 bookkeeper bookkeeper      29908 Aug 10 17:23 af9.log
-rw-r--r--   1 bookkeeper bookkeeper 1077238492 Aug 10 21:05 afa.log
-rw-r--r--   1 bookkeeper bookkeeper    3366518 Aug 10 21:05 afb.log
-rw-r--r--   1 bookkeeper bookkeeper 1076286747 Aug 10 22:45 afc.log
-rw-r--r--   1 bookkeeper bookkeeper    2741680 Aug 10 22:45 afd.log
-rw-r--r--   1 bookkeeper bookkeeper    7292945 Aug 10 22:45 afe.log
-rw-r--r--   1 bookkeeper bookkeeper 1077719254 Aug 11 00:19 aff.log
-rw-r--r--   1 bookkeeper bookkeeper    2805614 Aug 11 00:19 b00.log
-rw-r--r--   1 bookkeeper bookkeeper 1076754375 Aug 11 01:54 b01.log
-rw-r--r--   1 bookkeeper bookkeeper      14200 Aug 11 01:54 b02.log
-rw-r--r--   1 bookkeeper bookkeeper  607005424 Aug 11 03:03 b03.log
-rw-r--r--   1 bookkeeper bookkeeper   67281658 Aug 11 03:03 b04.log
-rw-r--r--   1 bookkeeper bookkeeper    6171074 Aug 11 03:03 b05.log
-rw-r--r--   1 bookkeeper bookkeeper  269327259 Aug 11 03:41 b06.log
-rw-r--r--   1 bookkeeper bookkeeper   67137290 Aug 11 03:41 b07.log
-rw-r--r--   1 bookkeeper bookkeeper    6731984 Aug 11 03:41 b08.log
-rw-r--r--   1 bookkeeper bookkeeper    1122884 Aug 11 03:41 b09.log
-rw-r--r--   1 bookkeeper bookkeeper   67148768 Aug 11 03:54 b0a.log
-rw-r--r--   1 bookkeeper bookkeeper   67149605 Aug 11 03:54 b0b.log
-rw-r--r--   1 bookkeeper bookkeeper     230599 Aug 11 03:54 b0c.log
-rw-r--r--   1 bookkeeper bookkeeper   67391383 Aug 11 04:06 b0e.log
-rw-r--r--   1 bookkeeper bookkeeper    6990596 Aug 11 04:06 b0f.log
-rw-r--r--   1 bookkeeper bookkeeper    1122946 Aug 11 04:06 b10.log
-rw-r--r--   1 bookkeeper bookkeeper   67613257 Aug 11 04:12 b12.log
-rw-r--r--   1 bookkeeper bookkeeper    5610154 Aug 11 04:12 b13.log
-rw-r--r--   1 bookkeeper bookkeeper   67419865 Aug 11 04:19 b15.log
-rw-r--r--   1 bookkeeper bookkeeper    6171074 Aug 11 04:19 b16.log
-rw-r--r--   1 bookkeeper bookkeeper   67235294 Aug 11 04:44 b18.log
-rw-r--r--   1 bookkeeper bookkeeper      33919 Aug 11 04:44 b19.log
-rw-r--r--   1 bookkeeper bookkeeper   67220798 Aug 11 05:03 b1b.log
-rw-r--r--   1 bookkeeper bookkeeper      34576 Aug 11 05:03 b1c.log
-rw-r--r--   1 bookkeeper bookkeeper   67222297 Aug 11 05:22 b1e.log
-rw-r--r--   1 bookkeeper bookkeeper     417023 Aug 11 05:22 b1f.log
-rw-r--r--   1 bookkeeper bookkeeper   67277897 Aug 11 05:48 b21.log
-rw-r--r--   1 bookkeeper bookkeeper      33900 Aug 11 05:48 b22.log
-rw-r--r--   1 bookkeeper bookkeeper   67267664 Aug 11 06:18 b24.log
-rw-r--r--   1 bookkeeper bookkeeper     254745 Aug 11 06:18 b25.log
-rw-r--r--   1 bookkeeper bookkeeper   67244061 Aug 11 06:37 b27.log
-rw-r--r--   1 bookkeeper bookkeeper     383492 Aug 11 06:37 b28.log
-rw-r--r--   1 bookkeeper bookkeeper   67246389 Aug 11 06:50 b2a.log
-rw-r--r--   1 bookkeeper bookkeeper     427674 Aug 11 06:50 b2b.log
-rw-r--r--   1 bookkeeper bookkeeper   67230177 Aug 11 07:09 b2d.log
-rw-r--r--   1 bookkeeper bookkeeper     345539 Aug 11 07:09 b2e.log
-rw-r--r--   1 bookkeeper bookkeeper   67281294 Aug 11 07:45 b30.log
-rw-r--r--   1 bookkeeper bookkeeper     279999 Aug 11 07:45 b31.log
-rw-r--r--   1 bookkeeper bookkeeper   67250545 Aug 11 08:14 b33.log
-rw-r--r--   1 bookkeeper bookkeeper     192450 Aug 11 08:14 b35.log
-rw-r--r--   1 bookkeeper bookkeeper   67148395 Aug 11 08:24 b37.log
-rw-r--r--   1 bookkeeper bookkeeper     198840 Aug 11 08:24 b38.log
-rw-r--r--   1 bookkeeper bookkeeper   67350868 Aug 11 08:35 b3a.log
-rw-r--r--   1 bookkeeper bookkeeper    8112414 Aug 11 08:35 b3b.log
-rw-r--r--   1 bookkeeper bookkeeper   67184481 Aug 11 08:39 b3d.log
-rw-r--r--   1 bookkeeper bookkeeper       4105 Aug 11 08:39 b3e.log
-rw-r--r--   1 bookkeeper bookkeeper   67189151 Aug 11 08:42 b40.log
-rw-r--r--   1 bookkeeper bookkeeper     406682 Aug 11 08:42 b41.log
-rw-r--r--   1 bookkeeper bookkeeper   67395883 Aug 11 08:47 b43.log
-rw-r--r--   1 bookkeeper bookkeeper    1044691 Aug 11 08:47 b44.log
-rw-r--r--   1 bookkeeper bookkeeper   62264695 Aug 11 08:54 b46.log
-rw-r--r--   1 bookkeeper bookkeeper    5081352 Aug 11 08:54 b47.log
-rw-r--r--   1 bookkeeper bookkeeper    7853790 Aug 11 08:54 b48.log
-rw-r--r--   1 bookkeeper bookkeeper    1683793 Aug 11 08:54 b49.log
-rw-r--r--   1 bookkeeper bookkeeper   67244835 Aug 11 09:00 b4b.log
-rw-r--r--   1 bookkeeper bookkeeper    9454075 Aug 11 09:00 b4c.log
-rw-r--r--   1 bookkeeper bookkeeper    1683791 Aug 11 09:00 b4d.log
-rw-r--r--   1 bookkeeper bookkeeper   67192412 Aug 11 09:01 b4f.log
-rw-r--r--   1 bookkeeper bookkeeper     357689 Aug 11 09:01 b50.log
-rw-r--r--   1 bookkeeper bookkeeper      76043 Aug 11 09:01 b51.log
-rw-r--r--   1 bookkeeper bookkeeper   67278639 Aug 11 09:13 b53.log
-rw-r--r--   1 bookkeeper bookkeeper    7292881 Aug 11 09:13 b54.log
-rw-r--r--   1 bookkeeper bookkeeper   67297217 Aug 11 09:19 b56.log
-rw-r--r--   1 bookkeeper bookkeeper    7853800 Aug 11 09:19 b57.log
-rw-r--r--   1 bookkeeper bookkeeper    1683794 Aug 11 09:19 b58.log
-rw-r--r--   1 bookkeeper bookkeeper     561974 Aug 11 09:19 b59.log
-rw-r--r--   1 bookkeeper bookkeeper   67248884 Aug 11 09:23 b5b.log
-rw-r--r--   1 bookkeeper bookkeeper      88111 Aug 11 09:23 b5c.log
-rw-r--r--   1 bookkeeper bookkeeper   67179649 Aug 11 09:25 b5e.log
-rw-r--r--   1 bookkeeper bookkeeper     432500 Aug 11 09:25 b5f.log
-rw-r--r--   1 bookkeeper bookkeeper   67121431 Aug 11 09:31 b61.log
-rw-r--r--   1 bookkeeper bookkeeper      33467 Aug 11 09:31 b62.log
-rw-r--r--   1 bookkeeper bookkeeper       5445 Aug 11 09:31 b63.log
-rw-r--r--   1 bookkeeper bookkeeper   67273050 Aug 11 09:37 b65.log
-rw-r--r--   1 bookkeeper bookkeeper    9536661 Aug 11 09:37 b66.log
-rw-r--r--   1 bookkeeper bookkeeper    1683794 Aug 11 09:37 b67.log
-rw-r--r--   1 bookkeeper bookkeeper   67152497 Aug 11 09:43 b69.log
-rw-r--r--   1 bookkeeper bookkeeper      28028 Aug 11 09:43 b6a.log
-rw-r--r--   1 bookkeeper bookkeeper   67531343 Aug 11 09:50 b6c.log
-rw-r--r--   1 bookkeeper bookkeeper    6171074 Aug 11 09:50 b6d.log
-rw-r--r--   1 bookkeeper bookkeeper   67195758 Aug 11 09:57 b6f.log
-rw-r--r--   1 bookkeeper bookkeeper    6950293 Aug 11 09:57 b70.log
-rw-r--r--   1 bookkeeper bookkeeper   67166446 Aug 11 10:03 b72.log
-rw-r--r--   1 bookkeeper bookkeeper     331784 Aug 11 10:03 b73.log
-rw-r--r--   1 bookkeeper bookkeeper      25848 Aug 11 10:03 b74.log
-rw-r--r--   1 bookkeeper bookkeeper   67446956 Aug 11 10:09 b76.log
-rw-r--r--   1 bookkeeper bookkeeper    9536517 Aug 11 10:09 b77.log
-rw-r--r--   1 bookkeeper bookkeeper    1122882 Aug 11 10:09 b78.log
-rw-r--r--   1 bookkeeper bookkeeper   26440538 Aug 11 10:13 b7a.log
-rw-r--r--   1 bookkeeper bookkeeper      86612 Aug 11 10:16 b7b.log
-rw-r--r--   1 bookkeeper bookkeeper   67153296 Aug 11 10:16 b7c.log
-rw-r--r--   1 bookkeeper bookkeeper     254048 Aug 11 10:16 b7d.log
-rw-r--r--   1 bookkeeper bookkeeper      26604 Aug 11 10:16 b7e.log
-rw-r--r--   1 bookkeeper bookkeeper   67159762 Aug 11 10:22 b80.log
-rw-r--r--   1 bookkeeper bookkeeper     202233 Aug 11 10:22 b81.log
-rw-r--r--   1 bookkeeper bookkeeper   67148425 Aug 11 10:28 b83.log
-rw-r--r--   1 bookkeeper bookkeeper      50046 Aug 11 10:28 b84.log
-rw-r--r--   1 bookkeeper bookkeeper   67660995 Aug 11 10:34 b86.log
-rw-r--r--   1 bookkeeper bookkeeper    4118262 Aug 11 10:34 b87.log
-rw-r--r--   1 bookkeeper bookkeeper   67295467 Aug 11 10:41 b89.log
-rw-r--r--   1 bookkeeper bookkeeper    8615035 Aug 11 10:41 b8a.log
-rw-r--r--   1 bookkeeper bookkeeper      60063 Aug 11 10:41 b8b.log
-rw-r--r--   1 bookkeeper bookkeeper      18688 Aug 11 10:41 b8c.log
-rw-r--r--   1 bookkeeper bookkeeper   67369524 Aug 11 10:47 b8e.log
-rw-r--r--   1 bookkeeper bookkeeper    6926366 Aug 11 10:47 b8f.log
-rw-r--r--   1 bookkeeper bookkeeper      27230 Aug 11 10:47 b90.log
-rw-r--r--   1 bookkeeper bookkeeper   67568664 Aug 11 10:54 b92.log
-rw-r--r--   1 bookkeeper bookkeeper    9536534 Aug 11 10:54 b93.log
-rw-r--r--   1 bookkeeper bookkeeper   67330475 Aug 11 11:00 b95.log
-rw-r--r--   1 bookkeeper bookkeeper    7853793 Aug 11 11:00 b96.log
-rw-r--r--   1 bookkeeper bookkeeper   67475153 Aug 11 11:04 b98.log
-rw-r--r--   1 bookkeeper bookkeeper     787250 Aug 11 11:04 b99.log
-rw-r--r--   1 bookkeeper bookkeeper   67554332 Aug 11 11:07 b9b.log
-rw-r--r--   1 bookkeeper bookkeeper    3093552 Aug 11 11:07 b9c.log
-rw-r--r--   1 bookkeeper bookkeeper      46149 Aug 11 11:07 b9d.log
-rw-r--r--   1 bookkeeper bookkeeper   67376914 Aug 11 11:19 b9f.log
-rw-r--r--   1 bookkeeper bookkeeper    8350898 Aug 11 11:19 ba0.log
-rw-r--r--   1 bookkeeper bookkeeper   67672165 Aug 11 11:24 ba2.log
-rw-r--r--   1 bookkeeper bookkeeper    3927427 Aug 11 11:24 ba3.log
-rw-r--r--   1 bookkeeper bookkeeper 1076494134 Aug 11 13:06 ba4.log
-rw-r--r--   1 bookkeeper bookkeeper    3366518 Aug 11 13:06 ba5.log
-rw-r--r--   1 bookkeeper bookkeeper 1076889511 Aug 11 15:00 ba6.log
-rw-r--r--   1 bookkeeper bookkeeper          0 Aug 11 15:00 ba9.log
-rw-r--r--   1 bookkeeper bookkeeper    2805609 Aug 11 15:00 ba7.log
-rw-r--r--   1 bookkeeper bookkeeper  269025280 Aug 11 15:25 ba8.log

For some reason the bookkeeper garbage collector doesn't clear the old logs, we have logs over 1GB which are older than 10 days.
We have issues with the disk space because of this.

The lastId file right now has:

[root@sveverdpulsar02 current]# cat lastId
ba9

Which would mean everything above this file should be cleared.

We also noticed that the bookkeeper process doesn't let go of those files (probably this is the reason why they don't get clear), but we're not sure why.

For example, a log file from 2'nd of August:

[root@sveverdpulsar02 current]# lsof 848.log
COMMAND     PID       USER   FD   TYPE DEVICE   SIZE/OFF   NODE NAME
java    3816608 bookkeeper  448r   REG  253,6 1076737783 958882 848.log

Do you have any idea what could cause this?

Thank you
@zwOvO
Copy link
Contributor

zwOvO commented Jan 18, 2024

Can you tell me what version of Bookkeeper you are using?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@zwOvO @stanbog