Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Starting takes a long time with InfluxDB API unavailable messages after 2.7.6 to 2.7.7 upgrade #25159

Open
glsf91 opened this issue Jul 14, 2024 · 4 comments
Open

Starting takes a long time with InfluxDB API unavailable messages after 2.7.6 to 2.7.7 upgrade #25159

glsf91 opened this issue Jul 14, 2024 · 4 comments
Assignees
@davidby-influx

Comments

@glsf91
Copy link

glsf91 commented Jul 14, 2024

I'm using Ubuntu 20.04.2 LTS with influxdb 2.7.6-1 and after an upgrade starting influxdb takes a long time with a lot of "InfluxDB API at http://localhost:8086/ready unavailable after xx attempts" messages
This also happens when I start influxdb with all buckets removed.
If I downgrade to 2.7.6-1 I don't have any problems anymore.

Steps to reproduce:
List the minimal actions needed to reproduce the behaviour.

  1. sudo service influxdb stop
  2. sudo apt-get install influxdb2
  3. sudo service influxdb start

Expected behaviour:
Starting command (3) will return in a few seconds.

Actual behaviour:
It takes a long time (2-5 minutes) before the starting command returns. In de mean time I see a lot "InfluxDB API at http://localhost:8086/ready unavailable after xx attempts" messages. In the end it will start.
My VM has 2 GB mem. Then it will take about 500 attempts. When increasing to 3 GB, it will take about 150 attempts. Influxdb takes a lot of memory and CPU during startup.

Environment info:
root@ubuntu1-Copy2:~# uname -srm
Linux 5.4.0-74-generic x86_64
Using a VM on ESXi with 2 CPU and 3 GB memory.

Config:
root@ubuntu1-Copy2:~# cat /var/lib/influxdb/.influxdbv2/config.toml
bolt-path = "/var/lib/influxdb/.influxdbv2/influxd.bolt"
engine-path = "/var/lib/influxdb/.influxdbv2/engine"
http-bind-address = ":8086"
storage-series-id-set-cache-size = 100
session-renew-disabled = true
session-length = 1440 # session renewal after 1 day

Logs:
Logging with debug level and with all buckets removed.

Jul 14 16:51:02 ubuntu1-Copy2 systemd[1]: Starting InfluxDB is an open-source, distributed, time series database...
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: time="2024-07-14T16:51:02+02:00" level=warning msg="DBUS_SESSION_BUS_ADDRESS envvar looks to be not set, this can lead to runaway dbus-daemon processes. To avoid this, set envvar DBUS_SESSION_BUS_ADDRESS=$XDG_RUNTIME_DIR/bus (if it exists) or DBUS_SESSION_BUS_ADDRESS=/dev/null." func="gosnowflake.(*defaultLogger).Warn" file="log.go:228"
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11660]: time="2024-07-14T16:51:02+02:00" level=warning msg="DBUS_SESSION_BUS_ADDRESS envvar looks to be not set, this can lead to runaway dbus-daemon processes. To avoid this, set envvar DBUS_SESSION_BUS_ADDRESS=$XDG_RUNTIME_DIR/bus (if it exists) or DBUS_SESSION_BUS_ADDRESS=/dev/null." func="gosnowflake.(*defaultLogger).Warn" file="log.go:228"
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11660]: Command "print-config" is deprecated, use the influx-cli command server-config to display the configuration values from the running server
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.172234Z lvl=info msg="Welcome to InfluxDB" log_id=0qORSlc0000 version=v2.7.7 commit=e9e0f744fa build_date=2024-07-11T18:45:02Z log_level=debug
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.172598Z lvl=debug msg="loaded config file" log_id=0qORSlc0000 path=/var/lib/influxdb/.influxdbv2/config.toml
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.173544Z lvl=info msg="Resources opened" log_id=0qORSlc0000 service=bolt path=/var/lib/influxdb/.influxdbv2/influxd.bolt
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.173903Z lvl=info msg="Resources opened" log_id=0qORSlc0000 service=sqlite path=/var/lib/influxdb/.influxdbv2/influxd.sqlite
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.177508Z lvl=debug msg="buckets find" log_id=0qORSlc0000 store=new took=0.205ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11691]: time="2024-07-14T16:51:02+02:00" level=warning msg="DBUS_SESSION_BUS_ADDRESS envvar looks to be not set, this can lead to runaway dbus-daemon processes. To avoid this, set envvar DBUS_SESSION_BUS_ADDRESS=$XDG_RUNTIME_DIR/bus (if it exists) or DBUS_SESSION_BUS_ADDRESS=/dev/null." func="gosnowflake.(*defaultLogger).Warn" file="log.go:228"
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.182174Z lvl=info msg="Checking InfluxDB metadata for prior version." log_id=0qORSlc0000 bolt_path=/var/lib/influxdb/.influxdbv2/influxd.bolt
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.182656Z lvl=info msg="Using data dir" log_id=0qORSlc0000 service=storage-engine service=store path=/var/lib/influxdb/.influxdbv2/engine/data
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.182917Z lvl=info msg="Compaction settings" log_id=0qORSlc0000 service=storage-engine service=store max_concurrent_compactions=1 throughput_bytes_per_second=50331648 throughput_bytes_per_second_burst=50331648
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.183139Z lvl=info msg="Open store (start)" log_id=0qORSlc0000 service=storage-engine service=store op_name=tsdb_open op_event=start
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11691]: Command "print-config" is deprecated, use the influx-cli command server-config to display the configuration values from the running server
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.208286Z lvl=info msg="index opened with 8 partitions" log_id=0qORSlc0000 service=storage-engine index=tsi
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.209939Z lvl=info msg="index opened with 8 partitions" log_id=0qORSlc0000 service=storage-engine index=tsi
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.210762Z lvl=info msg="loading changes (start)" log_id=0qORSlc0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.211086Z lvl=info msg="loading changes (end)" log_id=0qORSlc0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.323ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.211619Z lvl=info msg="Opened file" log_id=0qORSlc0000 service=storage-engine engine=tsm1 service=filestore path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4193/000000002-000000002.tsm id=0 duration=0.149ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.212011Z lvl=info msg="Opened shard" log_id=0qORSlc0000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4193 duration=25.833ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.218218Z lvl=info msg="loading changes (start)" log_id=0qORSlc0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.218280Z lvl=info msg="loading changes (end)" log_id=0qORSlc0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.082ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.219085Z lvl=info msg="Opened file" log_id=0qORSlc0000 service=storage-engine engine=tsm1 service=filestore path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4196/000000001-000000001.tsm id=0 duration=0.179ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.219305Z lvl=info msg="Reading file" log_id=0qORSlc0000 service=storage-engine engine=tsm1 service=cacheloader path=/var/lib/influxdb/.influxdbv2/engine/wal/c199f5ccd68d3769/autogen/4196/_00002.wal size=1979362
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.219346Z lvl=info msg="index opened with 8 partitions" log_id=0qORSlc0000 service=storage-engine index=tsi
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.220108Z lvl=info msg="loading changes (start)" log_id=0qORSlc0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.220331Z lvl=info msg="loading changes (end)" log_id=0qORSlc0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.225ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.220846Z lvl=info msg="Opened file" log_id=0qORSlc0000 service=storage-engine engine=tsm1 service=filestore path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4195/000000007-000000002.tsm id=0 duration=0.134ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.221125Z lvl=info msg="Opened shard" log_id=0qORSlc0000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4195 duration=8.859ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.228982Z lvl=info msg="index opened with 8 partitions" log_id=0qORSlc0000 service=storage-engine index=tsi
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.229667Z lvl=info msg="loading changes (start)" log_id=0qORSlc0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.230047Z lvl=info msg="loading changes (end)" log_id=0qORSlc0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.365ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.233302Z lvl=info msg="Opened file" log_id=0qORSlc0000 service=storage-engine engine=tsm1 service=filestore path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4194/000000002-000000002.tsm id=0 duration=0.087ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.233730Z lvl=info msg="Opened shard" log_id=0qORSlc0000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4194 duration=12.408ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11701]: time="2024-07-14T16:51:02+02:00" level=warning msg="DBUS_SESSION_BUS_ADDRESS envvar looks to be not set, this can lead to runaway dbus-daemon processes. To avoid this, set envvar DBUS_SESSION_BUS_ADDRESS=$XDG_RUNTIME_DIR/bus (if it exists) or DBUS_SESSION_BUS_ADDRESS=/dev/null." func="gosnowflake.(*defaultLogger).Warn" file="log.go:228"
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11701]: Command "print-config" is deprecated, use the influx-cli command server-config to display the configuration values from the running server
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.282854Z lvl=info msg="Opened shard" log_id=0qORSlc0000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4196 duration=98.187ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.283498Z lvl=info msg="Open store (end)" log_id=0qORSlc0000 service=storage-engine service=store op_name=tsdb_open op_event=end op_elapsed=100.356ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.283846Z lvl=info msg="Starting retention policy enforcement service" log_id=0qORSlc0000 service=retention check_interval=30m
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.284066Z lvl=info msg="Starting precreation service" log_id=0qORSlc0000 service=shard-precreation check_interval=10m advance_period=30m
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.285377Z lvl=info msg="Starting query controller" log_id=0qORSlc0000 service=storage-reads concurrency_quota=1024 initial_memory_bytes_quota_per_query=9223372036854775807 memory_bytes_quota_per_query=9223372036854775807 max_memory_bytes=0 queue_size=1024
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:02.289687Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.079ms
Jul 14 16:51:02 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 1 attempts...
Jul 14 16:51:03 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 2 attempts...
Jul 14 16:51:04 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 3 attempts...
Jul 14 16:51:05 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 4 attempts...
Jul 14 16:51:06 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:06.034196Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.046ms
Jul 14 16:51:06 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 5 attempts...
Jul 14 16:51:07 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 6 attempts...
Jul 14 16:51:08 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 7 attempts...
Jul 14 16:51:09 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 8 attempts...
Jul 14 16:51:09 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:09.893198Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.038ms
Jul 14 16:51:10 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 9 attempts...
Jul 14 16:51:11 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 10 attempts...
Jul 14 16:51:12 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 11 attempts...
Jul 14 16:51:13 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 12 attempts...
Jul 14 16:51:13 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:13.597506Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.030ms
Jul 14 16:51:14 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 13 attempts...
Jul 14 16:51:15 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 14 attempts...
Jul 14 16:51:16 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 15 attempts...
Jul 14 16:51:17 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:17.285693Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.041ms
Jul 14 16:51:17 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 16 attempts...
Jul 14 16:51:18 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 17 attempts...
Jul 14 16:51:19 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 18 attempts...
Jul 14 16:51:20 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 19 attempts...
Jul 14 16:51:20 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:20.935002Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.029ms
Jul 14 16:51:21 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 20 attempts...
Jul 14 16:51:22 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 21 attempts...
Jul 14 16:51:23 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 22 attempts...
Jul 14 16:51:24 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:24.495857Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.041ms
Jul 14 16:51:24 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 23 attempts...
Jul 14 16:51:25 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 24 attempts...
Jul 14 16:51:26 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 25 attempts...
Jul 14 16:51:27 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 26 attempts...
Jul 14 16:51:28 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:28.109382Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.066ms
Jul 14 16:51:28 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 27 attempts...
Jul 14 16:51:30 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 28 attempts...
Jul 14 16:51:31 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 29 attempts...
Jul 14 16:51:31 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:51:31.560661Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.051ms
Jul 14 16:51:32 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 30 attempts...
Jul 14 16:51:33 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 31 attempts...
Jul 14 16:51:34 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 32 attempts...
Jul 14 16:51:35 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 33 attempts...
Jul 14 16:51:36 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 34 attempts...
Jul 14 16:51:37 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 35 attempts...
Jul 14 16:51:38 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 36 attempts...
Jul 14 16:51:39 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 37 attempts...
Jul 14 16:51:40 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 38 attempts...
Jul 14 16:51:41 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 39 attempts...
Jul 14 16:51:42 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 40 attempts...
Jul 14 16:51:43 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 41 attempts...
Jul 14 16:51:44 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 42 attempts...
Jul 14 16:51:45 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 43 attempts...
Jul 14 16:51:46 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 44 attempts...
Jul 14 16:51:47 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 45 attempts...
Jul 14 16:51:48 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 46 attempts...
Jul 14 16:51:49 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 47 attempts...
Jul 14 16:51:50 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 48 attempts...
Jul 14 16:51:51 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 49 attempts...
Jul 14 16:51:52 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 50 attempts...
Jul 14 16:51:53 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 51 attempts...
Jul 14 16:51:54 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 52 attempts...
Jul 14 16:51:55 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 53 attempts...
Jul 14 16:51:56 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 54 attempts...
Jul 14 16:51:57 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 55 attempts...
Jul 14 16:51:58 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 56 attempts...
Jul 14 16:51:59 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 57 attempts...
Jul 14 16:52:00 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 58 attempts...
Jul 14 16:52:01 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 59 attempts...
Jul 14 16:52:02 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 60 attempts...
Jul 14 16:52:03 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 61 attempts...
Jul 14 16:52:04 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 62 attempts...
Jul 14 16:52:05 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 63 attempts...
Jul 14 16:52:06 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 64 attempts...
Jul 14 16:52:07 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 65 attempts...
Jul 14 16:52:09 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 66 attempts...
Jul 14 16:52:10 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 67 attempts...
Jul 14 16:52:11 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 68 attempts...
Jul 14 16:52:12 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 69 attempts...
Jul 14 16:52:13 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 70 attempts...
Jul 14 16:52:14 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 71 attempts...
Jul 14 16:52:15 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 72 attempts...
Jul 14 16:52:16 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 73 attempts...
Jul 14 16:52:17 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 74 attempts...
Jul 14 16:52:18 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 75 attempts...
Jul 14 16:52:19 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 76 attempts...
Jul 14 16:52:20 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 77 attempts...
Jul 14 16:52:21 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 78 attempts...
Jul 14 16:52:22 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 79 attempts...
Jul 14 16:52:23 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 80 attempts...
Jul 14 16:52:24 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 81 attempts...
Jul 14 16:52:25 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 82 attempts...
Jul 14 16:52:26 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 83 attempts...
Jul 14 16:52:27 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 84 attempts...
Jul 14 16:52:28 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 85 attempts...
Jul 14 16:52:28 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:52:28.743673Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.053ms
Jul 14 16:52:29 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 86 attempts...
Jul 14 16:52:30 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 87 attempts...
Jul 14 16:52:31 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 88 attempts...
Jul 14 16:52:32 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 89 attempts...
Jul 14 16:52:33 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 90 attempts...
Jul 14 16:52:34 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 91 attempts...
Jul 14 16:52:35 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 92 attempts...
Jul 14 16:52:36 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 93 attempts...
Jul 14 16:52:37 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 94 attempts...
Jul 14 16:52:38 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 95 attempts...
Jul 14 16:52:39 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 96 attempts...
Jul 14 16:52:40 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 97 attempts...
Jul 14 16:52:41 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 98 attempts...
Jul 14 16:52:42 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 99 attempts...
Jul 14 16:52:43 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 100 attempts...
Jul 14 16:52:44 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 101 attempts...
Jul 14 16:52:46 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 102 attempts...
Jul 14 16:52:47 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 103 attempts...
Jul 14 16:52:48 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 104 attempts...
Jul 14 16:52:49 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 105 attempts...
Jul 14 16:52:50 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 106 attempts...
Jul 14 16:52:51 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 107 attempts...
Jul 14 16:52:52 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 108 attempts...
Jul 14 16:52:53 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 109 attempts...
Jul 14 16:52:54 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 110 attempts...
Jul 14 16:52:55 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 111 attempts...
Jul 14 16:52:56 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 112 attempts...
Jul 14 16:52:57 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 113 attempts...
Jul 14 16:52:58 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 114 attempts...
Jul 14 16:52:59 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 115 attempts...
Jul 14 16:53:00 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 116 attempts...
Jul 14 16:53:01 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 117 attempts...
Jul 14 16:53:02 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 118 attempts...
Jul 14 16:53:03 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 119 attempts...
Jul 14 16:53:04 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 120 attempts...
Jul 14 16:53:05 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 121 attempts...
Jul 14 16:53:06 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 122 attempts...
Jul 14 16:53:07 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 123 attempts...
Jul 14 16:53:08 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 124 attempts...
Jul 14 16:53:09 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 125 attempts...
Jul 14 16:53:10 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 126 attempts...
Jul 14 16:53:11 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 127 attempts...
Jul 14 16:53:12 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 128 attempts...
Jul 14 16:53:13 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 129 attempts...
Jul 14 16:53:14 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 130 attempts...
Jul 14 16:53:15 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 131 attempts...
Jul 14 16:53:16 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 132 attempts...
Jul 14 16:53:17 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 133 attempts...
Jul 14 16:53:18 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 134 attempts...
Jul 14 16:53:19 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 135 attempts...
Jul 14 16:53:20 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 136 attempts...
Jul 14 16:53:21 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 137 attempts...
Jul 14 16:53:23 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 138 attempts...
Jul 14 16:53:24 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 139 attempts...
Jul 14 16:53:25 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 140 attempts...
Jul 14 16:53:25 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:53:25.243544Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.043ms
Jul 14 16:53:26 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 141 attempts...
Jul 14 16:53:27 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 142 attempts...
Jul 14 16:53:28 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 143 attempts...
Jul 14 16:53:29 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:53:29.080138Z lvl=debug msg="bucket find by name" log_id=0qORSlc0000 store=new took=0.045ms
Jul 14 16:53:29 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 144 attempts...
Jul 14 16:53:30 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 145 attempts...
Jul 14 16:53:31 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 146 attempts...
Jul 14 16:53:32 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB API at http://localhost:8086/ready unavailable after 147 attempts...
Jul 14 16:53:32 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:53:32.901183Z lvl=info msg="Configuring InfluxQL statement executor (zeros indicate unlimited)." log_id=0qORSlc0000 max_select_point=0 max_select_series=0 max_select_buckets=0
Jul 14 16:53:32 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:53:32.906586Z lvl=info msg=Starting log_id=0qORSlc0000 service=telemetry interval=8h
Jul 14 16:53:32 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:53:32.908516Z lvl=info msg=Listening log_id=0qORSlc0000 service=tcp-listener transport=http addr=:8086 port=8086
Jul 14 16:53:33 ubuntu1-Copy2 influxd-systemd-start.sh[11659]: ts=2024-07-14T14:53:33.283684Z lvl=debug msg=Request log_id=0qORSlc0000 service=http method=GET host=localhost:8086 path=/ready query= proto=HTTP/1.1 status_code=200 response_size=105 content_length=0 referrer= remote=[::1]:42620 user_agent=curl authenticated_id= user_id= took=0.208ms body=
Jul 14 16:53:33 ubuntu1-Copy2 influxd-systemd-start.sh[11658]: InfluxDB started
@davidby-influx
Copy link
Contributor

There weren't any changes between 2.7.6 and 2.7.7 that obviously affect start-up time (of course, with things like a Go version upgrade, all sorts of components may be different in ways that are outside of our control).

I don't see any errors in your startup log, so no indication that anything is wrong. Could you attach a log from a 2.7.6 boot sequence for comparison?

@davidby-influx davidby-influx self-assigned this Jul 18, 2024
@glsf91
Copy link
Author

glsf91 commented Jul 19, 2024

Of course. This is de fast startup with 2.7.6

Jul 19 10:55:42 ubuntu1-Copy2 systemd[1]: Starting InfluxDB is an open-source, distributed, time series database...
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1811]: Command "print-config" is deprecated, use the influx-cli command server-config to display the configuration values from the running server
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.101055Z lvl=info msg="Welcome to InfluxDB" log_id=0qUZ6j~0000 version=v2.7.6 commit=3c58c06206 build_date=2024-04-12T21:51:21Z log_level=info
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.101594Z lvl=info msg="Resources opened" log_id=0qUZ6j~0000 service=bolt path=/var/lib/influxdb/.influxdbv2/influxd.bolt
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.101680Z lvl=info msg="Resources opened" log_id=0qUZ6j~0000 service=sqlite path=/var/lib/influxdb/.influxdbv2/influxd.sqlite
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.103671Z lvl=info msg="Checking InfluxDB metadata for prior version." log_id=0qUZ6j~0000 bolt_path=/var/lib/influxdb/.influxdbv2/influxd.bolt
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.103760Z lvl=info msg="Using data dir" log_id=0qUZ6j~0000 service=storage-engine service=store path=/var/lib/influxdb/.influxdbv2/engine/data
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.103803Z lvl=info msg="Compaction settings" log_id=0qUZ6j~0000 service=storage-engine service=store max_concurrent_compactions=1 throughput_bytes_per_second=50331648 throughput_bytes_per_second_burst=50331648
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.103810Z lvl=info msg="Open store (start)" log_id=0qUZ6j~0000 service=storage-engine service=store op_name=tsdb_open op_event=start
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.118315Z lvl=info msg="index opened with 8 partitions" log_id=0qUZ6j~0000 service=storage-engine index=tsi
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.118787Z lvl=info msg="loading changes (start)" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.118811Z lvl=info msg="loading changes (end)" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.032ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.118934Z lvl=info msg="Reading file" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 service=cacheloader path=/var/lib/influxdb/.influxdbv2/engine/wal/c199f5ccd68d3769/autogen/8268/_00001.wal size=45348
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.119977Z lvl=info msg="Opened shard" log_id=0qUZ6j~0000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/8268 duration=14.984ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1843]: Command "print-config" is deprecated, use the influx-cli command server-config to display the configuration values from the running server
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.125725Z lvl=info msg="index opened with 8 partitions" log_id=0qUZ6j~0000 service=storage-engine index=tsi
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.125994Z lvl=info msg="loading changes (start)" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.126017Z lvl=info msg="loading changes (end)" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.024ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.126175Z lvl=info msg="Opened file" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 service=filestore path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4194/000000002-000000002.tsm id=0 duration=0.061ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.126222Z lvl=info msg="Opened shard" log_id=0qUZ6j~0000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4194 duration=6.212ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.132704Z lvl=info msg="index opened with 8 partitions" log_id=0qUZ6j~0000 service=storage-engine index=tsi
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.133443Z lvl=info msg="loading changes (start)" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.133469Z lvl=info msg="loading changes (end)" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.037ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.134794Z lvl=info msg="Opened file" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 service=filestore path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4193/000000002-000000002.tsm id=0 duration=0.422ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.134870Z lvl=info msg="Opened shard" log_id=0qUZ6j~0000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4193 duration=29.029ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.135551Z lvl=info msg="index opened with 8 partitions" log_id=0qUZ6j~0000 service=storage-engine index=tsi
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.136367Z lvl=info msg="loading changes (start)" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.136565Z lvl=info msg="loading changes (end)" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.214ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.136880Z lvl=info msg="Opened file" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 service=filestore path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4195/000000007-000000002.tsm id=0 duration=0.047ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.137043Z lvl=info msg="Opened shard" log_id=0qUZ6j~0000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4195 duration=10.812ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.141942Z lvl=info msg="index opened with 8 partitions" log_id=0qUZ6j~0000 service=storage-engine index=tsi
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.142188Z lvl=info msg="loading changes (start)" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=start
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.142208Z lvl=info msg="loading changes (end)" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 op_name="field indices" op_event=end op_elapsed=0.023ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.142435Z lvl=info msg="Opened file" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 service=filestore path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4196/000000001-000000001.tsm id=0 duration=0.091ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.142493Z lvl=info msg="Reading file" log_id=0qUZ6j~0000 service=storage-engine engine=tsm1 service=cacheloader path=/var/lib/influxdb/.influxdbv2/engine/wal/c199f5ccd68d3769/autogen/4196/_00002.wal size=2718713
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1855]: Command "print-config" is deprecated, use the influx-cli command server-config to display the configuration values from the running server
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.195267Z lvl=info msg="Opened shard" log_id=0qUZ6j~0000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/var/lib/influxdb/.influxdbv2/engine/data/c199f5ccd68d3769/autogen/4196 duration=60.381ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.195473Z lvl=info msg="Open store (end)" log_id=0qUZ6j~0000 service=storage-engine service=store op_name=tsdb_open op_event=end op_elapsed=91.657ms
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.195506Z lvl=info msg="Starting retention policy enforcement service" log_id=0qUZ6j~0000 service=retention check_interval=30m
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.195515Z lvl=info msg="Starting precreation service" log_id=0qUZ6j~0000 service=shard-precreation check_interval=10m advance_period=30m
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:43.196239Z lvl=info msg="Starting query controller" log_id=0qUZ6j~0000 service=storage-reads concurrency_quota=1024 initial_memory_bytes_quota_per_query=9223372036854775807 memory_bytes_quota_per_query=9223372036854775807 max_memory_bytes=0 queue_size=1024
Jul 19 10:55:43 ubuntu1-Copy2 influxd-systemd-start.sh[1809]: InfluxDB API at http://localhost:8086/ready unavailable after 1 attempts...
Jul 19 10:55:44 ubuntu1-Copy2 influxd-systemd-start.sh[1809]: InfluxDB API at http://localhost:8086/ready unavailable after 2 attempts...
Jul 19 10:55:45 ubuntu1-Copy2 influxd-systemd-start.sh[1809]: InfluxDB API at http://localhost:8086/ready unavailable after 3 attempts...
Jul 19 10:55:46 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:46.111411Z lvl=info msg="Configuring InfluxQL statement executor (zeros indicate unlimited)." log_id=0qUZ6j~0000 max_select_point=0 max_select_series=0 max_select_buckets=0
Jul 19 10:55:46 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:46.115388Z lvl=info msg=Starting log_id=0qUZ6j~0000 service=telemetry interval=8h
Jul 19 10:55:46 ubuntu1-Copy2 influxd-systemd-start.sh[1810]: ts=2024-07-19T08:55:46.115748Z lvl=info msg=Listening log_id=0qUZ6j~0000 service=tcp-listener transport=http addr=:8086 port=8086
Jul 19 10:55:46 ubuntu1-Copy2 influxd-systemd-start.sh[1809]: InfluxDB started
Jul 19 10:55:46 ubuntu1-Copy2 systemd[1]: Started InfluxDB is an open-source, distributed, time series database.

@davidby-influx
Copy link
Contributor

The difference I am seeing here is the bucket find by name messages. If you don't have debug-level logging turned on for 2.7.6, the omission of that message may be simply logging, not operational.

@glsf91
Copy link
Author

glsf91 commented Jul 20, 2024

Yes, with 2.7.6 I forgot to set debug level. But before I saw the same bucket find messages. Also after start. So it looks some regular task.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@davidby-influx davidby-influx

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@glsf91 @davidby-influx