Host not found: sentry-clickhouse-2.sentry-clickhouse-headless.sentry.svc.cluster.local

[XinXianChen]

error message:

root@sentry-clickhouse-0:/# tail -1000 /var/log/clickhouse-server/clickhouse-server.err.log
2024.04.12 03:05:04.199063 [ 52 ] {} Cluster: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = Host not found: sentry-clickhouse-1.sentry-clickhouse-headless.sentry.svc.cluster.local, Stack trace (when copying this message, always include the lines below):

0. Poco::Net::HostNotFoundException::HostNotFoundException(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int) @ 0x13c38909 in /usr/bin/clickhouse

1. Poco::Net::DNS::aierror(int, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x13c0a9bc in /usr/bin/clickhouse

2. Poco::Net::DNS::hostByName(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned int) @ 0x13c0a850 in /usr/bin/clickhouse

3. ? @ 0x909a326 in /usr/bin/clickhouse

4. ? @ 0x909ae77 in /usr/bin/clickhouse

5. DB::DNSResolver::resolveAddress(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned short) @ 0x909bd6d in /usr/bin/clickhouse

6. DB::Cluster::Address::getResolvedAddress() const @ 0x100723cb in /usr/bin/clickhouse

7. DB::Cluster::Address::Address(Poco::Util::AbstractConfiguration const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned int, unsigned int) @ 0x10072b97 in /usr/bin/clickhouse

8. void std::__1::vector<DB::Cluster::Address, std::__1::allocatorDB::Cluster::Address >::__emplace_back_slow_path<Poco::Util::AbstractConfiguration const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&, unsigned int&, unsigned int&>(Poco::Util::AbstractConfiguration const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&, unsigned int&, unsigned int&) @ 0x10084002 in /usr/bin/clickhouse

9. DB::Cluster::Cluster(Poco::Util::AbstractConfiguration const&, DB::Settings const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x1007735c in /usr/bin/clickhouse

10. DB::Clusters::updateClusters(Poco::Util::AbstractConfiguration const&, DB::Settings const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, Poco::Util::AbstractConfiguration*) @ 0x10075ed1 in /usr/bin/clickhouse

11. DB::Context::setClustersConfig(Poco::AutoPtrPoco::Util::AbstractConfiguration const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x1009eac2 in /usr/bin/clickhouse

12. ? @ 0x907e173 in /usr/bin/clickhouse

13. DB::ConfigReloader::reloadIfNewer(bool, bool, bool, bool) @ 0x114934ce in /usr/bin/clickhouse

14. DB::ConfigReloader::ConfigReloader(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, zkutil::ZooKeeperNodeCache&&, std::__1::shared_ptrPoco::Event const&, std::__1::function<void (Poco::AutoPtrPoco::Util::AbstractConfiguration, bool)>&&, bool) @ 0x1149064f in /usr/bin/clickhouse

15. DB::Server::main(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x906e39b in /usr/bin/clickhouse

16. Poco::Util::Application::run() @ 0x13c62643 in /usr/bin/clickhouse

17. DB::Server::run() @ 0x90631cf in /usr/bin/clickhouse

18. mainEntryClickHouseServer(int, char**) @ 0x9061573 in /usr/bin/clickhouse

19. main @ 0x8fe6afe in /usr/bin/clickhouse

20. __libc_start_main @ 0x270b3 in /usr/lib/x86_64-linux-gnu/libc-2.31.so

21. _start @ 0x8fb1dae in /usr/bin/clickhouse
    (version 21.8.13.6 (official build))
    2024.04.12 03:05:04.210907 [ 52 ] {} Cluster: Poco::Exception. Code: 1000, e.code() = 0, e.displayText() = Host not found: sentry-clickhouse-2.sentry-clickhouse-headless.sentry.svc.cluster.local, Stack trace (when copying this message, always include the lines below):

22. Poco::Net::HostNotFoundException::HostNotFoundException(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int) @ 0x13c38909 in /usr/bin/clickhouse

23. Poco::Net::DNS::aierror(int, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x13c0a9bc in /usr/bin/clickhouse

24. Poco::Net::DNS::hostByName(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned int) @ 0x13c0a850 in /usr/bin/clickhouse

25. ? @ 0x909a326 in /usr/bin/clickhouse

26. ? @ 0x909ae77 in /usr/bin/clickhouse

27. DB::DNSResolver::resolveAddress(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned short) @ 0x909bd6d in /usr/bin/clickhouse

28. DB::Cluster::Address::getResolvedAddress() const @ 0x100723cb in /usr/bin/clickhouse

29. DB::Cluster::Address::Address(Poco::Util::AbstractConfiguration const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, unsigned int, unsigned int) @ 0x10072b97 in /usr/bin/clickhouse

30. void std::__1::vector<DB::Cluster::Address, std::__1::allocatorDB::Cluster::Address >::__emplace_back_slow_path<Poco::Util::AbstractConfiguration const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&, unsigned int&, unsigned int&>(Poco::Util::AbstractConfiguration const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&, unsigned int&, unsigned int&) @ 0x10084002 in /usr/bin/clickhouse

31. DB::Cluster::Cluster(Poco::Util::AbstractConfiguration const&, DB::Settings const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&) @ 0x1007735c in /usr/bin/clickhouse

[XinXianChen]

I solved it. delete clickhouse pvc and redeploy

[geckiss]

This was happening to us because sentry-clickhouse was being Oomkilled.

[XinXianChen]

这种情况发生在我们身上是因为哨兵点击屋被 Oomkilled 了。

So how did you fix it

[Mokto]

This issue is stale because it has been open for 30 days with no activity.

[geckiss]

这种情况发生在我们身上是因为哨兵点击屋被 Oomkilled 了。

So how did you fix it

Increased memory limit.

[Mokto]

This issue is stale because it has been open for 30 days with no activity.