Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-14752

Zookeeper status fails on zk 3.6.1 with prometheus enabled

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 8.6
    • 8.7
    • Admin UI
    • None

    Description

      We specifically waited for SOLR-14463 to be released so it works fine with zookeeper 3.6, but unfortunately we still have problems. The reason could to be that in ZookeeperStatusHandler.java it explicitly expects integers to parse. But it seems that if you enable the new prometheus metrics in zookeeper all the values are posted as floats instead and that makes your check fail.

      This is our output of 'echo mntr | nc zookeeper 2181'

       

      zk_version	3.6.1--104dcb3e3fb464b30c5186d229e00af9f332524b, built on 04/21/2020 15:01 GMT
      zk_server_state	follower
      zk_peer_state	following - broadcast
      zk_open_file_descriptor_count	69.0
      zk_prep_processor_queue_time_ms{quantile="0.5"}	NaN
      zk_prep_processor_queue_time_ms{quantile="0.9"}	NaN
      zk_prep_processor_queue_time_ms{quantile="0.99"}	NaN
      zk_prep_processor_queue_time_ms_count	0.0
      zk_prep_processor_queue_time_ms_sum	0.0
      zk_jvm_memory_pool_allocated_bytes_total{pool="CodeHeap 'profiled nmethods'"}	5386112.0
      zk_jvm_memory_pool_allocated_bytes_total{pool="G1 Old Gen"}	5381768.0
      zk_jvm_memory_pool_allocated_bytes_total{pool="G1 Eden Space"}	9.437184E7
      zk_jvm_memory_pool_allocated_bytes_total{pool="CodeHeap 'non-profiled nmethods'"}	1023616.0
      zk_jvm_memory_pool_allocated_bytes_total{pool="G1 Survivor Space"}	7340032.0
      zk_jvm_memory_pool_allocated_bytes_total{pool="Compressed Class Space"}	2739816.0
      zk_jvm_memory_pool_allocated_bytes_total{pool="Metaspace"}	2.6625024E7
      zk_jvm_memory_pool_allocated_bytes_total{pool="CodeHeap 'non-nmethods'"}	1187456.0
      zk_fsynctime{quantile="0.5"}	NaN
      zk_fsynctime_count	380.0
      zk_fsynctime_sum	48.0
      zk_reads_issued_from_session_queue{quantile="0.5"}	NaN
      zk_reads_issued_from_session_queue_count	386.0
      zk_reads_issued_from_session_queue_sum	4.0
      zk_packets_received	2893.0
      zk_commit_commit_proc_req_queued{quantile="0.5"}	0.0
      zk_commit_commit_proc_req_queued_count	3275.0
      zk_commit_commit_proc_req_queued_sum	389.0
      zk_avg_latency	0.1878
      zk_dead_watchers_queued	0.0
      zk_tls_handshake_exceeded	0.0
      zk_last_client_response_size	16.0
      zk_jvm_memory_bytes_used{area="heap"}	4.1033352E7
      zk_jvm_memory_bytes_used{area="nonheap"}	3.9164144E7
      zk_jvm_memory_bytes_committed{area="heap"}	1.073741824E9
      zk_jvm_memory_bytes_committed{area="nonheap"}	4.3106304E7
      zk_jvm_memory_bytes_max{area="heap"}	1.073741824E9
      zk_jvm_memory_bytes_max{area="nonheap"}	-1.0
      zk_jvm_memory_bytes_init{area="heap"}	1.073741824E9
      zk_jvm_memory_bytes_init{area="nonheap"}	7667712.0
      zk_jvm_memory_pool_bytes_used{pool="CodeHeap 'non-nmethods'"}	1187456.0
      zk_jvm_memory_pool_bytes_used{pool="Metaspace"}	2.7396232E7
      zk_jvm_memory_pool_bytes_used{pool="CodeHeap 'profiled nmethods'"}	6577408.0
      zk_jvm_memory_pool_bytes_used{pool="Compressed Class Space"}	2739816.0
      zk_jvm_memory_pool_bytes_used{pool="G1 Eden Space"}	3.145728E7
      zk_jvm_memory_pool_bytes_used{pool="G1 Old Gen"}	5381768.0
      zk_jvm_memory_pool_bytes_used{pool="G1 Survivor Space"}	4194304.0
      zk_jvm_memory_pool_bytes_used{pool="CodeHeap 'non-profiled nmethods'"}	1263232.0
      zk_jvm_memory_pool_bytes_committed{pool="CodeHeap 'non-nmethods'"}	2555904.0
      zk_jvm_memory_pool_bytes_committed{pool="Metaspace"}	2.8360704E7
      zk_jvm_memory_pool_bytes_committed{pool="CodeHeap 'profiled nmethods'"}	6619136.0
      zk_jvm_memory_pool_bytes_committed{pool="Compressed Class Space"}	3014656.0
      zk_jvm_memory_pool_bytes_committed{pool="G1 Eden Space"}	5.24288E7
      zk_jvm_memory_pool_bytes_committed{pool="G1 Old Gen"}	1.01711872E9
      zk_jvm_memory_pool_bytes_committed{pool="G1 Survivor Space"}	4194304.0
      zk_jvm_memory_pool_bytes_committed{pool="CodeHeap 'non-profiled nmethods'"}	2555904.0
      zk_jvm_memory_pool_bytes_max{pool="CodeHeap 'non-nmethods'"}	5828608.0
      zk_jvm_memory_pool_bytes_max{pool="Metaspace"}	-1.0
      zk_jvm_memory_pool_bytes_max{pool="CodeHeap 'profiled nmethods'"}	1.22912768E8
      zk_jvm_memory_pool_bytes_max{pool="Compressed Class Space"}	1.073741824E9
      zk_jvm_memory_pool_bytes_max{pool="G1 Eden Space"}	-1.0
      zk_jvm_memory_pool_bytes_max{pool="G1 Old Gen"}	1.073741824E9
      zk_jvm_memory_pool_bytes_max{pool="G1 Survivor Space"}	-1.0
      zk_jvm_memory_pool_bytes_max{pool="CodeHeap 'non-profiled nmethods'"}	1.22916864E8
      zk_jvm_memory_pool_bytes_init{pool="CodeHeap 'non-nmethods'"}	2555904.0
      zk_jvm_memory_pool_bytes_init{pool="Metaspace"}	0.0
      zk_jvm_memory_pool_bytes_init{pool="CodeHeap 'profiled nmethods'"}	2555904.0
      zk_jvm_memory_pool_bytes_init{pool="Compressed Class Space"}	0.0
      zk_jvm_memory_pool_bytes_init{pool="G1 Eden Space"}	5.6623104E7
      zk_jvm_memory_pool_bytes_init{pool="G1 Old Gen"}	1.01711872E9
      zk_jvm_memory_pool_bytes_init{pool="G1 Survivor Space"}	0.0
      zk_jvm_memory_pool_bytes_init{pool="CodeHeap 'non-profiled nmethods'"}	2555904.0
      zk_approximate_data_size	221301.0
      zk_max_client_response_size	54601.0
      zk_outstanding_changes_queued	0.0
      zk_session_queues_drained{quantile="0.5"}	NaN
      zk_session_queues_drained_count	386.0
      zk_session_queues_drained_sum	53.0
      zk_time_waiting_empty_pool_in_commit_processor_read_ms{quantile="0.5"}	NaN
      zk_time_waiting_empty_pool_in_commit_processor_read_ms_count	386.0
      zk_time_waiting_empty_pool_in_commit_processor_read_ms_sum	1.0
      zk_election_time{quantile="0.5"}	NaN
      zk_election_time_count	2.0
      zk_election_time_sum	236.0
      zk_commit_count	0.0
      zk_write_commit_proc_issued{quantile="0.5"}	NaN
      zk_write_commit_proc_issued_count	386.0
      zk_write_commit_proc_issued_sum	386.0
      zk_commit_propagation_latency{quantile="0.5"}	NaN
      zk_commit_propagation_latency{quantile="0.9"}	NaN
      zk_commit_propagation_latency{quantile="0.99"}	NaN
      zk_commit_propagation_latency_count	383.0
      zk_commit_propagation_latency_sum	2595.0
      zk_read_per_namespace{key="solrcloud7",quantile="0.5"}	202.0
      zk_read_per_namespace_count{key="solrcloud7"}	549.0
      zk_read_per_namespace_sum{key="solrcloud7"}	731718.0
      zk_snapshottime{quantile="0.5"}	NaN
      zk_snapshottime_count	2.0
      zk_snapshottime_sum	4.0
      zk_ensemble_auth_success	0.0
      zk_reads_after_write_in_session_queue{quantile="0.5"}	NaN
      zk_reads_after_write_in_session_queue_count	53.0
      zk_reads_after_write_in_session_queue_sum	4.0
      zk_min_latency	0.0
      zk_sync_processor_queue_size{quantile="0.5"}	NaN
      zk_sync_processor_queue_size_count	384.0
      zk_sync_processor_queue_size_sum	3.0
      zk_write_per_namespace{key="zookeeper",quantile="0.5"}	NaN
      zk_write_per_namespace_count{key="zookeeper"}	3.0
      zk_write_per_namespace_sum{key="zookeeper"}	906.0
      zk_write_per_namespace{key="solrcloud7",quantile="0.5"}	NaN
      zk_write_per_namespace_count{key="solrcloud7"}	250.0
      zk_write_per_namespace_sum{key="solrcloud7"}	268323.0
      zk_concurrent_request_processing_in_commit_processor{quantile="0.5"}	NaN
      zk_concurrent_request_processing_in_commit_processor_count	3.0
      zk_concurrent_request_processing_in_commit_processor_sum	3.0
      zk_learner_proposal_received_count	383.0
      zk_packets_sent	2922.0
      zk_jvm_info{version="11.0.8+10-LTS",vendor="Azul Systems, Inc.",runtime="OpenJDK Runtime Environment"}	1.0
      zk_jvm_classes_loaded	3788.0
      zk_jvm_classes_loaded_total	3788.0
      zk_jvm_classes_unloaded_total	0.0
      zk_outstanding_requests	0.0
      zk_startup_txns_load_time{quantile="0.5"}	NaN
      zk_startup_txns_load_time_count	0.0
      zk_startup_txns_load_time_sum	0.0
      zk_snap_count	0.0
      zk_pending_session_queue_size{quantile="0.5"}	NaN
      zk_pending_session_queue_size_count	53.0
      zk_pending_session_queue_size_sum	53.0
      zk_read_commitproc_time_ms{quantile="0.5"}	0.0
      zk_read_commitproc_time_ms{quantile="0.9"}	0.0
      zk_read_commitproc_time_ms{quantile="0.99"}	1.0
      zk_read_commitproc_time_ms_count	2838.0
      zk_read_commitproc_time_ms_sum	198.0
      zk_stale_requests_dropped	0.0
      zk_om_proposal_process_time_ms{quantile="0.5"}	NaN
      zk_om_proposal_process_time_ms{quantile="0.9"}	NaN
      zk_om_proposal_process_time_ms{quantile="0.99"}	NaN
      zk_om_proposal_process_time_ms_count	0.0
      zk_om_proposal_process_time_ms_sum	0.0
      zk_jvm_threads_current	47.0
      zk_jvm_threads_daemon	20.0
      zk_jvm_threads_peak	47.0
      zk_jvm_threads_started_total	52.0
      zk_jvm_threads_deadlocked	0.0
      zk_jvm_threads_deadlocked_monitor	0.0
      zk_jvm_threads_state{state="RUNNABLE"}	13.0
      zk_jvm_threads_state{state="WAITING"}	13.0
      zk_jvm_threads_state{state="TERMINATED"}	0.0
      zk_jvm_threads_state{state="BLOCKED"}	0.0
      zk_jvm_threads_state{state="TIMED_WAITING"}	21.0
      zk_jvm_threads_state{state="NEW"}	0.0
      zk_sync_processor_queue_time_ms{quantile="0.5"}	NaN
      zk_sync_processor_queue_time_ms{quantile="0.9"}	NaN
      zk_sync_processor_queue_time_ms{quantile="0.99"}	NaN
      zk_sync_processor_queue_time_ms_count	383.0
      zk_sync_processor_queue_time_ms_sum	14.0
      zk_revalidate_count	0.0
      zk_add_dead_watcher_stall_time	0.0
      zk_sync_processor_queue_and_flush_time_ms{quantile="0.5"}	NaN
      zk_sync_processor_queue_and_flush_time_ms{quantile="0.9"}	NaN
      zk_sync_processor_queue_and_flush_time_ms{quantile="0.99"}	NaN
      zk_sync_processor_queue_and_flush_time_ms_count	383.0
      zk_sync_processor_queue_and_flush_time_ms_sum	307.0
      zk_response_packet_get_children_cache_hits	0.0
      zk_large_requests_rejected	0.0
      zk_sync_process_time{quantile="0.5"}	NaN
      zk_sync_process_time_count	383.0
      zk_sync_process_time_sum	23.0
      zk_min_client_response_size	16.0
      zk_jvm_buffer_pool_used_bytes{pool="mapped"}	0.0
      zk_jvm_buffer_pool_used_bytes{pool="direct"}	346079.0
      zk_jvm_buffer_pool_capacity_bytes{pool="mapped"}	0.0
      zk_jvm_buffer_pool_capacity_bytes{pool="direct"}	346079.0
      zk_jvm_buffer_pool_used_buffers{pool="mapped"}	0.0
      zk_jvm_buffer_pool_used_buffers{pool="direct"}	16.0
      zk_quit_leading_due_to_disloyal_voter	0.0
      zk_stale_replies	0.0
      zk_connection_rejected	0.0
      zk_num_alive_connections	4.0
      zk_request_throttle_wait_count	0.0
      zk_watch_count	21.0
      zk_local_sessions	0.0
      zk_learner_commit_received_count	383.0
      zk_server_write_committed_time_ms{quantile="0.5"}	NaN
      zk_server_write_committed_time_ms{quantile="0.9"}	NaN
      zk_server_write_committed_time_ms{quantile="0.99"}	NaN
      zk_server_write_committed_time_ms_count	333.0
      zk_server_write_committed_time_ms_sum	17.0
      zk_ensemble_auth_fail	0.0
      zk_write_final_proc_time_ms{quantile="0.5"}	NaN
      zk_write_final_proc_time_ms{quantile="0.9"}	NaN
      zk_write_final_proc_time_ms{quantile="0.99"}	NaN
      zk_write_final_proc_time_ms_count	386.0
      zk_write_final_proc_time_ms_sum	58.0
      zk_requests_in_session_queue{quantile="0.5"}	NaN
      zk_requests_in_session_queue_count	110.0
      zk_requests_in_session_queue_sum	118.0
      zk_process_cpu_seconds_total	8.9
      zk_process_start_time_seconds	1.597391274244E9
      zk_process_open_fds	69.0
      zk_process_max_fds	1048576.0
      zk_process_virtual_memory_bytes	6.740078592E9
      zk_process_resident_memory_bytes	1.8704384E8
      zk_response_packet_cache_hits	248.0
      zk_response_packet_cache_misses	70.0
      zk_ensemble_auth_skip	0.0
      zk_node_created_watch_count{quantile="0.5"}	NaN
      zk_node_created_watch_count_count	0.0
      zk_node_created_watch_count_sum	0.0
      zk_response_packet_get_children_cache_misses	0.0
      zk_diff_count	0.0
      zk_sync_processor_request_queued	383.0
      zk_dbinittime{quantile="0.5"}	NaN
      zk_dbinittime_count	1.0
      zk_dbinittime_sum	6.0
      zk_dead_watchers_cleaner_latency{quantile="0.5"}	NaN
      zk_dead_watchers_cleaner_latency{quantile="0.9"}	NaN
      zk_dead_watchers_cleaner_latency{quantile="0.99"}	NaN
      zk_dead_watchers_cleaner_latency_count	0.0
      zk_dead_watchers_cleaner_latency_sum	0.0
      zk_commit_process_time{quantile="0.5"}	0.0
      zk_commit_process_time_count	3275.0
      zk_commit_process_time_sum	126.0
      zk_quorum_size	3.0
      zk_node_deleted_watch_count{quantile="0.5"}	NaN
      zk_node_deleted_watch_count_count	0.0
      zk_node_deleted_watch_count_sum	0.0
      zk_connection_request_count	12.0
      zk_node_changed_watch_count{quantile="0.5"}	NaN
      zk_node_changed_watch_count_count	10.0
      zk_node_changed_watch_count_sum	10.0
      zk_readlatency{quantile="0.5"}	0.0
      zk_readlatency{quantile="0.9"}	1.0
      zk_readlatency{quantile="0.99"}	1.0
      zk_readlatency_count	2841.0
      zk_readlatency_sum	408.0
      zk_dead_watchers_cleared	0.0
      zk_outstanding_tls_handshake	0.0
      zk_read_commit_proc_issued{quantile="0.5"}	1.0
      zk_read_commit_proc_issued_count	3275.0
      zk_read_commit_proc_issued_sum	2834.0
      zk_write_commitproc_time_ms{quantile="0.5"}	NaN
      zk_write_commitproc_time_ms{quantile="0.9"}	NaN
      zk_write_commitproc_time_ms{quantile="0.99"}	NaN
      zk_write_commitproc_time_ms_count	53.0
      zk_write_commitproc_time_ms_sum	121.0
      zk_znode_count	126.0
      zk_synced_observers	0.0
      zk_request_commit_queued	386.0
      zk_looking_count	2.0
      zk_sessionless_connections_expired	0.0
      zk_read_final_proc_time_ms{quantile="0.5"}	0.0
      zk_read_final_proc_time_ms{quantile="0.9"}	0.0
      zk_read_final_proc_time_ms{quantile="0.99"}	1.0
      zk_read_final_proc_time_ms_count	2838.0
      zk_read_final_proc_time_ms_sum	122.0
      zk_unrecoverable_error_count	0.0
      zk_proposal_ack_creation_latency{quantile="0.5"}	NaN
      zk_proposal_ack_creation_latency{quantile="0.9"}	NaN
      zk_proposal_ack_creation_latency{quantile="0.99"}	NaN
      zk_proposal_ack_creation_latency_count	383.0
      zk_proposal_ack_creation_latency_sum	2387.0
      zk_ephemerals_count	21.0
      zk_local_write_committed_time_ms{quantile="0.5"}	NaN
      zk_local_write_committed_time_ms{quantile="0.9"}	NaN
      zk_local_write_committed_time_ms{quantile="0.99"}	NaN
      zk_local_write_committed_time_ms_count	53.0
      zk_local_write_committed_time_ms_sum	6.0
      zk_digest_mismatches_count	0.0
      zk_connection_revalidate_count	0.0
      zk_jvm_gc_collection_seconds_count{gc="G1 Young Generation"}	2.0
      zk_jvm_gc_collection_seconds_sum{gc="G1 Young Generation"}	0.022
      zk_jvm_gc_collection_seconds_count{gc="G1 Old Generation"}	0.0
      zk_jvm_gc_collection_seconds_sum{gc="G1 Old Generation"}	0.0
      zk_om_commit_process_time_ms{quantile="0.5"}	NaN
      zk_om_commit_process_time_ms{quantile="0.9"}	NaN
      zk_om_commit_process_time_ms{quantile="0.99"}	NaN
      zk_om_commit_process_time_ms_count	0.0
      zk_om_commit_process_time_ms_sum	0.0
      zk_max_file_descriptor_count	1048576.0
      zk_close_session_prep_time{quantile="0.5"}	NaN
      zk_close_session_prep_time{quantile="0.9"}	NaN
      zk_close_session_prep_time{quantile="0.99"}	NaN
      zk_close_session_prep_time_count	0.0
      zk_close_session_prep_time_sum	0.0
      zk_quorum_ack_latency{quantile="0.5"}	NaN
      zk_quorum_ack_latency{quantile="0.9"}	NaN
      zk_quorum_ack_latency{quantile="0.99"}	NaN
      zk_quorum_ack_latency_count	0.0
      zk_quorum_ack_latency_sum	0.0
      zk_netty_queued_buffer_capacity{quantile="0.5"}	NaN
      zk_netty_queued_buffer_capacity_count	0.0
      zk_netty_queued_buffer_capacity_sum	0.0
      zk_max_latency	10.0
      zk_prep_processor_queue_size{quantile="0.5"}	NaN
      zk_prep_processor_queue_size_count	0.0
      zk_prep_processor_queue_size_sum	0.0
      zk_prep_process_time{quantile="0.5"}	NaN
      zk_prep_process_time_count	0.0
      zk_prep_process_time_sum	0.0
      zk_connection_token_deficit{quantile="0.5"}	NaN
      zk_connection_token_deficit_count	12.0
      zk_connection_token_deficit_sum	0.0
      zk_uptime	3259902.0
      zk_proposal_count	0.0
      zk_updatelatency{quantile="0.5"}	NaN
      zk_updatelatency{quantile="0.9"}	NaN
      zk_updatelatency{quantile="0.99"}	NaN
      zk_updatelatency_count	50.0
      zk_updatelatency_sum	135.0
      zk_proposal_latency{quantile="0.5"}	NaN
      zk_proposal_latency{quantile="0.9"}	NaN
      zk_proposal_latency{quantile="0.99"}	NaN
      zk_proposal_latency_count	383.0
      zk_proposal_latency_sum	2083.0
      zk_prep_processor_request_queued	0.0
      zk_global_sessions	9.0
      zk_startup_snap_load_time{quantile="0.5"}	NaN
      zk_startup_snap_load_time_count	1.0
      zk_startup_snap_load_time_sum	0.0
      zk_write_batch_time_in_commit_processor{quantile="0.5"}	NaN
      zk_write_batch_time_in_commit_processor_count	386.0
      zk_write_batch_time_in_commit_processor_sum	67.0
      zk_outstanding_changes_removed	0.0
      zk_follower_sync_time{quantile="0.5"}	NaN
      zk_follower_sync_time_count	1.0
      zk_follower_sync_time_sum	34.0
      zk_read_commit_proc_req_queued{quantile="0.5"}	1.0
      zk_read_commit_proc_req_queued_count	3275.0
      zk_read_commit_proc_req_queued_sum	2845.0
      zk_sync_processor_batch_size{quantile="0.5"}	NaN
      zk_sync_processor_batch_size_count	380.0
      zk_sync_processor_batch_size_sum	383.0
      zk_connection_drop_probability	0.0
      zk_propagation_latency{quantile="0.5"}	NaN
      zk_propagation_latency{quantile="0.9"}	NaN
      zk_propagation_latency{quantile="0.99"}	NaN
      zk_propagation_latency_count	383.0
      zk_propagation_latency_sum	2656.0
      zk_sync_processor_queue_flush_time_ms{quantile="0.5"}	NaN
      zk_sync_processor_queue_flush_time_ms{quantile="0.9"}	NaN
      zk_sync_processor_queue_flush_time_ms{quantile="0.99"}	NaN
      zk_sync_processor_queue_flush_time_ms_count	380.0
      zk_sync_processor_queue_flush_time_ms_sum	261.0
      zk_stale_sessions_expired	0.0
      zk_startup_txns_loaded{quantile="0.5"}	NaN
      zk_startup_txns_loaded_count	0.0
      zk_startup_txns_loaded_sum	0.0
      zk_bytes_received_count	65360.0
      zk_connection_drop_count	0.0
      zk_write_commit_proc_req_queued{quantile="0.5"}	0.0
      zk_write_commit_proc_req_queued_count	3275.0
      zk_write_commit_proc_req_queued_sum	119.0
      zk_stale_requests	0.0
      zk_node_children_watch_count{quantile="0.5"}	NaN
      zk_node_children_watch_count_count	8.0
      zk_node_children_watch_count_sum	19.0
      

       And this is the stack trace when I try to look at the zookeeper status in the admin UI

      java.lang.NumberFormatException: For input string: "2.0"
      	at java.base/java.lang.NumberFormatException.forInputString(Unknown Source)
      	at java.base/java.lang.Integer.parseInt(Unknown Source)
      	at java.base/java.lang.Integer.parseInt(Unknown Source)
      	at org.apache.solr.handler.admin.ZookeeperStatusHandler.getZkStatus(ZookeeperStatusHandler.java:153)
      	at org.apache.solr.handler.admin.ZookeeperStatusHandler.handleRequestBody(ZookeeperStatusHandler.java:84)
      	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214)
      	at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:854)
      	at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:818)
      	at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:566)
      	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:415)
      	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
      	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1596)
      	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:545)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
      	at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:590)
      	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
      	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235)
      	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1610)
      	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233)
      	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1300)
      	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188)
      	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485)
      	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1580)
      	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186)
      	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1215)
      	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
      	at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:221)
      	at org.eclipse.jetty.server.handler.InetAccessHandler.handle(InetAccessHandler.java:177)
      	at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:146)
      	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
      	at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322)
      	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127)
      	at org.eclipse.jetty.server.Server.handle(Server.java:500)
      	at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383)
      	at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547)
      	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375)
      	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273)
      	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311)
      	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)
      	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117)
      	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336)
      	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313)
      	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171)
      	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129)
      	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806)
      	at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938)
      	at java.base/java.lang.Thread.run(Unknown Source)
      

      Attachments

        Issue Links

          Activity

            People

              janhoy Jan Høydahl
              der_eismann Philipp Trulson
              Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 10m
                  1h 10m