ScyllaDB University LIVE, FREE Virtual Training Event | March 21
Register for Free
ScyllaDB Documentation Logo Documentation
  • Deployments
    • Cloud
    • Server
  • Tools
    • ScyllaDB Manager
    • ScyllaDB Monitoring Stack
    • ScyllaDB Operator
  • Drivers
    • CQL Drivers
    • DynamoDB Drivers
    • Supported Driver Versions
  • Resources
    • ScyllaDB University
    • Community Forum
    • Tutorials
Install
Ask AI
ScyllaDB Docs ScyllaDB Open Source Reference Metrics

Caution

You're viewing documentation for a previous version. Switch to the latest stable version.

Metrics¶

Advanced rpc compressor¶

scylla_rpc_compression_bytes_sent¶

bytes written to RPC connections, before compression

  • Type: counter

  • Component: rpc_compression

  • Key: bytes_sent

scylla_rpc_compression_compressed_bytes_sent¶

bytes written to RPC connections, after compression

  • Type: counter

  • Component: rpc_compression

  • Key: compressed_bytes_sent

scylla_rpc_compression_compressed_bytes_received¶

bytes read from RPC connections, before decompression

  • Type: counter

  • Component: rpc_compression

  • Key: compressed_bytes_received

scylla_rpc_compression_messages_received¶

RPC messages received

  • Type: counter

  • Component: rpc_compression

  • Key: messages_received

scylla_rpc_compression_messages_sent¶

RPC messages sent

  • Type: counter

  • Component: rpc_compression

  • Key: messages_sent

scylla_rpc_compression_bytes_received¶

bytes read from RPC connections, after decompression

  • Type: counter

  • Component: rpc_compression

  • Key: bytes_received

scylla_rpc_compression_compression_cpu_nanos¶

nanoseconds spent on compression

  • Type: counter

  • Component: rpc_compression

  • Key: compression_cpu_nanos

scylla_rpc_compression_decompression_cpu_nanos¶

nanoseconds spent on decompression

  • Type: counter

  • Component: rpc_compression

  • Key: decompression_cpu_nanos

Batchlog manager¶

scylla_batchlog_manager_total_write_replay_attempts¶

Counts write operations issued in a batchlog replay flow. The high value of this metric indicates that we have a long batch replay list.

  • Type: counter

  • Component: batchlog_manager

  • Key: total_write_replay_attempts

Cache¶

scylla_auth_cache_roles¶

Number of roles currently cached

  • Type: gauge

  • Component: auth_cache

  • Key: roles

scylla_auth_cache_permissions¶

Total number of permission sets currently cached across all roles

  • Type: gauge

  • Component: auth_cache

  • Key: permissions

Client¶

scylla_s3_nr_connections¶

Total number of connections

  • Type: gauge

  • Component: s3

  • Key: nr_connections

scylla_s3_nr_active_connections¶

Total number of connections with running requests

  • Type: gauge

  • Component: s3

  • Key: nr_active_connections

scylla_s3_total_new_connections¶

Total number of new connections created so far

  • Type: counter

  • Component: s3

  • Key: total_new_connections

scylla_s3_total_read_requests¶

Total number of object read requests

  • Type: counter

  • Component: s3

  • Key: total_read_requests

scylla_s3_total_write_requests¶

Total number of object write requests

  • Type: counter

  • Component: s3

  • Key: total_write_requests

scylla_s3_total_read_bytes¶

Total number of bytes read from objects

  • Type: counter

  • Component: s3

  • Key: total_read_bytes

scylla_s3_total_write_bytes¶

Total number of bytes written to objects

  • Type: counter

  • Component: s3

  • Key: total_write_bytes

scylla_s3_total_read_latency_sec¶

Total time spent reading data from objects

  • Type: counter

  • Component: s3

  • Key: total_read_latency_sec

scylla_s3_total_write_latency_sec¶

Total time spend writing data to objects

  • Type: counter

  • Component: s3

  • Key: total_write_latency_sec

scylla_s3_total_read_prefetch_bytes¶

Total number of bytes requested from object

  • Type: counter

  • Component: s3

  • Key: total_read_prefetch_bytes

scylla_s3_downloads_blocked_on_memory¶

Counts the number of times S3 client downloads were delayed due to insufficient memory availability

  • Type: counter

  • Component: s3

  • Key: downloads_blocked_on_memory

Commitlog¶

scylla_commitlog_segments¶

Holds the current number of segments.

  • Type: gauge

  • Component: commitlog

  • Key: segments

scylla_schema_commitlog_segments¶

Holds the current number of segments.

  • Type: gauge

  • Component: schema_commitlog

  • Key: segments

scylla_commitlog_allocating_segments¶

Holds the number of not closed segments that still have some free space. This value should not get too high.

  • Type: gauge

  • Component: commitlog

  • Key: allocating_segments

scylla_schema_commitlog_allocating_segments¶

Holds the number of not closed segments that still have some free space. This value should not get too high.

  • Type: gauge

  • Component: schema_commitlog

  • Key: allocating_segments

scylla_commitlog_unused_segments¶

Holds the current number of unused segments. A non-zero value indicates that the disk write path became temporary slow.

  • Type: gauge

  • Component: commitlog

  • Key: unused_segments

scylla_schema_commitlog_unused_segments¶

Holds the current number of unused segments. A non-zero value indicates that the disk write path became temporary slow.

  • Type: gauge

  • Component: schema_commitlog

  • Key: unused_segments

scylla_commitlog_alloc¶

Counts number of times a new mutation has been added to a segment. Divide bytes_written by this value to get the average number of bytes per mutation written to the disk.

  • Type: counter

  • Component: commitlog

  • Key: alloc

scylla_schema_commitlog_alloc¶

Counts number of times a new mutation has been added to a segment. Divide bytes_written by this value to get the average number of bytes per mutation written to the disk.

  • Type: counter

  • Component: schema_commitlog

  • Key: alloc

scylla_commitlog_cycle¶

Counts number of commitlog write cycles - when the data is written from the internal memory buffer to the disk.

  • Type: counter

  • Component: commitlog

  • Key: cycle

scylla_schema_commitlog_cycle¶

Counts number of commitlog write cycles - when the data is written from the internal memory buffer to the disk.

  • Type: counter

  • Component: schema_commitlog

  • Key: cycle

scylla_commitlog_flush¶

Counts number of times the flush() method was called for a file.

  • Type: counter

  • Component: commitlog

  • Key: flush

scylla_schema_commitlog_flush¶

Counts number of times the flush() method was called for a file.

  • Type: counter

  • Component: schema_commitlog

  • Key: flush

scylla_commitlog_bytes_written¶

Counts number of bytes written to the disk. Divide this value by alloc to get the average number of bytes per mutation written to the disk.

  • Type: counter

  • Component: commitlog

  • Key: bytes_written

scylla_schema_commitlog_bytes_written¶

Counts number of bytes written to the disk. Divide this value by alloc to get the average number of bytes per mutation written to the disk.

  • Type: counter

  • Component: schema_commitlog

  • Key: bytes_written

scylla_commitlog_bytes_released¶

Counts number of bytes released from disk. (Deleted/recycled)

  • Type: counter

  • Component: commitlog

  • Key: bytes_released

scylla_schema_commitlog_bytes_released¶

Counts number of bytes released from disk. (Deleted/recycled)

  • Type: counter

  • Component: schema_commitlog

  • Key: bytes_released

scylla_commitlog_bytes_flush_requested¶

Counts number of bytes requested to be flushed (persisted).

  • Type: counter

  • Component: commitlog

  • Key: bytes_flush_requested

scylla_schema_commitlog_bytes_flush_requested¶

Counts number of bytes requested to be flushed (persisted).

  • Type: counter

  • Component: schema_commitlog

  • Key: bytes_flush_requested

scylla_commitlog_slack¶

Counts number of unused bytes written to the disk due to disk segment alignment.

  • Type: counter

  • Component: commitlog

  • Key: slack

scylla_schema_commitlog_slack¶

Counts number of unused bytes written to the disk due to disk segment alignment.

  • Type: counter

  • Component: schema_commitlog

  • Key: slack

scylla_commitlog_pending_flushes¶

Holds number of currently pending flushes. See the related flush_limit_exceeded metric.

  • Type: gauge

  • Component: commitlog

  • Key: pending_flushes

scylla_schema_commitlog_pending_flushes¶

Holds number of currently pending flushes. See the related flush_limit_exceeded metric.

  • Type: gauge

  • Component: schema_commitlog

  • Key: pending_flushes

scylla_commitlog_pending_allocations¶

Holds number of currently pending allocations. A non-zero value indicates that we have a bottleneck in the disk write flow.

  • Type: gauge

  • Component: commitlog

  • Key: pending_allocations

scylla_schema_commitlog_pending_allocations¶

Holds number of currently pending allocations. A non-zero value indicates that we have a bottleneck in the disk write flow.

  • Type: gauge

  • Component: schema_commitlog

  • Key: pending_allocations

scylla_commitlog_requests_blocked_memory¶

Counts number of requests blocked due to memory pressure. A non-zero value indicates that the commitlog memory quota is not enough to serve the required amount of requests.

  • Type: counter

  • Component: commitlog

  • Key: requests_blocked_memory

scylla_schema_commitlog_requests_blocked_memory¶

Counts number of requests blocked due to memory pressure. A non-zero value indicates that the commitlog memory quota is not enough to serve the required amount of requests.

  • Type: counter

  • Component: schema_commitlog

  • Key: requests_blocked_memory

scylla_commitlog_flush_limit_exceeded¶

Counts number of times a flush limit was exceeded. A non-zero value indicates that there are too many pending flush operations (see pending_flushes) and some of them will be blocked till the total amount of pending flush operations drops below c.

  • Type: counter

  • Component: commitlog

  • Key: flush_limit_exceeded

scylla_schema_commitlog_flush_limit_exceeded¶

Counts number of times a flush limit was exceeded. A non-zero value indicates that there are too many pending flush operations (see pending_flushes) and some of them will be blocked till the total amount of pending flush operations drops below c.

  • Type: counter

  • Component: schema_commitlog

  • Key: flush_limit_exceeded

scylla_commitlog_disk_total_bytes¶

Holds size of disk space in bytes reserved for data so far. A too high value indicates that we have some bottleneck in the writing to sstables path.

  • Type: gauge

  • Component: commitlog

  • Key: disk_total_bytes

scylla_schema_commitlog_disk_total_bytes¶

Holds size of disk space in bytes reserved for data so far. A too high value indicates that we have some bottleneck in the writing to sstables path.

  • Type: gauge

  • Component: schema_commitlog

  • Key: disk_total_bytes

scylla_commitlog_disk_active_bytes¶

Holds size of disk space in bytes used for data so far. A too high value indicates that we have some bottleneck in the writing to sstables path.

  • Type: gauge

  • Component: commitlog

  • Key: disk_active_bytes

scylla_schema_commitlog_disk_active_bytes¶

Holds size of disk space in bytes used for data so far. A too high value indicates that we have some bottleneck in the writing to sstables path.

  • Type: gauge

  • Component: schema_commitlog

  • Key: disk_active_bytes

scylla_commitlog_disk_slack_end_bytes¶

Holds size of disk space in bytes unused because of segment switching (end slack). A too high value indicates that we do not write enough data to each segment.

  • Type: gauge

  • Component: commitlog

  • Key: disk_slack_end_bytes

scylla_schema_commitlog_disk_slack_end_bytes¶

Holds size of disk space in bytes unused because of segment switching (end slack). A too high value indicates that we do not write enough data to each segment.

  • Type: gauge

  • Component: schema_commitlog

  • Key: disk_slack_end_bytes

scylla_commitlog_memory_buffer_bytes¶

Holds the total number of bytes in internal memory buffers.

  • Type: gauge

  • Component: commitlog

  • Key: memory_buffer_bytes

scylla_schema_commitlog_memory_buffer_bytes¶

Holds the total number of bytes in internal memory buffers.

  • Type: gauge

  • Component: schema_commitlog

  • Key: memory_buffer_bytes

scylla_commitlog_blocked_on_new_segment¶

Number of allocations blocked on acquiring new segment.

  • Type: gauge

  • Component: commitlog

  • Key: blocked_on_new_segment

scylla_schema_commitlog_blocked_on_new_segment¶

Number of allocations blocked on acquiring new segment.

  • Type: gauge

  • Component: schema_commitlog

  • Key: blocked_on_new_segment

scylla_commitlog_active_allocations¶

Current number of active allocations.

  • Type: gauge

  • Component: commitlog

  • Key: active_allocations

scylla_schema_commitlog_active_allocations¶

Current number of active allocations.

  • Type: gauge

  • Component: schema_commitlog

  • Key: active_allocations

Compaction manager¶

scylla_compaction_manager_compactions¶

Holds the number of currently active compactions.

  • Type: gauge

  • Component: compaction_manager

  • Key: compactions

scylla_compaction_manager_pending_compactions¶

Holds the number of compaction tasks waiting for an opportunity to run.

  • Type: gauge

  • Component: compaction_manager

  • Key: pending_compactions

scylla_compaction_manager_completed_compactions¶

Holds the number of completed compaction tasks.

  • Type: counter

  • Component: compaction_manager

  • Key: completed_compactions

scylla_compaction_manager_failed_compactions¶

Holds the number of failed compaction tasks.

  • Type: counter

  • Component: compaction_manager

  • Key: failed_compactions

scylla_compaction_manager_postponed_compactions¶

Holds the number of tables with postponed compaction.

  • Type: gauge

  • Component: compaction_manager

  • Key: postponed_compactions

scylla_compaction_manager_backlog¶

Holds the sum of compaction backlog for all tables in the system.

  • Type: gauge

  • Component: compaction_manager

  • Key: backlog

scylla_compaction_manager_normalized_backlog¶

Holds the sum of normalized compaction backlog for all tables in the system. Backlog is normalized by dividing backlog by shard’s available memory.

  • Type: gauge

  • Component: compaction_manager

  • Key: normalized_backlog

scylla_compaction_manager_validation_errors¶

Holds the number of encountered validation errors.

  • Type: counter

  • Component: compaction_manager

  • Key: validation_errors

Compressor¶

scylla_sstable_compression_dicts_total_live_memory_bytes¶

Total amount of memory consumed by SSTable compression dictionaries in RAM

  • Type: counter

  • Component: sstable_compression_dicts

  • Key: total_live_memory_bytes

Corrupt data handler¶

scylla_corrupt_data_entries_reported¶

Counts the number of corrupt data instances reported to the corrupt data handler. A non-zero value indicates that the database suffered data corruption.

  • Type: counter

  • Component: corrupt_data

  • Key: entries_reported

Database¶

scylla_memory_dirty_bytes¶

Holds the current size of all (regular and system) non-free memory in bytes: used memory + released memory that hasn’t been returned to a free memory pool yet. Total memory size minus this value represents the amount of available memory. If this value minus unspooled_dirty_bytes is too high then this means that the dirty memory eviction lags behind.

  • Type: gauge

  • Component: memory

  • Key: dirty_bytes

scylla_memory_unspooled_dirty_bytes¶

Holds the size of all (regular and system) used memory in bytes. Compare it to dirty_bytes to see how many memory is wasted (neither used nor available).

  • Type: gauge

  • Component: memory

  • Key: unspooled_dirty_bytes

scylla_memtables_pending_flushes¶

Holds the current number of memtables that are currently being flushed to sstables. High value in this metric may be an indication of storage being a bottleneck.

  • Type: gauge

  • Component: memtables

  • Key: pending_flushes

scylla_memtables_pending_flushes_bytes¶

Holds the current number of bytes in memtables that are currently being flushed to sstables. High value in this metric may be an indication of storage being a bottleneck.

  • Type: gauge

  • Component: memtables

  • Key: pending_flushes_bytes

scylla_memtables_failed_flushes¶

Holds the number of failed memtable flushes. High value in this metric may indicate a permanent failure to flush a memtable.

  • Type: gauge

  • Component: memtables

  • Key: failed_flushes

scylla_database_requests_blocked_memory_current¶

Holds the current number of requests blocked due to reaching the memory quota (tB). Non-zero value indicates that our bottleneck is memory and more specifically - the memory quota allocated for the databasecomponent.

  • Type: gauge

  • Component: database

  • Key: requests_blocked_memory_current

scylla_database_requests_blocked_memory¶

Holds the current number of requests blocked due to reaching the memory quota (tB). Non-zero value indicates that our bottleneck is memory and more specifically - the memory quota allocated for the databasecomponent.

  • Type: counter

  • Component: database

  • Key: requests_blocked_memory

scylla_database_clustering_filter_count¶

Counts bloom filter invocations.

  • Type: counter

  • Component: database

  • Key: clustering_filter_count

scylla_database_clustering_filter_sstables_checked¶

Counts sstables checked after applying the bloom filter. High value indicates that bloom filter is not very efficient.

  • Type: counter

  • Component: database

  • Key: clustering_filter_sstables_checked

scylla_database_clustering_filter_fast_path_count¶

Counts number of times bloom filtering short cut to include all sstables when only one full range was specified.

  • Type: counter

  • Component: database

  • Key: clustering_filter_fast_path_count

scylla_database_clustering_filter_surviving_sstables¶

Counts sstables that survived the clustering key filtering. High value indicates that bloom filter is not very efficient and still have to access a lot of sstables to get data.

  • Type: counter

  • Component: database

  • Key: clustering_filter_surviving_sstables

scylla_database_dropped_view_updates¶

Counts the number of view updates that have been dropped due to cluster overload.

  • Type: counter

  • Component: database

  • Key: dropped_view_updates

scylla_database_view_building_paused¶

Counts the number of times view building process was paused (e.g. due to node unavailability).

  • Type: counter

  • Component: database

  • Key: view_building_paused

scylla_database_total_writes¶

Counts the total number of successful write operations performed by this shard.

  • Type: counter

  • Component: database

  • Key: total_writes

scylla_database_total_writes_failed¶

Counts the total number of failed write operations. A sum of this value plus total_writes represents a total amount of writes attempted on this shard.

  • Type: counter

  • Component: database

  • Key: total_writes_failed

scylla_database_total_writes_timedout¶

Counts write operations failed due to a timeout. A positive value is a sign of storage being overloaded.

  • Type: counter

  • Component: database

  • Key: total_writes_timedout

scylla_database_total_writes_rate_limited¶

Counts write operations which were rejected on the replica side because the per-partition limit was reached.

  • Type: counter

  • Component: database

  • Key: total_writes_rate_limited

scylla_database_total_writes_rejected_due_to_out_of_space_prevention¶

Counts write operations which were rejected due to disabled user tables writes.

  • Type: counter

  • Component: database

  • Key: total_writes_rejected_due_to_out_of_space_prevention

scylla_database_total_reads_rate_limited¶

Counts read operations which were rejected on the replica side because the per-partition limit was reached.

  • Type: counter

  • Component: database

  • Key: total_reads_rate_limited

scylla_database_view_update_backlog¶

Holds the current size in bytes of the pending view updates for all tables

  • Type: current_bytes

  • Component: database

  • Key: view_update_backlog

scylla_database_querier_cache_lookups¶

Counts querier cache lookups (paging queries)

  • Type: counter

  • Component: database

  • Key: querier_cache_lookups

scylla_database_querier_cache_misses¶

Counts querier cache lookups that failed to find a cached querier

  • Type: counter

  • Component: database

  • Key: querier_cache_misses

scylla_database_querier_cache_drops¶

Counts querier cache lookups that found a cached querier but had to drop it

  • Type: counter

  • Component: database

  • Key: querier_cache_drops

scylla_database_querier_cache_scheduling_group_mismatches¶

Counts querier cache lookups that found a cached querier but had to drop it due to scheduling group mismatch

  • Type: counter

  • Component: database

  • Key: querier_cache_scheduling_group_mismatches

scylla_database_querier_cache_time_based_evictions¶

Counts querier cache entries that timed out and were evicted.

  • Type: counter

  • Component: database

  • Key: querier_cache_time_based_evictions

scylla_database_querier_cache_resource_based_evictions¶

Counts querier cache entries that were evicted to free up resources (limited by reader concurrency limits) necessary to create new readers.

  • Type: counter

  • Component: database

  • Key: querier_cache_resource_based_evictions

scylla_database_querier_cache_population¶

The number of entries currently in the querier cache.

  • Type: gauge

  • Component: database

  • Key: querier_cache_population

scylla_database_total_result_bytes¶

Holds the current amount of memory used for results.

  • Type: gauge

  • Component: database

  • Key: total_result_bytes

scylla_database_short_data_queries¶

The rate of data queries (data or digest reads) that returned less rows than requested due to result size limiting.

  • Type: counter

  • Component: database

  • Key: short_data_queries

scylla_database_short_mutation_queries¶

The rate of mutation queries that returned less rows than requested due to result size limiting.

  • Type: counter

  • Component: database

  • Key: short_mutation_queries

scylla_database_multishard_query_unpopped_fragments¶

The total number of fragments that were extracted from the shard reader but were unconsumed by the query and moved back into the reader.

  • Type: counter

  • Component: database

  • Key: multishard_query_unpopped_fragments

scylla_database_multishard_query_unpopped_bytes¶

The total number of bytes that were extracted from the shard reader but were unconsumed by the query and moved back into the reader.

  • Type: counter

  • Component: database

  • Key: multishard_query_unpopped_bytes

scylla_database_multishard_query_failed_reader_stops¶

The number of times the stopping of a shard reader failed.

  • Type: counter

  • Component: database

  • Key: multishard_query_failed_reader_stops

scylla_database_multishard_query_failed_reader_saves¶

The number of times the saving of a shard reader failed.

  • Type: counter

  • Component: database

  • Key: multishard_query_failed_reader_saves

scylla_database_counter_cell_lock_acquisition¶

The number of acquired counter cell locks.

  • Type: total_operations

  • Component: database

  • Key: counter_cell_lock_acquisition

scylla_database_counter_cell_lock_pending¶

The number of counter updates waiting for a lock.

  • Type: queue_length

  • Component: database

  • Key: counter_cell_lock_pending

scylla_database_large_partition_exceeding_threshold¶

Number of large partitions exceeding compaction_large_partition_warning_threshold_mb. Large partitions have performance impact and should be avoided, check the documentation for details.

  • Type: counter

  • Component: database

  • Key: large_partition_exceeding_threshold

scylla_database_total_view_updates_pushed_local¶

Total number of view updates generated for tables and applied locally.

  • Type: total_operations

  • Component: database

  • Key: total_view_updates_pushed_local

scylla_database_total_view_updates_pushed_remote¶

Total number of view updates generated for tables and sent to remote replicas.

  • Type: total_operations

  • Component: database

  • Key: total_view_updates_pushed_remote

scylla_database_total_view_updates_failed_local¶

Total number of view updates generated for tables and failed to be applied locally.

  • Type: total_operations

  • Component: database

  • Key: total_view_updates_failed_local

scylla_database_total_view_updates_failed_remote¶

Total number of view updates generated for tables and failed to be sent to remote replicas.

  • Type: total_operations

  • Component: database

  • Key: total_view_updates_failed_remote

scylla_database_total_view_updates_on_wrong_node¶

Total number of view updates which are computed on the wrong node.

  • Type: total_operations

  • Component: database

  • Key: total_view_updates_on_wrong_node

scylla_database_total_view_updates_failed_pairing¶

Total number of view updates for which we failed base/view pairing.

  • Type: total_operations

  • Component: database

  • Key: total_view_updates_failed_pairing

scylla_database_total_view_updates_due_to_replica_count_mismatch¶

Total number of view updates for which there were more view replicas than base replicas and we had to generate an extra view update because the additional view replica wouldn’t get paired with any base replica.Should only increase during RF change. Should stop increasing shortly after finishing the RF change.

  • Type: total_operations

  • Component: database

  • Key: total_view_updates_due_to_replica_count_mismatch

scylla_database_schema_changed¶

The number of times the schema changed

  • Type: counter

  • Component: database

  • Key: schema_changed

Dirty memory manager¶

scylla_memory_regular_dirty_bytes¶

Holds the current size of a all non-free memory in bytes: used memory + released memory that hasn’t been returned to a free memory pool yet. Total memory size minus this value represents the amount of available memory. If this value minus unspooled_dirty_bytes is too high then this means that the dirty memory eviction lags behind.

  • Type: gauge

  • Component: memory

  • Key: regular_dirty_bytes

scylla_memory_system_dirty_bytes¶

Holds the current size of a all non-free memory in bytes: used memory + released memory that hasn’t been returned to a free memory pool yet. Total memory size minus this value represents the amount of available memory. If this value minus unspooled_dirty_bytes is too high then this means that the dirty memory eviction lags behind.

  • Type: gauge

  • Component: memory

  • Key: system_dirty_bytes

scylla_memory_regular_unspooled_dirty_bytes¶

Holds the size of used memory in bytes. Compare it to dirty_bytes to see how many memory is wasted (neither used nor available).

  • Type: gauge

  • Component: memory

  • Key: regular_unspooled_dirty_bytes

scylla_memory_system_unspooled_dirty_bytes¶

Holds the size of used memory in bytes. Compare it to dirty_bytes to see how many memory is wasted (neither used nor available).

  • Type: gauge

  • Component: memory

  • Key: system_unspooled_dirty_bytes

Gossiper¶

scylla_gossip_heart_beat¶

Heartbeat of the current Node.

  • Type: counter

  • Component: gossip

  • Key: heart_beat

scylla_gossip_live¶

How many live nodes the current node sees

  • Type: gauge

  • Component: gossip

  • Key: live

scylla_gossip_unreachable¶

How many unreachable nodes the current node sees

  • Type: gauge

  • Component: gossip

  • Key: unreachable

Log¶

scylla_cdc_operations_on_static_row_performed_total¶

number of total CDC operations that processed a static_row

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_static_row_performed_total

scylla_cdc_operations_on_clustering_row_performed_total¶

number of total CDC operations that processed a clustering_row

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_clustering_row_performed_total

scylla_cdc_operations_on_map_performed_total¶

number of total CDC operations that processed a map

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_map_performed_total

scylla_cdc_operations_on_set_performed_total¶

number of total CDC operations that processed a set

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_set_performed_total

scylla_cdc_operations_on_list_performed_total¶

number of total CDC operations that processed a list

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_list_performed_total

scylla_cdc_operations_on_udt_performed_total¶

number of total CDC operations that processed a udt

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_udt_performed_total

scylla_cdc_operations_on_range_tombstone_performed_total¶

number of total CDC operations that processed a range_tombstone

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_range_tombstone_performed_total

scylla_cdc_operations_on_partition_delete_performed_total¶

number of total CDC operations that processed a partition_delete

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_partition_delete_performed_total

scylla_cdc_operations_on_row_delete_performed_total¶

number of total CDC operations that processed a row_delete

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_row_delete_performed_total

scylla_cdc_operations_on_static_row_performed_failed¶

number of failed CDC operations that processed a static_row

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_static_row_performed_failed

scylla_cdc_operations_on_clustering_row_performed_failed¶

number of failed CDC operations that processed a clustering_row

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_clustering_row_performed_failed

scylla_cdc_operations_on_map_performed_failed¶

number of failed CDC operations that processed a map

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_map_performed_failed

scylla_cdc_operations_on_set_performed_failed¶

number of failed CDC operations that processed a set

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_set_performed_failed

scylla_cdc_operations_on_list_performed_failed¶

number of failed CDC operations that processed a list

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_list_performed_failed

scylla_cdc_operations_on_udt_performed_failed¶

number of failed CDC operations that processed a udt

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_udt_performed_failed

scylla_cdc_operations_on_range_tombstone_performed_failed¶

number of failed CDC operations that processed a range_tombstone

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_range_tombstone_performed_failed

scylla_cdc_operations_on_partition_delete_performed_failed¶

number of failed CDC operations that processed a partition_delete

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_partition_delete_performed_failed

scylla_cdc_operations_on_row_delete_performed_failed¶

number of failed CDC operations that processed a row_delete

  • Type: total_operations

  • Component: cdc

  • Key: operations_on_row_delete_performed_failed

scylla_cdc_operations_total¶

number of total CDC operations

  • Type: total_operations

  • Component: cdc

  • Key: operations_total

scylla_cdc_operations_failed¶

number of failed CDC operations

  • Type: total_operations

  • Component: cdc

  • Key: operations_failed

scylla_cdc_preimage_selects_total¶

number of total preimage queries performed

  • Type: total_operations

  • Component: cdc

  • Key: preimage_selects_total

scylla_cdc_preimage_selects_failed¶

number of failed preimage queries performed

  • Type: total_operations

  • Component: cdc

  • Key: preimage_selects_failed

scylla_cdc_operations_with_preimage_total¶

number of total operations that included preimage

  • Type: total_operations

  • Component: cdc

  • Key: operations_with_preimage_total

scylla_cdc_operations_with_preimage_failed¶

number of failed operations that included preimage

  • Type: total_operations

  • Component: cdc

  • Key: operations_with_preimage_failed

scylla_cdc_operations_with_postimage_total¶

number of total operations that included postimage

  • Type: total_operations

  • Component: cdc

  • Key: operations_with_postimage_total

scylla_cdc_operations_with_postimage_failed¶

number of failed operations that included postimage

  • Type: total_operations

  • Component: cdc

  • Key: operations_with_postimage_failed

Logalloc¶

scylla_lsa_total_space_bytes¶

Holds a current size of allocated memory in bytes.

  • Type: gauge

  • Component: lsa

  • Key: total_space_bytes

scylla_lsa_used_space_bytes¶

Holds a current amount of used memory in bytes.

  • Type: gauge

  • Component: lsa

  • Key: used_space_bytes

scylla_lsa_non_lsa_used_space_bytes¶

Holds a current amount of used non-LSA memory.

  • Type: gauge

  • Component: lsa

  • Key: non_lsa_used_space_bytes

scylla_lsa_free_space¶

Holds a current amount of free memory that is under lsa control.

  • Type: gauge

  • Component: lsa

  • Key: free_space

scylla_lsa_occupancy¶

Holds a current portion (in percents) of the used memory.

  • Type: gauge

  • Component: lsa

  • Key: occupancy

scylla_lsa_segments_compacted¶

Counts a number of compacted segments.

  • Type: counter

  • Component: lsa

  • Key: segments_compacted

scylla_lsa_memory_compacted¶

Counts number of bytes which were copied as part of segment compaction.

  • Type: counter

  • Component: lsa

  • Key: memory_compacted

scylla_lsa_memory_allocated¶

Counts number of bytes which were requested from LSA.

  • Type: counter

  • Component: lsa

  • Key: memory_allocated

scylla_lsa_memory_evicted¶

Counts number of bytes which were evicted.

  • Type: counter

  • Component: lsa

  • Key: memory_evicted

scylla_lsa_memory_freed¶

Counts number of bytes which were requested to be freed in LSA.

  • Type: counter

  • Component: lsa

  • Key: memory_freed

scylla_lsa_reclaim_time_ms¶

Total time spent in reclaiming LSA memory back to std allocator.

  • Type: counter

  • Component: lsa

  • Key: reclaim_time_ms

scylla_lsa_evict_time_ms¶

Total time spent in evicting objects, that was not accounted under reclaim_time_ms

  • Type: counter

  • Component: lsa

  • Key: evict_time_ms

scylla_lsa_compact_time_ms¶

Total time spent in segment compaction, that was not accounted under reclaim_time_ms

  • Type: counter

  • Component: lsa

  • Key: compact_time_ms

Main¶

scylla_scylladb_current_version¶

Current ScyllaDB version.

  • Type: gauge

  • Component: scylladb

  • Key: current_version

Manager¶

scylla_hints_for_views_manager_size_of_hints_in_progress¶

Size of hinted mutations that are scheduled to be written.

  • Type: gauge

  • Component: hints_for_views_manager

  • Key: size_of_hints_in_progress

scylla_hints_manager_size_of_hints_in_progress¶

Size of hinted mutations that are scheduled to be written.

  • Type: gauge

  • Component: hints_manager

  • Key: size_of_hints_in_progress

scylla_hints_for_views_manager_written¶

Number of successfully written hints.

  • Type: counter

  • Component: hints_for_views_manager

  • Key: written

scylla_hints_manager_written¶

Number of successfully written hints.

  • Type: counter

  • Component: hints_manager

  • Key: written

scylla_hints_for_views_manager_errors¶

Number of errors during hints writes.

  • Type: counter

  • Component: hints_for_views_manager

  • Key: errors

scylla_hints_manager_errors¶

Number of errors during hints writes.

  • Type: counter

  • Component: hints_manager

  • Key: errors

scylla_hints_for_views_manager_dropped¶

Number of dropped hints.

  • Type: counter

  • Component: hints_for_views_manager

  • Key: dropped

scylla_hints_manager_dropped¶

Number of dropped hints.

  • Type: counter

  • Component: hints_manager

  • Key: dropped

scylla_hints_for_views_manager_sent_total¶

Number of sent hints.

  • Type: counter

  • Component: hints_for_views_manager

  • Key: sent_total

scylla_hints_manager_sent_total¶

Number of sent hints.

  • Type: counter

  • Component: hints_manager

  • Key: sent_total

scylla_hints_for_views_manager_sent_bytes_total¶

The total size of the sent hints (in bytes)

  • Type: counter

  • Component: hints_for_views_manager

  • Key: sent_bytes_total

scylla_hints_manager_sent_bytes_total¶

The total size of the sent hints (in bytes)

  • Type: counter

  • Component: hints_manager

  • Key: sent_bytes_total

scylla_hints_for_views_manager_discarded¶

Number of hints that were discarded during sending (too old, schema changed, etc.).

  • Type: counter

  • Component: hints_for_views_manager

  • Key: discarded

scylla_hints_manager_discarded¶

Number of hints that were discarded during sending (too old, schema changed, etc.).

  • Type: counter

  • Component: hints_manager

  • Key: discarded

scylla_hints_for_views_manager_send_errors¶

Number of unexpected errors during sending, sending will be retried later

  • Type: counter

  • Component: hints_for_views_manager

  • Key: send_errors

scylla_hints_manager_send_errors¶

Number of unexpected errors during sending, sending will be retried later

  • Type: counter

  • Component: hints_manager

  • Key: send_errors

scylla_hints_for_views_manager_corrupted_files¶

Number of hints files that were discarded during sending because the file was corrupted.

  • Type: counter

  • Component: hints_for_views_manager

  • Key: corrupted_files

scylla_hints_manager_corrupted_files¶

Number of hints files that were discarded during sending because the file was corrupted.

  • Type: counter

  • Component: hints_manager

  • Key: corrupted_files

scylla_hints_for_views_manager_pending_drains¶

Number of tasks waiting in the queue for draining hints

  • Type: gauge

  • Component: hints_for_views_manager

  • Key: pending_drains

scylla_hints_manager_pending_drains¶

Number of tasks waiting in the queue for draining hints

  • Type: gauge

  • Component: hints_manager

  • Key: pending_drains

scylla_hints_for_views_manager_pending_sends¶

Number of tasks waiting in the queue for sending a hint

  • Type: gauge

  • Component: hints_for_views_manager

  • Key: pending_sends

scylla_hints_manager_pending_sends¶

Number of tasks waiting in the queue for sending a hint

  • Type: gauge

  • Component: hints_manager

  • Key: pending_sends

Mapreduce service¶

scylla_mapreduce_service_requests_dispatched_to_other_nodes¶

how many mapreduce requests were dispatched to other nodes

  • Type: total_operations

  • Component: mapreduce_service

  • Key: requests_dispatched_to_other_nodes

scylla_mapreduce_service_requests_dispatched_to_own_shards¶

how many mapreduce requests were dispatched to local shards

  • Type: total_operations

  • Component: mapreduce_service

  • Key: requests_dispatched_to_own_shards

scylla_mapreduce_service_requests_executed¶

how many mapreduce requests were executed

  • Type: total_operations

  • Component: mapreduce_service

  • Key: requests_executed

Query processor¶

scylla_query_processor_statements_prepared¶

Counts the total number of parsed CQL requests.

  • Type: counter

  • Component: query_processor

  • Key: statements_prepared

scylla_query_processor_queries¶

Counts queries by consistency level.

  • Type: counter

  • Component: query_processor

  • Key: queries

scylla_cql_reads¶

Counts the total number of CQL SELECT requests.

  • Type: counter

  • Component: cql

  • Key: reads

scylla_cql_inserts¶

Counts the total number of CQL INSERT requests with/without conditions.

  • Type: counter

  • Component: cql

  • Key: inserts

scylla_cql_updates¶

Counts the total number of CQL UPDATE requests with/without conditions.

  • Type: counter

  • Component: cql

  • Key: updates

scylla_cql_deletes¶

Counts the total number of CQL DELETE requests with/without conditions.

  • Type: counter

  • Component: cql

  • Key: deletes

scylla_cql_reads_per_ks¶

Counts the number of CQL SELECT requests executed on particular keyspaces. Label `who’ indicates where the reqs come from (clients or DB internals)

  • Type: counter

  • Component: cql

  • Key: reads_per_ks

scylla_cql_inserts_per_ks¶

Counts the number of CQL INSERT requests executed on particular keyspaces. Label `who’ indicates where the reqs come from (clients or DB internals).

  • Type: counter

  • Component: cql

  • Key: inserts_per_ks

scylla_cql_updates_per_ks¶

Counts the number of CQL UPDATE requests executed on particular keyspaces. Label `who’ indicates where the reqs come from (clients or DB internals)

  • Type: counter

  • Component: cql

  • Key: updates_per_ks

scylla_cql_deletes_per_ks¶

Counts the number of CQL DELETE requests executed on particular keyspaces. Label `who’ indicates where the reqs come from (clients or DB internals)

  • Type: counter

  • Component: cql

  • Key: deletes_per_ks

scylla_cql_batches¶

Counts the total number of CQL BATCH requests without conditions.

  • Type: counter

  • Component: cql

  • Key: batches

scylla_cql_statements_in_batches¶

Counts the total number of sub-statements in CQL BATCH requests without conditions.

  • Type: counter

  • Component: cql

  • Key: statements_in_batches

scylla_cql_batches_pure_logged¶

Counts the total number of LOGGED batches that were executed as LOGGED batches.

  • Type: counter

  • Component: cql

  • Key: batches_pure_logged

scylla_cql_batches_pure_unlogged¶

Counts the total number of UNLOGGED batches that were executed as UNLOGGED batches.

  • Type: counter

  • Component: cql

  • Key: batches_pure_unlogged

scylla_cql_batches_unlogged_from_logged¶

Counts the total number of LOGGED batches that were executed as UNLOGGED batches.

  • Type: counter

  • Component: cql

  • Key: batches_unlogged_from_logged

scylla_cql_rows_read¶

Counts the total number of rows read during CQL requests.

  • Type: counter

  • Component: cql

  • Key: rows_read

scylla_cql_prepared_cache_evictions¶

Counts the number of prepared statements cache entries evictions.

  • Type: counter

  • Component: cql

  • Key: prepared_cache_evictions

scylla_cql_unprivileged_entries_evictions_on_size¶

Counts a number of evictions of prepared statements from the prepared statements cache after they have been used only once. An increasing counter suggests the user may be preparing a different statement for each request instead of reusing the same prepared statement with parameters.

  • Type: counter

  • Component: cql

  • Key: unprivileged_entries_evictions_on_size

scylla_cql_prepared_cache_size¶

A number of entries in the prepared statements cache.

  • Type: gauge

  • Component: cql

  • Key: prepared_cache_size

scylla_cql_prepared_cache_memory_footprint¶

Size (in bytes) of the prepared statements cache.

  • Type: gauge

  • Component: cql

  • Key: prepared_cache_memory_footprint

scylla_cql_secondary_index_creates¶

Counts the total number of CQL CREATE INDEX requests.

  • Type: counter

  • Component: cql

  • Key: secondary_index_creates

scylla_cql_secondary_index_drops¶

Counts the total number of CQL DROP INDEX requests.

  • Type: counter

  • Component: cql

  • Key: secondary_index_drops

scylla_cql_secondary_index_reads¶

Counts the total number of CQL read requests performed using secondary indexes.

  • Type: counter

  • Component: cql

  • Key: secondary_index_reads

scylla_cql_secondary_index_rows_read¶

Counts the total number of rows read during CQL requests performed using secondary indexes.

  • Type: counter

  • Component: cql

  • Key: secondary_index_rows_read

scylla_cql_filtered_read_requests¶

Counts the total number of CQL read requests that required ALLOW FILTERING. See filtered_rows_read_total to compare how many rows needed to be filtered.

  • Type: counter

  • Component: cql

  • Key: filtered_read_requests

scylla_cql_filtered_rows_read_total¶

Counts the total number of rows read during CQL requests that required ALLOW FILTERING. See filtered_rows_matched_total and filtered_rows_dropped_total for information how accurate filtering queries are.

  • Type: counter

  • Component: cql

  • Key: filtered_rows_read_total

scylla_cql_filtered_rows_matched_total¶

Counts the number of rows read during CQL requests that required ALLOW FILTERING and accepted by the filter. Number similar to filtered_rows_read_total indicates that filtering is accurate.

  • Type: counter

  • Component: cql

  • Key: filtered_rows_matched_total

scylla_cql_filtered_rows_dropped_total¶

Counts the number of rows read during CQL requests that required ALLOW FILTERING and dropped by the filter. Number similar to filtered_rows_read_total indicates that filtering is not accurate and might cause performance degradation.

  • Type: counter

  • Component: cql

  • Key: filtered_rows_dropped_total

scylla_cql_select_bypass_caches¶

Counts the number of SELECT query executions with BYPASS CACHE option.

  • Type: counter

  • Component: cql

  • Key: select_bypass_caches

scylla_cql_select_allow_filtering¶

Counts the number of SELECT query executions with ALLOW FILTERING option.

  • Type: counter

  • Component: cql

  • Key: select_allow_filtering

scylla_cql_select_partition_range_scan¶

Counts the number of SELECT query executions requiring partition range scan.

  • Type: counter

  • Component: cql

  • Key: select_partition_range_scan

scylla_cql_select_partition_range_scan_no_bypass_cache¶

Counts the number of SELECT query executions requiring partition range scan without BYPASS CACHE option.

  • Type: counter

  • Component: cql

  • Key: select_partition_range_scan_no_bypass_cache

scylla_cql_select_parallelized¶

Counts the number of parallelized aggregation SELECT query executions.

  • Type: counter

  • Component: cql

  • Key: select_parallelized

scylla_cql_authorized_prepared_statements_cache_evictions¶

Counts the number of authenticated prepared statements cache entries evictions.

  • Type: counter

  • Component: cql

  • Key: authorized_prepared_statements_cache_evictions

scylla_cql_authorized_prepared_statements_privileged_entries_evictions_on_size¶

Counts a number of evictions of prepared statements from the authorized prepared statements cache after they have been used more than once.

  • Type: counter

  • Component: cql

  • Key: authorized_prepared_statements_privileged_entries_evictions_on_size

scylla_cql_authorized_prepared_statements_unprivileged_entries_evictions_on_size¶

Counts a number of evictions of prepared statements from the authorized prepared statements cache after they have been used only once. An increasing counter suggests the user may be preparing a different statement for each request instead of reusing the same prepared statement with parameters.

  • Type: counter

  • Component: cql

  • Key: authorized_prepared_statements_unprivileged_entries_evictions_on_size

scylla_cql_authorized_prepared_statements_cache_size¶

Number of entries in the authenticated prepared statements cache.

  • Type: gauge

  • Component: cql

  • Key: authorized_prepared_statements_cache_size

scylla_cql_user_prepared_auth_cache_footprint¶

Size (in bytes) of the authenticated prepared statements cache.

  • Type: gauge

  • Component: cql

  • Key: user_prepared_auth_cache_footprint

scylla_cql_reverse_queries¶

Counts the number of CQL SELECT requests with reverse ORDER BY order.

  • Type: counter

  • Component: cql

  • Key: reverse_queries

scylla_cql_unpaged_select_queries¶

Counts the total number of unpaged CQL SELECT requests.

  • Type: counter

  • Component: cql

  • Key: unpaged_select_queries

scylla_cql_unpaged_select_queries_per_ks¶

Counts the number of unpaged CQL SELECT requests against particular keyspaces.

  • Type: counter

  • Component: cql

  • Key: unpaged_select_queries_per_ks

scylla_cql_minimum_replication_factor_fail_violations¶

Counts the number of minimum_replication_factor_fail_threshold guardrail violations, i.e. attempts to create a keyspace with RF on one of the DCs below the set guardrail.

  • Type: counter

  • Component: cql

  • Key: minimum_replication_factor_fail_violations

scylla_cql_minimum_replication_factor_warn_violations¶

Counts the number of minimum_replication_factor_warn_threshold guardrail violations, i.e. attempts to create a keyspace with RF on one of the DCs below the set guardrail.

  • Type: counter

  • Component: cql

  • Key: minimum_replication_factor_warn_violations

scylla_cql_maximum_replication_factor_warn_violations¶

Counts the number of maximum_replication_factor_warn_threshold guardrail violations, i.e. attempts to create a keyspace with RF on one of the DCs above the set guardrail.

  • Type: counter

  • Component: cql

  • Key: maximum_replication_factor_warn_violations

scylla_cql_maximum_replication_factor_fail_violations¶

Counts the number of maximum_replication_factor_fail_threshold guardrail violations, i.e. attempts to create a keyspace with RF on one of the DCs above the set guardrail.

  • Type: counter

  • Component: cql

  • Key: maximum_replication_factor_fail_violations

scylla_cql_replication_strategy_warn_list_violations¶

Counts the number of replication_strategy_warn_list guardrail violations, i.e. attempts to set a discouraged replication strategy in a keyspace via CREATE/ALTER KEYSPACE.

  • Type: counter

  • Component: cql

  • Key: replication_strategy_warn_list_violations

scylla_cql_replication_strategy_fail_list_violations¶

Counts the number of replication_strategy_fail_list guardrail violations, i.e. attempts to set a forbidden replication strategy in a keyspace via CREATE/ALTER KEYSPACE.

  • Type: counter

  • Component: cql

  • Key: replication_strategy_fail_list_violations

scylla_cql_forwarded_requests¶

Counts the total number of attempts to forward CQL requests to other nodes. One request may be forwarded multiple times, particularly when a write is handled by a non-replica node.

  • Type: counter

  • Component: cql

  • Key: forwarded_requests

scylla_cql_writes_per_consistency_level¶

Counts the number of writes for each consistency level.

  • Type: counter

  • Component: cql

  • Key: writes_per_consistency_level

scylla_cql_write_consistency_levels_disallowed_violations¶

Counts the number of write_consistency_levels_disallowed guardrail violations, i.e. attempts to write with a forbidden consistency level.

  • Type: counter

  • Component: cql

  • Key: write_consistency_levels_disallowed_violations

scylla_cql_write_consistency_levels_warned_violations¶

Counts the number of write_consistency_levels_warned guardrail violations, i.e. attempts to write with a discouraged consistency level.

  • Type: counter

  • Component: cql

  • Key: write_consistency_levels_warned_violations

Raft group0¶

scylla_raft_group0_status¶

status of the raft group, 1 - normal, 2 - aborted

  • Type: gauge

  • Component: raft_group0

  • Key: status

Rate limiter¶

scylla_per_partition_rate_limiter_allocations¶

Number of times a entry was allocated over an empty/expired entry.

  • Type: counter

  • Component: per_partition_rate_limiter

  • Key: allocations

scylla_per_partition_rate_limiter_successful_lookups¶

Number of times a lookup returned an already allocated entry.

  • Type: counter

  • Component: per_partition_rate_limiter

  • Key: successful_lookups

scylla_per_partition_rate_limiter_failed_allocations¶

Number of times the rate limiter gave up trying to allocate.

  • Type: counter

  • Component: per_partition_rate_limiter

  • Key: failed_allocations

scylla_per_partition_rate_limiter_probe_count¶

Number of probes made during lookups.

  • Type: counter

  • Component: per_partition_rate_limiter

  • Key: probe_count

scylla_per_partition_rate_limiter_load_factor¶

Current load factor of the hash table (upper bound, may be overestimated).

  • Type: gauge

  • Component: per_partition_rate_limiter

  • Key: load_factor

Reader concurrency semaphore¶

scylla_database_sstable_read_queue_overloads¶

Counts the number of times the sstable read queue was overloaded. A non-zero value indicates that we have to drop read requests because they arrive faster than we can serve them.

  • Type: counter

  • Component: database

  • Key: sstable_read_queue_overloads

scylla_database_active_reads¶

Holds the number of currently active read operations.

  • Type: gauge

  • Component: database

  • Key: active_reads

scylla_database_reads_memory_consumption¶

Holds the amount of memory consumed by current read operations.

  • Type: gauge

  • Component: database

  • Key: reads_memory_consumption

scylla_database_queued_reads¶

Holds the number of currently queued read operations.

  • Type: gauge

  • Component: database

  • Key: queued_reads

scylla_database_paused_reads¶

The number of currently active reads that are temporarily paused.

  • Type: gauge

  • Component: database

  • Key: paused_reads

scylla_database_paused_reads_permit_based_evictions¶

The number of paused reads evicted to free up permits. Permits are required for new reads to start, and the database will evict paused reads (if any) to be able to admit new ones, if there is a shortage of permits.

  • Type: counter

  • Component: database

  • Key: paused_reads_permit_based_evictions

scylla_database_reads_shed_due_to_overload¶

The number of reads shed because the admission queue reached its max capacity. When the queue is full, excessive reads are shed to avoid overload.

  • Type: counter

  • Component: database

  • Key: reads_shed_due_to_overload

scylla_database_disk_reads¶

Holds the number of currently active disk read operations.

  • Type: gauge

  • Component: database

  • Key: disk_reads

scylla_database_sstables_read¶

Holds the number of currently read sstables.

  • Type: gauge

  • Component: database

  • Key: sstables_read

scylla_database_total_reads¶

Counts the total number of successful user reads on this shard.

  • Type: counter

  • Component: database

  • Key: total_reads

scylla_database_total_reads_failed¶

Counts the total number of failed user read operations. Add the total_reads to this value to get the total amount of reads issued on this shard.

  • Type: counter

  • Component: database

  • Key: total_reads_failed

Repair¶

scylla_node_ops_finished_percentage¶

Finished percentage of node operation on this shard

  • Type: gauge

  • Component: node_ops

  • Key: finished_percentage

Row cache¶

scylla_cache_bytes_used¶

current bytes used by the cache out of the total size of memory

  • Type: gauge

  • Component: cache

  • Key: bytes_used

scylla_cache_bytes_total¶

total size of memory for the cache

  • Type: gauge

  • Component: cache

  • Key: bytes_total

scylla_cache_partition_hits¶

number of partitions needed by reads and found in cache

  • Type: counter

  • Component: cache

  • Key: partition_hits

scylla_cache_partition_misses¶

number of partitions needed by reads and missing in cache

  • Type: counter

  • Component: cache

  • Key: partition_misses

scylla_cache_partition_insertions¶

total number of partitions added to cache

  • Type: counter

  • Component: cache

  • Key: partition_insertions

scylla_cache_row_hits¶

total number of rows needed by reads and found in cache

  • Type: counter

  • Component: cache

  • Key: row_hits

scylla_cache_dummy_row_hits¶

total number of dummy rows touched by reads in cache

  • Type: counter

  • Component: cache

  • Key: dummy_row_hits

scylla_cache_row_misses¶

total number of rows needed by reads and missing in cache

  • Type: counter

  • Component: cache

  • Key: row_misses

scylla_cache_row_insertions¶

total number of rows added to cache

  • Type: counter

  • Component: cache

  • Key: row_insertions

scylla_cache_row_evictions¶

total number of rows evicted from cache

  • Type: counter

  • Component: cache

  • Key: row_evictions

scylla_cache_row_removals¶

total number of invalidated rows

  • Type: counter

  • Component: cache

  • Key: row_removals

scylla_cache_rows_dropped_by_tombstones¶

Number of rows dropped in cache by a tombstone write

  • Type: counter

  • Component: cache

  • Key: rows_dropped_by_tombstones

scylla_cache_rows_compacted_with_tombstones¶

Number of rows scanned during write of a tombstone for the purpose of compaction in cache

  • Type: counter

  • Component: cache

  • Key: rows_compacted_with_tombstones

scylla_cache_static_row_insertions¶

total number of static rows added to cache

  • Type: counter

  • Component: cache

  • Key: static_row_insertions

scylla_cache_concurrent_misses_same_key¶

total number of operation with misses same key

  • Type: counter

  • Component: cache

  • Key: concurrent_misses_same_key

scylla_cache_partition_merges¶

total number of partitions merged

  • Type: counter

  • Component: cache

  • Key: partition_merges

scylla_cache_partition_evictions¶

total number of evicted partitions

  • Type: counter

  • Component: cache

  • Key: partition_evictions

scylla_cache_partition_removals¶

total number of invalidated partitions

  • Type: counter

  • Component: cache

  • Key: partition_removals

scylla_cache_mispopulations¶

number of entries not inserted by reads

  • Type: counter

  • Component: cache

  • Key: mispopulations

scylla_cache_partitions¶

total number of cached partitions

  • Type: gauge

  • Component: cache

  • Key: partitions

scylla_cache_rows¶

total number of cached rows

  • Type: gauge

  • Component: cache

  • Key: rows

scylla_cache_reads¶

number of started reads

  • Type: counter

  • Component: cache

  • Key: reads

scylla_cache_reads_with_misses¶

number of reads which had to read from sstables

  • Type: counter

  • Component: cache

  • Key: reads_with_misses

scylla_cache_active_reads¶

number of currently active reads

  • Type: gauge

  • Component: cache

  • Key: active_reads

scylla_cache_sstable_reader_recreations¶

number of times sstable reader was recreated due to memtable flush

  • Type: counter

  • Component: cache

  • Key: sstable_reader_recreations

scylla_cache_sstable_partition_skips¶

number of times sstable reader was fast forwarded across partitions

  • Type: counter

  • Component: cache

  • Key: sstable_partition_skips

scylla_cache_sstable_row_skips¶

number of times sstable reader was fast forwarded within a partition

  • Type: counter

  • Component: cache

  • Key: sstable_row_skips

scylla_cache_pinned_dirty_memory_overload¶

amount of pinned bytes that we tried to unpin over the limit. This should sit constantly at 0, and any number different than 0 is indicative of a bug

  • Type: counter

  • Component: cache

  • Key: pinned_dirty_memory_overload

scylla_cache_rows_processed_from_memtable¶

total number of rows in memtables which were processed during cache update on memtable flush

  • Type: counter

  • Component: cache

  • Key: rows_processed_from_memtable

scylla_cache_rows_dropped_from_memtable¶

total number of rows in memtables which were dropped during cache update on memtable flush

  • Type: counter

  • Component: cache

  • Key: rows_dropped_from_memtable

scylla_cache_rows_merged_from_memtable¶

total number of rows in memtables which were merged with existing rows during cache update on memtable flush

  • Type: counter

  • Component: cache

  • Key: rows_merged_from_memtable

scylla_cache_range_tombstone_reads¶

total amount of range tombstones processed during read

  • Type: counter

  • Component: cache

  • Key: range_tombstone_reads

scylla_cache_row_tombstone_reads¶

total amount of row tombstones processed during read

  • Type: counter

  • Component: cache

  • Key: row_tombstone_reads

scylla_cache_rows_compacted¶

total amount of attempts to compact expired rows during read

  • Type: counter

  • Component: cache

  • Key: rows_compacted

scylla_cache_rows_compacted_away¶

total amount of compacted and removed rows during read

  • Type: counter

  • Component: cache

  • Key: rows_compacted_away

Row level¶

scylla_repair_tx_row_nr¶

Total number of rows sent on this shard.

  • Type: counter

  • Component: repair

  • Key: tx_row_nr

scylla_repair_rx_row_nr¶

Total number of rows received on this shard.

  • Type: counter

  • Component: repair

  • Key: rx_row_nr

scylla_repair_tx_row_bytes¶

Total bytes of rows sent on this shard.

  • Type: counter

  • Component: repair

  • Key: tx_row_bytes

scylla_repair_rx_row_bytes¶

Total bytes of rows received on this shard.

  • Type: counter

  • Component: repair

  • Key: rx_row_bytes

scylla_repair_tx_hashes_nr¶

Total number of row hashes sent on this shard.

  • Type: counter

  • Component: repair

  • Key: tx_hashes_nr

scylla_repair_rx_hashes_nr¶

Total number of row hashes received on this shard.

  • Type: counter

  • Component: repair

  • Key: rx_hashes_nr

scylla_repair_row_from_disk_nr¶

Total number of rows read from disk on this shard.

  • Type: counter

  • Component: repair

  • Key: row_from_disk_nr

scylla_repair_row_from_disk_bytes¶

Total bytes of rows read from disk on this shard.

  • Type: counter

  • Component: repair

  • Key: row_from_disk_bytes

scylla_repair_inc_sst_skipped_bytes¶

Total number of bytes skipped from sstables for incremental repair on this shard.

  • Type: counter

  • Component: repair

  • Key: inc_sst_skipped_bytes

scylla_repair_inc_sst_read_bytes¶

Total number of bytes read from sstables for incremental repair on this shard.

  • Type: counter

  • Component: repair

  • Key: inc_sst_read_bytes

scylla_repair_tablet_time_ms¶

Time spent on tablet repair on this shard in milliseconds.

  • Type: counter

  • Component: repair

  • Key: tablet_time_ms

Secondary index manager¶

scylla_index_query_latencies¶

Index query latencies

  • Type: histogram

  • Component: index

  • Key: query_latencies

Segment manager¶

scylla_logstor_sm_segments_in_use¶

Counts number of segments currently in use.

  • Type: gauge

  • Component: logstor_sm

  • Key: segments_in_use

scylla_logstor_sm_free_segments¶

Counts number of free segments currently available.

  • Type: gauge

  • Component: logstor_sm

  • Key: free_segments

scylla_logstor_sm_segment_pool_size¶

Counts number of segments in the segment pool.

  • Type: gauge

  • Component: logstor_sm

  • Key: segment_pool_size

scylla_logstor_sm_segment_pool_segments_put¶

Counts number of segments returned to the segment pool.

  • Type: counter

  • Component: logstor_sm

  • Key: segment_pool_segments_put

scylla_logstor_sm_segment_pool_normal_segments_get¶

Counts number of segments taken from the segment pool for normal writes.

  • Type: counter

  • Component: logstor_sm

  • Key: segment_pool_normal_segments_get

scylla_logstor_sm_segment_pool_compaction_segments_get¶

Counts number of segments taken from the segment pool for compaction.

  • Type: counter

  • Component: logstor_sm

  • Key: segment_pool_compaction_segments_get

scylla_logstor_sm_segment_pool_separator_segments_get¶

Counts number of segments taken from the segment pool for separator writes.

  • Type: counter

  • Component: logstor_sm

  • Key: segment_pool_separator_segments_get

scylla_logstor_sm_segment_pool_normal_segments_wait¶

Counts number of times normal writes had to wait for a segment to become available in the segment pool.

  • Type: counter

  • Component: logstor_sm

  • Key: segment_pool_normal_segments_wait

scylla_logstor_sm_bytes_written¶

Counts number of bytes written to the disk.

  • Type: counter

  • Component: logstor_sm

  • Key: bytes_written

scylla_logstor_sm_data_bytes_written¶

Counts number of data bytes written to the disk.

  • Type: counter

  • Component: logstor_sm

  • Key: data_bytes_written

scylla_logstor_sm_bytes_read¶

Counts number of bytes read from the disk.

  • Type: counter

  • Component: logstor_sm

  • Key: bytes_read

scylla_logstor_sm_bytes_freed¶

Counts number of data bytes freed.

  • Type: counter

  • Component: logstor_sm

  • Key: bytes_freed

scylla_logstor_sm_segments_allocated¶

Counts number of segments allocated.

  • Type: counter

  • Component: logstor_sm

  • Key: segments_allocated

scylla_logstor_sm_segments_freed¶

Counts number of segments freed.

  • Type: counter

  • Component: logstor_sm

  • Key: segments_freed

scylla_logstor_sm_disk_usage¶

Total disk usage.

  • Type: gauge

  • Component: logstor_sm

  • Key: disk_usage

scylla_logstor_sm_compaction_bytes_written¶

Counts number of bytes written to the disk by compaction.

  • Type: counter

  • Component: logstor_sm

  • Key: compaction_bytes_written

scylla_logstor_sm_compaction_data_bytes_written¶

Counts number of data bytes written to the disk by compaction.

  • Type: counter

  • Component: logstor_sm

  • Key: compaction_data_bytes_written

scylla_logstor_sm_segments_compacted¶

Counts number of segments compacted.

  • Type: counter

  • Component: logstor_sm

  • Key: segments_compacted

scylla_logstor_sm_compaction_segments_freed¶

Counts number of segments freed by compaction.

  • Type: counter

  • Component: logstor_sm

  • Key: compaction_segments_freed

scylla_logstor_sm_compaction_records_skipped¶

Counts number of records skipped during compaction.

  • Type: counter

  • Component: logstor_sm

  • Key: compaction_records_skipped

scylla_logstor_sm_compaction_records_rewritten¶

Counts number of records rewritten during compaction.

  • Type: counter

  • Component: logstor_sm

  • Key: compaction_records_rewritten

scylla_logstor_sm_separator_bytes_written¶

Counts number of bytes written to the separator.

  • Type: counter

  • Component: logstor_sm

  • Key: separator_bytes_written

scylla_logstor_sm_separator_data_bytes_written¶

Counts number of data bytes written to the separator.

  • Type: counter

  • Component: logstor_sm

  • Key: separator_data_bytes_written

scylla_logstor_sm_separator_buffer_flushed¶

Counts number of times the separator buffer has been flushed.

  • Type: counter

  • Component: logstor_sm

  • Key: separator_buffer_flushed

scylla_logstor_sm_separator_segments_freed¶

Counts number of segments freed by the separator.

  • Type: counter

  • Component: logstor_sm

  • Key: separator_segments_freed

scylla_logstor_sm_separator_flow_control_delay¶

Current delay applied to writes to control separator debt in microseconds.

  • Type: gauge

  • Component: logstor_sm

  • Key: separator_flow_control_delay

Server¶

scylla_raft_add_entries¶

Number of entries added on this node, the log_entry_type label can be command, dummy or config

  • Type: total_operations

  • Component: raft

  • Key: add_entries

scylla_raft_messages_received¶

Number of messages received, the message_type determines the type of message

  • Type: total_operations

  • Component: raft

  • Key: messages_received

scylla_raft_messages_sent¶

Number of messages sent, the message_type determines the type of message

  • Type: total_operations

  • Component: raft

  • Key: messages_sent

scylla_raft_waiter_awoken¶

Number of waiters that got result back

  • Type: total_operations

  • Component: raft

  • Key: waiter_awoken

scylla_raft_waiter_dropped¶

Number of waiters that did not get result back

  • Type: total_operations

  • Component: raft

  • Key: waiter_dropped

scylla_raft_polls¶

Number of times raft state machine polled

  • Type: total_operations

  • Component: raft

  • Key: polls

scylla_raft_store_term_and_vote¶

Number of times term and vote persisted

  • Type: total_operations

  • Component: raft

  • Key: store_term_and_vote

scylla_raft_store_snapshot¶

Number of snapshots persisted

  • Type: total_operations

  • Component: raft

  • Key: store_snapshot

scylla_raft_sm_load_snapshot¶

Number of times user state machine reloaded with a snapshot

  • Type: total_operations

  • Component: raft

  • Key: sm_load_snapshot

scylla_raft_truncate_persisted_log¶

Number of times log truncated on storage

  • Type: total_operations

  • Component: raft

  • Key: truncate_persisted_log

scylla_raft_persisted_log_entries¶

Number of log entries persisted

  • Type: total_operations

  • Component: raft

  • Key: persisted_log_entries

scylla_raft_queue_entries_for_apply¶

Number of log entries queued to be applied

  • Type: total_operations

  • Component: raft

  • Key: queue_entries_for_apply

scylla_raft_applied_entries¶

Number of log entries applied

  • Type: total_operations

  • Component: raft

  • Key: applied_entries

scylla_raft_snapshots_taken¶

Number of times user’s state machine snapshotted

  • Type: total_operations

  • Component: raft

  • Key: snapshots_taken

scylla_raft_in_memory_log_size¶

size of in-memory part of the log

  • Type: gauge

  • Component: raft

  • Key: in_memory_log_size

scylla_raft_log_memory_usage¶

memory usage of in-memory part of the log in bytes

  • Type: gauge

  • Component: raft

  • Key: log_memory_usage

scylla_raft_log_last_index¶

term of the last log entry

  • Type: gauge

  • Component: raft

  • Key: log_last_index

scylla_raft_log_last_term¶

index of the last log entry

  • Type: gauge

  • Component: raft

  • Key: log_last_term

scylla_raft_snapshot_last_index¶

term of the snapshot

  • Type: gauge

  • Component: raft

  • Key: snapshot_last_index

scylla_raft_snapshot_last_term¶

index of the snapshot

  • Type: gauge

  • Component: raft

  • Key: snapshot_last_term

scylla_raft_state¶

current state: 0 - follower, 1 - candidate, 2 - leader

  • Type: gauge

  • Component: raft

  • Key: state

scylla_raft_commit_index¶

commit index

  • Type: gauge

  • Component: raft

  • Key: commit_index

scylla_raft_apply_index¶

applied index

  • Type: gauge

  • Component: raft

  • Key: apply_index

Sstables¶

scylla_sstables_index_page_cache_hits¶

Index page cache requests which were served from cache

  • Type: counter

  • Component: sstables

  • Key: index_page_cache_hits

scylla_sstables_index_page_cache_misses¶

Index page cache requests which had to perform I/O

  • Type: counter

  • Component: sstables

  • Key: index_page_cache_misses

scylla_sstables_index_page_cache_evictions¶

Total number of index page cache pages which have been evicted

  • Type: counter

  • Component: sstables

  • Key: index_page_cache_evictions

scylla_sstables_index_page_cache_populations¶

Total number of index page cache pages which were inserted into the cache

  • Type: counter

  • Component: sstables

  • Key: index_page_cache_populations

scylla_sstables_index_page_cache_bytes¶

Total number of bytes cached in the index page cache

  • Type: gauge

  • Component: sstables

  • Key: index_page_cache_bytes

scylla_sstables_index_page_cache_bytes_in_std¶

Total number of bytes in temporary buffers which live in the std allocator

  • Type: gauge

  • Component: sstables

  • Key: index_page_cache_bytes_in_std

scylla_sstables_index_page_hits¶

Index page requests which could be satisfied without waiting

  • Type: counter

  • Component: sstables

  • Key: index_page_hits

scylla_sstables_index_page_misses¶

Index page requests which initiated a read from disk

  • Type: counter

  • Component: sstables

  • Key: index_page_misses

scylla_sstables_index_page_blocks¶

Index page requests which needed to wait due to page not being loaded yet

  • Type: counter

  • Component: sstables

  • Key: index_page_blocks

scylla_sstables_index_page_evictions¶

Index pages which got evicted from memory

  • Type: counter

  • Component: sstables

  • Key: index_page_evictions

scylla_sstables_index_page_populations¶

Index pages which got populated into memory

  • Type: counter

  • Component: sstables

  • Key: index_page_populations

scylla_sstables_index_page_used_bytes¶

Amount of bytes used by index pages in memory

  • Type: gauge

  • Component: sstables

  • Key: index_page_used_bytes

scylla_sstables_pi_cache_hits_l0¶

Number of requests for promoted index block in state l0 which didn’t have to go to the page cache

  • Type: counter

  • Component: sstables

  • Key: pi_cache_hits_l0

scylla_sstables_pi_cache_hits_l1¶

Number of requests for promoted index block in state l1 which didn’t have to go to the page cache

  • Type: counter

  • Component: sstables

  • Key: pi_cache_hits_l1

scylla_sstables_pi_cache_hits_l2¶

Number of requests for promoted index block in state l2 which didn’t have to go to the page cache

  • Type: counter

  • Component: sstables

  • Key: pi_cache_hits_l2

scylla_sstables_pi_cache_misses_l0¶

Number of requests for promoted index block in state l0 which had to go to the page cache

  • Type: counter

  • Component: sstables

  • Key: pi_cache_misses_l0

scylla_sstables_pi_cache_misses_l1¶

Number of requests for promoted index block in state l1 which had to go to the page cache

  • Type: counter

  • Component: sstables

  • Key: pi_cache_misses_l1

scylla_sstables_pi_cache_misses_l2¶

Number of requests for promoted index block in state l2 which had to go to the page cache

  • Type: counter

  • Component: sstables

  • Key: pi_cache_misses_l2

scylla_sstables_pi_cache_populations¶

Number of promoted index blocks which got inserted

  • Type: counter

  • Component: sstables

  • Key: pi_cache_populations

scylla_sstables_pi_cache_evictions¶

Number of promoted index blocks which got evicted

  • Type: counter

  • Component: sstables

  • Key: pi_cache_evictions

scylla_sstables_pi_cache_bytes¶

Number of bytes currently used by cached promoted index blocks

  • Type: gauge

  • Component: sstables

  • Key: pi_cache_bytes

scylla_sstables_pi_cache_block_count¶

Number of promoted index blocks currently cached

  • Type: gauge

  • Component: sstables

  • Key: pi_cache_block_count

scylla_sstables_partition_writes¶

Number of partitions written

  • Type: counter

  • Component: sstables

  • Key: partition_writes

scylla_sstables_static_row_writes¶

Number of static rows written

  • Type: counter

  • Component: sstables

  • Key: static_row_writes

scylla_sstables_row_writes¶

Number of clustering rows written

  • Type: counter

  • Component: sstables

  • Key: row_writes

scylla_sstables_cell_writes¶

Number of cells written

  • Type: counter

  • Component: sstables

  • Key: cell_writes

scylla_sstables_tombstone_writes¶

Number of tombstones written

  • Type: counter

  • Component: sstables

  • Key: tombstone_writes

scylla_sstables_range_tombstone_writes¶

Number of range tombstones written

  • Type: counter

  • Component: sstables

  • Key: range_tombstone_writes

scylla_sstables_pi_auto_scale_events¶

Number of promoted index auto-scaling events

  • Type: counter

  • Component: sstables

  • Key: pi_auto_scale_events

scylla_sstables_range_tombstone_reads¶

Number of range tombstones read

  • Type: counter

  • Component: sstables

  • Key: range_tombstone_reads

scylla_sstables_row_tombstone_reads¶

Number of row tombstones read

  • Type: counter

  • Component: sstables

  • Key: row_tombstone_reads

scylla_sstables_cell_tombstone_writes¶

Number of cell tombstones written

  • Type: counter

  • Component: sstables

  • Key: cell_tombstone_writes

scylla_sstables_single_partition_reads¶

Number of single partition flat mutation reads

  • Type: counter

  • Component: sstables

  • Key: single_partition_reads

scylla_sstables_range_partition_reads¶

Number of partition range flat mutation reads

  • Type: counter

  • Component: sstables

  • Key: range_partition_reads

scylla_sstables_partition_reads¶

Number of partitions read

  • Type: counter

  • Component: sstables

  • Key: partition_reads

scylla_sstables_partition_seeks¶

Number of partitions seeked

  • Type: counter

  • Component: sstables

  • Key: partition_seeks

scylla_sstables_row_reads¶

Number of rows read

  • Type: counter

  • Component: sstables

  • Key: row_reads

scylla_sstables_capped_local_deletion_time¶

Number of SStables with tombstones whose local deletion time was capped at the maximum allowed value in Statistics

  • Type: counter

  • Component: sstables

  • Key: capped_local_deletion_time

scylla_sstables_capped_tombstone_deletion_time¶

Number of tombstones whose local deletion time was capped at the maximum allowed value

  • Type: counter

  • Component: sstables

  • Key: capped_tombstone_deletion_time

scylla_sstables_total_open_for_reading¶

Counter of sstables open for reading

  • Type: counter

  • Component: sstables

  • Key: total_open_for_reading

scylla_sstables_total_open_for_writing¶

Counter of sstables open for writing

  • Type: counter

  • Component: sstables

  • Key: total_open_for_writing

scylla_sstables_currently_open_for_reading¶

Number of sstables currently open for reading

  • Type: gauge

  • Component: sstables

  • Key: currently_open_for_reading

scylla_sstables_currently_open_for_writing¶

Number of sstables currently open for writing

  • Type: gauge

  • Component: sstables

  • Key: currently_open_for_writing

scylla_sstables_total_deleted¶

Counter of deleted sstables

  • Type: counter

  • Component: sstables

  • Key: total_deleted

scylla_sstables_bloom_filter_memory_size¶

Bloom filter memory usage in bytes.

  • Type: gauge

  • Component: sstables

  • Key: bloom_filter_memory_size

Sstables manager¶

scylla_object_storage_memory_usage¶

Total number of bytes consumed by object storage client

  • Type: gauge

  • Component: object_storage

  • Key: memory_usage

Stats¶

scylla_alternator_operation¶

number of operations via Alternator API

  • Type: total_operations

  • Component: alternator

  • Key: operation

scylla_alternator_op_latency¶

Latency histogram of an operation via Alternator API

  • Type: histogram

  • Component: alternator

  • Key: op_latency

scylla_alternator_op_latency_summary¶

Latency summary of an operation via Alternator API

  • Type: summary

  • Component: alternator

  • Key: op_latency_summary

scylla_alternator_unsupported_operations¶

number of unsupported operations via Alternator API

  • Type: total_operations

  • Component: alternator

  • Key: unsupported_operations

scylla_alternator_total_operations¶

number of total operations via Alternator API

  • Type: total_operations

  • Component: alternator

  • Key: total_operations

scylla_alternator_reads_before_write¶

number of performed read-before-write operations

  • Type: total_operations

  • Component: alternator

  • Key: reads_before_write

scylla_alternator_write_using_lwt¶

number of writes that used LWT

  • Type: total_operations

  • Component: alternator

  • Key: write_using_lwt

scylla_alternator_shard_bounce_for_lwt¶

number writes that had to be bounced from this shard because of LWT requirements

  • Type: total_operations

  • Component: alternator

  • Key: shard_bounce_for_lwt

scylla_alternator_requests_blocked_memory¶

Counts a number of requests blocked due to memory pressure.

  • Type: total_operations

  • Component: alternator

  • Key: requests_blocked_memory

scylla_alternator_requests_shed¶

Counts a number of requests shed due to overload.

  • Type: total_operations

  • Component: alternator

  • Key: requests_shed

scylla_alternator_filtered_rows_read_total¶

number of rows read during filtering operations

  • Type: total_operations

  • Component: alternator

  • Key: filtered_rows_read_total

scylla_alternator_filtered_rows_matched_total¶

number of rows read and matched during filtering operations

  • Type: total_operations

  • Component: alternator

  • Key: filtered_rows_matched_total

scylla_alternator_rcu_total¶

total number of consumed read units

  • Type: counter

  • Component: alternator

  • Key: rcu_total

scylla_alternator_wcu_total¶

total number of consumed write units

  • Type: counter

  • Component: alternator

  • Key: wcu_total

scylla_alternator_filtered_rows_dropped_total¶

number of rows read and dropped during filtering operations

  • Type: total_operations

  • Component: alternator

  • Key: filtered_rows_dropped_total

scylla_alternator_batch_item_count¶

The total number of items processed across all batches

  • Type: counter

  • Component: alternator

  • Key: batch_item_count

scylla_alternator_batch_item_count_histogram¶

Histogram of the number of items in a batch request

  • Type: histogram

  • Component: alternator

  • Key: batch_item_count_histogram

scylla_alternator_operation_size_kb¶

Histogram of item sizes involved in a request

  • Type: histogram

  • Component: alternator

  • Key: operation_size_kb

scylla_alternator_expression_cache_evictions¶

Counts number of entries evicted from expressions cache

  • Type: total_operations

  • Component: alternator

  • Key: expression_cache_evictions

scylla_alternator_expression_cache_hits¶

Counts number of hits of cached expressions

  • Type: total_operations

  • Component: alternator

  • Key: expression_cache_hits

scylla_alternator_expression_cache_misses¶

Counts number of misses of cached expressions

  • Type: total_operations

  • Component: alternator

  • Key: expression_cache_misses

scylla_alternator_authentication_failures¶

total number of authentication failures

  • Type: counter

  • Component: alternator

  • Key: authentication_failures

scylla_alternator_authorization_failures¶

total number of authorization failures

  • Type: counter

  • Component: alternator

  • Key: authorization_failures

Storage proxy¶

scylla_storage_proxy_coordinator_write_latency_summary¶

Write latency summary

  • Type: summary

  • Component: storage_proxy_coordinator

  • Key: write_latency_summary

scylla_storage_proxy_coordinator_write_latency¶

The general write latency histogram

  • Type: histogram

  • Component: storage_proxy_coordinator

  • Key: write_latency

scylla_storage_proxy_coordinator_foreground_writes¶

number of currently pending foreground write requests

  • Type: queue_length

  • Component: storage_proxy_coordinator

  • Key: foreground_writes

scylla_storage_proxy_coordinator_background_writes¶

number of currently pending background write requests

  • Type: queue_length

  • Component: storage_proxy_coordinator

  • Key: background_writes

scylla_storage_proxy_coordinator_current_throttled_base_writes¶

number of currently throttled base replica write requests

  • Type: queue_length

  • Component: storage_proxy_coordinator

  • Key: current_throttled_base_writes

scylla_storage_proxy_coordinator_throttled_base_writes_total¶

number of throttled base replica write requests, a throttled write is one whose response was delayed, see mv_flow_control_delay_total

  • Type: counter

  • Component: storage_proxy_coordinator

  • Key: throttled_base_writes_total

scylla_storage_proxy_coordinator_last_mv_flow_control_delay¶

delay (in seconds) added for MV flow control in the last request

  • Type: gauge

  • Component: storage_proxy_coordinator

  • Key: last_mv_flow_control_delay

scylla_storage_proxy_coordinator_mv_flow_control_delay_total¶

total delay (in microseconds) added for MV flow control, to delay the response sent to finished writes, divide this by throttled_base_writes_total to find the average delay

  • Type: counter

  • Component: storage_proxy_coordinator

  • Key: mv_flow_control_delay_total

scylla_storage_proxy_coordinator_throttled_writes¶

number of throttled write requests

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: throttled_writes

scylla_storage_proxy_coordinator_write_timeouts¶

number of write request failed due to a timeout

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: write_timeouts

scylla_storage_proxy_coordinator_write_unavailable¶

number write requests failed due to an unavailable error

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: write_unavailable

scylla_storage_proxy_coordinator_write_rate_limited¶

number of write requests which were rejected because rate limit for the partition was reached. rejected_by_coordinator indicates if it was rejected by the coordinator or the replica

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: write_rate_limited

scylla_storage_proxy_coordinator_background_writes_failed¶

number of write requests that failed after CL was reached

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: background_writes_failed

scylla_storage_proxy_coordinator_writes_coordinator_outside_replica_set¶

number of CQL write requests which arrived to a non-replica and had to be forwarded to a replica

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: writes_coordinator_outside_replica_set

scylla_storage_proxy_coordinator_reads_coordinator_outside_replica_set¶

number of CQL read requests which arrived to a non-replica and had to be forwarded to a replica

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: reads_coordinator_outside_replica_set

scylla_storage_proxy_coordinator_writes_failed_due_to_too_many_in_flight_hints¶

number of CQL write requests which failed because the hinted handoff mechanism is overloaded and cannot store any more in-flight hints

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: writes_failed_due_to_too_many_in_flight_hints

scylla_storage_proxy_coordinator_read_latency_summary¶

Read latency summary

  • Type: summary

  • Component: storage_proxy_coordinator

  • Key: read_latency_summary

scylla_storage_proxy_coordinator_read_latency¶

The general read latency histogram

  • Type: histogram

  • Component: storage_proxy_coordinator

  • Key: read_latency

scylla_storage_proxy_coordinator_foreground_reads¶

number of currently pending foreground read requests

  • Type: queue_length

  • Component: storage_proxy_coordinator

  • Key: foreground_reads

scylla_storage_proxy_coordinator_background_reads¶

number of currently pending background read requests

  • Type: queue_length

  • Component: storage_proxy_coordinator

  • Key: background_reads

scylla_storage_proxy_coordinator_read_retries¶

number of read retry attempts

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: read_retries

scylla_storage_proxy_coordinator_canceled_read_repairs¶

number of global read repairs canceled due to a concurrent write

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: canceled_read_repairs

scylla_storage_proxy_coordinator_foreground_read_repairs¶

number of foreground read repairs

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: foreground_read_repairs

scylla_storage_proxy_coordinator_background_read_repairs¶

number of background read repairs

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: background_read_repairs

scylla_storage_proxy_coordinator_read_timeouts¶

number of read request failed due to a timeout

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: read_timeouts

scylla_storage_proxy_coordinator_read_unavailable¶

number read requests failed due to an unavailable error

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: read_unavailable

scylla_storage_proxy_coordinator_read_rate_limited¶

number of read requests which were rejected because rate limit for the partition was reached. rejected_by_coordinator indicates if it was rejected by the coordinator or the replica

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: read_rate_limited

scylla_storage_proxy_coordinator_range_timeouts¶

number of range read operations failed due to a timeout

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: range_timeouts

scylla_storage_proxy_coordinator_range_unavailable¶

number of range read operations failed due to an unavailable error

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: range_unavailable

scylla_storage_proxy_coordinator_speculative_digest_reads¶

number of speculative digest read requests that were sent

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: speculative_digest_reads

scylla_storage_proxy_coordinator_speculative_data_reads¶

number of speculative data read requests that were sent

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: speculative_data_reads

scylla_storage_proxy_coordinator_cas_read_latency_summary¶

CAS read latency summary

  • Type: summary

  • Component: storage_proxy_coordinator

  • Key: cas_read_latency_summary

scylla_storage_proxy_coordinator_cas_write_latency_summary¶

CAS write latency summary

  • Type: summary

  • Component: storage_proxy_coordinator

  • Key: cas_write_latency_summary

scylla_storage_proxy_coordinator_cas_read_latency¶

Transactional read latency histogram

  • Type: histogram

  • Component: storage_proxy_coordinator

  • Key: cas_read_latency

scylla_storage_proxy_coordinator_cas_write_latency¶

Transactional write latency histogram

  • Type: histogram

  • Component: storage_proxy_coordinator

  • Key: cas_write_latency

scylla_storage_proxy_coordinator_cas_write_timeouts¶

number of transactional write request failed due to a timeout

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_write_timeouts

scylla_storage_proxy_coordinator_cas_write_unavailable¶

number of transactional write requests failed due to an unavailable error

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_write_unavailable

scylla_storage_proxy_coordinator_cas_read_timeouts¶

number of transactional read request failed due to a timeout

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_read_timeouts

scylla_storage_proxy_coordinator_cas_read_unavailable¶

number of transactional read requests failed due to an unavailable error

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_read_unavailable

scylla_storage_proxy_coordinator_cas_read_unfinished_commit¶

number of transaction commit attempts that occurred on read

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_read_unfinished_commit

scylla_storage_proxy_coordinator_cas_write_unfinished_commit¶

number of transaction commit attempts that occurred on write

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_write_unfinished_commit

scylla_storage_proxy_coordinator_cas_write_condition_not_met¶

number of transaction preconditions that did not match current values

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_write_condition_not_met

scylla_storage_proxy_coordinator_cas_write_timeout_due_to_uncertainty¶

how many times write timeout was reported because of uncertainty in the result

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_write_timeout_due_to_uncertainty

scylla_storage_proxy_coordinator_cas_failed_read_round_optimization¶

CAS read rounds issued only if previous value is missing on some replica

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_failed_read_round_optimization

scylla_storage_proxy_coordinator_cas_read_contention¶

how many contended reads were encountered

  • Type: histogram

  • Component: storage_proxy_coordinator

  • Key: cas_read_contention

scylla_storage_proxy_coordinator_cas_write_contention¶

how many contended writes were encountered

  • Type: histogram

  • Component: storage_proxy_coordinator

  • Key: cas_write_contention

scylla_storage_proxy_coordinator_cas_prune¶

how many times paxos prune was done after successful cas operation

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_prune

scylla_storage_proxy_coordinator_cas_dropped_prune¶

how many times a coordinator did not perform prune after cas

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_dropped_prune

scylla_storage_proxy_coordinator_cas_total_operations¶

number of total paxos operations executed (reads and writes)

  • Type: total_operations

  • Component: storage_proxy_coordinator

  • Key: cas_total_operations

scylla_storage_proxy_coordinator_cas_foreground¶

how many paxos operations that did not yet produce a result are running

  • Type: gauge

  • Component: storage_proxy_coordinator

  • Key: cas_foreground

scylla_storage_proxy_coordinator_cas_background¶

how many paxos operations are still running after a result was already returned

  • Type: gauge

  • Component: storage_proxy_coordinator

  • Key: cas_background

scylla_storage_proxy_replica_received_counter_updates¶

number of counter updates received by this node acting as an update leader

  • Type: total_operations

  • Component: storage_proxy_replica

  • Key: received_counter_updates

scylla_storage_proxy_replica_received_mutations¶

number of mutations received by a replica Node

  • Type: total_operations

  • Component: storage_proxy_replica

  • Key: received_mutations

scylla_storage_proxy_replica_forwarded_mutations¶

number of mutations forwarded to other replica Nodes

  • Type: total_operations

  • Component: storage_proxy_replica

  • Key: forwarded_mutations

scylla_storage_proxy_replica_forwarding_errors¶

number of errors during forwarding mutations to other replica Nodes

  • Type: total_operations

  • Component: storage_proxy_replica

  • Key: forwarding_errors

scylla_storage_proxy_replica_reads¶

number of remote reads this Node received. op_type label could be data, mutation_data or digest

  • Type: total_operations

  • Component: storage_proxy_replica

  • Key: reads

scylla_storage_proxy_replica_cross_shard_ops¶

number of operations that crossed a shard boundary

  • Type: total_operations

  • Component: storage_proxy_replica

  • Key: cross_shard_ops

scylla_storage_proxy_replica_fenced_out_requests¶

number of requests that resulted in a stale_topology_exception

  • Type: total_operations

  • Component: storage_proxy_replica

  • Key: fenced_out_requests

scylla_storage_proxy_replica_cas_dropped_prune¶

how many times a coordinator did not perform prune after cas

  • Type: total_operations

  • Component: storage_proxy_replica

  • Key: cas_dropped_prune

scylla_storage_proxy_replica_received_hints_total¶

number of hints and MV hints received by this node

  • Type: counter

  • Component: storage_proxy_replica

  • Key: received_hints_total

scylla_storage_proxy_replica_received_hints_bytes_total¶

total size of hints and MV hints received by this node

  • Type: counter

  • Component: storage_proxy_replica

  • Key: received_hints_bytes_total

scylla_storage_proxy_coordinator_total_write_attempts_local_node¶

total number of write requestson a local Node

  • Type: counter

  • Component: storage_proxy_coordinator

  • Key: total_write_attempts_local_node

scylla_storage_proxy_coordinator_write_errors_local_node¶

number of write requests that failedon a local Node

  • Type: counter

  • Component: storage_proxy_coordinator

  • Key: write_errors_local_node

scylla_storage_proxy_coordinator_background_replica_writes_failed_local_node¶

background_replica_writes_failedon a local Node

  • Type: counter

  • Component: storage_proxy_coordinator

  • Key: background_replica_writes_failed_local_node

scylla_storage_proxy_coordinator_read_repair_write_attempts_local_node¶

number of write operations in a read repair contexton a local Node

  • Type: counter

  • Component: storage_proxy_coordinator

  • Key: read_repair_write_attempts_local_node

scylla_storage_proxy_coordinator_total_write_attempts_remote_node¶

total number of write requests when communicating with external Nodes in another DC

  • Type: counter

  • Component: storage_proxy_coordinator

  • Key: total_write_attempts_remote_node

scylla_storage_proxy_coordinator_write_errors_remote_node¶

number of write requests that failed when communicating with external Nodes in another DC

  • Type: counter

  • Component: storage_proxy_coordinator

  • Key: write_errors_remote_node

scylla_storage_proxy_coordinator_background_replica_writes_failed_remote_node¶

background_replica_writes_failed when communicating with external Nodes in another DC

  • Type: counter

  • Component: storage_proxy_coordinator

  • Key: background_replica_writes_failed_remote_node

scylla_storage_proxy_coordinator_read_repair_write_attempts_remote_node¶

number of write operations in a read repair context when communicating with external Nodes in another DC

  • Type: counter

  • Component: storage_proxy_coordinator

  • Key: read_repair_write_attempts_remote_node

scylla_storage_proxy_coordinator_queued_write_bytes¶

number of bytes in pending write requests

  • Type: current_bytes

  • Component: storage_proxy_coordinator

  • Key: queued_write_bytes

scylla_storage_proxy_coordinator_background_write_bytes¶

number of bytes in pending background write requests

  • Type: current_bytes

  • Component: storage_proxy_coordinator

  • Key: background_write_bytes

scylla_storage_proxy_coordinator_current_throttled_writes¶

number of currently throttled write requests

  • Type: queue_length

  • Component: storage_proxy_coordinator

  • Key: current_throttled_writes

scylla_storage_proxy_replica_view_update_backlog¶

Tracks the size of scylla_database_view_update_backlog and is used instead of that one to calculate the max backlog across all shards, which is then used by other nodes to calculate appropriate throttling delays if it grows too large. If it’s notably different from scylla_database_view_update_backlog, it means that we’re currently processing a write that generated a large number of view updates.

  • Type: current_bytes

  • Component: storage_proxy_replica

  • Key: view_update_backlog

Storage service¶

scylla_node_operation_mode¶

The operation mode of the current node. UNKNOWN = 0, STARTING = 1, JOINING = 2, NORMAL = 3, LEAVING = 4, DECOMMISSIONED = 5, DRAINING = 6, DRAINED = 7, MOVING = 8, MAINTENANCE = 9

  • Type: gauge

  • Component: node

  • Key: operation_mode

Stream manager¶

scylla_streaming_total_incoming_bytes¶

Total number of bytes received on this shard.

  • Type: counter

  • Component: streaming

  • Key: total_incoming_bytes

scylla_streaming_total_outgoing_bytes¶

Total number of bytes sent on this shard.

  • Type: counter

  • Component: streaming

  • Key: total_outgoing_bytes

scylla_streaming_finished_percentage¶

Finished percentage of node operation on this shard

  • Type: gauge

  • Component: streaming

  • Key: finished_percentage

Table¶

scylla_column_family_memtable_switch¶

Number of times flush has resulted in the memtable being switched out

  • Type: counter

  • Component: column_family

  • Key: memtable_switch

scylla_column_family_memtable_partition_writes¶

Number of write operations performed on partitions in memtables

  • Type: counter

  • Component: column_family

  • Key: memtable_partition_writes

scylla_column_family_memtable_partition_hits¶

Number of times a write operation was issued on an existing partition in memtables

  • Type: counter

  • Component: column_family

  • Key: memtable_partition_hits

scylla_column_family_memtable_row_writes¶

Number of row writes performed in memtables

  • Type: counter

  • Component: column_family

  • Key: memtable_row_writes

scylla_column_family_memtable_row_hits¶

Number of rows overwritten by write operations in memtables

  • Type: counter

  • Component: column_family

  • Key: memtable_row_hits

scylla_column_family_memtable_rows_dropped_by_tombstones¶

Number of rows dropped in memtables by a tombstone write

  • Type: counter

  • Component: column_family

  • Key: memtable_rows_dropped_by_tombstones

scylla_column_family_memtable_rows_compacted_with_tombstones¶

Number of rows scanned during write of a tombstone for the purpose of compaction in memtables

  • Type: counter

  • Component: column_family

  • Key: memtable_rows_compacted_with_tombstones

scylla_column_family_memtable_range_tombstone_reads¶

Number of range tombstones read from memtables

  • Type: counter

  • Component: column_family

  • Key: memtable_range_tombstone_reads

scylla_column_family_memtable_row_tombstone_reads¶

Number of row tombstones read from memtables

  • Type: counter

  • Component: column_family

  • Key: memtable_row_tombstone_reads

scylla_column_family_pending_tasks¶

Estimated number of tasks pending for this column family

  • Type: gauge

  • Component: column_family

  • Key: pending_tasks

scylla_column_family_live_disk_space¶

Live disk space used

  • Type: gauge

  • Component: column_family

  • Key: live_disk_space

scylla_column_family_total_disk_space¶

Total disk space used

  • Type: gauge

  • Component: column_family

  • Key: total_disk_space

scylla_column_family_total_disk_space_before_compression¶

Hypothetical total disk space used if data files weren’t compressed

  • Type: gauge

  • Component: column_family

  • Key: total_disk_space_before_compression

scylla_column_family_live_sstable¶

Live sstable count

  • Type: gauge

  • Component: column_family

  • Key: live_sstable

scylla_column_family_pending_compaction¶

Estimated number of compactions pending for this column family

  • Type: gauge

  • Component: column_family

  • Key: pending_compaction

scylla_column_family_pending_sstable_deletions¶

Number of tasks waiting to delete sstables from a table

  • Type: gauge

  • Component: column_family

  • Key: pending_sstable_deletions

scylla_column_family_row_lock_exclusive_row_acquisitions¶

Row lock acquisitions for exclusive_row lock

  • Type: total_operations

  • Component: column_family

  • Key: row_lock_exclusive_row_acquisitions

scylla_column_family_row_lock_shared_row_acquisitions¶

Row lock acquisitions for shared_row lock

  • Type: total_operations

  • Component: column_family

  • Key: row_lock_shared_row_acquisitions

scylla_column_family_row_lock_exclusive_partition_acquisitions¶

Row lock acquisitions for exclusive_partition lock

  • Type: total_operations

  • Component: column_family

  • Key: row_lock_exclusive_partition_acquisitions

scylla_column_family_row_lock_shared_partition_acquisitions¶

Row lock acquisitions for shared_partition lock

  • Type: total_operations

  • Component: column_family

  • Key: row_lock_shared_partition_acquisitions

scylla_column_family_row_lock_exclusive_row_operations_currently_waiting_for_lock¶

Operations currently waiting for exclusive_row lock

  • Type: queue_length

  • Component: column_family

  • Key: row_lock_exclusive_row_operations_currently_waiting_for_lock

scylla_column_family_row_lock_shared_row_operations_currently_waiting_for_lock¶

Operations currently waiting for shared_row lock

  • Type: queue_length

  • Component: column_family

  • Key: row_lock_shared_row_operations_currently_waiting_for_lock

scylla_column_family_row_lock_exclusive_partition_operations_currently_waiting_for_lock¶

Operations currently waiting for exclusive_partition lock

  • Type: queue_length

  • Component: column_family

  • Key: row_lock_exclusive_partition_operations_currently_waiting_for_lock

scylla_column_family_row_lock_shared_partition_operations_currently_waiting_for_lock¶

Operations currently waiting for shared_partition lock

  • Type: queue_length

  • Component: column_family

  • Key: row_lock_shared_partition_operations_currently_waiting_for_lock

scylla_column_family_row_lock_exclusive_row_waiting_time¶

Histogram representing time that operations spent on waiting for exclusive_row lock

  • Type: histogram

  • Component: column_family

  • Key: row_lock_exclusive_row_waiting_time

scylla_column_family_row_lock_shared_row_waiting_time¶

Histogram representing time that operations spent on waiting for shared_row lock

  • Type: histogram

  • Component: column_family

  • Key: row_lock_shared_row_waiting_time

scylla_column_family_row_lock_exclusive_partition_waiting_time¶

Histogram representing time that operations spent on waiting for exclusive_partition lock

  • Type: histogram

  • Component: column_family

  • Key: row_lock_exclusive_partition_waiting_time

scylla_column_family_row_lock_shared_partition_waiting_time¶

Histogram representing time that operations spent on waiting for shared_partition lock

  • Type: histogram

  • Component: column_family

  • Key: row_lock_shared_partition_waiting_time

scylla_column_family_tablet_count¶

Tablet count

  • Type: gauge

  • Component: column_family

  • Key: tablet_count

scylla_column_family_read_latency_summary¶

Read latency summary

  • Type: summary

  • Component: column_family

  • Key: read_latency_summary

scylla_column_family_write_latency_summary¶

Write latency summary

  • Type: summary

  • Component: column_family

  • Key: write_latency_summary

scylla_column_family_cas_prepare_latency_summary¶

CAS prepare round latency summary

  • Type: summary

  • Component: column_family

  • Key: cas_prepare_latency_summary

scylla_column_family_cas_propose_latency_summary¶

CAS accept round latency summary

  • Type: summary

  • Component: column_family

  • Key: cas_propose_latency_summary

scylla_column_family_cas_commit_latency_summary¶

CAS learn round latency summary

  • Type: summary

  • Component: column_family

  • Key: cas_commit_latency_summary

scylla_column_family_read_latency¶

Read latency histogram

  • Type: histogram

  • Component: column_family

  • Key: read_latency

scylla_column_family_write_latency¶

Write latency histogram

  • Type: histogram

  • Component: column_family

  • Key: write_latency

scylla_column_family_cas_prepare_latency¶

CAS prepare round latency histogram

  • Type: histogram

  • Component: column_family

  • Key: cas_prepare_latency

scylla_column_family_cas_propose_latency¶

CAS accept round latency histogram

  • Type: histogram

  • Component: column_family

  • Key: cas_propose_latency

scylla_column_family_cas_commit_latency¶

CAS learn round latency histogram

  • Type: histogram

  • Component: column_family

  • Key: cas_commit_latency

scylla_column_family_cache_hit_rate¶

Cache hit rate

  • Type: gauge

  • Component: column_family

  • Key: cache_hit_rate

scylla_tablets_count¶

Tablet count

  • Type: gauge

  • Component: tablets

  • Key: count

Tablet allocator¶

scylla_group_name_calls¶

number of calls to the load balancer

  • Type: counter

  • Component: group_name

  • Key: calls

scylla_group_name_migrations_produced¶

number of migrations produced by the load balancer

  • Type: counter

  • Component: group_name

  • Key: migrations_produced

scylla_group_name_migrations_skipped¶

number of migrations skipped by the load balancer due to load limits

  • Type: counter

  • Component: group_name

  • Key: migrations_skipped

scylla_group_name_cross_rack_collocations¶

number of co-locating migrations which move replica across racks

  • Type: counter

  • Component: group_name

  • Key: cross_rack_collocations

scylla_group_name_load¶

node load during last load balancing

  • Type: gauge

  • Component: group_name

  • Key: load

scylla_group_name_resizes_emitted¶

number of resizes produced by the load balancer

  • Type: counter

  • Component: group_name

  • Key: resizes_emitted

scylla_group_name_resizes_revoked¶

number of resizes revoked by the load balancer

  • Type: counter

  • Component: group_name

  • Key: resizes_revoked

scylla_group_name_resizes_finalized¶

number of resizes finalized by the load balancer

  • Type: counter

  • Component: group_name

  • Key: resizes_finalized

scylla_group_name_auto_repair_needs_repair_nr¶

number of tablets with auto repair enabled that currently needs repair

  • Type: counter

  • Component: group_name

  • Key: auto_repair_needs_repair_nr

scylla_group_name_auto_repair_enabled_nr¶

number of tablets with auto repair enabled

  • Type: counter

  • Component: group_name

  • Key: auto_repair_enabled_nr

Topology coordinator¶

scylla_tablet_ops_failed¶

Number of failed tablet auto repair

  • Type: gauge

  • Component: tablet_ops

  • Key: failed

scylla_tablet_ops_succeeded¶

Number of succeeded tablet auto repair

  • Type: gauge

  • Component: tablet_ops

  • Key: succeeded

Trace keyspace helper¶

scylla_tracing_keyspace_helper_tracing_errors¶

Counts a number of errors during writing to a system_traces keyspace. One error may cause one or more tracing records to be lost.

  • Type: counter

  • Component: tracing_keyspace_helper

  • Key: tracing_errors

scylla_tracing_keyspace_helper_bad_column_family_errors¶

Counts a number of times write failed due to one of the tables in the system_traces keyspace has an incompatible schema. One error may result one or more tracing records to be lost. Non-zero value indicates that the administrator has to take immediate steps to fix the corresponding schema. The appropriate error message will be printed in the syslog.

  • Type: counter

  • Component: tracing_keyspace_helper

  • Key: bad_column_family_errors

Tracing¶

scylla_tracing_dropped_sessions¶

Counts a number of dropped sessions due to too many pending sessions/records. High value indicates that backend is saturated with the rate with which new tracing records are created.

  • Type: counter

  • Component: tracing

  • Key: dropped_sessions

scylla_tracing_dropped_records¶

Counts a number of dropped records due to too many pending records. High value indicates that backend is saturated with the rate with which new tracing records are created.

  • Type: counter

  • Component: tracing

  • Key: dropped_records

scylla_tracing_trace_records_count¶

This metric is a rate of tracing records generation.

  • Type: counter

  • Component: tracing

  • Key: trace_records_count

scylla_tracing_trace_errors¶

Counts a number of trace records dropped due to an error (e.g. OOM).

  • Type: counter

  • Component: tracing

  • Key: trace_errors

scylla_tracing_active_sessions¶

Holds a number of a currently active tracing sessions.

  • Type: gauge

  • Component: tracing

  • Key: active_sessions

scylla_tracing_cached_records¶

Holds a number of tracing records cached in the tracing sessions that are not going to be written in the next write event. If sum of this metric, pending_for_write_records and flushing_records is close to m we are likely to start dropping tracing records.

  • Type: gauge

  • Component: tracing

  • Key: cached_records

scylla_tracing_pending_for_write_records¶

Holds a number of tracing records that are going to be written in the next write event. If sum of this metric, cached_records and flushing_records is close to m we are likely to start dropping tracing records.

  • Type: gauge

  • Component: tracing

  • Key: pending_for_write_records

scylla_tracing_flushing_records¶

Holds a number of tracing records that currently being written to the I/O backend. If sum of this metric, cached_records and pending_for_write_records is close to m we are likely to start dropping tracing records.

  • Type: gauge

  • Component: tracing

  • Key: flushing_records

Ttl¶

scylla_expiration_scan_passes¶

number of passes over the database

  • Type: total_operations

  • Component: expiration

  • Key: scan_passes

scylla_expiration_scan_table¶

number of table scans (counting each scan of each table that enabled expiration)

  • Type: total_operations

  • Component: expiration

  • Key: scan_table

scylla_expiration_items_deleted¶

number of items deleted after expiration

  • Type: total_operations

  • Component: expiration

  • Key: items_deleted

scylla_expiration_secondary_ranges_scanned¶

number of token ranges scanned by this node while their primary owner was down

  • Type: total_operations

  • Component: expiration

  • Key: secondary_ranges_scanned

Vector store client¶

scylla_vector_store_dns_refreshes¶

Number of DNS refreshes

  • Type: gauge

  • Component: vector_store

  • Key: dns_refreshes

View¶

scylla_column_family_view_updates_pushed_remote¶

Number of updates (mutations) pushed to remote view replicas

  • Type: total_operations

  • Component: column_family

  • Key: view_updates_pushed_remote

scylla_column_family_view_updates_failed_remote¶

Number of updates (mutations) that failed to be pushed to remote view replicas

  • Type: total_operations

  • Component: column_family

  • Key: view_updates_failed_remote

scylla_column_family_view_updates_pushed_local¶

Number of updates (mutations) pushed to local view replicas

  • Type: total_operations

  • Component: column_family

  • Key: view_updates_pushed_local

scylla_column_family_view_updates_failed_local¶

Number of updates (mutations) that failed to be pushed to local view replicas

  • Type: total_operations

  • Component: column_family

  • Key: view_updates_failed_local

scylla_column_family_view_updates_pending¶

Number of updates pushed to view and are still to be completed

  • Type: gauge

  • Component: column_family

  • Key: view_updates_pending

scylla_view_builder_pending_bookkeeping_ops¶

Number of tasks waiting to perform bookkeeping operations

  • Type: gauge

  • Component: view_builder

  • Key: pending_bookkeeping_ops

scylla_view_builder_steps_performed¶

Number of performed build steps.

  • Type: counter

  • Component: view_builder

  • Key: steps_performed

scylla_view_builder_steps_failed¶

Number of failed build steps.

  • Type: counter

  • Component: view_builder

  • Key: steps_failed

scylla_view_builder_builds_in_progress¶

Number of currently active view builds.

  • Type: gauge

  • Component: view_builder

  • Key: builds_in_progress

View update generator¶

scylla_view_update_generator_pending_registrations¶

Number of tasks waiting to register staging sstables

  • Type: gauge

  • Component: view_update_generator

  • Key: pending_registrations

scylla_view_update_generator_queued_batches_count¶

Number of sets of sstables queued for view update generation

  • Type: gauge

  • Component: view_update_generator

  • Key: queued_batches_count

scylla_view_update_generator_sstables_to_move_count¶

Number of sets of sstables which are already processed and wait to be moved from their staging directory

  • Type: gauge

  • Component: view_update_generator

  • Key: sstables_to_move_count

scylla_view_update_generator_sstables_pending_work¶

Number of bytes remaining to be processed from SSTables for view updates

  • Type: gauge

  • Component: view_update_generator

  • Key: sstables_pending_work

Wasm instance cache¶

scylla_user_functions_cache_hits¶

The number of user defined function cache hits

  • Type: counter

  • Component: user_functions

  • Key: cache_hits

scylla_user_functions_cache_misses¶

The number of user defined functions loaded

  • Type: counter

  • Component: user_functions

  • Key: cache_misses

scylla_user_functions_cache_blocks¶

The number of times a user defined function waited for an instance

  • Type: counter

  • Component: user_functions

  • Key: cache_blocks

scylla_user_functions_cache_instace_count_any¶

The total number of cached wasm instances, instances in use and empty instances

  • Type: gauge

  • Component: user_functions

  • Key: cache_instace_count_any

scylla_user_functions_cache_total_size¶

The total size of instances stored in the user defined function cache

  • Type: gauge

  • Component: user_functions

  • Key: cache_total_size

Was this page helpful?

PREVIOUS
Tasks
NEXT
ScyllaDB FAQ
  • Create an issue
  • Edit this page

On this page

  • Metrics
    • Advanced rpc compressor
    • Batchlog manager
    • Cache
    • Client
    • Commitlog
    • Compaction manager
    • Compressor
    • Corrupt data handler
    • Database
    • Dirty memory manager
    • Gossiper
    • Log
    • Logalloc
    • Main
    • Manager
    • Mapreduce service
    • Query processor
    • Raft group0
    • Rate limiter
    • Reader concurrency semaphore
    • Repair
    • Row cache
    • Row level
    • Secondary index manager
    • Segment manager
    • Server
    • Sstables
    • Sstables manager
    • Stats
    • Storage proxy
    • Storage service
    • Stream manager
    • Table
    • Tablet allocator
    • Topology coordinator
    • Trace keyspace helper
    • Tracing
    • Ttl
    • Vector store client
    • View
    • View update generator
    • Wasm instance cache
ScyllaDB Open Source
  • Getting Started
    • Install ScyllaDB 6.2
      • Launch ScyllaDB 6.2 on AWS
      • Launch ScyllaDB 6.2 on GCP
      • Launch ScyllaDB 6.2 on Azure
      • ScyllaDB Web Installer for Linux
      • Install ScyllaDB 6.2 Linux Packages
      • Run ScyllaDB in Docker
      • Install ScyllaDB Without root Privileges
      • Air-gapped Server Installation
      • ScyllaDB Housekeeping and how to disable it
      • ScyllaDB Developer Mode
    • Configure ScyllaDB
    • ScyllaDB Configuration Reference
    • ScyllaDB Requirements
      • System Requirements
      • OS Support
      • Cloud Instance Recommendations
      • ScyllaDB in a Shared Environment
    • Migrate to ScyllaDB
      • Migration Process from Cassandra to ScyllaDB
      • ScyllaDB and Apache Cassandra Compatibility
      • Migration Tools Overview
    • Integration Solutions
      • Integrate ScyllaDB with Spark
      • Integrate ScyllaDB with KairosDB
      • Integrate ScyllaDB with Presto
      • Integrate ScyllaDB with Elasticsearch
      • Integrate ScyllaDB with Kubernetes
      • Integrate ScyllaDB with the JanusGraph Graph Data System
      • Integrate ScyllaDB with DataDog
      • Integrate ScyllaDB with Kafka
      • Integrate ScyllaDB with IOTA Chronicle
      • Integrate ScyllaDB with Spring
      • Shard-Aware Kafka Connector for ScyllaDB
      • Install ScyllaDB with Ansible
      • Integrate ScyllaDB with Databricks
      • Integrate ScyllaDB with Jaeger Server
      • Integrate ScyllaDB with MindsDB
  • ScyllaDB for Administrators
    • Administration Guide
    • Procedures
      • Cluster Management
      • Backup & Restore
      • Change Configuration
      • Maintenance
      • Best Practices
      • Benchmarking ScyllaDB
      • Migrate from Cassandra to ScyllaDB
      • Disable Housekeeping
    • Security
      • ScyllaDB Security Checklist
      • Enable Authentication
      • Enable and Disable Authentication Without Downtime
      • Creating a Superuser
      • Generate a cqlshrc File
      • Reset Authenticator Password
      • Enable Authorization
      • Grant Authorization CQL Reference
      • Certificate-based Authentication
      • Role Based Access Control (RBAC)
      • ScyllaDB Auditing Guide
      • Encryption: Data in Transit Client to Node
      • Encryption: Data in Transit Node to Node
      • Generating a self-signed Certificate Chain Using openssl
      • Configure SaslauthdAuthenticator
      • Encryption at Rest
      • LDAP Authentication
      • LDAP Authorization (Role Management)
      • Software Bill Of Materials (SBOM)
    • Admin Tools
      • Nodetool Reference
      • CQLSh
      • Admin REST API
      • Tracing
      • ScyllaDB SStable
      • ScyllaDB SStable Script API
      • ScyllaDB Types
      • SSTableLoader
      • cassandra-stress
      • ScyllaDB Logs
      • Seastar Perftune
      • Virtual Tables
      • Reading mutation fragments
      • Maintenance socket
      • Maintenance mode
      • Task manager
    • ScyllaDB Monitoring Stack
    • ScyllaDB Operator
    • ScyllaDB Manager
    • Upgrade Procedures
      • About Upgrade
      • Upgrade Guides
    • System Configuration
      • System Configuration Guide
      • scylla.yaml
      • ScyllaDB Snitches
    • Benchmarking ScyllaDB
    • ScyllaDB Diagnostic Tools
  • ScyllaDB for Developers
    • Develop with ScyllaDB
    • Tutorials and Example Projects
    • Learn to Use ScyllaDB
    • ScyllaDB Alternator
    • ScyllaDB Drivers
  • CQL Reference
    • CQLSh: the CQL shell
    • Reserved CQL Keywords and Types (Appendices)
    • Compaction
    • Consistency Levels
    • Consistency Level Calculator
    • Data Definition
    • Data Manipulation
      • SELECT
      • INSERT
      • UPDATE
      • DELETE
      • BATCH
    • Data Types
    • Definitions
    • Global Secondary Indexes
    • Expiring Data with Time to Live (TTL)
    • Functions
    • CQL Guardrails
    • Wasm support for user-defined functions
    • JSON Support
    • Materialized Views
    • DESCRIBE SCHEMA
    • Service Levels
    • ScyllaDB CQL Extensions
  • Alternator: DynamoDB API in ScyllaDB
    • Getting Started With ScyllaDB Alternator
    • ScyllaDB Alternator for DynamoDB users
    • Alternator-specific APIs
    • Reducing network costs in Alternator
  • Features
    • Lightweight Transactions
    • Global Secondary Indexes
    • Local Secondary Indexes
    • Materialized Views
    • Counters
    • Change Data Capture
      • CDC Overview
      • The CDC Log Table
      • Basic operations in CDC
      • CDC Streams
      • CDC Stream Changes
      • Querying CDC Streams
      • Advanced column types
      • Preimages and postimages
      • Data Consistency in CDC
    • Workload Attributes
    • Workload Prioritization
    • Backup and Restore
    • Incremental Repair
    • Automatic Repair
    • Vector Search
  • ScyllaDB Architecture
    • Data Distribution with Tablets
    • ScyllaDB Ring Architecture
    • ScyllaDB Fault Tolerance
    • Consistency Level Console Demo
    • ScyllaDB Anti-Entropy
      • ScyllaDB Hinted Handoff
      • ScyllaDB Read Repair
      • ScyllaDB Repair
    • SSTable
      • ScyllaDB SSTable - 2.x
      • ScyllaDB SSTable - 3.x
    • Compaction Strategies
    • Raft Consensus Algorithm in ScyllaDB
    • Zero-token Nodes
  • Troubleshooting ScyllaDB
    • Errors and Support
      • Report a ScyllaDB problem
      • Error Messages
      • Change Log Level
    • ScyllaDB Startup
      • Ownership Problems
      • ScyllaDB will not Start
      • ScyllaDB Python Script broken
    • Cluster and Node
      • Handling Node Failures
      • Failure to Add, Remove, or Replace a Node
      • Failed Decommission Problem
      • Cluster Timeouts
      • Node Joined With No Data
      • NullPointerException
      • Failed Schema Sync
    • Data Modeling
      • ScyllaDB Large Partitions Table
      • ScyllaDB Large Rows and Cells Table
      • Large Partitions Hunting
      • Failure to Update the Schema
    • Data Storage and SSTables
      • Space Utilization Increasing
      • Disk Space is not Reclaimed
      • SSTable Corruption Problem
      • Pointless Compactions
      • Limiting Compaction
    • CQL
      • Time Range Query Fails
      • COPY FROM Fails
      • CQL Connection Table
    • ScyllaDB Monitor and Manager
      • Manager and Monitoring integration
      • Manager lists healthy nodes as down
    • Installation and Removal
      • Removing ScyllaDB on Ubuntu breaks system packages
  • Knowledge Base
    • Upgrading from experimental CDC
    • Compaction
    • Consistency in ScyllaDB
    • Counting all rows in a table is slow
    • CQL Query Does Not Display Entire Result Set
    • When CQLSh query returns partial results with followed by “More”
    • Run ScyllaDB and supporting services as a custom user:group
    • Customizing CPUSET
    • Decoding Stack Traces
    • Snapshots and Disk Utilization
    • DPDK mode
    • Debug your database with Flame Graphs
    • Efficient Tombstone Garbage Collection in ICS
    • How to Change gc_grace_seconds for a Table
    • Gossip in ScyllaDB
    • How does ScyllaDB LWT Differ from Apache Cassandra ?
    • Map CPUs to ScyllaDB Shards
    • ScyllaDB Memory Usage
    • NTP Configuration for ScyllaDB
    • POSIX networking for ScyllaDB
    • ScyllaDB consistency quiz for administrators
    • Recreate RAID devices
    • How to Safely Increase the Replication Factor
    • ScyllaDB and Spark integration
    • Increase ScyllaDB resource limits over systemd
    • ScyllaDB Seed Nodes
    • How to Set up a Swap Space
    • ScyllaDB Snapshots
    • ScyllaDB payload sent duplicated static columns
    • Stopping a local repair
    • System Limits
    • How to flush old tombstones from a table
    • Time to Live (TTL) and Compaction
    • ScyllaDB Nodes are Unresponsive
    • Update a Primary Key
    • Using the perf utility with ScyllaDB
    • Configure ScyllaDB Networking with Multiple NIC/IP Combinations
  • Reference
    • AWS Images
    • Azure Images
    • GCP Images
    • Configuration Parameters
    • Glossary
    • Limits
    • API Reference
      • Authorization Cache
      • Cache Service
      • Collectd
      • Column Family
      • Commit Log
      • Compaction Manager
      • Endpoint Snitch Info
      • Error Injection
      • Failure Detector
      • Gossiper
      • Hinted Handoff
      • LSA
      • Messaging Service
      • Raft
      • Storage Proxy
      • Storage Service
      • Stream Manager
      • System
      • Task Manager Test
      • Task Manager
      • Tasks
    • Metrics
  • ScyllaDB FAQ
  • 2024.2 and earlier documentation
Docs Tutorials University Contact Us About Us
© 2026, ScyllaDB. All rights reserved. | Terms of Service | Privacy Policy | ScyllaDB, and ScyllaDB Cloud, are registered trademarks of ScyllaDB, Inc.
Last updated on 03 Apr 2026.
Powered by Sphinx 9.1.0 & ScyllaDB Theme 1.9.1
Ask AI