Apache Atlas statistics reference

Atlas collects statistics on the metadata it processes. Use this information to help troubleshoot problems and to gauge performance.

To view statistics, click the graph button in the top right corner.

Figure 1. Graph button to view statistics
Figure 2. Graph button to view statistics

Entity statistics

Entity statistics display the distribution of entity across their types. A second column displays the number of these entities that were marked as deleted.

Figure 3. Entities statistics
Figure 4. Entities statistics

Classification statistics

Classification statistics list classifications assigned to entities and the count of entities marked with that classification. The count for each classification is a hyperlink that runs a search for entities marked with the classification.

Server statistics

Server statistics reflect the current server session and the metadata collection messages that Atlas reads from a dedicated Kafka topic.
Figure 5. Server Statistics
Figure 6. Server Statistics

Server Statistics displays the following sections and fields:

Server Details

  • startTimeStamp — The timestamp when the Atlas server was started.
  • activeTimeStamp — The timestamp when the server instance became active and ready to process requests. In single-instance setups, this matches startTimeStamp. In high-availability setups, it reflects when this instance was elected active, including after failover.
  • upTime — The total elapsed time the server has been running since startTimeStamp. In high-availability setups, this is measured from when the process started, not from when the instance became active, so it can be nonzero on a standby instance that has not yet been elected active.
  • statusBackendStore — The status of the Atlas server connection to the persistence backend where entity metadata is stored (by default, the HBase namespace for JanusGraph or when using the relational JanusGraph store, the configured JDBC database).
  • statusIndexStore — The status of the Atlas server connection to the Solr collection where entity metadata is indexed.
  • collectionTime — The last time metrics were calculated.
  • lastMessageProcessedTime — The timestamp of the last message Atlas recorded from the Kafka topic where services publish metadata.
  • offsetCurrent — The index in the Kafka partition that was most recently read.
  • offsetStart — The index in the Kafka partition that was first read.

Notification Details

  • Kafka Topic-Partition
    • Atlas Hook — The primary topic through which integration hooks and services (for example, Hive, HBase, and Spark) send metadata to Atlas.
    • Spark-Atlas Hook Topic — A supplementary topic provided for Spark communication to Atlas.
  • Message Statistics
    • Period — The interval that the statistics apply to, including the total lifetime of Atlas. Each period indicated includes a timestamp for when the period started.
    • Count — The number of messages processed by Atlas during the period.
    • Avg Time (ms) — The average time Atlas took to process a message during the period, measured from when Atlas began processing the message to when its entity changes were committed.
    • Creates — The number of entities produced from the messages processed during the period.
    • Updates — The number of entities updated based on the messages processed during the period.
    • Deletes — The number of entities deleted based on the messages processed during the period.
    • Failed — The number of messages that were received but not processed.