Offsets Subcommand
Learn how to use the offsets
subcommand of the
srm-client
command line tool.
offsets
subcommand on the target cluster to export the translated offsets
of the source cluster. For
example:srm-control offsets --source [SOURCE_CLUSTER] --target [TARGET_CLUSTER] --group [GROUP1] --export > out.csv
Exported
offsets can then be applied to the consumer groups in the target cluster with the
kafka-consumer-groups
tool. Alternatively, this process can be automated by
enabling automatic group offset synchronization. If this feature is enabled, the translated
offsets are automatically exported from the source cluster and applied to the target
cluster.For detailed steps on cluster migration, see Migrating Consumer Groups Between Clusters. For more information regarding automatic offset group synchronization, see Configuring automatic group offset synchronization.
Client Override Options
The offset subcommand supports client override options. Client override options allow users
to temporarily specify or override configuration properties. These options also enable users
to issue srm-control
commands even if the SRM’s configuration file is not
available on the host that the command is being issued from. While it is possible to specify
a range of properties with the client override options, and they can prove to be a powerful
tool in certain scenarios, Cloudera recommends that you use Cloudera Manager to manage
client configuration options.
--bootstrap-servers
: Specifies the bootstraps servers.--props
: Specifies client configuration properties.
A simple example of using client override options is when you want to change the bootstrap server. This can be done in two ways.
--bootstrap-servers
option.
srm-control --bootstrap-servers localhost:9092 offsets --source [SOURCE_CLUSTER] --group [GROUP] --export > out.csv
--props
option together with the
bootstrap.servers
Kafka property to define the bootstrap server.
srm-control --props bootstrap.servers=localhost:9092 offsets --source [SOURCE_CLUSTER] --group [GROUP] --export > out.csv