Star Quix Streams

 Install Quix Streams

 Edit on GitHub

State API

quixstreams.state.base.state

State

class State(ABC, Generic[K, V])

[VIEW SOURCE]

Primary interface for working with key-value state data from StreamingDataFrame

State.get

@abstractmethod
def get(key: K, default: Optional[V] = None) -> Optional[V]

[VIEW SOURCE]

Get the value for key if key is present in the state, else default

Arguments:

• key: key
• default: default value to return if the key is not found

Returns:

value or None if the key is not found and default is not provided

State.get_bytes

def get_bytes(key: K, default: Optional[bytes] = None) -> Optional[bytes]

[VIEW SOURCE]

Get the value for key if key is present in the state, else default

Arguments:

• key: key
• default: default value to return if the key is not found

Returns:

value as bytes or None if the key is not found and default is not provided

State.set

@abstractmethod
def set(key: K, value: V) -> None

[VIEW SOURCE]

Set value for the key.

Arguments:

• key: key
• value: value

State.set_bytes

@abstractmethod
def set_bytes(key: K, value: bytes) -> None

[VIEW SOURCE]

Set value for the key.

Arguments:

• key: key
• value: value

State.delete

@abstractmethod
def delete(key: K)

[VIEW SOURCE]

Delete value for the key.

This function always returns None, even if value is not found.

Arguments:

• key: key

State.exists

@abstractmethod
def exists(key: K) -> bool

[VIEW SOURCE]

Check if the key exists in state.

Arguments:

• key: key

Returns:

True if key exists, False otherwise

TransactionState

class TransactionState(State)

[VIEW SOURCE]

TransactionState.__init__

def __init__(prefix: bytes, transaction: "PartitionTransaction")

[VIEW SOURCE]

Simple key-value state to be provided into StreamingDataFrame functions

Arguments:

• transaction: instance of PartitionTransaction

TransactionState.get

def get(key: K, default: Optional[V] = None) -> Optional[V]

[VIEW SOURCE]

Get the value for key if key is present in the state, else default

Arguments:

• key: key
• default: default value to return if the key is not found

Returns:

value or None if the key is not found and default is not provided

TransactionState.get_bytes

def get_bytes(key: K, default: Optional[bytes] = None) -> Optional[bytes]

[VIEW SOURCE]

Get the bytes value for key if key is present in the state, else default

Arguments:

• key: key
• default: default value to return if the key is not found

Returns:

value or None if the key is not found and default is not provided

TransactionState.set

def set(key: K, value: V) -> None

[VIEW SOURCE]

Set value for the key.

Arguments:

• key: key
• value: value

TransactionState.set_bytes

def set_bytes(key: K, value: bytes) -> None

[VIEW SOURCE]

Set value for the key.

Arguments:

• key: key
• value: value

TransactionState.delete

def delete(key: K)

[VIEW SOURCE]

Delete value for the key.

This function always returns None, even if value is not found.

Arguments:

• key: key

TransactionState.exists

def exists(key: K) -> bool

[VIEW SOURCE]

Check if the key exists in state.

Arguments:

• key: key

Returns:

True if key exists, False otherwise

quixstreams.state.rocksdb.options

RocksDBOptions

@dataclasses.dataclass(frozen=True)
class RocksDBOptions(RocksDBOptionsType)

[VIEW SOURCE]

RocksDB database options.

Arguments:

• dumps: function to dump data to JSON
• loads: function to load data from JSON
• open_max_retries: number of times to retry opening the database if it's locked by another process. To disable retrying, pass 0
• open_retry_backoff: number of seconds to wait between each retry.
• on_corrupted_recreate: when True, the corrupted DB will be destroyed if the use_changelog_topics=True is also set on the Application. If this option is True, but use_changelog_topics=False, the DB won't be destroyed. Note: risk of data loss! Make sure that the changelog topics are up-to-date before enabling it in production. Default - False.

Please see rocksdict.Options for a complete description of other options.

RocksDBOptions.to_options

def to_options() -> rocksdict.Options

[VIEW SOURCE]

Convert parameters to rocksdict.Options

Returns:

instance of rocksdict.Options