memoryscope.core.utils

class memoryscope.core.utils.DatetimeHandler(dt: datetime | str | int | float | None = None)

基类：object

Handles operations related to datetime such as parsing, extraction, and formatting, with support for both Chinese and English contexts including weekday names and specialized text parsing for date components.

__init__(dt: datetime | str | int | float | None = None)

Initialize the DatetimeHandler instance with a datetime object, string, integer, or float representation of a timestamp. If no argument is provided, the current time is used.

参数:

dt (datetime.datetime | str | int | float, optional) -- The datetime to be handled. Can be a datetime object, a timestamp string, or a numeric timestamp. Defaults to None, which sets the instance to the current datetime.

self._dt

The internal datetime representation of the input.

Type:

datetime.datetime

self._dt_info_dict

A dictionary containing parsed datetime information, defaults to None.

Type:

dict | None

get_dt_info_dict(language: LanguageEnum)

Property method to get the dictionary containing parsed datetime information. If None, initialize using _parse_dt_info.

返回:

A dictionary with parsed datetime information.

返回类型:

dict

classmethod extract_date_parts_cn(input_string: str) → dict

Extracts various components of a date (year, month, day, etc.) from an input string based on Chinese formats.

This method identifies year, month, day, weekday, and hour components within the input string based on predefined patterns. It supports relative terms like '每' (every) and translates weekday names into numeric representations.

参数:

input_string (str) -- The Chinese text containing date and time information.

返回:

A dictionary with keys 'year', 'month', 'day', 'weekday', and 'hour',

each holding the corresponding extracted value. If a component is not found, it will not be included in the dictionary. For relative terms like '每' (every), the value is set to -1.

返回类型:

dict

classmethod extract_date_parts_en(input_string: str) → dict

Extracts various components of a date (year, month, day, etc.) from an input string based on English formats.

This method employs regex patterns to identify and parse different date and time elements within the provided text. It supports extraction of year, month name, day, 12-hour and 24-hour time formats, and weekdays.

参数:

input_string (str) -- The English text containing date and time information.

返回:

A dictionary containing the extracted date parts with default values of -1 where components are not found. Keys include 'year', 'month', 'day', 'hour', 'minute', 'second', and 'weekday'.

返回类型:

dict

classmethod extract_date_parts(input_string: str, language: LanguageEnum) → dict

Extracts various date components from the input string based on the current language context.

This method dynamically selects a language-specific function to parse the input string and extract date parts such as year, month, day, etc. If the function for current language context does not exist, a warning is logged and an empty dictionary is returned.

参数:

• input_string (str) -- The string containing date information to be parsed.

• language (str) -- current language.

返回:

A dictionary containing extracted date components, or an empty dictionary if parsing fails.

返回类型:

dict

classmethod has_time_word_cn(query: str, datetime_word_list: List[str]) → bool

Check if the input query contains any datetime-related words based on the cn language context.

参数:

• query (str) -- The input string to check for datetime-related words.

• datetime_word_list (list[str]) -- datetime keywords

返回:

True if the query contains at least one datetime-related word, False otherwise.

返回类型:

bool

classmethod has_time_word_en(query: str, datetime_word_list: List[str]) → bool

Check if the input query contains any datetime-related words based on the en language context.

参数:

• query (str) -- The input string to check for datetime-related words.

• datetime_word_list (list[str]) -- datetime keywords

返回:

True if the query contains at least one datetime-related word, False otherwise.

返回类型:

bool

classmethod has_time_word(query: str, language: LanguageEnum) → bool

datetime_format(dt_format: str = '%Y%m%d') → str

Format the stored datetime object into a string based on the provided format.

参数:

dt_format (str, optional) -- The datetime format string. Defaults to "%Y%m%d".

返回:

A formatted datetime string.

返回类型:

str

string_format(string_format: str, language: LanguageEnum) → str

Format the datetime information stored in the instance using a custom string format.

参数:

• string_format (str) -- A format string where placeholders are keys from dt_info_dict.

• language (str) -- current language.

返回:

A formatted datetime string.

返回类型:

str

property timestamp: int

Get the timestamp representation of the stored datetime.

返回:

A timestamp value.

返回类型:

int

class memoryscope.core.utils.Logger(name: str, level: int = 20, format_style: str = '%(asctime)s %(levelname)s [%(module)s:%(lineno)d] %(message)s', date_format_style: str = '%Y-%m-%d %H:%M:%S', to_stream: bool = False, to_file: bool = True, file_mode: str = 'w', file_type: str = 'log', dir_path: str = 'log', max_bytes: int = 1073741824, backup_count: int = 10)

基类：Logger

The Logger class handle the stream of information or errors in activities.

__init__(name: str, level: int = 20, format_style: str = '%(asctime)s %(levelname)s [%(module)s:%(lineno)d] %(message)s', date_format_style: str = '%Y-%m-%d %H:%M:%S', to_stream: bool = False, to_file: bool = True, file_mode: str = 'w', file_type: str = 'log', dir_path: str = 'log', max_bytes: int = 1073741824, backup_count: int = 10)

Initializes the Logger instance, setting up handlers for console and file logging based on provided parameters.

参数:

• name (str) -- Identifier for the logger.

• level (int, optional) -- Logging level. Defaults to logging.INFO.

• format_style (str, optional) -- Log message format. Defaults to LOG_FORMAT constant.

• date_format_style (str, optional) -- Date format for logs. Defaults to DATE_FORMAT constant.

• to_stream (bool, optional) -- Enables console logging. Defaults to True.

• to_file (bool, optional) -- Enables file logging. Defaults to True.

• file_mode (str, optional) -- File open mode. Defaults to 'w'.

• file_type (str, optional) -- Log file extension type. Defaults to 'log'.

• dir_path (str, optional) -- Directory for log files. Defaults to 'log'.

• max_bytes (int, optional) -- Maximum log file size before rotation. Defaults to 1GB.

• backup_count (int, optional) -- Number of rotated log files to retain. Defaults to 10.

log_dictionary_info(dictionary, title='')

format_current_context(context, title='')

wrap_in_box(context)

format_chat_message(message)

format_rank_message(model_response)

close()

Closes all handlers associated with this logger instance.

This method iterates over the handlers attached to the logger and calls their close method to ensure that any system resources used by the handlers are freed properly.

clear()

Clears all handlers from the logger.

set_trace_id(trace_id: str)

Sets the trace ID for the logger. If the provided trace ID is longer than 8 characters, it will be truncated to the first 8 characters.

参数:

trace_id (str) -- The trace identifier to be associated with the logs.

makeRecord(name, level, fn, lno, msg, args, exc_info, func=None, extra=None, sinfo=None)

Creates a log record with additional trace_id included in the extra information.

This method extends the default behavior of creating a log record by adding a trace_id from the logger instance to the record's extra data, allowing for traceability within logged data.

参数:

• name (str) -- The name of the logger.

• level (int) -- The logging level of the record.

• fn (str) -- The name of the function containing the logging call.

• lno (int) -- The line number at which the logging call was made.

• msg (str) -- The logged message, before formatting.

• args (tuple) -- The arguments to the log message.

• exc_info (tuple) -- Exception information or None.

• func (function) -- The function where the logging call was made. Defaults to None.

• extra (dict) -- Additional information for the log record. Defaults to None.

• sinfo (str) -- Stack trace information or None.

返回:

The created log record with potentially enriched 'extra' field.

返回类型:

logging.LogRecord

classmethod get_logger(name: str | None = None, **kwargs)

Retrieves or creates a logger instance with the specified name and configurations.

If no name is provided, it defaults to the first registered logger's name or 'default' if none exist. This method ensures that only one logger instance exists per name by reusing existing instances stored in LOGGER_DICT.

参数:

• name (str, optional) -- The name of the logger. Defaults to None, which triggers auto-naming logic.

• **kwargs -- Additional keyword arguments to configure the logger.

返回:

The requested or newly created logger instance.

返回类型:

Logger

class memoryscope.core.utils.PromptHandler(class_path: str, language: LanguageEnum | str, prompt_file: str = '', prompt_dict: dict | None = None, **kwargs)

基类：object

The PromptHandler class manages prompt messages by loading them from YAML or JSON files and dictionaries, supporting language selection based on a context, and providing dictionary-like access to the prompt messages.

__init__(class_path: str, language: LanguageEnum | str, prompt_file: str = '', prompt_dict: dict | None = None, **kwargs)

Initializes the PromptHandler with paths to prompt sources and additional keyword arguments.

参数:

• class_path (str) -- The path to the class where prompts are utilized.

• prompt_file (str, optional) -- The path to an external file containing prompts. Defaults to "".

• prompt_dict (dict, optional) -- A dictionary directly containing prompt definitions. Defaults to None.

• language (LanguageEnum, str) -- context language.

• **kwargs -- Additional keyword arguments that might be used in prompt handling.

static file_path_completion(file_path: str, raise_exception: bool = True) → str

Attempts to complete the given file path by appending either a .yaml or .json extension based on the existence of the respective file. If neither exists, an exception is raised.

参数:

• file_path (str) -- The base path of the file to be completed.

• raise_exception (bool) -- If the file cannot be found, report an error.

返回:

The completed file path with the appropriate extension.

返回类型:

str

抛出:

RuntimeError -- If neither the .yaml nor .json file exists at the given path.

add_prompt_file(file_path: str, raise_exception: bool = True)

Adds prompt messages from a YAML or JSON file to the internal dictionary.

This method supports loading prompts from files ending with '.yaml' or '.json'. It uses the respective libraries to parse the content and merge it into the current prompt dictionary.

参数:

• file_path (str) -- The path to the YAML or JSON file containing the prompts.

• raise_exception (bool) -- If the file cannot be found, report an error.

add_prompt_dict(prompt_dict: dict)

Adds prompt messages from a dictionary, ensuring each message has a valid entry for the current language.

参数:

prompt_dict (dict) -- A dictionary where keys represent prompt identifiers and values are nested dictionaries containing language-specific prompt messages.

抛出:

RuntimeError -- If a prompt message for the current language is not found.

property prompt_dict: dict

Retrieves the internal dictionary containing all prompt messages.

返回:

The dictionary of prompt messages with keys as identifiers and values as prompt strings.

返回类型:

dict

class memoryscope.core.utils.Registry(name: str)

基类：object

A registry to manage and instantiate various modules by their names, ensuring the uniqueness of registered entries. It supports both individual and bulk registration of modules, as well as retrieval of modules by name.

name

The name of the registry.

Type:

str

module_dict

A dictionary holding registered modules where keys are module names and values are the modules themselves.

Type:

Dict[str, Any]

__init__(name: str)

Initializes the Registry with a given name.

参数:

name (str) -- The name to identify this registry.

register(module_name: str | None = None, module: Any | None = None)

Registers module in the registry in a single call.

参数:

• module_name (str) -- The name of module to be registered.

• module (List[Any] | Dict[str, Any]) -- The module to be registered.

抛出:

NotImplementedError -- If the input is already registered.

batch_register(modules: List[Any] | Dict[str, Any])

Registers multiple modules in the registry in a single call. Accepts either a list of modules or a dictionary

mapping names to modules.

参数:

modules (List[Any] | Dict[str, Any]) -- A list of modules or a dictionary mapping module names to the modules.

抛出:

NotImplementedError -- If the input is neither a list nor a dictionary.

class memoryscope.core.utils.ResponseTextParser(response_text: str, language: LanguageEnum, logger_prefix: str = '')

基类：object

The ResponseTextParser class is designed to parse and process response texts. It provides methods to extract patterns from the text and filter out unnecessary information, while also logging the processing steps and outcomes.

PATTERN_V1 = re.compile('<(.*?)>')

__init__(response_text: str, language: LanguageEnum, logger_prefix: str = '')

parse_v1() → List[List[str]]

Extract specific patterns from the text which match content within angle brackets.

返回:

Contents match the specific patterns.

parse_v2() → List[str]

Extract lines which contain NONE_WORD.

返回:

Contents match the specific patterns.

class memoryscope.core.utils.Timer(name: str, time_log_type: Literal['end', 'wrap', 'none'] = 'end', use_ms: bool = True, stack_level: int = 2, float_precision: int = 4, **kwargs)

基类：object

A class used to measure the execution time of code blocks. It supports logging the elapsed time and can be customized to display time in seconds or milliseconds.

__init__(name: str, time_log_type: Literal['end', 'wrap', 'none'] = 'end', use_ms: bool = True, stack_level: int = 2, float_precision: int = 4, **kwargs)

Initializes the Timer instance with the provided args and sets up a logger

参数:

• name (str) -- The log name.

• time_log_type (str) -- The log type. Defaults to 'End'.

• use_ms (bool) -- Use 'ms' as the timescale or not. Defaults to True.

• stack_level (int) -- The stack level of log. Defaults to 2.

• float_precision (int) -- The precision of cost time. Defaults to 4.

property cost_str

Represent the cost time into a formatted string.

memoryscope.core.utils.underscore_to_camelcase(name: str, is_first_title: bool = True) → str

Converts an underscore_notation string to CamelCase.

参数:

• name (str) -- The underscore_notation string to be converted.

• is_first_title (bool) -- Title the first word or not. Defaults to True

返回:

A CamelCase formatted string.

返回类型:

str

memoryscope.core.utils.camelcase_to_underscore(name: str) → str

Converts a CamelCase string to underscore_notation.

参数:

name (str) -- The CamelCase formatted string to be converted.

返回:

A converted string in underscore_notation.

返回类型:

str

memoryscope.core.utils.init_instance_by_config(config: dict, default_class_dir: str = 'memoryscope', **kwargs)

Initialize an instance of a class specified in the configuration dictionary.

This function dynamically imports a class from a module path, allowing for user-defined classes or default paths. It supports adding a suffix to the class name, merging additional keyword arguments with the config, and handling nested module paths.

参数:

• config (dict) -- A dictionary containing the configuration, including the 'class' key that specifies the class's module path.

• default_class_dir (str, optional) -- The default module path prefix to use if not explicitly defined in 'config'. Defaults to "memory_scope".

• **kwargs -- Additional keyword arguments to pass to the class constructor.

返回:

An instance initialized with the provided config and kwargs.

返回类型:

instance

memoryscope.core.utils.prompt_to_msg(system_prompt: str, few_shot: str, user_query: str, concat_system_prompt: bool = True) → List[Message]

Converts input strings into a structured list of message objects suitable for AI interactions.

参数:

• system_prompt (str) -- The system-level instruction or context.

• few_shot (str) -- An example or demonstration input, often used for illustrating expected behavior.

• user_query (str) -- The actual user query or prompt to be processed.

• concat_system_prompt (bool) -- Concat system prompt again or not in the user message. A simple method to improve the effectiveness for some LLMs. Defaults to True.

返回:

A list of Message objects, each representing a part of the conversation setup.

返回类型:

List[Message]

memoryscope.core.utils.char_logo(words: str, seed: int = 1729505193571729521, color=None)

Render the context of logo with colors

参数:

• words -- The context of logo.

• seed -- The random seed which generates colors if there is no specific color. Defaults to the current timestamp.

• color -- The specific color. Defaults to None.

返回:

A rendered logo

memoryscope.core.utils.md5_hash(input_string: str) → str

Computes a MD5 hash of the given input string.

参数:

input_string (str) -- The string for which the MD5 hash needs to be computed.

返回:

A hexadecimal MD5 hash representation.

返回类型:

str

memoryscope.core.utils.contains_keyword(text, keywords) → bool

Checks if the given text contains any of the specified keywords, ignoring case.

参数:

• text (str) -- The text to search within.

• keywords (List[str]) -- A list of keywords to look for in the text.

返回:

True if any keyword is found in the text, False otherwise.

返回类型:

bool

memoryscope.core.utils.cosine_similarity(query: List[float], documents: List[List[float]])