Skip to content

Tutorial

DJ-Cookbook
Installation Guide
Quick Start

docs

Operator Schemas 算子提要
Data Recipe Gallery
Dataset Configuration Guide
“Bad” Data Exhibition
DJ-SORA
DataJuicer-Agent
DJ_service
How-to Guide for Developers
Distributed Data Processing in Data-Juicer
Sandbox
Awesome Data-Model Co-Development of MLLMs

demos

Demos

tools

Distributed Fuzzy Deduplication Tools
Auto Evaluation Toolkit
GPT EVAL: Evaluate your model with OpenAI API
Evaluation Results Recorder
Format Conversion Tools
Multimodal Tools
Post Tuning Tools
Hyper-parameter Optimization for Data Recipe
Label Studio Service Utility
Metrics for video generation
VBench metrics
Postprocess tools
Preprocess Tools
Data Scoring

thirdparty

LLM Ecosystems
Third-party Model Library

API Reference

API Reference

en|main

Language

English 简体中文

Version

main v1.4.3 v1.4.2 v1.4.1 v1.4.0

data_juicer.ops.common.special_characters module¶

Copyright © 2024, Data-Juicer Team

Made with Sphinx and @pradyunsg's Furo