Repository Issue Activity (beta)

#480 datatrove 0.9.0 `VLLMServer` is incompatible with newer vLLM CLI (`--disable-log-requests` removed)

#521 ReadabilityInscriptis fails dependency validation and the sandbox's empty warmup

#324 Unexpected behavior when using sentence_dedup with split_sentences=True

#74 In-file parallelism

#508 xxhash is pinned to <4: the proper fix needs a decision on str-vs-bytes hashing

#501 HuggingFaceDatasetWriter reuses already-committed CommitOperationAdd objects when a writer instance is reused across ranks

#485 Docs idea: add a small dataset-audit example using filters, exclusion_writer, and summary stats

#494 Outdated/not SLURM-compatible benchmark/analyze_results.py

#372 [deleted]

#339 task hang when extraction raises error

#360 Wrong stats files at the end when the job is relaunch

#325 JsonlWriter failed when trying to write Timestamp object

#477 Question: could `url_filterblacklistsv0_3_0.tar.gz` be hosted externally?

#476 Overloaded dependencies with `inference` feature

#315 Missing `main` function in `check_dataset.py`

#443 Conflicting library requirements for datatrove==0.7.0

#413 ModuleNotFoundError: No module named 'datatrove.pipeline.media'

#401 Add "download speed" logger

#400 Add `generate_function` to inference pipeline to enable custom generation

#399 Expose `generation_kwargs` to `InferenceConfig`

#397 About Raypipeline Error

#388 Wrong language filter argument in examples using default ft176 backend

#381 Jsonl Reader: Why does it read fewer documents than I have in total?

#365 `LanguageFilter` does not detect simple French sentence as French

#357 AssertionError: Need to run with n_tasks = n_files. len(sequence_file)=1, len(sequence_file)=1, len(byte_range_file)=0