Spaces:

reddit-tools-HF
/

dataset-creator-reddit-bestofredditorupdates

Running

App Files Files Community

derek-thomas HF staff commited on Oct 25, 2023

Commit

4469d41

•

1 Parent(s): 1b32c70

Removing old split name

Files changed (1) hide show

main.py +1 -1

main.py CHANGED Viewed

@@ -29,7 +29,7 @@ def get_dataset():
     try:
         dataset = load_dataset(dataset_name, download_mode="reuse_cache_if_exists", ignore_verifications=True)
         logger.debug("Loading existing dataset")
-        if "__index_level_0__" in dataset["all_days"].column_names:
             dataset = dataset.remove_columns(["__index_level_0__"])
     except FileNotFoundError:
         logger.warning("Creating new dataset")

     try:
         dataset = load_dataset(dataset_name, download_mode="reuse_cache_if_exists", ignore_verifications=True)
         logger.debug("Loading existing dataset")
+        if "__index_level_0__" in dataset["train"].column_names:
             dataset = dataset.remove_columns(["__index_level_0__"])
     except FileNotFoundError:
         logger.warning("Creating new dataset")