o 2j1@s dZddlZddlZddlZddlmZddlZddlmZm Z ddl m Z ddl m Z mZddlmZdd lmZmZmZmZmZmZmZdd lmZe eZgd Z            d*d edeedBej ddfdeedBej ddfdedededee!edBej"ddfdee!edBej"ddfdee!edBej"ddfdeedBej"ddfdeedBej"ddfd ee#ej"d!dfd"ee$dBej"d#dfd$ed%dfd&d'Z%d ededBdedBde!edBd%e&eee!edBff d(d)Z'dS)+aContains command to upload a repo or file with the CLI. Usage: # Upload file (implicit) hf upload my-cool-model ./my-cool-model.safetensors # Upload file (explicit) hf upload my-cool-model ./my-cool-model.safetensors model.safetensors # Upload directory (implicit). If `my-cool-model/` is a directory it will be uploaded, otherwise an exception is raised. hf upload my-cool-model # Upload directory (explicit) hf upload my-cool-model ./models/my-cool-model . # Upload filtered directory (example: tensorboard logs except for the last run) hf upload my-cool-model ./model/training /logs --include "*.tfevents.*" --exclude "*20230905*" # Upload with wildcard hf upload my-cool-model "./model/training/*.safetensors" # Upload private dataset hf upload Wauplin/my-cool-dataset ./data . --repo-type=dataset --private # Upload with token hf upload Wauplin/my-cool-model --token=hf_**** # Sync local Space with Hub (upload new files, delete removed files) hf upload Wauplin/space-example --repo-type=space --exclude="/logs/*" --delete="*" --commit-message="Sync local Space with Hub" # Schedule commits every 30 minutes hf upload Wauplin/my-cool-model --every=30 # Upload using an hf:// URI (repo type, revision and path in repo are read from the URI) hf upload hf://datasets/Wauplin/my-cool-dataset@my-branch/data/train.csv ./train.csv N) Annotated) constantslogging)CommitScheduler)CLIErrorRevisionNotFoundError) parse_hf_uri) PrivateOpt RepoIdArgRepoTypeRepoTypeOptionalOpt RevisionOptTokenOpt get_hf_api)out)zhf upload my-cool-model . .z:hf upload Wauplin/my-cool-model ./models/model.safetensorszChf upload Wauplin/my-cool-dataset ./data /train --repo-type=datasetzrhf upload Wauplin/my-cool-model ./models . --commit-message="Epoch 34/50" --commit-description="Val accuracy: 68%"z?hf upload bigcode/the-stack . . --repo-type dataset --create-prFrepo_id local_pathzkLocal path to the file or folder to upload. Wildcard patterns are supported. Defaults to current directory.)help path_in_repoz\Path of the file or folder in the repo. Defaults to the relative path of the file or folder. repo_typerevisionprivateincludez'Glob patterns to match files to upload.excludez.Glob patterns to exclude from files to upload.deletezDGlob patterns for file to be deleted from the repo while committing.commit_messagez9The summary / title / first line of the generated commit.commit_descriptionz(The description of the generated commit. create_prz0Whether to upload content as a new Pull Request.everyzNIf set, a background job is scheduled to create commits every `every` minutes.tokenreturncs$durdkrtjdddtjrZ|dur!tdd dur-tddt}|jr8td |j|j |j  |j rY|durVtd |j d |d|j }n|p^t j j t| d t|||d \ dtf fdd }|}tjd|ddS)zLUpload a file or a folder to the Hub. Recommended for single-commit uploads.Nrz --every must be a positive valuer) param_hintz3'--repo-type' cannot be used with an 'hf://' URI ('z').z2'--revision' cannot be used with an 'hf://' URI ('z@Buckets are not supported by `hf upload`. Use `hf sync` instead.z)Cannot combine a path in the hf:// URI ('z&') with the `path_in_repo` argument (')r )rrrrr!c s6tj r8 durt dkrt trtddur)tdkr)tddur8tdkr8tddurtj r^tj } rV dt  n } g}g}n } } }}durutdkrutdt | |||d }t dd|j d z td qty|Yd Swtj stj std dj d  dkrdnddj } dursz j| dWntytd dj| d dYnwtj r j | dSj |  d S)Nrz3Ignoring --include since a single file is uploaded.z3Ignoring --exclude since a single file is uploaded.z2Ignoring --delete since a single file is uploaded.z8Ignoring --delete when uploading with scheduled commits.) folder_pathrrrallow_patternsignore_patternsrrrhf_apizScheduling commits every z minutes to .TdzStopped scheduled commits.zNo such file or directory: 'z'.spacegradio)rrexist_okr space_sdk)rrrzBranch 'z' not found. Creating it...)rrbranchr+)path_or_fileobjrrrrrrr) r#rrrrrrrr$r%delete_patterns)ospathisfilelen isinstancelistwarningswarndirnameendswithrrtextrtimesleepKeyboardInterruptstopisdirFileNotFoundError create_repo repo_inforloggerinfo create_branch upload_file upload_folder)r#pir$r% schedulercreatedapirrrrrrrr repo_type_strresolved_includeresolved_local_pathresolved_path_in_reporU/var/www/html/whisper/venv/lib/python3.10/site-packages/huggingface_hub/cli/upload.py run_uploads             zupload..run_uploadUploaded)url)typer BadParameter startswithr HF_PROTOCOLrr is_bucketidtyperrr modelvaluer_resolve_upload_pathsstrrresult)rrrrrrrrrrrrrr urirSrarQrKrRuploadWs4?    ,erccs|dd}|}dur2tfdddDr2|dur td|dur,|dkr,tdddgfSdurAtj|rA|||fSdurPtj|rP|d|fSdur\td |d |durotjrotj|fS|durxd|fS||fS) N/c3s|]}|vVqdS)NrQ).0crrQrR 'sz(_resolve_upload_paths..)*?[z9Cannot set --include when local_path contains a wildcard.r'zs %   $    #)/5;< K