o 2j( @sdZddlZddlZddlmZddlmZmZddlZddl m Z ddl m Z ddl mZmZmZmZmZdd lmZmZdd lmZgd Zed Zd*d edBfddZd edBdededBddfddZdededBdedBddfddZde deddfddZde dededBddfddZde dededdfdd Z dededefd!d"Z!de deded#e"ddf d$d%Z#de ded&ee$Bd'eddf d(d)Z%dS)+aShared ``cp`` command to copy files between local paths, repositories and buckets. This single command backs three identical CLI entry points: ``hf cp`` (top-level), ``hf repos cp`` and ``hf buckets cp``. It supports any source/destination combination of local file, repo/bucket ``hf://`` URI, and ``-`` (stdin/stdout), with two exceptions: - bucket-to-repo copies are not supported (server limitation), and - local-to-local copies (use a regular ``cp`` for that). N)replace) AnnotatedLiteral)HfApi)CLIError)HfUriSoftTemporaryDirectorydisable_progress_bars is_hf_uri parse_hf_uri)TokenOpt get_hf_api)out) z(hf cp hf://username/my-model/config.jsonz6hf cp hf://username/my-model/config.json ./config.jsonz8hf cp hf://datasets/username/my-dataset/data.csv ./data/z3hf cp hf://buckets/username/my-bucket/config.json -zBhf cp ./model.safetensors hf://username/my-model/model.safetensorsz9hf cp ./config.json hf://buckets/username/my-bucket/logs/z3hf cp - hf://buckets/username/my-bucket/config.jsonz;hf cp hf://username/source-model/ hf://username/dest-model/z]hf cp hf://datasets/username/my-dataset/processed/ hf://buckets/username/my-bucket/processed/zihf cp hf://buckets/username/my-bucket/logs/ hf://buckets/username/archive-bucket/ # copies contents only)reposbucketscontextc sL  d dtttjddfdttdBtjddfdtddffd d }|S) zBuild the ``cp`` command function for a given alias. The three entry points (`hf cp`, `hf repos cp`, `hf buckets cp`) share the exact same logic; 'context' only adds a guardrail on the remote endpoint type (see `_enforce_context`). Nsrcz?Source: local file, hf:// URI (repo or bucket), or - for stdin.)helpdstzEDestination: local path, hf:// URI (repo or bucket), or - for stdout.tokenreturncst||t|||dS)aCopy files between local paths, repositories, and buckets. Handles uploads (local/stdin -> repo/bucket), downloads (repo/bucket -> local/stdout) and remote-to-remote copies (repo/bucket -> repo/bucket). Bucket-to-repo and local-to-local copies are not supported. For directories, use `hf upload`/`hf download` (repos) or `hf buckets sync` (buckets). Remote-to-remote copies only work within the same storage region (https://huggingface.co/docs/hub/storage-regions). N)_enforce_context_run_cp)rrrrR/var/www/html/whisper/venv/lib/python3.10/site-packages/huggingface_hub/cli/_cp.pycpBs zmake_cp..cp)NN)rstrtyperArgumentr )rrrrrmake_cp;s(    r!rrrcCsl|durdS|durt|r|n|}t|sdS|dkr%t|jr%td|dkr2t|js4tddSdS)aGuardrail for the `hf repos cp` / `hf buckets cp` aliases. These aliases are exact duplicates of `hf cp`, so a bare `hf repos cp` could otherwise touch a bucket (and vice versa). We validate the type of the remote side: the destination for uploads and remote-to-remote copies, or the source when downloading to a local path / stdout. The top-level `hf cp` (i.e. 'context' is None) accepts any combination. NrzW`hf repos cp` only works with repositories. Use `hf cp` or `hf buckets cp` for buckets.rzW`hf buckets cp` only works with buckets. Use `hf cp` or `hf repos cp` for repositories.)r r is_bucketr)rrrremoterrrr[srrcCst|d}|dk}|dk}t|}|duot|}|r3|r3|dus#J|||tjd||ddS|sE|sE|dur@tdtd|rX|rPt||dSt|||dS|dus^Jt ||||ddS)N)r-Copiedrrz?Missing destination. Provide a repo or bucket hf:// URI as DST.zVOne of SRC or DST must be a repo (hf://username/...) or bucket (hf://buckets/...) URI.) src_is_stdin) rr copy_filesrresultr BadParameter_download_file_to_stdout_download_file_to_local_upload_file_to_remote)rrrapir' dst_is_stdout src_is_hf dst_is_hfrrrros0       rr.c Cst|}t||}t[t?}tj||}t|||t|d}| d}r9t j j || d}s+Wdn1sCwYWdn1sRwYWddSWddS1sjwYdS)NrbiH)r _source_filenamer rospathjoin_download_singleopenreadsysstdoutbufferwrite)r.rurifilenametmp_dirtmp_pathfchunkrrrr+s"   "r+cCst|}t||}|dur|}ntj|s!|tjs!|dr)tj||}n|}tj|}|r:tj |ddt |||t j d||ddS)N/T)exist_ok Downloadedr&) r r3r4r5isdirendswithsepr6dirnamemakedirsr7rr))r.rrr>r? local_path parent_dirrrrr,s "  r,r>rLcCs|jr|j|j|j|fgdddStj|pd}td|d}|j|j|j |j|j |d}t ||WddS1s@wYdS)zDownload a single file (repo or bucket) to ``local_path``. Used by `_download_file_to_local` and `_download_file_to_stdout`. T)raise_on_missing_files.z.tmp)prefixdir)repo_id repo_typer?revision local_dirN) r"download_bucket_filesid path_in_repor4r5rJrhf_hub_downloadtyperTr)r.r>rLrMr@downloaded_pathrrrr7s"r7cCs0|jdks |drtd|jdddS)NrDzSource path must include a file name, not just a repo/bucket or directory path. Use `hf download` or `hf buckets sync` to copy directories.r )rXrHrr*rsplit)r>rrrrr3s r3r'cCst|}|r/|jdks|drtdtjj}t ||||jt j dd| ddSt j|r:tdt j|sHtd||j}|dkrVt j|}n|drf|dt j|}n|}t ||||t j d|t||d  ddS) Nr\rDzAStdin upload requires a full destination path including filename.Uploadedstdinr&z]Source must be a file, not a directory. Use `hf upload` or `hf buckets sync` for directories.zSource file not found: )rX)r rXrHrr*r:r`r<r9_upload_singlerr)to_urir4r5rGisfilebasenamer)r.rrr'r>datarP remote_pathrrrr-s,      r-sourcerfcCs>|jr|j|j||fgddS|j|||j|j|jddS)z4Upload a single file or bytes (to a repo or bucket).)add)path_or_fileobjrXrRrSrTN)r"batch_bucket_filesrW upload_filerZrT)r.r>rgrfrrrras ra)N)&__doc__r4r: dataclassesrtypingrrrhuggingface_hubrhuggingface_hub.errorsrhuggingface_hub.utilsrrr r r _cli_utilsr r_outputr CP_EXAMPLES CpContextr!rrrr+r,r7r3boolr-bytesrarrrrs,      " "$  &