o 2jR$@sdZddlmZddlZddlmZddlmZmZm Z m Z ddl m Z dd l mZmZmZmZdd lmZdd lmZmZdd lmZmZeeZed dZejdgdd    ddeeej ddfdee!ej"dddfdee dBej"dddfdee!ej"dddfdeddf d dZ#d!ede!fd"d#Z$ejd$gd%d      dd!eedBej d&dfd'ee!ej"d(d)d*dfd+ee!ej"d,d-dfd.ee!ej"d/d0d1dfd2ededdfd3d4Z%d5edBd2edBd'e!d+e!d.e!dedBddfd6d7Z&d!ed'e!d+e!d.e!dedBddf d8d9Z'ejd:d;dd:Z(ejd?gd@d   ddeeej d=dfdAee!ej"dBdCdDdfdEee!ej"dFdGdfdeddf dHd?Z)ejdIgdJd      dd!eeej dKdfd.ee!ej"d/d0dLdfdAee!ej"dBdCdDdfdMee!ej"dNdOdfdPee*edBej"dQdfdRee*edBej"dSdfdeddfdTdUZ+ejdVgdWd ddXeeej dYdfdZeeej d[dfdeddfd\dVZ,ejd]gd^d               dd_eedBej d`dfdaeedBej dbdfd?ee!ej"dcdfddee!ej"dedfdfdgee!ej"dhdidfdjeedBej"dkdfdleedBej"dmdfdMee!ej"dNdndfdPee*edBej"dodfdRee*edBej"dpdfdqeedBej"drdfdsee!ej"dtdudfdvee!ej"dwdxdfdyee!ej"dzd{d|dfdeddf d}d]Z-ejd~gddeddS)z7Contains commands to interact with buckets via the CLI.) AnnotatedN)logging) BUCKET_PREFIX BucketFile FilterMatcher_parse_bucket_uri) REPO_REGIONS) SearchOptTokenOpt get_hf_api typer_factory)make_cp) format_sizeprint_file_listing) OutputFormatoutz"Commands to interact with buckets.)helpcreate)zhf buckets create my-bucketz hf buckets create user/my-bucketz-hf buckets create hf://buckets/user/my-bucketz*hf buckets create user/my-bucket --privatez+hf buckets create user/my-bucket --exist-okz,hf buckets create user/my-bucket --region us)nameexamplesF bucket_idzTBucket ID: bucket_name, namespace/bucket_name, or hf://buckets/namespace/bucket_nameprivatez --privatezCreate a private bucket.regionz--regionzdCloud region in which to create the bucket. Can be one of 'us' or 'eu'. Requires Team plan or above.exist_okz --exist-okz3Do not raise an error if the bucket already exists.tokenreturncCsvt|d}|tr t|}|jrtd|dtd|j}|j||r'|nd||d}t j d|j |j ddS) zCreate a new bucket.rz-Cannot specify a prefix for bucket creation: . Use namespace/bucket_name or namespace/bucket_name.N)rrrzBucket created)uriurl)r startswithrr path_in_repotyper BadParameterid create_bucketrresultr!to_urir")rrrrrapiparsed bucket_urlr.V/var/www/html/whisper/venv/lib/python3.10/site-packages/huggingface_hub/cli/buckets.pyr.s" *  argumentcCs.|tr|ttd}d|vS|}d|vS)zFCheck if argument is a bucket ID (namespace/name) vs just a namespace.N/)r#rlen)r0pathr.r.r/ _is_bucket_idls r4z list | ls) zhf buckets listzhf buckets list huggingfacez$hf buckets list --search "my-prefix"zhf buckets list user/my-bucketz!hf buckets list user/my-bucket -Rz!hf buckets list user/my-bucket -hz%hf buckets list user/my-bucket --treez(hf buckets list user/my-bucket --tree -hz+hf buckets list hf://buckets/user/my-bucketz%hf buckets list user/my-bucket/sub -RzyNamespace (user or org) to list buckets, or bucket ID (namespace/bucket_name(/prefix) or hf://buckets/...) to list files.human_readablez--human-readablez-hz$Show sizes in human readable format.as_treez--treez3List files in tree format (only for listing files). recursivez --recursivez-Rz0List files recursively (only for listing files).searchcCsT|duot|}|r|durtdt|||||ddSt||||||ddS)zList buckets or files in a bucket. When called with no argument or a namespace, lists buckets. When called with a bucket ID (namespace/bucket_name), lists files in the bucket. Nz'Cannot use --search when listing files.)r0r5r6r7r) namespacer8r5r6r7r)r4r%r& _list_files _list_buckets)r0r5r6r7r8r is_file_moder.r.r/list_cmdus&9   r=r9cs|rtd|rtd|dur$|tr$|ttd}|d}t|d}fdd|j||dD}tj |d d id dS) zList buckets in a namespace.z'Cannot use --tree when listing buckets.z,Cannot use --recursive when listing buckets.Nr1rcs6g|]}|j|jrt|jn|j|j|jdqS))r'rsize total_files created_at)r'rrr>r?r@).0bucketr5r.r/ sz!_list_buckets..)r9r8r>right) alignments) r%r&r#rr2rstripr list_bucketsrtable)r9r8r5r6r7rr+itemsr.rCr/r;s       r;cCs\|r tjtjkr tdt|d}t|}t|j |j |j pd|d}t ||||ddS)zList files in a bucket.z%Cannot use --tree with --format json.rNprefixr7)r5r6r7) rmoderjsonr%r&r rlistlist_bucket_treer'r$r)r0r5r6r7rr+r,rJr.r.r/r:s  r:infozhf buckets info user/my-bucketz+hf buckets info hf://buckets/user/my-bucketzFBucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_namecCs0t|d}t|}||j}tj|dddS)zGet info about a bucket.rr')id_keyN)r r bucket_infor'rdict)rrr+r,rBr.r.r/rQs  delete)z hf buckets delete user/my-bucketz-hf buckets delete hf://buckets/user/my-bucketz&hf buckets delete user/my-bucket --yesz-hf buckets delete user/my-bucket --missing-okyesz--yesz-yzSkip confirmation prompt. missing_okz --missing-okz3Do not raise an error if the bucket does not exist.cCs|trt|}|jrtd|dtd|j}nd|vr,td|dtdtjd|d|d t |d }|j ||d tj d |d dS)zDelete a bucket. This deletes the entire bucket and all its contents. Use `hf buckets rm` to remove individual files. z-Cannot specify a prefix for bucket deletion: rr r1zInvalid bucket ID: z-. Must be in format namespace/bucket_name or z(Are you sure you want to delete bucket ''?rVr)rWzBucket deletedrN) r#rrr$r%r&r'rconfirmr delete_bucketr))rrVrWrr,r+r.r.r/rUs& % z remove | rm)z)hf buckets remove user/my-bucket/file.txtz2hf buckets rm hf://buckets/user/my-bucket/file.txtz.hf buckets rm user/my-bucket/logs/ --recursivez:hf buckets rm user/my-bucket --recursive --include "*.tmp"z8hf buckets rm user/my-bucket/data/ --recursive --dry-runzBucket path: namespace/bucket_name/path or hf://buckets/namespace/bucket_name/path. With --recursive, namespace/bucket_name is also accepted to target all files.z0Remove files recursively under the given prefix.dry_runz --dry-runz8Preview what would be deleted without actually deleting.includezQInclude only files matching pattern (can specify multiple). Requires --recursive.excludezLExclude files matching pattern (can specify multiple). Requires --recursive.cslt|}|j|j}|dkr|stddd|s |r'|s'tdt|d} |rtd} g} | j|p;dd d D]} t | t rV| | | d t | d q?| d t | d |sf|rvt||d fdd| D} n| } dd| D}tdd| D}t|d d}|stddSt |d|}|s|stddd|Dtjd|dddd|rtdfdd|Dtd|ddS| j|d tjd!|dd"t ||d#dS|}|std$|rtd%td&|td'dStjd(|d)d|d| j|gd tjd*|d+dS),zbRemove files from a bucket. To delete an entire bucket, use `hf buckets delete` instead. z?No file path specified. To remove files, provide a path (e.g. 'zd/FILE') or use --recursive to remove all files. To delete the entire bucket, use `hf buckets delete z`.z,--include and --exclude require --recursive.rzListing files from remoteNTrKzListing files from remote (z files))include_patternsexclude_patternscsg|] }|jr|qSr.)matchesr3rAf)matcherr.r/rDszremove..cSsg|]}|jqSr.)r3rdr.r.r/rDscss|]}|jVqdSN)r>rdr.r.r/ szremove..rCzNo files to remove.z file(s) totaling  css|]}d|VqdS)z Nr.rAr3r.r.r/rhszRemove z from 'rXFrYc3s$|] }dtd|VqdS)delete: r1N)rrjrZr.r/rhs"z (dry run) z would be removed.)rUzRemoved ')r files_deletedr>zFile path cannot be empty.rkr1z"(dry run) 1 file would be removed.zRemove 'z' from 'z File removed)r3r)rr'r$r%r&r rstatusrP isinstancerappendupdater2donersumrtextjoinr[batch_bucket_filesr)r)r0r7rVr]r^r_rr,rLr+rn all_filesitem matched_files file_paths total_sizesize_str count_label file_pathr.)rrfr/removeQs|=             rmove)z/hf buckets move user/old-bucket user/new-bucketz/hf buckets move user/my-bucket my-org/my-bucketzIhf buckets move hf://buckets/user/old-bucket hf://buckets/user/new-bucketfrom_idzMSource bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_nameto_idzRDestination bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_namecCst|}|jrtd|dtdt|}|jr&td|dtdt|d}|j|j|jdtj d|j|jddS)z2Move (rename) a bucket to a new name or namespace.z)Cannot specify a prefix for bucket move: rr r)rrz Bucket movedN) rr$r%r&rr move_bucketr'rr))rrr parsed_from parsed_tor+r.r.r/rs" sync)z2hf buckets sync ./data hf://buckets/user/my-bucketz2hf buckets sync hf://buckets/user/my-bucket ./dataz;hf buckets sync ./data hf://buckets/user/my-bucket --deletez^hf buckets sync hf://buckets/user/my-bucket ./data --include "*.safetensors" --exclude "*.tmp"zIhf buckets sync ./data hf://buckets/user/my-bucket --plan sync-plan.jsonlz'hf buckets sync --apply sync-plan.jsonlzs|       3  !"# A #   1 ! ' -.   * !'-4 : @FMT\] {