gjR$L dZddlmZddlZddlmZddlmZmZm Z m Z ddl m Z dd l mZmZmZmZdd lmZdd lmZmZdd lmZmZejeZed Zedgd d|deeej dfdee!ej"ddfdee dzej"ddfdee!ej"ddfdeddf d Z#d!ede!fd"Z$ed#gd$ d}d!eedzej d%fd&ee!ej"d'd(d)fd*ee!ej"d+d,fd-ee!ej"d.d/d0fd1ededdfd2Z%d3edzd1edzd&e!d*e!d-e!dedzddfd4Z&d!ed&e!d*e!d-e!dedzddf d5Z'ed6d7d8g d~deeej d9fdeddfd:Z(ed;gd< ddeeej d9fd=ee!ej"d>d?d@fdAee!ej"dBdCfdeddf dDZ)edEgdF dd!eeej dGfd-ee!ej"d.d/dHfd=ee!ej"d>d?d@fdIee!ej"dJdKfdLee*edzej"dMfdNee*edzej"dOfdeddfdPZ+edQgdR d~dSeeej dTfdUeeej dVfdeddfdWZ,edXgdY ddZeedzej d[fd\eedzej d]fd;ee!ej"d^fd_ee!ej"d`dafdbee!ej"dcddfdeeedzej"dffdgeedzej"dhfdIee!ej"dJdifdLee*edzej"djfdNee*edzej"dkfdleedzej"dmfdnee!ej"dodpfdqee!ej"drdsfdtee!ej"dudvdwfdeddf dxZ-edygdzed{dS)z7Contains commands to interact with buckets via the CLI.) AnnotatedN)logging) BUCKET_PREFIX BucketFile FilterMatcher_parse_bucket_uri) REPO_REGIONS) SearchOptTokenOpt get_hf_api typer_factory)make_cp) format_sizeprint_file_listing) OutputFormatoutz"Commands to interact with buckets.)helpcreate)zhf buckets create my-bucketz hf buckets create user/my-bucketz-hf buckets create hf://buckets/user/my-bucketz*hf buckets create user/my-bucket --privatez+hf buckets create user/my-bucket --exist-okz,hf buckets create user/my-bucket --region us)nameexamplesF bucket_idzTBucket ID: bucket_name, namespace/bucket_name, or hf://buckets/namespace/bucket_nameprivatez --privatezCreate a private bucket.regionz--regionzdCloud region in which to create the bucket. Can be one of 'us' or 'eu'. Requires Team plan or above.exist_okz --exist-okz3Do not raise an error if the bucket already exists.tokenreturnctt|}|tr=t|}|jr t jd|dtd|j}|||r|nd||}tj d|j |j dS) zCreate a new bucket.rz-Cannot specify a prefix for bucket creation: . Use namespace/bucket_name or namespace/bucket_name.N)rrrzBucket created)uriurl)r startswithrr path_in_repotyper BadParameterid create_bucketrresultr#to_urir$)rrrrrapiparsed bucket_urls _/var/www/app.qaans.com/backend/venv/lib/python3.11/site-packages/huggingface_hub/cli/buckets.pyrr.sT 5 ! ! !CM**"9--   $W WW1>WWW I """, #J JZ^%:%:%<%<*.QQQQQQargumentc||tr|ttd}n|}d|vS)zFCheck if argument is a bucket ID (namespace/name) vs just a namespace.N/)r%rlen)r2paths r0 _is_bucket_idr7lsA=))M**,,- $;r1z list | ls) zhf buckets listzhf buckets list huggingfacez$hf buckets list --search "my-prefix"zhf buckets list user/my-bucketz!hf buckets list user/my-bucket -Rz!hf buckets list user/my-bucket -hz%hf buckets list user/my-bucket --treez(hf buckets list user/my-bucket --tree -hz+hf buckets list hf://buckets/user/my-bucketz%hf buckets list user/my-bucket/sub -RzyNamespace (user or org) to list buckets, or bucket ID (namespace/bucket_name(/prefix) or hf://buckets/...) to list files.human_readablez--human-readablez-hz$Show sizes in human readable format.as_treez--treez3List files in tree format (only for listing files). recursivez --recursivez-Rz0List files recursively (only for listing files).searchc|duot|}|r,|tjdt|||||dSt ||||||dS)zList buckets or files in a bucket. When called with no argument or a namespace, lists buckets. When called with a bucket ID (namespace/bucket_name), lists files in the bucket. Nz'Cannot use --search when listing files.)r2r8r9r:r) namespacer;r8r9r:r)r7r'r( _list_files _list_buckets)r2r8r9r:r;r is_file_modes r0list_cmdrAusr4'CM(,C,CL  $%NOO O)        )       r1r=c|rtjd|rtjd|K|tr1|t td}|d}t |}fd|||D}tj |dd i dS) zList buckets in a namespace.z'Cannot use --tree when listing buckets.z,Cannot use --recursive when listing buckets.Nr4r cg|]:}|j|jrt|jn|j|j|jd;S))r)rsize total_files created_at)r)rrrDrErF).0bucketr8s r0 z!_list_buckets..se     )~@N_K ^<<r>sJ38|000 !HIII 5 ! ! !C x ( (F   I&.$     Eu^WXabbbbbbr1infozhf buckets info user/my-bucketz+hf buckets info hf://buckets/user/my-bucketzFBucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_namect|}t|}||j}t j|ddS)zGet info about a bucket.r r))id_keyN)rr bucket_infor)rdict)rrr-r.rHs r0rWrWsO" 5 ! ! !C y ) )F __VY ' 'FHVD!!!!!!r1delete)z hf buckets delete user/my-bucketz-hf buckets delete hf://buckets/user/my-bucketz&hf buckets delete user/my-bucket --yesz-hf buckets delete user/my-bucket --missing-okyesz--yesz-yzSkip confirmation prompt. missing_okz --missing-okz3Do not raise an error if the bucket does not exist.c|tr>t|}|jr t jd|dtd|j}n$d|vr t jd|dtdtjd|d| t| }| || tj d | dS)zDelete a bucket. This deletes the entire bucket and all its contents. Use `hf buckets rm` to remove individual files. z-Cannot specify a prefix for bucket deletion: r!r"r4zInvalid bucket ID: z-. Must be in format namespace/bucket_name or z(Are you sure you want to delete bucket ''?r]r )r^zBucket deleted)rN) r%rrr&r'r(r)rconfirmr delete_bucketr+)rr]r^rr.r-s r0r\r\s-JM**  "9--   $W WW1>WWW I I    a) a a;H a a a   KH9HHHcRRRR 5 ! ! !CiJ777J9555555r1z remove | rm)z)hf buckets remove user/my-bucket/file.txtz2hf buckets rm hf://buckets/user/my-bucket/file.txtz.hf buckets rm user/my-bucket/logs/ --recursivez:hf buckets rm user/my-bucket --recursive --include "*.tmp"z8hf buckets rm user/my-bucket/data/ --recursive --dry-runzBucket path: namespace/bucket_name/path or hf://buckets/namespace/bucket_name/path. With --recursive, namespace/bucket_name is also accepted to target all files.z0Remove files recursively under the given prefix.dry_runz --dry-runz8Preview what would be deleted without actually deleting.includezQInclude only files matching pattern (can specify multiple). Requires --recursive.excludezLExclude files matching pattern (can specify multiple). Requires --recursive.cLt|}|j|j}|dkr|stjddd|s|r|stjdt |} |rt jd} g} | |pdd D]R} t| tr;| | | d t| d S| d t| d |s|r t|| fd| D} n| } d| D}t!d| D}t#|d }|st jddSt|d|}|sP|sNt jdd|Dt jd|ddd|rMt jdfd|Dt jd|ddS| |t jd|dd t||!dS|}|stjd"|r7t jd#t.d$|t jd%dSt jd&|d'd|| |gt jd(|)dS)*zbRemove files from a bucket. To delete an entire bucket, use `hf buckets delete` instead. z?No file path specified. To remove files, provide a path (e.g. 'zd/FILE') or use --recursive to remove all files. To delete the entire bucket, use `hf buckets delete z`.z,--include and --exclude require --recursive.r zListing files from remoteNTrQzListing files from remote (z files))include_patternsexclude_patternscHg|]}|j|S)matchesr6)rGfmatchers r0rIzremove..s,MMM1W__QV5L5LMQMMMr1cg|] }|j Srl)r6rGrns r0rIzremove..s444af444r1c3$K|] }|jV dSN)rDrqs r0 zremove..s$77A777777r1)r8zNo files to remove.z file(s) totaling  c3 K|] }d|V dS)z Nrl)rGr6s r0rtzremove..s(BBt{D{{BBBBBBr1zRemove z from 'r`Frac36K|]}dtd|VdS)delete: r4N)r)rGr6rs r0rtzremove..s:ccPTK-KKKTKKccccccr1z (dry run) z would be removed.)r\zRemoved ')r files_deletedrDzFile path cannot be empty.rxr4z"(dry run) 1 file would be removed.zRemove 'z' from 'z File removed)r6r)rr)r&r'r(rrstatusrV isinstancerappendupdater5donersumrtextjoinrbbatch_bucket_filesr+r)r2r:r]rdrerfrr.rRr-r{ all_filesitem matched_files file_paths total_sizesize_str count_label file_pathrros @@r0removerQszx ( (F I  F ||I|  R  R RDM R R R   Q7QIQ !OPPP 5 ! ! !C<H788&( (( >T)   U UD $ ++ U  &&& SC NNSSSTTT I#i..IIIJJJ  &g &#WwWWWGMMMM MMMMM%M44m444 7777777 z$???  H* + + + FZFFHFF  P7 P HTYYBBzBBBBB C C C KC+CCiCCC O O O O   HTYYccccXbccccc d d d HA+AAA B B B F y<<< 7{ 7 79 7 7 7j//         C$%ABB B   HF FyFF9FF G G G H9 : : : F ?y??)???SIIII y)=== > YGGGGGGr1move)z/hf buckets move user/old-bucket user/new-bucketz/hf buckets move user/my-bucket my-org/my-bucketzIhf buckets move hf://buckets/user/old-bucket hf://buckets/user/new-bucketfrom_idzMSource bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_nameto_idzRDestination bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_namect|}|jr tjd|dtdt|}|jr tjd|dtdt |}||j|jtj d|j|jdS)z2Move (rename) a bucket to a new name or namespace.z)Cannot specify a prefix for bucket move: r!r"r )rrz Bucket movedN) rr&r'r(rr move_bucketr)rr+)rrr parsed_from parsed_tor-s r0rrs2$G,,K   S S S-: S S S   "%((I   S S S-: S S S   5 ! ! !COOKN),O???J~{~Y\JJJJJJr1sync)z2hf buckets sync ./data hf://buckets/user/my-bucketz2hf buckets sync hf://buckets/user/my-bucket ./dataz;hf buckets sync ./data hf://buckets/user/my-bucket --deletez^hf buckets sync hf://buckets/user/my-bucket ./data --include "*.safetensors" --exclude "*.tmp"zIhf buckets sync ./data hf://buckets/user/my-bucket --plan sync-plan.jsonlz'hf buckets sync --apply sync-plan.jsonlzrWr\rUrrrrlr1r0rs. >= ######"!!!!! ::::::::&&&&&&&&  H % %m!EFFF     0   90R0R g    0R  +    0R t w     0R*  F    +0R8 90R: ;0R0R0R  0RfCD     0    E> >  d W    >    7    > $  F    %> 2   C    3> B C> D E> F G> > > > B 3Tz 3 $J 3 3 3  3 : 3  3 3 3 3Fcccc c : c  cccc0  (5 " " Y     "  "  " " " "   .  -.6.6 Y    .6    ,     .6  F    .6, -.6. /.6.6.6.6b    6    [HH a    H   C    H$    ,     %H4  K    5HB S D d    CHN S D _    OHZ [H\ ]HHH  HD  *"K"K  `    "K  e     "K "K "K"K"K"KT       &         yrPrP  d ^     rP  d c     rP   B     rP&  N    'rP4  O    5rPB  d  P     CrPN  d  6     OrPZ  H    [rPh S D I    irPt S D I    urP@ d  ;    ArPL  T    MrPZ  V    [rPh   8    irPx yrPz {rPrPrP  rPv      ')r1