o ^i@sddlZddlZddlmZddlmZddlmZddlm Z m Z m Z m Z ddl mZddlmZGd d d eZGd d d eZGd ddeZdS)N) defaultdict) HTMLParser)Path)AnyCallableOptionalUnion)default_loader) VisionDatasetcs|eZdZdZdeeefddffdd Zdedee ee efddfd d Z deddfd d Z d eddfddZ ZS)Flickr8kParserzBParser for extracting captions from the Flickr8k dataset web page.rootreturnNcs,t||_i|_d|_d|_d|_dS)NF)super__init__r annotationsin_table current_tag current_img)selfr  __class__V/var/www/html/RAG/RAG_venv/lib/python3.10/site-packages/torchvision/datasets/flickr.pyrs  zFlickr8kParser.__init__tagattrscCs||_|dkr d|_dSdS)NtableTrr)rrrrrrhandle_starttag zFlickr8kParser.handle_starttagcCsd|_|dkr d|_dSdS)NrFr)rrrrr handle_endtag"rzFlickr8kParser.handle_endtagdatacCs|jrJ|dkr d|_dS|jdkr3|dd}tj|j|d}t|d}||_g|j |<dS|jdkrL|jrN|j}|j | | dSdSdSdS)NzImage Not Founda/z_*.jpgrli) rrrsplitospathjoinr globrappendstrip)rr!img_idrrr handle_data(s   zFlickr8kParser.handle_data)__name__ __module__ __qualname____doc__rstrrrlisttuplerrr r. __classcell__rrrrr s & r c seZdZdZddefdeeefdedee dee de ege fddf fd d Z d e de e e ffd d Zde fddZZS)Flickr8ka?`Flickr8k Entities `_ Dataset. Args: root (str or ``pathlib.Path``): Root directory where images are downloaded to. ann_file (string): Path to annotation file. transform (callable, optional): A function/transform that takes in a PIL image or torch.Tensor, depends on the given loader, and returns a transformed version. E.g, ``transforms.RandomCrop`` target_transform (callable, optional): A function/transform that takes in the target and transforms it. loader (callable, optional): A function to load an image given its path. By default, it uses PIL as its image loader, but users could also pass in ``torchvision.io.decode_image`` for decoding image data into tensors directly. Nr ann_file transformtarget_transformloaderrcstj|||dtj||_t|j}t|j}| | Wdn1s,wY|j |_ t t |j |_||_dS)Nr9r:)rrr'r( expanduserr8r r openfeedreadrr4sortedkeysidsr;)rr r8r9r:r;parserfhrrrrFs   zFlickr8k.__init__indexcCsN|j|}||}|jdur||}|j|}|jdur#||}||fSz Args: index (int): Index Returns: tuple: Tuple (image, target). target is a list of captions for the image. N)rCr;r9rr:)rrFr-imgtargetrrr __getitem__Zs       zFlickr8k.__getitem__cC t|jSNlenrCrrrr__len__p zFlickr8k.__len__)r/r0r1r2r rr3rrrrrintr5rJrPr6rrrrr77s(  r7c s|eZdZdZddefdededeedeedeegefddf fd d Z d e de eeffd d Z de fddZ ZS) Flickr30ka8`Flickr30k Entities `_ Dataset. Args: root (str or ``pathlib.Path``): Root directory where images are downloaded to. ann_file (string): Path to annotation file. transform (callable, optional): A function/transform that takes in a PIL image or torch.Tensor, depends on the given loader, and returns a transformed version. E.g, ``transforms.RandomCrop`` target_transform (callable, optional): A function/transform that takes in the target and transforms it. loader (callable, optional): A function to load an image given its path. By default, it uses PIL as its image loader, but users could also pass in ``torchvision.io.decode_image`` for decoding image data into tensors directly. Nr r8r9r:r;rc stj|||dtj||_tt|_t |j"}|D]}| d\}} |j|dd | qWdn1s?wYtt |j|_||_dS)Nr< r$)rrr'r(r=r8rr4rr>r,r&r+rArBrCr;) rr r8r9r:r;rEliner-captionrrrrs   zFlickr30k.__init__rFcCs^|j|}tj|j|}||}|jdur||}|j|}|jdur+||}||fSrG) rCr'r(r)r r;r9rr:)rrFr-filenamerHrIrrrrJs       zFlickr30k.__getitem__cCrKrLrMrOrrrrPrQzFlickr30k.__len__)r/r0r1r2r r3rrrrrRr5rJrPr6rrrrrSts( rS)r*r' collectionsr html.parserrpathlibrtypingrrrrfolderr visionr r r7rSrrrrs     +=