o
h; @ sx d dl Zd dlmZ d dlmZmZmZmZm Z d dl
Z d dl m
Z
ddlmZmZmZ ddlmZ G dd d eZdS )
N)Path)AnyCallablecastOptionalUnion)Image )check_integrity download_and_extract_archiveverify_str_arg)
VisionDatasetc sJ e Zd ZdZdZdZdZdZdZdZ dd gd
d gd d
ggZ
ddgddggZ dZ d2de
eef dedee dee dee ded df fd d
Zdee d ee fd d Zd!ed eeef fd"d#Zd efd$d%Zd3d&ed'ee d eejeej f fd(d)Z d efd*d+Z d4d,d-Z d efd.d/Z dee d dfd0d1Z Z!S )5STL10a `STL10 `_ Dataset.
Args:
root (str or ``pathlib.Path``): Root directory of dataset where directory
``stl10_binary`` exists.
split (string): One of {'train', 'test', 'unlabeled', 'train+unlabeled'}.
Accordingly, dataset is selected.
folds (int, optional): One of {0-9} or None.
For training, loads one of the 10 pre-defined folds of 1k samples for the
standard evaluation procedure. If no value is passed, loads the 5k samples.
transform (callable, optional): A function/transform that takes in a PIL image
and returns a transformed version. E.g, ``transforms.RandomCrop``
target_transform (callable, optional): A function/transform that takes in the
target and transforms it.
download (bool, optional): If true, downloads the dataset from the internet and
puts it in root directory. If dataset is already downloaded, it is not
downloaded again.
Z stl10_binaryz9http://ai.stanford.edu/~acoates/stl10/stl10_binary.tar.gzzstl10_binary.tar.gzZ 91f7769df0f17e558f3565bffb0c7dfbzclass_names.txtzfold_indices.txtz train_X.binZ 918c2871b30a85fa023e0c44e0bee87fz train_y.binZ 5a34089d4802c674881badbb80307741zunlabeled_X.binZ 5242ba1fed5e4be9e1e742405eb56ca4z
test_X.binZ 7f263ba9f9e0b06b93213547f721ac82z
test_y.binZ 36f9794fa4beb8a2c72628de14fa638e)traintrain+unlabeled unlabeledtestr NFrootsplitfolds transformtarget_transformdownloadreturnc s t j|||d t|d| j| _| || _|r | n| s&t d| | jdkrO|
| j d d | j d d \| _ | _
ttj| j
| _
| | n| jdkr|
| j d d | j d d \| _ | _
ttj| j
| _
| | |
| j d d \}}t| j |f| _ t| j
td g|jd f| _
n4| jd
kr|
| j d d \| _ }td g| j jd | _
n|
| jd d | jd d \| _ | _
tj| j| j| j} tj | rt | }
|
| _ W d d S 1 sw Y d S d S ) N)r r r zHDataset not found or corrupted. You can use download=True to download itr r r r r )!super__init__r splitsr
_verify_foldsr r _check_integrity RuntimeError_STL10__loadfile
train_listdatalabelsr npndarray_STL10__load_foldsZ concatenateZasarrayshape test_listospathjoinr base_folderclass_names_fileisfileopenread
splitlinesclasses) selfr r r r r r Zunlabeled_data_Z
class_filef __class__ `/home/www/facesmatcher.com/frenv_anti/lib/python3.10/site-packages/torchvision/datasets/stl10.pyr / s:
(
(
&
(
"zSTL10.__init__c C sN |d u r|S t |tr |tdv r|S d}t||d}t|t|)N
zDValue for argument folds should be in the range [0, 10), but got {}.z>Expected type None or int for argument folds, but got type {}.)
isinstanceintrange
ValueErrorformattype)r5 r msgr: r: r; r [ s
zSTL10._verify_foldsindexc C sx | j dur| j| t| j | }}n| j| d}}tt|d}| jdur.| |}| jdur8| |}||fS )z
Args:
index (int): Index
Returns:
tuple: (image, target) where target is index of the target class.
N)r r r ) r% r$ r> r Z fromarrayr& transposer r )r5 rD Zimgtargetr: r: r; __getitem__g s
zSTL10.__getitem__c C s | j jd S )Nr )r$ r) r5 r: r: r; __len__ s z
STL10.__len__ data_file labels_filec C s d }|r-t j| j| j|}t|d}tj|tjdd }W d n1 s(w Y t j| j| j|}t|d }tj|tjd}t |d}t
|d}W d ||fS 1 s^w Y ||fS )Nrb)dtyper )r ` rO )r r rN r ) r+ r, r- r r. r1 r& fromfileZuint8ZreshaperE ) r5 rJ rK r% Zpath_to_labelsr7 Z path_to_dataZ
everythingZimagesr: r: r; Z
__loadfile s
zSTL10.__loadfilec C s> | j | j D ]\}}tj| j| j|}t||s dS qdS )NFT)r# r* r+ r, r- r r. r
)r5 filenamemd5Zfpathr: r: r; r s
zSTL10._check_integrityc C s0 | rd S t| j| j| j| jd | d S )N)rQ rR )r r urlr rQ tgz_md5rH r: r: r; r s zSTL10.downloadc C s dj di | jS )NzSplit: {split}r: )rA __dict__rH r: r: r;
extra_repr s zSTL10.extra_reprc C s |d u rd S t j| j| j| j}t|=}| | }t j
|t j dd}| j |d d d d d d f | _ | j
d urJ| j
| | _
W d d S W d d S 1 sUw Y d S )N )rM sep)r+ r, r- r r. folds_list_filer1 r2 r3 r& Z
fromstringZint64r$ r% )r5 r Z
path_to_foldsr7 Zstr_idxZlist_idxr: r: r; Z __load_folds s
"zSTL10.__load_folds)r NNNF)N)r N)"__name__
__module__ __qualname____doc__r. rS rQ rT r/ rY r# r* r r strr r r> r boolr r tupler rG rI r& r' r" r r rV r(
__classcell__r: r: r8 r; r sT
, ,
r )Zos.pathr+ pathlibr typingr r r r r numpyr& ZPILr utilsr
r r Zvisionr
r r: r: r: r; s