XRe@sdZddlmZddlZddlZddlZddlZddlmZddl m Z m Z m Z ddl mZmZmZddlmZddlmZdd lmZdd lmZdd lmZd d dfZGdd d eZGdddeZdZdZ dZ!ej"r:e#nej$Z%Gdd d e&Z'Gdddej(Z)Gdddej(Z*Gdddej(Z+Gdddej(Z,ddZ-dd Z.Gd!d"d"e&Z/d#d$Z0d%d&Z1dS)'z Multi-part parsing for file uploads. Exposes one class, ``MultiPartParser``, which feeds chunks of uploaded data to file upload handlers for processing. )unicode_literalsN)settings)RequestDataTooBigSuspiciousMultipartFormTooManyFieldsSent)SkipFileStopFutureHandlers StopUpload)six)MultiValueDict) force_text)unquote)unescape_entitiesMultiPartParserMultiPartParserErrorInputStreamExhaustedc@seZdZdS)rN)__name__ __module__ __qualname__rrI/home/ubuntu/projects/ifolica/build/django/django/http/multipartparser.pyrs c@seZdZdZdS)rz5 No more reads are allowed from this device. N)rrr__doc__rrrrr"s rawfilefieldc@sUeZdZdZdddZddZddZd d Zd d ZdS) rz A rfc2388 multipart/form-data parser. ``MultiValueDict.parse()`` reads the input stream in ``chunk_size`` chunks and returns a tuple of ``(MultiValueDict(POST), MultiValueDict(FILES))``. Nc Cst|jdd}|jds4td|nt|jd\}}|jd}| sutj| rtd|nyt|jdd } Wntt fk rd } YnX| d krtd | nt |t j r|jd}n||_ ||_d d |D} tdg| |_||_|pXtj|_| |_||_dS)a Initialize the MultiPartParser object. :META: The standard ``META`` dictionary in Django request objects. :input_data: The raw post data, as a file-like object. :upload_handlers: A list of UploadHandler instances that perform operations on the uploaded data. :encoding: The encoding with which to treat the incoming data. CONTENT_TYPEz multipart/zInvalid Content-Type: %sasciiboundaryz!Invalid boundary in multipart: %sCONTENT_LENGTHrzInvalid content length: %rcSs"g|]}|jr|jqSr) chunk_size).0xrrr es z,MultiPartParser.__init__..Nli)get startswithr parse_headerencodecgivalid_boundaryint ValueError TypeError isinstancer text_type _boundary _input_datamin _chunk_size_metarDEFAULT_CHARSET _encoding_content_length_upload_handlers) selfZMETAZ input_dataZupload_handlersencoding content_typectypesoptsrcontent_lengthZpossible_sizesrrr__init__6s.      zMultiPartParser.__init__c"1Csrddlm}|j}|j}|jdkrJ|d|jtfSxS|D]K}|j|j|j|j|j |}|dk rQ|d|dfSqQW|dd|_ t|_ t t |j|j}d}dgt|}d} d} d} yxt||j D]\} } }|rH|j||d}ny"| dd}|d j}Wntttfk rwYnX| jd }|dk r|dj}nt||d d }| tkr| d7} tjdk rtj| krtd ntjdk r0tj| } n|dkr|jd| }| t|7} ytj|}Wqt k r|}YqXn"|jd| }| t|7} | t|d7} tjdk r| tjkrt!dn|j j"|t||d d q| t#kr|jd}|ret||d d }|j$t%|}n|sqqn| jddif\}}|j}|jd}yt&| jdd}Wn!tt't(fk rd}YnXdgt|}yxD|D]<}y |j)||||||Wqt*k rCPYqXqWxV|D]N}|dkr@dj+|j,}t|d}xL|dkr|jd|}|dj+|j,7}t|d}qWytj|}Wq@t-k r<}z2d|}t.j/t0t0|t1j2dWYdd}~Xq@XnxZt3|D]L\}}t|} |j4|||}||| 7<|dkrMPqMqMWqOWWn&t5k r|j6t7|YqX|}qt7|qWWnHt8k r-}z(|j6|j9st7|jnWYdd}~XnXt7|jx$|D]}|j:}!|!rBPqBqBW|j |j fS)z Parse the POST data and break it into a FILES MultiValueDict and a POST MultiValueDict. Returns a tuple containing the POST and FILES dictionary, respectively. r) QueryDictr<NZmutableTzcontent-dispositionnamezcontent-transfer-encodingerrorsreplacezRThe number of GET/POST parameters exceeded settings.DATA_UPLOAD_MAX_NUMBER_FIELDS.base64sizer$z;Request body exceeded settings.DATA_UPLOAD_MAX_MEMORY_SIZE.filenamez content-typercharsetzcontent-lengthr&z Could not decode base64 data: %r);Z django.httprBr8r:r9r Zhandle_raw_inputr3r6r2Z_post_files LazyStream ChunkIterr5lenParserhandle_file_completestripKeyError IndexErrorAttributeErrorr'r FIELDrZDATA_UPLOAD_MAX_NUMBER_FIELDSrZDATA_UPLOAD_MAX_MEMORY_SIZEreadrG b64decode_BASE64_DECODE_ERRORr appendlistFILE IE_sanitizerr-r/r.Znew_filerjoinsplit Exceptionr reraisersysexc_info enumerateZreceive_data_chunkr _close_filesexhaustr Zconnection_resetZupload_complete)"r;rBr<handlershandlerresultstreamold_field_namecountersZnum_bytes_readZ num_post_keysZ read_sizeZ item_typeZ meta_dataZ field_stream disposition field_nameZtransfer_encodingZraw_datadata file_namer=Zcontent_type_extrarJr@chunkZstripped_chunk remainingZ over_chunkemsgiZ chunk_lengthretvalrrrparsems       "                  9         #   zMultiPartParser.parsecCsfx_t|jD]N\}}|j||}|r|jjt||jdd|PqqWdS)zT Handle all the signaling that takes place when a file is complete. rErFN)rcr:Z file_completerLrZr r8)r;rjrkrtrgZfile_objrrrrQ(s z$MultiPartParser.handle_file_completecCs'|o&||jdddjS)z3Cleanup filename from Internet Explorer full paths.\rCN)rfindrR)r;rIrrrr\5szMultiPartParser.IE_sanitizecCs7x0|jD]%}t|dr |jjq q WdS)Nr)r:hasattrrclose)r;rgrrrrd9szMultiPartParser._close_files) rrrrrArvrQr\rdrrrrr/s 7 c@s|eZdZdZdddZddZdddZd d Zd d Zd dZ ddZ ddZ dS)rMa! The LazyStream wrapper allows one to get and "unget" bytes from a stream. Given a producer object (an iterator that yields bytestrings), the LazyStream object will support iteration, reading, and keeping a "look-back" variable in case you need to "unget" some bytes. NcCsC||_d|_d|_||_d|_||_g|_dS)z Every LazyStream must have a producer when instantiated. A producer is an iterable that returns a string each time it is called. FrKrN) _producerZ_empty _leftoverlengthposition _remaining_unget_history)r;Zproducerr}rrrrAJs      zLazyStream.__init__cCs|jS)N)r~)r;rrrtellYszLazyStream.tellcs+fdd}dj|}|S)Nc 3sdkrjn}|dkr9djVdSx|dkr|dks`tdyt}Wntk rdSYq<X|d|}j||d|t|8}|Vq<WdS)NrKrz0remaining bytes to read should never go negative)rr]AssertionErrornext StopIterationungetrO)rqrpZemitting)r;rHrrparts]s   zLazyStream.read..partsrK)r])r;rHroutr)r;rHrrW\szLazyStream.readcCsO|jr|j}d|_nt|j}g|_|jt|7_|S)a  Used when the exact number of bytes to read is unimportant. This procedure just returns whatever is chunk is conveniently returned from the iterator instead. Useful to avoid unnecessary bookkeeping if performance is an issue. rK)r|rr{rr~rO)r;outputrrr__next__ws    zLazyStream.__next__cCs g|_dS)z Used to invalidate/disable this lazy stream. Replaces the producer with an empty list. Any leftover bytes that have already been read will still be reported upon read() and/or next(). N)r{)r;rrrrzszLazyStream.closecCs|S)Nr)r;rrr__iter__szLazyStream.__iter__cCsQ|s dS|jt||jt|8_dj||jg|_dS)z Places bytes back onto the front of the lazy stream. Future calls to read() will return those bytes first. The stream position and thus tell() will be rewound. NrK)_update_unget_historyrOr~r]r|)r;bytesrrrrs zLazyStream.ungetcs^g|jdd|_tfdd|jD}|dkrZtdndS)a[ Updates the unget history as a sanity check to see if we've pushed back the same number of bytes in one chunk. If we keep ungetting the same number of bytes many times (here, 50), we're mostly likely in an infinite loop of some sort. This is usually caused by a maliciously-malformed MIME request. N1cs"g|]}|kr|qSrr)r!Zcurrent_number) num_bytesrrr#s z4LazyStream._update_unget_history..(zThe multipart parser got stuck, which shouldn't happen with normal uploaded files. Check for malicious upload activity; if there is none, report this to the Django developers.)rrOr)r;rZ number_equalr)rrrs " z LazyStream._update_unget_history) rrrrrArrWrrzrrrrrrrrMBs     rMc@s=eZdZdZd ddZddZdd Zd S) rNz An iterable that will yield chunks of data. Given a file-like object as the constructor, this object will yield chunks of read operations from that object. @icCs||_||_dS)N)flor )r;rr rrrrAs zChunkIter.__init__c CsNy|jj|j}Wntk r6tYnX|rA|StdS)N)rrWr rr)r;rnrrrrs zChunkIter.__next__cCs|S)Nr)r;rrrrszChunkIter.__iter__Ni)rrrrrArrrrrrrNs  rNc@s:eZdZdZddZddZddZdS) InterBoundaryIterz7 A Producer that will iterate over boundaries. cCs||_||_dS)N)_streamr2)r;rirrrrrAs zInterBoundaryIter.__init__cCs|S)Nr)r;rrrrszInterBoundaryIter.__iter__c Cs?ytt|j|jSWntk r:tYnXdS)N)rM BoundaryIterrr2rr)r;rrrrs zInterBoundaryIter.__next__N)rrrrrArrrrrrrs   rc@sIeZdZdZddZddZddZdd d Zd S) rae A Producer that is sensitive to boundaries. Will happily yield bytes until a boundary is found. Will yield the bytes before the boundary, throw away the boundary bytes themselves, and push the post-boundary bytes back on the stream. The future calls to next() after locating the boundary will raise a StopIteration exception. cCsf||_||_d|_t|d|_|jjd}|sRtn|jj|dS)NFrC)rr2_donerO _rollbackrWrr)r;rirZ unused_charrrrrAs    zBoundaryIter.__init__cCs|S)Nr)r;rrrrszBoundaryIter.__iter__c CsO|jrtn|j}|j}d}g}xN|D]=}|t|7}|j|||krmPn|s:Pq:q:Wd|_|stndj|}|j|t||jk}|r|\}} |j|| dd|_|d|S|d| s$d|_|S|j|| d|d| SdS)NrTrK) rrrrrOappendr]_find_boundaryr) r;rirollback bytes_readchunksrrprendrrrrrs8         !   zBoundaryIter.__next__FcCs|j|j}|dkr"dS|}|t|j}td|d}|||ddkru|d8}ntd|d}|||ddkr|d8}n||fSdS)a) Finds a multipart boundary in data. Should no boundary exist in the data None is returned instead. Otherwise a tuple containing the indices of the following are returned: * the end of current encapsulation * the start of the next encapsulation rNrCs s )findr2rOmax)r;rneofindexrrlastrrrr&s    zBoundaryIter._find_boundaryN)rrrrrArrrrrrrrs    )rc Csjd}yt|}Wn!tk r9t|d}YnX|dkrUtdnx|D]}q\WdS)z Completely exhausts an iterator or stream. Raise a MultiPartParserError if the argument is not a stream or an iterable. Ni@zGmultipartparser.exhaust() was passed a non-iterable or stream parameter)iterr/rNr)Zstream_or_iterableiterator__rrrre@s   rec Cs;|j|}|jd}dd}|d krP|j|ti|fS|d|}|j||ddt}i}x|jdD]w}y||\} \} } Wntk rwYnX| dkrt}| jd rt}qn| | f|| ._parse_headerrCNr&s zcontent-dispositionrI) rWrrRAWr^r.rVr'r[) riZmax_header_sizerpZ header_endrheaderZTYPEZoutdictrrDrrrrrparse_boundary_streamSs.        rc@s(eZdZddZddZdS)rPcCs||_d||_dS)Ns--)r _separator)r;rirrrrrAs zParser.__init__ccs8t|j|j}x|D]}t|dVqWdS)Ni)rrrr)r;ZboundarystreamZ sub_streamrrrrs zParser.__iter__N)rrrrArrrrrrPs  rPc Cstd|}|jdjjd}i}x|D]}|jd}|dkr;d}|d|jjjd}|jdr|dd}|jd d krd }qn||ddj}|rA|jd \} } }t j r)t |jd | j}qAt |j| }nt |d kr|dd|ddko~d knr|dd}|j ddj dd }n|||s>    sa  ; !