U .bl9@s ddlZddlZddlZddlmZddlmZmZmZm Z m Z e e Z deee e giZddZddZd%d d Zd&d d Zd'd dZddZddZddZGdddZGdddZGdddeZGdddeZGdddeZGdd d eZGd!d"d"eZGd#d$d$eZdS)(N)crc32) ChecksumErrorConnectionClosedErrorConnectionErrorEndpointConnectionErrorReadTimeoutErrorZGENERAL_CONNECTION_ERRORcCs<|dkrt}n|dkr(td||||d}|S)a1Calculate time to sleep based on exponential function. The format is:: base * growth_factor ^ (attempts - 1) If ``base`` is set to 'rand' then a random number between 0 and 1 will be used as the base. Base must be greater than 0, otherwise a ValueError will be raised. Zrandrz.The 'base' param must be greater than 0, got: )random ValueError)base growth_factorattemptsZ time_to_sleepr9/tmp/pip-unpacked-wheel-7df6wvge/botocore/retryhandler.pydelay_exponential+s  rcCstjt||dS)zCreate an exponential delay function based on the attempts. This is used so that you only have to pass it the attempts parameter to calculate the delay. r r ) functoolspartialrrrrr!create_exponential_delay_functionBs rcCs$t||d}t||d}t||dS)N)operation_name)checkeraction) create_checker_from_retry_configcreate_retry_action_from_config RetryHandler)configrrrrrrcreate_retry_handlerNsrcCs0|dd}|ddkr,t|d|ddSdS)N __default__delaytypeZ exponentialr r r)r)rrZ delay_configrrrrXs   rc Csg}d}g}d|krj|ddg}|dd}|D]4}||}|t|t|}|dk r4||q4|dk r||dk r||d} | D]4}|t| |t| |}|dk r||qt|dkrt|d|dSt|} t| |t|dSdS)Nrpolicies max_attemptsrr)r!)r!retryable_exceptions) getappend_create_single_checker_extract_retryable_exceptionextendlenMaxAttemptsDecorator MultiCheckertuple) rrcheckersr!r"r keyZcurrent_configZretry_exceptionZoperation_policiesZ multi_checkerrrrres:     rcCs2d|dkrt|ddSd|dkr.tSdS)Nresponse applies_when socket_errors)_create_single_response_checkerExceptionRaiser)rrrrr%s    r%cCsZd|krt|d|dd}n8d|kr6t|dd}n d|krNt|dd}ntd|S)NZservice_error_codeZhttp_status_code) status_code error_code)r3 crc32body)headerzUnknown retry policy)ServiceErrorCodeCheckerHTTPStatusCodeChecker CRC32Checkerr )r.rrrrr1sr1cCsN|d}d|dikrtgSd|krJg}|dD]}|t|q2|SdS)Nr/r5r.r0)r#rr' EXCEPTION_MAP)rr/ exceptionsnamerrrr&s r&c@s eZdZdZddZddZdS)raRetry handler. The retry handler takes two params, ``checker`` object and an ``action`` object. The ``checker`` object must be a callable object and based on a response and an attempt number, determines whether or not sufficient criteria for a retry has been met. If this is the case then the ``action`` object (which also is a callable) determines what needs to happen in the event of a retry. cCs||_||_dSN)_checker_action)selfrrrrr__init__szRetryHandler.__init__cKsn|||d}t|jtr8|ddd}|d|i|jf|r`|j|d}td||Stdd S) zHandler for a retry. Intended to be hooked up to an event handler (hence the **kwargs), this will process retries appropriately. )attempt_numberr.caught_exceptionZ request_dictcontextretriesretries_context)r zRetry needed, action of: %szNo retry needed.N) isinstancer>r)r#updater?loggerdebug)r@r r.rCkwargsZchecker_kwargsrFresultrrr__call__s    zRetryHandler.__call__N)__name__ __module__ __qualname____doc__rArMrrrrrs rc@s(eZdZdZddZddZddZdS) BaseCheckerzBase class for retry checkers. Each class is responsible for checking a single criteria that determines whether or not a retry should not happen. cCs4|dk r|||S|dk r(|||StddS)aDetermine if retry criteria matches. Note that either ``response`` is not None and ``caught_exception`` is None or ``response`` is None and ``caught_exception`` is not None. :type attempt_number: int :param attempt_number: The total number of times we've attempted to send the request. :param response: The HTTP response (if one was received). :type caught_exception: Exception :param caught_exception: Any exception that was caught while trying to send the HTTP response. :return: True, if the retry criteria matches (and therefore a retry should occur. False if the criteria does not match. Nz,Both response and caught_exception are None.)_check_response_check_caught_exceptionr )r@rBr.rCrrrrMs zBaseChecker.__call__cCsdSr=rr@rBr.rrrrSszBaseChecker._check_responsecCsdSr=rr@rBrCrrrrTsz#BaseChecker._check_caught_exceptionN)rNrOrPrQrMrSrTrrrrrRsrRc@s*eZdZdZd ddZddZddZdS) r)aAllow retries up to a maximum number of attempts. This will pass through calls to the decorated retry checker, provided that the number of attempts does not exceed max_attempts. It will also catch any retryable_exceptions passed in. Once max_attempts has been exceeded, then False will be returned or the retryable_exceptions that was previously being caught will be raised. NcCs||_||_||_dSr=)r> _max_attempts_retryable_exceptions)r@rr!r"rrrrAszMaxAttemptsDecorator.__init__cCsz|rt|dd|j|d<||||}|rr||jkrl|dk r\d|dkr\d|ddd<td|dS|SndSdS) NmaxrZResponseMetadatarTZMaxAttemptsReachedz0Reached the maximum number of retry attempts: %sF)rYr#rW _should_retryrIrJ)r@rBr.rCrFZ should_retryrrrrMs0   zMaxAttemptsDecorator.__call__c Csp|jr^||jkr^z||||WS|jk rZ}ztjd|ddWYdSd}~XYqlXn||||SdS)Nz,retry needed, retryable exception caught: %sT)exc_info)rXrWr>rIrJ)r@rBr.rCerrrrZ0sz"MaxAttemptsDecorator._should_retry)N)rNrOrPrQrArMrZrrrrr)s r)c@seZdZddZddZdS)r8cCs ||_dSr=) _status_code)r@r3rrrrADszHTTPStatusCodeChecker.__init__cCs*|dj|jkr"td|jdSdSdS)Nrz5retry needed: retryable HTTP status code received: %sTF)r3r]rIrJrUrrrrSGsz%HTTPStatusCodeChecker._check_responseNrNrOrPrArSrrrrr8Csr8c@seZdZddZddZdS)r7cCs||_||_dSr=)r] _error_code)r@r3r4rrrrASsz ServiceErrorCodeChecker.__init__cCsJ|dj|jkrF|ddid}||jkrFtd|j|jdSdS)NrrErrorZCodez>retry needed: matching HTTP status and error code seen: %s, %sTF)r3r]r#r_rIrJ)r@rBr.Zactual_error_coderrrrSWs z'ServiceErrorCodeChecker._check_responseNr^rrrrr7Rsr7c@seZdZddZddZdS)r*cCs ||_dSr=Z _checkers)r@r,rrrrAfszMultiChecker.__init__cCs(|jD]}||||}|r|SqdS)NFra)r@rBr.rCrZchecker_responserrrrMis  zMultiChecker.__call__N)rNrOrPrArMrrrrr*esr*c@seZdZddZddZdS)r9cCs ||_dSr=) _header_name)r@r6rrrrAtszCRC32Checker.__init__cCst|d}|j|j}|dkr.td|jnBt|djd@}|t|ksptdt||tdt||ddS)Nrz?crc32 check skipped, the %s header is not in the http response.lz>retry needed: crc32 check failed, expected != actual: %s != %sr)Z checksum_typeZexpected_checksumZactual_checksum) headersr#rbrIrJrcontentintr)r@rBr. http_responseZ expected_crcZ actual_crc32rrrrSxs& zCRC32Checker._check_responseNr^rrrrr9ssr9c@seZdZdZddZdS)r2z`Raise any caught exceptions. This class will raise any non None ``caught_exception``. cCs|dSr=rrVrrrrTsz'ExceptionRaiser._check_caught_exceptionN)rNrOrPrQrTrrrrr2sr2)N)N)N)rloggingr binasciirZbotocore.exceptionsrrrrr getLoggerrNrIr:rrrrrr%r1r&rrRr)r8r7r*r9r2rrrrs8    "  ).?