U ad< @sddlZddlZddlZddlmZddlmZddlmZddl m Z m Z ddl m Z mZddlZddlmZddlmZmZdd lmZdd lmZdd lmZeejed krdd lmZzzddlmZWn e k rddl!mZYnXddl"m#Z#zddl$m%Z%Wn,e k r>ddl&m'Z'dddZ%YnXWn^e k rz(ddlm%Z%ddl(mZddl)m#Z#Wne k redYnXYnXzddl*Z*dZ+Wne k rdZ+YnXGdddeZ,dS)N) LooseVersion)urlparse) HTTPError)Requesturlopen) ServerProxyFault)sleep) BaseCommand CommandError) color_style) signalcommand)InstallRequirementz19.0)install_req_from_line) PipSession)parse_requirements)get_installed_distributions)castTFc sXddlm}m}ddlm|dkr,|}n||}|j||||d}fdd|DS)zReturn a list of installed Distribution objects. Left for compatibility until direct pkg_resources uses are refactored out. r)get_default_environmentget_environment) DistributionN) local_onlyinclude_editableseditables_only user_onlycsg|]}t|jqS)rZ_dist).0distZ_DistrT/tmp/pip-unpacked-wheel-portabvm/django_extensions/management/commands/pipchecker.py 7sz/get_installed_distributions..)Zpip._internal.metadatarrZ$pip._internal.metadata.pkg_resourcesrZiter_installed_distributions) rrrrpathsrrenvdistsrrrr s  rz#Pip version 6 or higher is requiredcs^eZdZdZfddZeddZdddZd d Zd d Z d dZ ddZ ddZ Z S)Commandz4Scan pip requirement files for out-of-date packages.c sRt||jdddddd|jddd d gd d d f|jdddddddS)Nz-tz--github-api-tokenstoregithub_api_tokenz"A github api authentication token.)actiondesthelpz-rz --requirementappend requirementsZFILENAMEzeCheck all the packages listed in the given requirements file. This option can be used multiple times.)r'r(defaultmetavarr)z-nz--newer store_true show_newerz9Also show when newer version then available is installed.)super add_arguments add_argument)selfparser __class__rrr1Ks0 zCommand.add_argumentsc Ost|_||_|dr |d}nftjdr4dg}nRtjdrVddtdD}n0tjdrjdg}ntjdr~dg}ntdi|_t }|D]v}t ||dD]d}t |t st |j}|jr|jn|jj}ttjtd kr||jd |j|<q||jd |j|<qqW5QRX|d r0|d |_n$tjd rNtjd |_nd|_|trl|n|j|jd |dS)Nr+zrequirements.txtcSs:g|]2}tjtjd|r|drd|qS)r+z.txtzrequirements/{0})ospathisfilejoinlowerendswithformat)rfrrrr fsz"Command.handle..zrequirements-dev.txtzrequirements-prod.txtzRequirements file(s) not found)sessionz6.0.8)pip_requrlr&ZGITHUB_API_TOKENzYCannot check github urls. The requests library is not installed. ( pip install requests )) r styleoptionsr7r8existslistdirr reqsrr isinstancerr requirementnamelinkfilenamerpip __version__rAr&environget check_pypi HAS_REQUESTS check_githubstdoutwriteERROR check_other)r3argsrCZ req_filesr?rKreqrIrrrhandle\sN          zCommand.handleNcCst||d}tt|S)z#Shorcut for return contents as jsonheaders)rjsonloadsrread)r3rAr[rXrrr_urlopen_as_jsons zCommand._urlopen_as_jsoncCstdt| S)Nz([ab]|rc|dev)\d+$)researchstr)r3versionrrr _is_stableszCommand._is_stablecs@|r,fdd|D}|r,t|dS|r.rre)r3 dist_version availableZstablerrgr_available_versions   zCommand._available_versionc CstD]&}|j}||jkr||j|d<qtd}t|jD]x\}}|dr\qDnDd|kr|d}t|j}d}d}|r z<| |dj dp| |dj ddd}d }t d Wqt k r}z&|j|j|jd t d W5d}~XYqXq|||} | s,|jd } nV|jdrV|| krV|jd| } n,| |krt|jd| } nd} |j|=qD|jdj|d} nd} |} |jdj| | d|j|=qDdS)z>If the requirement is frozen to pypi, check for a new version.rzhttps://pypi.python.org/pypirATNr@-_FzRetrying in 60 seconds!<zFrelease is not on pypi (check capitalization and/or --extra-index-url)r/z{0} available (newer installed)z {0} available up to date"{dist.project_name} {dist.version}rz not installed{pkg_info:40} {msg}pkg_infomsg)r project_namerFkeysrlistitemsrrcZpackage_releasesrIreplacer rrSrT faultStringrjrBWARNrCINFOr=BOLD) r3rrIpypirXrhretryrierrZavailable_versionrurtrrrrPsJ   ,    zCommand.check_pypic Cst|jD]z\}}|d}|s&qt|}|drBd|krBq|drNqddi}|jrld|j|d<zt|j d d d  d  d  d }t |d kr|\}}nPd|kr|dd \}}|d|ddddd7}n|jd|fWqWnLttfk rJ}z(|j|jd||fWYqW5d}~XYnXztjd|d} Wn@tk r}z |jdt|WYdSd}~XYnXd| kr| ddkr|j|jddSd| kr | ddr |j|jddSd} d|kr@| d\} } | drX| d d} nd|krX| d\} } | dkrn|jd } | r,d!|| }tj||d}d"|| | }tj||d}d|kr|dd#kr|jd$| dd%|} nD|d&d'd(|Dkr|jd)} n|jd*|d&dd%} d+|krHd,j|d+d-}n$| dkrX|}nd.|| dd%}|jd/j|| d0|j|=qdS)1a If the requirement is frozen to a github url, check for new commits. API Tokens ---------- For more than 50 github api calls per hour, pipchecker requires authentication with the github api by settings the environemnt variable ``GITHUB_API_TOKEN`` or setting the command flag --github-api-token='mytoken'``. To create a github api token for use at the command line:: curl -u 'rizumu' -d '{"scopes":["repo"], "note":"pipchecker"}' https://api.github.com/authorizations For more info on github api tokens: https://help.github.com/articles/creating-an-oauth-token-for-command-line-use http://developer.github.com/v3/oauth/#oauth-authorizations-api Requirement Format ------------------ Pipchecker gets the sha of frozen repo and checks if it is found at the head of any branches. If it is not found then the requirement is considered to be out of date. Therefore, freezing at the commit hash will provide the expected results, but if freezing at a branch or tag name, pipchecker will not be able to determine with certainty if the repo is out of date. Freeze at the commit hash (sha):: git+git://github.com/django/django.git@393c268e725f5b229ecb554f3fac02cfc250d2df#egg=Django https://github.com/django/django/archive/393c268e725f5b229ecb554f3fac02cfc250d2df.tar.gz#egg=Django https://github.com/django/django/archive/393c268e725f5b229ecb554f3fac02cfc250d2df.zip#egg=Django Freeze with a branch name:: git+git://github.com/django/django.git@master#egg=Django https://github.com/django/django/archive/master.tar.gz#egg=Django https://github.com/django/django/archive/master.zip#egg=Django Freeze with a tag:: git+git://github.com/django/django.git@1.5b2#egg=Django https://github.com/django/django/archive/1.5b2.tar.gz#egg=Django https://github.com/django/django/archive/1.5b2.zip#egg=Django Do not freeze:: git+git://github.com/django/django.git#egg=Django rAgitz github.com/).tar.gzz.tar.bz2.zipz content-typezapplication/jsonz token {0} Authorization#rmr/archiveN@rrz Failed to parse %r z Failed to parse %r: %s zhttps://api.github.com/django/rZz %s messagezBad credentialsz( Github API: Bad credentials. Aborting! zAPI Rate Limit Exceededz, Github API: Rate Limit Exceeded. Aborting! z.gitzrepo is not frozenz-https://api.github.com/repos/{0}/{1}/branchesz0https://api.github.com/repos/{0}/{1}/commits/{2}z Not Foundz*{0} not found in {1}. Repo may be private. shacSsg|]}|ddqS)commitrr)rbranchrrrr Esz(Command.check_github..roz!{0} is not the head of any branchrrprqz{0} {1}rrrs)rxrFryrb startswithr<r&r=rr8splitstriprstriplenrzrBrU ValueError IndexErrorrSrTrequestsrOr\rr~r})r3rIrXZreq_urlr[ path_partsuserrepoeZ test_authZfrozen_commit_sha repo_nameZfrozen_commit_fullruZ branch_urlZ branch_dataZfrozen_commit_urlZfrozen_commit_datartrrrrRs/ (  "        zCommand.check_githubcCs|jr|j|jd|jD]\\}}d|krFdj|dd}nd|kr`dj|dd}nd}|j|jd j|d q$d S) z If the requirement is frozen somewhere other than pypi or github, skip. If you have a private pypi or use --extra-index-url, consider contributing support here. z7 Only pypi and github based requirements are supported:rrprqrAz{url})rAzunknown packagez1{pkg_info:40} is not a pypi or github requirement)rtN)rFrSrTrBrUryr=r~)r3rIrXrtrrrrVSszCommand.check_other)N)__name__ __module__ __qualname__r)r1r rYr_rdrjrPrRrV __classcell__rrr5rr$Hs  6 -r$)TTFFN)-r\r7r`Zdistutils.versionr urllib.parser urllib.errorrurllib.requestrr xmlrpc.clientrrrLtimer Zdjango.core.management.baser r Z"django_extensions.management.colorr Z"django_extensions.management.utilsr Zpip._internal.reqrrMpip._internal.req.constructorsrpip._internal.network.sessionr ImportErrorZpip._internal.downloadZpip._internal.req.req_filerpip._internal.utils.miscrtypingrZ pip.downloadZpip.reqrrQr$rrrrsX