o ?e3@s$dZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z ddl m Z ddlmZedZdZdZejdkrLeZ ejd krWeZejZneZejZed Zed Zd d ZddZddZddZddZ ddZ!ddZ"d!ddZ#ddZ$d"dd Z%dS)#z/Converting code to AST. Adapted from Tangent. N)errors) inspect_utils) tf_inspect ) )r __future__z\s*cCs |ddS)z7Removes any backslash line continuations from the code.z\ r)replace) code_stringr h/home/www/facesmatcher.com/pyenv/lib/python3.10/site-packages/tensorflow/python/autograph/pyct/parser.py_unfold_continuations:s rcCst|}tt|j}d}g}z |D]}||qWn tjy'Ynw|D]&}|\}}}}}|tjkr@|}t |}qQ|tj tj tj tj fvrPd}qQq*|sU|St |}d|v} t|D]3\} }|\}}}}}|tjkrd|vrw| s}d|vr| stdt ||kr||d}||f|| <qat|} g} t|d| dD]0\} }tt| }tt|}t |t |kr| t |t |d}n| }| |qd| } | S)z9Dedents a code so that its first line starts at row zero.Nr  z:code mixing tabs and spaces for indentation is not allowedr)rtokenizegenerate_tokensioStringIOreadlineappend TokenErrorINDENTlenNLNEWLINESTRINGCOMMENT enumeraterUnsupportedLanguageElementError untokenizezipsplitrematch_LEADING_WHITESPACEgroupjoin)r Z token_genZblock_indentationtokenstoktok_typeZ tok_string_Z block_levelZfirst_indent_uses_tabsiZnew_codeZ dedented_codelinenew_lineZoriginal_indent new_indentZ dedented_liner r r dedent_block?sj          r0c Cst|r t|Szt|}Wnty'}z td|d|d}~wwt|}tdd|D}d ||f}t |t |d|fS)aReturns the AST and source code of given entity. Args: entity: Any, Python function/method/class future_features: Iterable[Text], future features to use (e.g. 'print_statement'). See https://docs.python.org/2/reference/simple_stmts.html#future Returns: gast.AST, Text: the parsed AST node; the source code that was parsed to generate the AST (including any prefixes that this function may have added). z$Unable to locate the source code of a=. Note that functions defined in certain environments, like the interactive Python shell, do not expose their source code. If that is the case, you should define them in a .py source file. If you are certain the code is graph-compatible, wrap the call using @tf.autograph.experimental.do_not_convert. Original error: Ncss|]}d|VqdS)zfrom __future__ import {}N)format).0namer r r s  zparse_entity..r) preamble_len) rislambda _parse_lambdaZgetimmediatesourceOSErrorrZInaccessibleSourceCodeErrorr0tupler'parser)entityZfuture_featuresZoriginal_sourceesourceZfuture_statementsr r r parse_entitys$  r>c Cst|D] }t|dd}|dur|||_t|dd}|dur%|||_q||d|}t|dd}|durB|dd||d<t|dd} | dur]td|d } | dur]| d } | durk|d | d|d <d d d |D} || fS) zCReturns a clean node and source code without indenting and context.linenoN end_linenoend_col_offset col_offsetz(?z$_without_context..) gastwalkgetattrr?r@r#searchstartr') nodelinesminlmaxlnr?r@Z code_linesrBrDr$Z code_blockr r r _without_contexts*       rScCs0|durdSt|tjr|jSt|tsJ|SN) isinstancerINameidstr)rNr r r _arg_names  rYcCst|}tdd|jjD}|t|jkrdS|jt|jjkr$dS|jt|jjkr/dStdd|jj D}|t|j krCdSdS)z.Returns True is node fits the argspec of func.cs|]}t|VqdSrTrYr2argr r r r4z(_node_matches_argspec..FcsrZrTr[r\r r r r4r^T) rgetfullargspecr9argsvarargsrYvarargvarkwkwarg kwonlyargs)rNfuncZarg_specZ node_argsZnode_kwonlyargsr r r _node_matches_argspecs rgcst}t}jj}t||j}d|}t |ddd}g}|D]}t |d||kr5| |q%g} |D]}| ddt |Dq:g} | D]C} td} } t | D]"}t| t |d| } t |d| }t |dd }|d urw|}t| |} qZ| |kr| krnqN| | | | fqNt| d kr| \\}} } t||| | S| sd d d | D}tdd|fdd | D}t|d kr|\\}} } t||| | Sd ddt|D}tdd|)a&Returns the AST and source code of given lambda function. Args: lam: types.LambdaType, Python function/method/class Returns: gast.AST, Text: the parsed AST node; the source code that was parsed to generate the AST (including any prefixes that this function may have added). rrFr5 single_noder?css |] }t|tjr|VqdSrT)rUrILambda)r2rRr r r r4s   z _parse_lambda..r@NrArcSsg|]}t|qSr )unparse)r2lr r r rG+rHz!_parse_lambda..z#could not parse the source code of z*: no matching AST found among candidates: csg|] }t|dr|qS)r)rg)r2vlamr r rG1scss.|]\}\}}}d|t|ddVqdS)z Match {}: {} F)include_encoding_markerN)r1rk)r2r,rNr+r r r r47s   z: found multiple definitions with identical signatures at the location. This error may be avoided by defining each lambda on a single line and with unique argument names. The matching definitions were: )inspect getmodule getsourcefile__code__co_firstlineno linecachegetlines__dict__r'r:rKrextendrIrJMAX_SIZEminmaxrrSrrr)romodfZdef_linerOr=Z all_nodesZ search_nodesrNZ lambda_nodes candidateslnrPrQrRr?r@Z lambda_codesmatchesr rnr r7sf               r7TcCsJt|}|j}|r||d}|r#t|dkrtd||dS|S)aReturns the AST of given piece of code. Args: src: Text preamble_len: Int, indicates leading nodes in the parsed AST which should be dropped. single_node: Bool, whether `src` is assumed to be represented by exactly one AST node. Returns: ast.AST NrAz!expected exactly one node, got {}r)rIr:bodyr ValueErrorr1)srcr5riZ module_nodenodesr r r r:Bs   r:cCs<t|}t|tdd} t|tjstd||j S)zReturns the AST of given identifier. Args: src: A piece of code that represents a single Python expression Returns: A gast.AST object. Raises: ValueError: if src does not consist of a single Expression. Trhz.expected exactly one node of type Expr, got {}) STANDARD_PREAMBLEstripr:STANDARD_PREAMBLE_LENrUrIExprrr1value)rrNr r r parse_expressionZs  rcCs~~t|ttfs |f}g}|r|d|D]#}t|tjr$t|}n|}ttur/t ||t | qd |S)aReturns the source code of given AST. Args: node: The code to compile, as an AST object. indentation: Unused, deprecated. The returning code will always be indented at 4 spaces. include_encoding_marker: Bool, whether to include a comment on the first line to explicitly specify UTF-8 encoding. Returns: code: The source code generated from the AST object source_mapping: A mapping between the user and AutoGraph generated code. z# coding=utf-8r) rUlistr9rrIASTZ gast_to_ast astunparseastfix_missing_locationsrkrr')rN indentationrpcodesrRZast_nr r r rkms     rk)rT)NT)&__doc__rrqrrvr#systextwraprrrIZ tensorflow.python.autograph.pyctrrZtensorflow.python.utilrdedentZ PY2_PREAMBLEZ PY3_PREAMBLErz version_informaxsizeZmaxintcountrcompiler%rr0r>rSrYrgr7r:rrkr r r r sH        D$"  Z