o ?e@sxdZddlZddlZddlZddlZddlZddlZedddgZddZ dd Z d d Z d d Z ddZ ddZdS)z-A module to support operations on ipynb filesNCodeLine cell_numbercodecCs(|ddko|do|ddd S)z+Checks if the cell consists of Python code.Z cell_typersourcerz%% startswith)cellr e/home/www/facesmatcher.com/pyenv/lib/python3.10/site-packages/tensorflow/tools/compatibility/ipynb.py is_pythons r cCstdt|\}}dd|D}tjddd=}|d||\}}} } |r:|r:t|||d} t | |n t dd | |} | | ||} | }Wd n1sXwYt |j|| | |fS) z;The function where we inject the support for ipynb upgrade.z,Extracting code lines from original notebookcSsg|]}|jqSr )r).0clr r r %sz process_file..wF)delete z&Was not able to process the file: %s N)print _get_codetempfileNamedTemporaryFileZupdate_string_pastajoin_update_notebooksplitjsondump SyntaxErrorZ _format_logshutilmovename)Z in_filenameZ out_filenameZupgraderraw_codenotebookZ raw_lines temp_fileZprocessed_fileZnew_file_contentlogZprocess_errors new_notebookZfiles_processedZ report_texterrorsr r r process_file!s(    r&cCs|D] }||r dSqdS)aChecks if the cell has magic, that is not Python-based. Args: code_line: A line of Python code magic_list: A list of jupyter "magic" exceptions Returns: If the line jupyter "magic" line, not Python line >>> skip_magic('!ls -laF', ['%', '!', '?']) True TFr) code_lineZ magic_listmagicr r r skip_magic>s  r)cCs td|S)zChecks if a line was split with `\`. Args: code_line: A line of Python code Returns: If the line was split with `\` >>> skip_magic("!gcloud ml-engine models create ${MODEL} \\\n") True z\\\s*\n$)research)r'r r r check_line_splitSs r,c Csg}t| }t|}Wdn1swYd}|dD]Q}t|rr|d}d}t|D]<\}} t| gds>|rFd| } t| }|rLt| }|t|dkr_| d r_| d d } | t || d d q1|d7}q!||fS) z5Loads the ipynb file and returns a list of CodeLines.NrcellsrF)%!?###!!!r###===) openrloadr enumerater)r,lenendswithreplaceappendrrstrip) Z input_filer in_filer!Z cell_indexrZ cell_linesZ is_line_splitZline_idxr'r r r rcs2    rcst|}t|tksJdt|td|dD].}t|s&qfddt|D}fdd|D}d|dd d d|d <d 7q|S) z)Updates notebook, once migration is done.zCThe lengths of input and converted files are not the same: {} vs {}rr-csg|] \}}|jkr|qSr )r)r idxr') code_cell_idxr r rs z$_update_notebook..csg|]}|qSr r )r r=)updated_code_linesr r rsrr1rr3rr2)copydeepcopyr7formatr r6rr9)Zoriginal_notebookZoriginal_raw_linesr?r$rZapplicable_linesZnew_coder )r>r?r rs$    r)__doc__ collectionsr@rr*rr namedtuplerr r&r)r,rrr r r r s -