PL j( 0dZddlZddlZddlZddlmZmZddlmZm Z ddl m Z m Z m Z mZddlmZddlmZddlmZmZmZmZeejZeeZeeZejd Z ejd Z!d ed efd Z"d e efdZ#ded e$fdZ%eGddZ&eGddZ'eGddZ(eGddZ)eGddZ*eGddZ+eGddZ,ded e-ee.efdzfd Z/Gd!d"eZ0hd#Z1d$d%d&d'd(d)Z2d*d+d,d-Z3d.ed/ed e$fd0Z4d1ed e-e$effd2Z5d1ed e-e$effd3Z6d1ed e-e$effd4Z7d1ed e-e$effd5Z8e8e5e6e6e7d6Z9d7Z:d7Z;d8ZdZ?d;Z@dZAe=e>fd?ed@ed e-e.e.ffdAZBe?e@fd?ed@ed e-e.e.ffdBZCGdCdDe0ZDdS)Ea\ File Operations Module Provides file manipulation capabilities (read, write, patch, search) that work across all terminal backends (local, docker, ssh, singularity, modal, daytona, vercel_sandbox). The key insight is that all file operations can be expressed as shell commands, so we wrap the terminal backend's execute() interface to provide a unified file API. Usage: from tools.file_operations import ShellFileOperations from tools.terminal_tool import _active_environments # Get file operations for a terminal environment file_ops = ShellFileOperations(terminal_env) # Read a file result = file_ops.read_file("/path/to/file.py") # Write a file result = file_ops.write_file("/path/to/new.py", "print('hello')") # Search for content result = file_ops.search("TODO", path=".", file_glob="*.py") N)ABCabstractmethod) dataclassfield)OptionalListDictAny)Path)BINARY_EXTENSIONS)build_write_denied_pathsbuild_write_denied_prefixesget_safe_write_rootis_write_deniedz!\x1b\][^\x07\x1b]*(?:\x07|\x1b\\)z+'?\x07?__HERMES_FENCE_[A-Za-z0-9]+__\x07?'?textreturnct|s|Sg}|dD]}d|vpd|v}td|}td|}|dd}|r|ddkrr||d|S)z;Strip leaked terminal fence wrappers from file read output.Tkeepends__HERMES_FENCE_z]z' ) splitlines_OSC_SEQUENCE_REsub_FENCE_MARKER_REreplacestripappendjoin)r cleaned_lineslinehad_terminal_wrappercleaneds 9/home/kuhnn/.hermes/hermes-agent/tools/file_operations.py_strip_terminal_fence_leaksr&<s  !M..&&0D8KGtO"&&r400"&&r733//&"--  GMM*$=$=$C$C W%%%% 77= ! !!ctS)a\Return the resolved HERMES_WRITE_SAFE_ROOT path, or None if unset. When set, all write_file/patch operations are constrained to this directory tree. Writes outside it are denied even if the target is not on the static deny list. Opt-in hardening for gateway/messaging deployments that should only touch a workspace checkout. )_shared_get_safe_write_rootr'r%_get_safe_write_rootr+Ms ' ( ((r'pathc t|S)z.Return True if path is on the write deny list.)_shared_is_write_denied)r,s r%_is_write_deniedr/Xs "4 ( ((r'c$eZdZUdZdZeed<dZeed<dZ eed<dZ e ed<d Z e eed <dZe ed <dZe ed <d Ze eed <d Ze eed<d Ze eed<d Ze eed<eeZeeed<defdZd S) ReadResultzResult from reading a file.rcontentr total_lines file_sizeF truncatedNhint is_binaryis_imagebase64_content mime_type dimensionserrordefault_factory similar_filesrcHd|jDS)Nc*i|]\}}||gk ||SNr*.0kvs r% z&ReadResult.to_dict..rs(TTTA!-AQSGG1GGGr'__dict__itemsselfs r%to_dictzReadResult.to_dictqs$TT!4!4!6!6TTTTr')__name__ __module__ __qualname____doc__r2str__annotations__r3intr4r5boolr6rr7r8r9r:r;r<rlistr?rdictrMr*r'r%r1r1as#%%GSKIsItD(3-ItHd$(NHSM(((#Ix}### $J $$$E8C=$uT:::M49:::UUUUUUUr'r1ceZdZUdZdZeed<dZeed<dZ e e e e fed<dZe e ed<dZe e ed <dZe e ed <d efd ZdS) WriteResultzResult from writing a file.r bytes_writtenF dirs_createdNlintlsp_diagnosticsr<warningrcHd|jDS)Nci|] \}}||| SrBr*rCs r%rGz'WriteResult.to_dict..sHHHA!-1---r'rHrKs r%rMzWriteResult.to_dicts$HH!4!4!6!6HHHHr')rNrOrPrQrZrTrSr[rUr\rr rRr r]r<r^rWrMr*r'r%rYrYus%%M3L$%)D(4S> ")))&*OXc])))E8C=!GXc]!!!IIIIIIIr'rYc$eZdZUdZdZeed<dZeed<e e Z e eed<e e Z e eed<e e Ze eed <d Zeeeefed <d Zeeed <d Zeeed <defdZd S) PatchResultzResult from patching a file.Fsuccessrdiffr=files_modified files_created files_deletedNr\r]r<rcd|ji}|jr |j|d<|jr |j|d<|jr |j|d<|jr |j|d<|jr |j|d<|jr |j|d<|jr |j|d<|S) Nrcrdrerfrgr\r]r<)rcrdrerfrgr\r]r<rLresults r%rMzPatchResult.to_dictsT\* 9 '!YF6N   ;'+':F# $   9&*&8F? #   9&*&8F? # 9 '!YF6N   =(,( ")))%)OXc])))E8C=r'rbc@eZdZUdZeed<eed<eed<dZeed<dS) SearchMatchzA single search match.r, line_numberr2gmtimeN) rNrOrPrQrRrSrTrnfloatr*r'r%rlrlsF  III LLLE5r'rlceZdZUdZeeZeee d<eeZ ee e d<ee Z ee efe d<dZee d<dZee d <d Zee e d <d e fd Zd S) SearchResultzResult from searching.r=matchesfilescountsr total_countFr5Nr<rcd|ji}|jrd|jD|d<|jr |j|d<|jr |j|d<|jrd|d<|jr |j|d<|S) Nruc8g|]}|j|j|jdS))r,r"r2r,rmr2)rDms r% z(SearchResult.to_dict..s8!!!19MM!!!r'rrrsrtTr5r<)rurrrsrtr5r<ris r%rMzSearchResult.to_dicts!12 < !!!!!F9  : )"jF7O ; +#{F8  > '"&F;  : )"jF7O r')rNrOrPrQrrVrrrrlrSrsrRrWrtr rTrur5rUr<rrMr*r'r%rqrqs  !&t!-`` segments. Prefer the rightmost numeric separator so a path like ``dir/file-12-name.py-8-context`` resolves to ``dir/file-12-name.py`` line ``8`` instead of truncating at ``file``. --Nz-(\d+)-)refinditerstartrTgroupend)r"match candidater,s r%_parse_search_context_liners 44<<t E[T22  }t  D t U[[^^$$d599;;<<&8 88r'cdeZdZdZed!dedededefdZededefd Z eded ede fd Z e d"ded edede de f dZedede fdZedede fdZededede fdZe d#dedededeedededededefd ZdS)$FileOperationsz@Abstract interface for file operations across terminal backends.rr,offsetlimitrcdS)z$Read a file with pagination support.Nr*)rLr,rrs r% read_filezFileOperations.read_file  r'cdS)a Read the complete file content as a plain string. No pagination, no line-number prefixes, no per-line truncation. Returns ReadResult with .content = full file text, .error set on failure. Always reads to EOF regardless of file size. Nr*rLr,s r% read_file_rawzFileOperations.read_file_raw s  r'r2cdS)z8Write content to a file, creating directories as needed.Nr*)rLr,r2s r% write_filezFileOperations.write_filerr'F old_string new_string replace_allcdS)z,Replace text in a file using fuzzy matching.Nr*)rLr,rrrs r% patch_replacezFileOperations.patch_replaces  r' patch_contentcdS)zApply a V4A format patch.Nr*)rLrs r% patch_v4azFileOperations.patch_v4a rr'cdS)z>Delete a file. Returns WriteResult with .error set on failure.Nr*rs r% delete_filezFileOperations.delete_file%rr'srcdstcdS)zSMove/rename a file from src to dst. Returns WriteResult with .error set on failure.Nr*)rLrrs r% move_filezFileOperations.move_file*rr'.N2rpatterntarget file_glob output_modecontextc dS)zSearch for content or files.Nr*) rLrr,rrrrrrs r%searchzFileOperations.search/s r'rrFrr2Nrrr2r)rNrOrPrQrrRrTr1rrrYrrUrbrrrrrrqrr*r'r%rrsJJ  c 3 3    ^  # *   ^  s S [   ^ */  # 3 C #' 4?   ^  s {   ^      ^  S s {   ^ BKOP<=  c  C "3- 7: IL  69 BN   ^   r'r>.bmp.gif.ico.jpg.png.jpeg.webpz python -m py_compile {file} 2>&1znode --check {file} 2>&1znpx tsc --noEmit {file} 2>&1zgo vet {file} 2>&1zrustfmt --check {file} 2>&1).pyz.jsz.tsz.goz.rs)z/this is not the tsc command you are looking forz%could not determine executable to runznot found in npm registry)zno input filename givenzerror: not a workspace)zcannot find packagezgo: cannot find main module)npxrustfmtgobase_cmdr~ct|}|sdS|tfd|DS)aUReturn True iff ``output`` from ``base_cmd`` indicates the linter itself couldn't run (a tooling gap), as opposed to a real lint error in the file being checked. ``base_cmd`` is the first word of the linter command line (``npx``, ``rustfmt``, ``go``, ...). ``output`` is the stdout/stderr captured from running it. Fc3 K|]}|vV dSrBr*)rDplowers r% z._looks_like_linter_unusable..xs',,aqEz,,,,,,r')_LINTER_UNUSABLE_PATTERNSgetrany)rr~patternsrs @r%_looks_like_linter_unusablerksU),,X66H u LLNNE ,,,,8,,, , ,,r'r2c ddl} ||dS#|j$r'}dd|jd|jd|jdfcYd}~Sd}~wt $r%}dt|jd |fcYd}~Sd}~wwxYw) z;In-process JSON syntax check. Returns (ok, error_message).rNTrFzJSONDecodeError:  (line , column ): ) jsonloadsJSONDecodeErrormsglinenocolno ExceptiontyperN)r2_jsones r%_lint_json_inprocr{s1 Gx  VVVU!%UUUU17UUUUUUUUUU 111a)00Q0000000001s, A;A A; A;A60A;6A;c ddl}n#t$rYdSwxYw ||dS#|j$r}dd|fcYd}~Sd}~wt$r%}dt |jd|fcYd}~Sd}~wwxYw)uIn-process YAML syntax check. Returns (ok, error_message). Skipped gracefully if PyYAML isn't installed — YAML parsing is optional. rNT__SKIP__rFz YAMLError: r)yaml ImportError safe_load YAMLErrorrrrN)r2_yamlrs r%_lint_yaml_inprocrs       1    x ?((('A''''''''' 111a)00Q0000000001s8 0 A8AA8 A8A3-A83A8c ddl}n(#t$r ddl}n#t$rYYdSwxYwYnwxYw ||dS#t$r%}dt |jd|fcYd}~Sd}~wwxYw)zddl} ||dS#t$rH}|jrd|jd|jdnd}dt |jd |j|fcYd}~Sd}~wt$r%}dt |jd |fcYd}~Sd}~wwxYw) uIn-process Python syntax check via ast.parse. Catches SyntaxError, IndentationError, and everything else the ast module rejects — matching py_compile's scope but with no subprocess overhead and no dependency on a ``python`` in PATH. rNrrrrrFr) astparse SyntaxErrorrrrrNrr)r2_astrlocs r%_lint_python_inprocrs1 7x ::::;(J666186666a)99QU9C999999999 111a)00Q0000000001s, B=A*$B* B7BBB)rz.jsonz.yamlz.ymlz.tomliirrrvaluedefaultcT t|S#ttf$r|cYSwxYw)z8Best-effort integer coercion for tool pagination inputs.)rT TypeError ValueError)rrs r% _coerce_intrs<5zz z "s ''rrcddlm}|}tdt|t}t|t }tdt ||}||fS)aReturn safe read_file pagination bounds. Tool schemas declare minimum/maximum values, but not every caller or provider enforces schemas before dispatch. Clamp here so invalid values cannot leak into sed ranges like ``0,-1p``. The upper bound on ``limit`` comes from ``tool_output.max_lines`` in config.yaml (defaults to the module-level ``MAX_LINES`` constant). r) get_max_linesr)tools.tool_output_limitsrmaxrDEFAULT_READ_OFFSETDEFAULT_READ_LIMITmin)rrr max_linesnormalized_offsetnormalized_limits r%normalize_read_paginationrst766666 IA{63FGGHH"5*<==1c"2I>>?? . ..r'ctdt|t}tdt|t}||fS)zCReturn safe search pagination bounds for shell head/tail pipelines.rr)rrDEFAULT_SEARCH_OFFSETDEFAULT_SEARCH_LIMIT)rrrrs r%normalize_search_paginationr sFA{63HIIJJ1k%1EFFGG . ..r'c6eZdZdZdEdefdZ dFdededededef d Zd ede fd Z dEd ed ede fdZ d ede fdZ dGdededefdZ d edefdZdedefdZdedededefdZdHd edededefdZd edefdZd edefd Zd edefd!Zd"ed#edefd$Zd ededefd%Z dId ed'ed(ed)e def d*Zd+edefd,ZdEd edeedefd-Z dEd ed.eed/eedefd0Zde fd1Z d2ede fd3Z!d eddfd4Z"ddd5d ed.eed/eedefd6Z# dJd:ed ed;edede$fd?Z%d:ed ededede$f d@Z&d:ed ededede$f dAZ'd:ed edede$fdBZ(d:ed edede$fdCZ)d:ed edede$fdDZ*dS)KShellFileOperationsz File operations implemented via shell commands. Works with ANY terminal backend that has execute(command, cwd) method. This includes local, docker, singularity, ssh, modal, and daytona environments. Ncwdc||_|p2t|ddp!tt|ddddpd|_i|_dS)u Initialize file operations with a terminal environment. Args: terminal_env: Any object with execute(command, cwd) method. Returns {"output": str, "returncode": int} cwd: Optional explicit fallback cwd when the terminal env has no cwd attribute (rare — most backends track cwd live). Note: Every _exec() call prefers the LIVE ``terminal_env.cwd`` over ``self.cwd`` so ``cd`` commands run via the terminal tool are picked up immediately. ``self.cwd`` is only used as a fallback when the env has no cwd at all — it is NOT the authoritative cwd, despite being settable at init time. Historical bug (fixed): prior versions of this class used the init-time cwd for every _exec() call, which caused relative paths passed to patch/read/write to target the wrong directory after the user ran ``cd`` in the terminal. Patches would claim success and return a plausible diff but land in the original directory, producing apparent silent failures. r Nconfig/)envgetattrr _command_cache)rL terminal_envr s r%__init__zShellFileOperations.__init__se0  V',t<<V7<4@@%NNVRU 02r'commandtimeout stdin_datarci}|r||d<|||d<|pt|jddp|j}|jj|fd|i|}t |dd|dd S) uExecute command via terminal backend. Args: stdin_data: If provided, piped to the process's stdin instead of embedding in the command string. Bypasses ARG_MAX. Cwd resolution order (critical — see class docstring): 1. Explicit ``cwd`` arg (if provided) 2. Live ``self.env.cwd`` (tracks ``cd`` commands run via terminal) 3. Init-time ``self.cwd`` (fallback when env has no cwd attribute) This ordering ensures relative paths in file operations follow the terminal's current directory — not the directory this file_ops was originally created in. See test_file_ops_cwd_tracking.py. rNrr r~r returncoder)rr)rrr executerr)rLrr rrkwargs effective_cwdrjs r%_execzShellFileOperations._exec"s"  ( 'F9   !#-F< Iwtx==I !!'GG}GGG::h++jjq11    r'cmdc||jvr>|d|d}|jdk|j|<|j|S)z6Check if a command exists in the environment (cached).z command -v z >/dev/null 2>&1 && echo 'yes'yes)rrrr)rLrrjs r% _has_commandz ShellFileOperations._has_commandBs[ d) ) )ZZ Qc Q Q QRRF'-}':':'<'<'ED  $"3''r'r,content_samplectj|d}|tvrdS|rEt d|ddD}|t t|dz dkSdS)z Check if a file is likely binary. Uses extension check (fast) + content analysis (fallback). rTc3HK|]}t|dk|dvdVdS) z rN)ord)rDcs r%rz8ShellFileOperations._is_likely_binary..UsJ E Ea"%a&&2++!82C2C!"2C2C2C2C E Er'Nig333333?F)osr,splitextrr sumrlen)rLr,r"ext non_printables r%_is_likely_binaryz%ShellFileOperations._is_likely_binaryIs gt$$Q'--// # # #4  I E E>%4%+@ E E EEEM 3s>':':D#A#AADH Hur'ctj|d}|tvS)z2Check if file is an image we can return as base64.r)r(r,r)rIMAGE_EXTENSIONS)rLr,r,s r% _is_imagezShellFileOperations._is_image[s4gt$$Q'--//&&&r'rr2 start_linecddlm}|}|d}g}t||D]@\}}t ||kr |d|dz}||dd|Ad|S) z7Add line numbers to content in LINE_NUM|CONTENT format.r)get_max_line_length )rNz... [truncated]6d|)rr4split enumerater+rr ) rLr2r2r4max_line_lengthlinesnumberedir"s r%_add_line_numbersz%ShellFileOperations._add_line_numbers`s@@@@@@--// d## j999 . .GAt4yy?**,_,-0AA OOq,,,d,, - - - -yy"""r'c|s|S|dr9|d}|jdkr|jr|j}|dkr|S|dr ||ddzS|dd}|d}|dkr |d|n|}|rt jd|rt|d |}|jdkrQ|jr8|j}|dt|zd} || zS|S) z Expand shell-style paths like ~ and ~user to absolute paths. This must be done BEFORE shell escaping, since ~ doesn't expand inside single quotes. ~z echo $HOMErz~/rNrz[a-zA-Z0-9._-]+zecho ~) startswithrrrrfindr fullmatchr+) rLr,rjhomerest slash_idxusername expand_result user_homesuffixs r% _expand_pathz ShellFileOperations._expand_pathmsr K ??3   2ZZ --F1$$)<)<)>)>$}**,,3;;K__T**+$qrr(?*ABBx IIcNN /8A~~4  ++42 -? J J2%)JJ/B/B/B$C$CM$.!33 8L8R8R8T8T3$1$8$>$>$@$@ !%a#h--&7&8&8!9(611 r'argc:d|ddzdzS)z/Escape a string for safe use in shell commands.'z'"'"')r)rLrLs r%_escape_shell_argz%ShellFileOperations._escape_shell_args"S[[i000366r' old_content new_contentfilenamec|d}|d}tj||d|d|}d|S)z2Generate unified diff between old and new content.Trza/zb/)fromfiletofiler)rdifflib unified_diffr )rLrPrQrR old_lines new_linesrds r% _unified_diffz!ShellFileOperations._unified_diffsn**D*99 **D*99 # y$(__"??    wwt}}r'rrrc ||}t||\}}d||d}||}|jdkr||St |j} t| }n#t$rd}YnwxYw|tkr | |rtdd|dSd||d}||} t | j} ||| rtd|d S||zd z } d |d | d ||} || } | jdkrtd| jSt | j}d||}||}t |j} t| }n#t$rd}YnwxYw|| k}d}|rd| d zd|d| d|d }t|||||||S)a Read a file with pagination, binary detection, and line numbers. Args: path: File path (absolute or relative to cwd) offset: Line number to start from (1-indexed, default 1) limit: Maximum lines to return (default 500, max 2000) Returns: ReadResult with content, metadata, or error info wc -c < 2>/dev/nullrTzImage file detected. Automatically redirected to vision_analyze tool. Use vision_analyze with this file path to inspect the image contents.)r8r7r4r6 head -c 1000 zUBinary file - cannot display as text. Use appropriate tools to handle this file type.r7r4r<rzsed -n ',zp' Failed to read file: r<zwc -l < Nz Use offset=z to continue reading (showing -z of z lines))r2r3r4r5r6)rKrrOrr_suggest_similar_filesr&rrTrr MAX_FILE_SIZEr1r1r.r>)rLr,rrstat_cmd stat_result stat_outputr4 sample_cmd sample_result sample_outputend_lineread_cmd read_result read_outputwc_cmd wc_result wc_outputr3r5r6s r%rzShellFileOperations.read_files  &&1&%@@ Id44T::HHHjj**  A % %..t44 41+2DEE  K--//00II   III  } $ $  >>$   #\  PT%;%;D%A%AOOO  :.. 3M4HII  ! !$ 6 6 #m E>A%RfRRxRRD4J4J44P4PRRjj**  A % %$PK/dev/null | head -50r5dZF<(g?c|d S)Nrr*)xs r%z..s 1Q4%r')keycg|]\}}|Sr*r*)rD_fps r%rzz>ShellFileOperations._suggest_similar_files../s...%!R2...r'NzFile not found: )r<r?)r(r,dirnamebasenamer)rrOrrrrr8rAr+setrrr sortr1)rLr,dir_pathrRbasename_no_extr, lower_namels_cmd ls_resultscoredflfscorecommonsimilars r%rdz*ShellFileOperations._suggest_similar_filess7??4((/C7##D))'**844Q7gx((+1133^^%% T$00::SSSJJv&&   ! # # (8(>(>(@(@ #%++--33D99 F FWWYY##EEW%%a((+11337L7L7N7NNNEE]]:.. #*2G2G2K2K #EE2%%EE:%%#b''A++EE#RW--a00399;;sBB __s2ww6F6{{c#j//3r77&C&Cc&III "199MM5"',,x*C*C"DEEE  (((..6"1":...+T++!    r'cZ||}d||d}||}|jdkr||St |j} t|}n#t$rd}YnwxYw| |rtdd|S|d||d}t |j}| ||rtd|dS|d ||}|jdkrtd |j Stt |j| S) zRead the complete file content as a plain string. No pagination, no line-number prefixes, no per-line truncation. Uses cat so the full file is returned regardless of size. r\r]rT)r8r7r4r^u'Binary file — cannot display as text.r_cat rarb)r2r4) rKrOrrrdr&rrTrrr1r1r.) rLr,rfrgrhr4rjrk cat_results r%rz!ShellFileOperations.read_file_raw6s   &&Hd44T::HHHjj**  A % %..t44 41+2DEE  K--//00II   III  >>$   RttyQQQ Q #]43I3I$3O3O#]#]#]^^ 3M4HII  ! !$ 6 6 )? ZZ Et'='=d'C'C E EFF  1 $ $$OJ rr)rLrrrrjs r%rzShellFileOperations.move_fileas$$$$s R RA"" R")P)P)P)PQQQQQQ R M$((-- M M0F0Fs0K0K M M    q %Vs%V%V%V%Vv}%V%VWWW W}}r'c$||}t|rtd|dStj|d}d}|tvp||}|rGd| |d}| |}|j dkr|j r|j }| |tj|}d } |r:d | |} | | } | j dkrd } d | |} | | | } | j dkrtd| j Sd| |d}| |} t|j }n2#t"$r%t%|d}YnwxYw||||}d}|js|jr||||}|r|}t|| |r|nd|S)uO Write content to a file, creating parent directories as needed. Pipes content through stdin to avoid OS ARG_MAX limits on large files. The content never appears in the shell command string — only the file path does. After the write, runs a post-first / pre-lazy lint check via ``_check_lint_delta()``. If the new content is clean, the lint call is O(one parse). If the new content has errors, the pre-write content is linted too and only errors newly introduced by this write are surfaced — pre-existing problems are filtered out so the agent isn't distracted chasing them. Args: path: File path to write content: Content to write Returns: WriteResult with bytes written, lint summary, or error. Write denied: '(' is a protected system/credential file.rbrNrr]rFz mkdir -p Tzcat > )rzFailed to write file: r\zutf-8 pre_content post_content)rZr[r\r])rKr/rYr(r,r)rLINTERS_INPROC_lsp_handles_extensionrOrrr_snapshot_lsp_baselinerrTrrr+encode_check_lint_deltarcr}_maybe_lsp_diagnosticsrM)rLr,r2r,rwant_prermrnparentr[ mkdir_cmd mkdir_result write_cmd write_resultrfrgrZ lint_resultr]blocks r%rzShellFileOperations.write_filess.  && D ! ! g%et%e%e%efff f"gt$$Q'--//%) .(LD,G,G,L,L  1 Id44T::HHHH**X..K$))k.@))0  ##D)))&&  $DD$:$:6$B$BDDI::i00L%**# Q%S%STTT TId44T::HHHjj**  9 2 8 8 : :;;MM 9 9 9w 7 788MMM 9,,T{Y`,aa *.   (+"5 (//+G0E ("''%*5?$$&&&4+     s &G33,H"!H"Frrrc ||}t|rtd|dSd||d}||}|jdkrtd|S|j}ddlm}|||||\} } } } | s| dkr@| pd |} dd lm }| || | ||z } n#t$rYnwxYwt| S| || }|j rtd |j Sd||d}||}|jdkrtd |S|j d d dd}| d d dd}||kr4td|dt|dt|dS||| |}|||| }td||g|r|nd|jS)ai Replace text in a file using fuzzy matching. Args: path: File path to modify old_string: Text to find (must be unique unless replace_all=True) new_string: Replacement text replace_all: If True, replace all occurrences Returns: PatchResult with diff and lint results rrrbrr]rra)fuzzy_find_and_replacez'Could not find match for old_string in )format_no_match_hintzFailed to write changes: z2Post-write verification failed: could not re-read z r5 z#Post-write verification failed for z5: on-disk content differs from intended write (wrote z chars, read back zb chars after normalizing line endings). The patch did not persist. Re-read the file and try again.rTN)rcrdrer\r])rKr/rbrOrrrtools.fuzzy_matchrrrrr<rr+rZrrMr])rLr,rrrrmrnr2rrQ match_count _strategyr<err_msgrr verify_cmd verify_result_verify_stdout_normalized_new_content_normalizedrdrs r%rz!ShellFileOperations.patch_replacesB  && D ! ! g%et%e%e%efff fE$0066DDDjj**  A % %%CT%C%CDDD D$ =<<<<<5K5K Z[6 6 2 [)U  .K1$$OOOOG BBBBBB//jRYZZZ    W--- -t[99   W%UAS%U%UVVV VGD22488FFF  :..  "a ' '%`Z^%`%`aaa a%2$8$@$@$N$N$V$VW[]a$b$b!"-"5"5fd"C"C"K"KDRV"W"W $(? ? ?MdMM566MM011MMM !!';== ,,TwU`,aa  6*5?$$&&&4)8    s5C CCrctddlm}m}||\}}|rtd|S|||}|S)a Apply a V4A format patch. V4A format: *** Begin Patch *** Update File: path/to/file.py @@ context hint @@ context line -removed line +added line *** End Patch Args: patch_content: V4A format patch string Returns: PatchResult with changes made r)parse_v4a_patchapply_v4a_operationszFailed to parse patch: rb)tools.patch_parserrrrb)rLrrr operations parse_errorrjs r%rzShellFileOperations.patch_v4aMsm( MLLLLLLL"1/-"@"@ K  N%L{%L%LMMM M&%j$77 r'ctj|d}t|}||Ud||d}||}|jdkrtdd|d S|j }||\}}|d krtdd |d  St||rd n|S|tvrtdd|d St|} | d} | | std| d S| d||} || d} | jdkrt| | j rzddlm} | | j }t'd|D|dd}td| d|dd St| jdk| j r| j nd S)u8 Run syntax check on a file after editing. Prefers the in-process linter for structured formats (JSON, YAML, TOML) when possible — those parse via the Python stdlib in microseconds and don't require a subprocess. Falls back to the shell linter table for compiled/type-checked languages (py_compile, node --check, tsc, go vet, rustfmt). Args: path: File path (used to select the linter + for shell invocation). content: Optional file content. If provided AND an in-process linter matches the extension, we lint the content directly without re-reading the file from disk. Ignored for shell linters. Returns: LintResult with status and any errors. rNrr]rTzFailed to read z for lint)r}rrzNo linter available for z (missing dependency)rrcr~zNo linter for z filesz not availablez{file}r{r) strip_ansic3fK|],}||V-dSrBrrDlns r%rz2ShellFileOperations._check_lint..s7IIbhhjjIIIIIIIr'xz not usable: )r(r,r)rrrrOrrr|rLINTERSr8r!rrtools.ansi_striprrnextr)rLr,r2r,inprocrmrnrerr linter_cmdrrrjrr$ first_lines r% _check_lintzShellFileOperations._check_lintks(gt$$Q'--// ##C((  L$"8"8">">LLL"jj22 (A--%d<]d<]<]<]^^^^%,fWooGBj  !$8mSV8m8m8mnnnnbr1BsCCC C g  d4PS4P4P4PQQQ QS\ ##%%a(  ** Qdx4O4O4OPPP P  4+A+A$+G+GHHC,,  q %@6=%Y%Y 4 3 3 3 3 3 j//5577GIIg&8&8&:&:III J#DD*TcT2BDD  $),2M,?,?,A,AI6=&&(((r    r'rrc|||}|js|jr|S||S|||}|js|js|js|Sd|jDfd|jD}|st d|jdSt ddd |z S) u\ Run post-write syntax lint with pre-write baseline comparison. Two-tier strategy: 1. **Syntax check** (in-process or shell-based, microseconds). Catches the bug class that motivated this layer: corrupt writes, mashed quotes, truncated output. Hot path. 2. **Delta refinement against pre-write content** when the syntax tier reports errors. Filter out errors that already existed pre-edit so the agent isn't distracted by inherited state. Semantic diagnostics from the LSP layer are fetched separately via :meth:`_maybe_lsp_diagnostics` and surfaced in the ``lsp_diagnostics`` field on :class:`WriteResult` / :class:`PatchResult`. Keeping the two channels separate lets the agent (and any downstream parsers) read syntax errors and semantic errors as independent signals. Args: path: File path (for linter selection). pre_content: File content BEFORE the write. Pass None for new files or when the pre-state isn't available — the delta refinement is skipped and all post errors are returned. post_content: File content AFTER the write. Optional; if None, the shell linter reads from disk (same as _check_lint). Returns: LintResult. ``output`` contains either the full post-lint errors (no pre-state) or just the new-error lines (delta refinement applied). )r2Nc^h|]*}||+Sr*rrs r% z8ShellFileOperations._check_lint_delta..s-PPPBRXXZZPRXXZZPPPr'chg|].}||v,|/Sr*r)rDr pre_liness r%rzz9ShellFileOperations._check_lint_delta..s9jjjRrxxzzjbhhjj`iNiNibNiNiNir'Fu^Pre-existing lint errors — this edit didn't introduce new ones but the file is still broken.)rcr~rzLNew lint errors introduced by this edit (pre-existing errors filtered out): r5r)rrcr}r~rr|r )rLr,rrpostpre post_linesrs @r%rz%ShellFileOperations._check_lint_deltas-Ll;; < 4< K  Kt[99 ; #+ SZ KQP#**?*?*A*APPP jjjj4;#9#9#;#;jjj  {x  8:>))J:O:OP    r'c~t|dd}|dS ddlm}n#t$rYdSwxYwt ||S)u}Return True iff this FileOperations is wired to a local backend. LSP servers run on the host process — they need access to the files they're linting. Remote/sandboxed backends (Docker, Modal, SSH, Daytona) keep files inside the sandbox where the host-side LSP server can't reach them, so we skip the LSP path for those entirely. rNFr)LocalEnvironment)rtools.environments.localrr isinstance)rLrrs r%_lsp_local_onlyz#ShellFileOperations._lsp_local_only sndE4(( ;5  A A A A A A A   55 #/000s  ,,r,c|sdS ddlm}n#t$rYdSwxYw|}|D]}||jvrdSdS)uReturn True iff some registered LSP server claims this extension. Used to decide whether to capture pre-write content for the line-shift map. Capturing is cheap (one ``cat`` on the host) but pointless if no LSP would ever look at the file. Safe to call on remote backends — the registry is purely in-process metadata; we still gate the actual LSP path on :meth:`_lsp_local_only`. Fr)SERVERST)agent.lsp.serversrrr extensions)rLr,r ext_lowersrvs r%rz*ShellFileOperations._lsp_handles_extension s 5  1 1 1 1 1 1 1   55 IIKK   CCN**tt+us  c|sdS ddlm}|}n#t$rYdSwxYw|dS ||dS#t$rYdSwxYw)uLCapture pre-edit LSP diagnostics so the post-write delta is correct. Best-effort. Silent on every failure path — LSP is an enrichment layer and must never break a write. Skipped entirely on non-local backends (Docker, Modal, SSH, etc.) — the server can't see files inside the sandbox. Nr get_service)r agent.lsprrsnapshot_baseline)rLr,rsvcs r%rz*ShellFileOperations._snapshot_lsp_baseline7s##%%  F  - - - - - -+--CC    FF  ; F   ! !$ ' ' ' ' '    DD s) 77A A$#A$rc|sdS ddlm}n#t$rYdSwxYw |}n#t$rYdSwxYw|||sdSd}|.|,||kr& ddlm}|||}n#t$rd}YnwxYw ||d|}n#t$rYdSwxYw|sdS ddlm } m } | ||} | sdS| d | zS#t$rYdSwxYw) uBest-effort LSP semantic diagnostics for ``path``. Returns a formatted ```` block, or empty string when LSP is unavailable / disabled / produced no errors. When both ``pre_content`` and ``post_content`` are provided, a line-shift map is built and passed to the LSPService so baseline diagnostics are remapped into post-edit coordinates before the set-difference. Without this, edits that delete or insert lines surface every pre-existing diagnostic below the edit point as "introduced by this edit". Wraps everything in a try/except so a misbehaving LSP server can't break a write. This intentionally swallows all errors — the calling tier already returned a clean syntax result, so ``""`` here just means "no extra info to add". Skipped entirely on non-local backends (Docker, Modal, SSH, etc.) — same reasoning as ``_snapshot_lsp_baseline``. rrrN)build_line_shiftT)delta line_shift)report_for_filetruncatez)LSP diagnostics introduced by this edit: ) rrrr enabled_foragent.lsp.range_shiftrget_diagnostics_syncagent.lsp.reporterrr) rLr,rrrrrr diagnosticsrrrs r%rz*ShellFileOperations._maybe_lsp_diagnosticsNs6##%% 2  - - - - - - -   22  +--CC   22  ;cood33;2   "|'?KS_D_D_ "BBBBBB--k<HH  " " "!  " 224tPZ2[[KK   22  2  D D D D D D D D#OD+66E r8H5PQQ Q   22 sW -- < A  A 3B BBB22 C?CC. C.. C<;C<rrrrrrrrc t||\}}||}|d||d} d| jvrt j|pd} t j|} d|g} |d|| d} d| jvr=| r:|d || d }|j d kr|j r| }g}|j d D]q}|s| }||vs!||vs| |d dr3|t j| |r|r3| dd|d dzt!d| d S|dkr|||||S||||||||S)a\ Search for content or files. Args: pattern: Regex (for content) or glob pattern (for files) path: Directory/file to search (default: cwd) target: "content" (grep) or "files" (glob) file_glob: File pattern filter for content search (e.g., "*.py") limit: Max results (default 50) offset: Skip first N results output_mode: "content", "files_only", or "count" context: Lines of context around matches Returns: SearchResult with matches or file list ztest -e z! && echo exists || echo not_found not_foundrzPath not found: ztest -d z && echo yes || echo nor rtz 2>/dev/null | head -20rr5NzSimilar paths: z, rz. r<rurs)r rKrrOrr(r,rrrrrr8rArr rq _search_files_search_content)rLrr,rrrrrrcheckrbasename_query hint_parts parent_checkrlower_q candidatesentryles r%rzShellFileOperations.searchs&4FEBB   && ed&<&> >r'c(|dsd|vr|}n|dd}t|}td|jD}|dr|||||S|dstdS|sd nd }|rd |nd } d } |s d |d zd|} d||| d||d| } | | d} | j sJd||| d||d| } | | d} g}| j dD]}|s|d d }t|dkrJ|d dd r||d x|||r|}g}|D]} t||j}n$#t$$rt|j}YnwxYwtd|Dr{||||||z}t|t|S)z-Search for files by name pattern (glob-like).z**/rc3HK|]}|dvo|dVdS>..rrNrArDparts r%rz4ShellFileOperations._search_files..sL' '   # <(<(<' ' ' ' ' ' r'rgrBzFile search requires 'rg' (ripgrep) or 'find'. Install ripgrep for best results: https://github.com/BurntSushi/ripgrep#installationrbz-not -path '*/.*'rrz | tail -n +rz | head -n zfind z -type f -name z* -printf '%T@ %p\n' 2>/dev/null | sort -rnrxrz 2>/dev/null | sort -rnr5ryrrc3HK|]}|dvo|dVdSrr r s r%rz4ShellFileOperations._search_files..s8^^Dt;.G4??33G3G^^^^^^r'rsru)rAr8r rpartsr!_search_files_rgrqrOrrrr+risdigitrresolve relative_tor)rLrr,rrsearch_pattern search_roothas_hidden_path_ancestorhidden_excludehidden_filter_exprpagination_exprrrj cmd_simplersr"rnormalized_rootfiltered_files file_path rel_partss r%rz!ShellFileOperations._search_filess!!%(( 4S-?-?$NN$]]3//3N4jj #&' ' #)' ' ' $ $     T " " N((ufMM M  (( K 5MT,,RT5CK1111 ' LKVaZKKEKKOMd,,T22M4FMMW[WmWmn|W}W}MM;JMMC,,}""$$ 8C!7!7!=!=C?QCCbfbxbxzHcIcICC1@CCJZZ BZ77FM''))//55 # #D JJsA&&E5zzQ58#3#3C#<#<#D#D#F#F U1X&&&& T"""" $ :)1133ON" 1 1 6 $Y 7 7 9 9 E Eo V V \II!666 $Y 5III6^^T]^^^^^%%i0000"6&5.#89EE     s9JJ65J6cd|vr|dsd|}n|}||z}d||d||d|}||d}d|jd D} | s~d ||d||d|} || d}d |jd D} | |||z} t | t| t| |k S) adSearch for files by name using ripgrep's --files mode. rg --files respects .gitignore and excludes hidden directories by default, and uses parallel directory traversal for ~200x speedup over find on wide trees. Results are sorted by modification time (most recently edited first) when rg >= 13.0 supports --sortr. r*zrg --files --sortr=modified -g rz 2>/dev/null | head -n rxrcg|]}||Sr*r*rDrs r%rzz8ShellFileOperations._search_files_rg..<sGGG1QGQGGGr'r5zrg --files -g cg|]}||Sr*r*r#s r%rzz8ShellFileOperations._search_files_rg..FKKKqKKKKr')rsrur5)rArOrrrr8rqr+) rLrr,rr glob_pattern fetch_limit cmd_sortedrj all_files cmd_plainpages r%rz$ShellFileOperations._search_files_rg%s g  g&8&8&=&= (w==LL"Lfn  'd.D.D\.R.R ' '%%d++ ' '$ ' '  J33GG 3 3 5 5 ; ;D A AGGG  L+!7!7 !E!E++))$//++(++  ZZ 2Z66FKKFM$7$7$9$9$?$?$E$EKKKI./I)nn 3    r'c |dr||||||||S|dr||||||||StdS)z,Search for content inside files (grep-like).r grepzqContent search requires ripgrep (rg) or grep. Install ripgrep: https://github.com/BurntSushi/ripgrep#installationrb)r!_search_with_rg_search_with_greprq)rLrr,rrrrrs r%rz#ShellFileOperations._search_contentPs   T " " ''y%(3W>> >   v & & ))'4E6*5w@@ @ \ r'c gd}|dkr$|dt|g|r*|d||g|dkr|dn|dkr|d|||||||dkr||zd zn||z} |d d d t| gd |} || d} | jdkr_| jsFt| dr | j r| j nd} td| dS|dkrcd| j dD} t| }| |||z}t||S|dkri}| j dD]_}d|vrY|dd}t|dkr0 t|d||d<O#t $rY[wxYw`t|t#|St'jd}g}| j dD]}|r|dkr ||}|r|t-|dpd|dzt|d|dd d!"|dkrPt1|}|r?|t-|d|d|dd d!"t|}||||z}t|||||zk#S)$zSearch using ripgrep.)r z --line-numberz --no-headingz--with-filenamer-Cz--glob files_only-lcount-crr7head-nrrxrrystderr Search errorSearch failed: rcg|]}||Sr*r*r#s r%rzz7ShellFileOperations._search_with_rg..r%r'r5r:rrtru^([A-Za-z]:)?(.*?):(\d+):(.*)$rrrNrrxrrrur5)extendrRrOrr rrrrhasattrr8rqr8r+rsplitrTrr*valuesrcompilerrlrrrLrr,rrrrr cmd_partsr'rrj error_msgr)totalr+rtr"r _match_rerrryparseds r%r.z#ShellFileOperations._search_with_rgasONN  Q;;   dCLL1 2 2 2  L   h(>(>y(I(IJ K K K , & &   T " " " " G # #   T " " " //88999//55666 /6kkefns**uv~ #vtS-=-=>???hhy!!C,,  q )<)<)>)> 181J1Jpv}p ++---bpI&C &C&CQRSSS S , & &KKFM$7$7$9$9$?$?$E$EKKKI NNEVFUN23Dd>>> > G # #F ++--33D99 ! !$;; KKQ//E5zzQ!/258}}F58,,)!!! D!v3v}};O;OPPP P #DEEIG ++--33D99  tt||OOD))NN;ggajj.B!''!**<$' OO ! 4C4 0$$$ Q;;7==F{!'(.q $*1IdsdO((( LLE6&5.01D!&5.0 s>J J*)J*c ddg}|d|dkr$|dt|g|r*|d||g|dkr|dn|d kr|d ||||||||z|dkrd ndz} |d d dt| gd|} || d} | jdkr_| jsFt| dr | j r| j nd} td| dS|dkrcd| j dD} t| }| |||z}t||S|d kri}| j dD]_}d|vrY|dd}t|dkr0 t|d||d<O#t $rY[wxYw`t|t#|St'jd}g}| j dD]}|r|dkr ||}|r|t-|dpd|dzt|d |d!d"d#$|dkrPt1|}|r?|t-|d|d|dd"d#$t|}||||z}t|||||zk%S)&zFallback search using grep.r-z-rnHz--exclude-dir='.*'rr1z --includer2r3r4r5rr7r6r7rrxrryr8r9r:rcg|]}||Sr*r*r#s r%rzz9ShellFileOperations._search_with_grep..r%r'r5rr<rr=r>rrrr?Nrrxr@)rrArRrOr rrrrrBr8rqr8r+rCrTrr*rDrrErrlrrrFs r%r/z%ShellFileOperations._search_with_grepsV$  -... Q;;   dCLL1 2 2 2  O   k4+A+A)+L+LM N N N , & &   T " " " " G # #   T " " " //88999//55666fnw{{B #vtS-=-=>???hhy!!C,,  q )<)<)>)> 181J1Jpv}p ++---bpI&C &C&CQRSSS S , & &KKFM$7$7$9$9$?$?$E$EKKKI NNEVFUN23Dd>>> > G # #F ++--33D99 ! !$;; KKQ//E5zzQ!/258}}F58,,)!!! D!v3v}};O;OPPP P #DEEIG ++--33D99  tt||OOD))NN;ggajj.B!''!**<$' OO ! 4C4 0$$$ Q;;7==F{!'(.q $*1IdsdO(((LLE6&5.01D!&5.0 sJ// J<;J<rB)NNN)rrrr)+rNrOrPrQrRrrTrrrUr!r.r1r>rKrOrZr1rrdrrYrrrrbrrrr|rrrrrrrqrrrrr.r/r*r'r%r r s[!2!2#!2!2!2!2FCG $  S s C  )6    @((((((c3$$'c'd'''' # # ## #c # # # #######J7S7S7777  3 # RU    Z Z cZ 3Z 3Z Z Z Z Z x2 32 :2 2 2 2 h # *    B  S s {    $q sq Sq [q q q q p+0a a #a 3a Ca #'a 4?a a a a Fs{=>c=>=>C=>"3-=>7:=>IL=>=>69=>BN=>=>=>=>~P SP P CP P Q]P P P P d) ) 3) s) C) T`) ) ) ) Vs#(3-",/>ALOT`"`s`#`(3-`"`,/`>A`LO`T`````D^^C^HSM^!$^.1^@C^NQ^Vb^^^^^^r'r )ErQr(rrVabcrr dataclassesrrtypingrrr r pathlibr tools.binary_extensionsr agent.file_safetyr rrr)rr.rRrD_HOMEWRITE_DENIED_PATHSWRITE_DENIED_PREFIXESrErrr&r+rUr/r1rYrbrlrqr|rtuplerTrrr0rrrrrrrr MAX_LINESMAX_LINE_LENGTHrerrrrrrr r r*r'r%rZs4 ########((((((((,,,,,,,,,,,,555555 IDIKK--e4433E::2:BCC2:LMM"c"c""""")hsm)))))3)4)))) UUUUUUU U& IIIIIII I&  >    6              9S9U3S=-AD-H9999:1 1 1 1 1 S1 1 1 rNMM . % )  (   (   . -# -s -t - - - - 1s 1uT3Y'7 1 1 1 11s1uT3Y'71111&1s1uT3Y'71111"11tSy)911110         sSS-@+=//c/%(/BGS/////&/D-A///'*/FKCQTHo////jjjjj.jjjjjr'