PL ji'dZddlmZddlZddlZddlmZmZmZddl m Z ej e Z ddZdd Zdd Zdd ZeZeZddZGdde ZdS)uParallel.ai web search + content extraction — plugin form. Subclasses :class:`agent.web_search_provider.WebSearchProvider`. Uses two distinct Parallel SDK clients: - ``Parallel`` (sync) — for :meth:`search` - ``AsyncParallel`` (async) — for :meth:`extract` This is the first plugin to exercise the **async-extract** code path in the ABC: :meth:`extract` is declared ``async def``, and the dispatcher in :func:`tools.web_tools.web_extract_tool` detects coroutines via :func:`inspect.iscoroutinefunction` and awaits. Config keys this provider responds to:: web: search_backend: "parallel" # explicit per-capability extract_backend: "parallel" # explicit per-capability backend: "parallel" # shared fallback # Optional: search mode (default "agentic"; also "fast" or "one-shot") # via the PARALLEL_SEARCH_MODE env var. Env vars:: PARALLEL_API_KEY=... # https://parallel.ai (required) PARALLEL_SEARCH_MODE=agentic # optional: agentic|fast|one-shot ) annotationsN)AnyDictList)WebSearchProviderreturnNonec ddlm}|dddS#t$rYdSt$r!}tt |d}~wwxYw)aMTrigger lazy install of the parallel SDK if it isn't present. Mirrors the lazy-deps pattern used by the legacy implementation. Swallows benign ImportError from the lazy_deps helper itself; if the SDK is genuinely missing the subsequent ``from parallel import ...`` raises ImportError that the caller can handle. r)ensurezsearch.parallelF)promptN)tools.lazy_depsr ImportError Exceptionstr) _lazy_ensureexcs A/home/kuhnn/.hermes/hermes-agent/plugins/web/parallel/provider.py_ensure_parallel_sdk_installedr.s$:::::: &u555555      $$$#c((###$s A AA  Arcddlm}t|dd}||Stjd}|st dt ddlm}||}||_ |S)zLazy-load + cache the sync Parallel client. Cache lives on :mod:`tools.web_tools` (as ``_parallel_client``) so unit tests that reset that name between cases keep working. rN_parallel_clientPARALLEL_API_KEYVPARALLEL_API_KEY environment variable not set. Get your API key at https://parallel.ai)Parallelapi_key) tools.web_tools web_toolsgetattrosgetenv ValueErrorrparallelrr)_wtcachedrrclients r_get_sync_clientr&@s "!!!!! S,d 3 3F  i*++G   6   #$$$!!!!!! Xg & & &F!C Mcddlm}t|dd}||Stjd}|st dt ddlm}||}||_ |S)z}Lazy-load + cache the async Parallel client. Cache lives on :mod:`tools.web_tools` (as ``_async_parallel_client``). rN_async_parallel_clientrr) AsyncParallelr) rrrrr r!rr"r*r))r#r$rr*r%s r_get_async_clientr+[s "!!!!! S2D 9 9F  i*++G   6   #$$$&&&&&& ]7 + + +F!'C Mr'c.ddlm}d|_d|_dS)zDrop both cached clients so tests can re-instantiate cleanly. Clears the canonical slots on :mod:`tools.web_tools` (where :func:`_get_sync_client` / :func:`_get_async_client` read/write them). rN)rrrr))r#s r_reset_clients_for_testsr-us, "!!!!!C!%Cr'rctjdd}|dvrd}|S)zDReturn the validated PARALLEL_SEARCH_MODE value (default "agentic").PARALLEL_SEARCH_MODEagentic>one-shotfastr0)rr lowerstrip)modes r_resolve_search_moder6sB 9+Y 7 7 = = ? ? E E G GD 222 Kr'cteZdZdZeddZeddZddZddZdd Z dddZ ddZ ddZ dS)ParallelWebSearchProviderz,Parallel.ai search + async extract provider.rrcdS)Nr"selfs rnamezParallelWebSearchProvider.namezr'cdS)Nrr:r;s r display_namez&ParallelWebSearchProvider.display_namer>r'boolcjttjddS)zBReturn True when ``PARALLEL_API_KEY`` is set to a non-empty value.r)rArr r4r;s r is_availablez&ParallelWebSearchProvider.is_availables)BI0"55;;==>>>r'cdSNTr:r;s rsupports_searchz)ParallelWebSearchProvider.supports_searchtr'cdSrFr:r;s rsupports_extractz*ParallelWebSearchProvider.supports_extractrHr'querylimitintDict[str, Any]c  ddlm}|rdddSt}td|||t j|g||t|d}g}t|j pgD]P\}}|j pg} | |j pd |jpd | rd | nd |d zd Qd d|idS#t $r} dt#| dcYd} ~ Sd} ~ wt$$r} dd| dcYd} ~ Sd} ~ wt&$r-} td| dd| dcYd} ~ Sd} ~ wwxYw)zExecute a Parallel search (sync). Uses the ``beta.search`` endpoint with the configured mode (``PARALLEL_SEARCH_MODE`` env var, default "agentic"). Limit is capped at 20 server-side. ris_interruptedF Interrupted)successerrorz)Parallel search: '%s' (mode=%s, limit=%d))search_queries objectiver5 max_resultsrC )urltitle descriptionpositionTweb)rTdataNParallel SDK not installed: zParallel search error: %szParallel search failed: )tools.interruptrRr6loggerinfor&betasearchmin enumerateresultsexcerptsappendr\r]joinr!rrrwarning) r<rLrMrRr5response web_resultsiresultrkrs rrgz ParallelWebSearchProvider.searchs)' Q 6 6 6 6 6 6~ B#(=AAA'))D KK;UD%   ()).55 %wrNN 6HK&x'7'=2>>   6!?0b""%z/R!'!3=E'Msxx'9'9'92$%E  $e[-ABB B 9 9 9$s3xx88 8 8 8 8 8 8    ===       Q Q Q NN6 < < <$/O#/O/OPP P P P P P P QsGC+CC++ E 5D E  E D& E & E 3"EE E urls List[str]kwargsrList[Dict[str, Any]]c F K ddlm}|r d|DStdt |t j|dd{V}g}|jpgD]Y}|j pd}|sd |j pg}|j pd}|j pd} ||| |||| d d Z|jpgD];} || j pddd| jp| jpd d | j pdid<|S#t$$r fd|DcYd Sd wt&$r fd|DcYd Sd wt($r3 td  fd|DcYd Sd wwxYw)uSExtract content from one or more URLs via the async SDK. Returns the legacy list-of-results shape that :func:`tools.web_tools.web_extract_tool` expects: one entry per successful URL plus one entry per failed URL with an ``error`` field. Errors are not raised — they're returned as per-URL items. rrQcg|]}|ddd S)rSrC)r\rUr]r:).0us r z5ParallelWebSearchProvider.extract..s/HIA CCr'zParallel extract: %d URL(s)T)rs full_contentNrCz ) sourceURLr])r\r]content raw_contentmetadatazextraction failedr})r\r]r~rUrc8g|]}|ddtdS)rCr\r]r~rU)rryrzrs rr{z5ParallelWebSearchProvider.extract.. s,\\\RSArCHHMM\\\r'c$g|] }|dddd S)rCrbrr:rs rr{z5ParallelWebSearchProvider.extract.. s?B2@d_b@d@deer'zParallel extract error: %sc$g|] }|dddd S)rCzParallel extract failed: rr:rs rr{z5ParallelWebSearchProvider.extract..s?B2@a\_@a@abbr')rcrRrdrelenr+rfextractrjr|rmrkr\r]rlerrorsr~ error_typer!rrrn) r<rsrurRrorjrrr~r\r]rUrs @rrz!ParallelWebSearchProvider.extracts7  6 6 6 6 6 6~ MQ KK5s4yy A A A.005==!>H -/G"*0b   -3A$kk&/*?R@@Gj&B *"!&#*'.25$F$F ".B  $yB!##%!&!Y%2B!YFY%0%)/r$B N ] ] ]\\\\W[\\\ \ \ \ \ \ \             NN7 = = =       sGD#DD## F - E:F  F  E F  F -(FF F cdddddddgdS) Nrpaidz2Objective-tuned search + parallel page extraction.rzParallel API keyzhttps://parallel.ai)keyr r\)r=badgetagenv_varsr:r;s rget_setup_schemaz*ParallelWebSearchProvider.get_setup_schemas4G.00   r'Nrr)rrA)rK)rLrrMrNrrO)rsrtrurrrv)rrO) __name__ __module__ __qualname____doc__propertyr=r@rDrGrJrgrrr:r'rr8r8s66 XX????.Q.Q.Q.Q.Q`AAAAF       r'r8)rr )rrr)r __future__rloggingrtypingrrragent.web_search_providerr getLoggerrrdrr&r+r-_get_parallel_client_get_async_parallel_clientr6r8r:r'rrs(8#""""" """"""""""777777  8 $ $$$$$$64 & & & &(.T T T T T 1T T T T T r'