˟fiRSSKrSSKJr SSKJrJrJrJrJr SSK J r J r J r J r SSKJrJrJrJr SSKJr SSKJrJr SS KJrJrJrJrJrJrJr \R@"S 5r!\RD"5r#\#RI\RJ"S 55 SS \\&\'4S \(S\(S\)S\\\*S\\\*S\+S\+S\)S\+S\4Sjjr,SS\S \(S\(S\)S\\\*S\\\*S\+S\+S\)S\+S\4Sjjr-SS\\*\&\4S \(S\(S\)S\\\*S\\\*S\+S\+S\)S\+S\4Sjjr.SS\\\*\\&4S \(S\(S\)S\\\*S\\\*S\+S\+S\)S\+S\+4Sjjr/g) N)PathLike)BinaryIOListOptionalSetUnion)coherence_ratioencoding_languagesmb_encoding_languagesmerge_coherence_ratios)IANA_SUPPORTEDTOO_BIG_SEQUENCETOO_SMALL_SEQUENCETRACE) mess_ratio) CharsetMatchCharsetMatches)any_specified_encodingcut_sequence_chunks iana_nameidentify_sig_or_bom is_cp_similaris_multi_byte_encodingshould_strip_sig_or_bomcharset_normalizerz)%(asctime)s | %(levelname)s | %(message)s sequencessteps chunk_size threshold cp_isolation cp_exclusionpreemptive_behaviourexplainlanguage_thresholdenable_fallbackreturnc [U[[45(d#[SR [ U555eU(aB[ Rn [ R[5 [ R[5 [U5n U S:Xa{[ RS5 U(aE[ R[5 [ RW =(d [R 5 [#[%USSS/S5/5$UbG[ R'[S S R)U55 UV s/sHn [+U S5PM nn O/nUbG[ R'[S S R)U55 UV s/sHn [+U S5PM nn O/nXU-::a![ R'[S UUU 5 S nU nUS :aX- U:a [-X- 5n[U5[.:n [U5[0:nU (a*[ R'[SR U 55 O0U(a)[ R'[SR U 55 /nU(a [3U5OSnUb,UR5U5 [ R'[SU5 [75n/n/nSnSnSn[#5n[9U5unnUb6UR5U5 [ R'[S[U5U5 UR5S5 SU;aUR5S5 U[:-GHJnU(aUU;aMU(aUU;aM"UU;aM*UR=U5 SnUU:HnU=(a [?U5nUS;a$U(d[ R'[SU5 MUS;a$U(d[ R'[SU5 M[AU5nU(a8USLa3[GUSLaUS[-S5OU[U5[-S5US9 O[GUSLaUO U[U5SUS9nSn UHn![MUU!5(dMSn O U (a[ R'[SUW!5 GMZ[OU(dSO [U5U [-X- 55n"U=(a USL=(a [U5U :n#U#(a[ R'[SU5 [-[U"5S- 5n$[QU$S5n$Sn%Sn&/n'/n([SUUU"UUUUUU5 H{n)U'R5U)5 U(R5[UU)UUSL=(a S [U5s=:*=(a S:*Os 55 U(S U:aU%S - n%U%U$:dU(dMtUSLdM{ O U&(d+U(a$U(dU[-S"5SRWUS#S$9 U((a[YU(5[U(5- OSn*U*U:dU%U$:awUR5U5 [ R'[S&UU%[[U*S'-S(S)95 U (a4USSU4;a+U&(d$[%UUUS/U5n+UU:XaU+nO US:XaU+nOU+nGM\[ R'[S*U[[U*S'-S(S)95 U(d []U5n,O [_U5n,U,(a3[ R'[S+R U[GU,555 /n-US:wa?U'H9n)[aU)UU,(aS,R)U,5OS5n.U-R5U.5 M; [cU-5n/U/(a*[ R'[S-R U/U55 UR5[%UUU*UU/U55 UUSS4;abU*S.:a\[ RS/U5 U(a.[ R[5 [ RW 5 [#UU/5s $UU:XdGM[ RS0U5 U(a.[ R[5 [ RW 5 [#UU/5s $ [U5S:XaU(dU(dU(a[ R'[S15 U(a2[ RS2URd5 UR5U5 OU(aUb+U(a!U(aURfURf:wdUb'[ RS35 UR5U5 O-U(a&[ RS45 UR5U5 U(a<[ RS5URi5Rd[U5S - 5 O[ RS65 U(a.[ R[5 [ RW 5 U$s sn fs sn f![B[D4a [ R'[SU5 GMf=f![H[J4aWn[U[J5(d%[ R'[SU[GU55 UR5U5 SnAGM}SnAff=f![Ha4n[ R'[S!U[GU55 U$n%Sn&SnAGN7SnAff=f![HaBn[ R'[S%U[GU55 UR5U5 SnAGM SnAff=f)7a2 Given a raw bytes sequence, return the best possibles charset usable to render str objects. If there is no results, it is a strong indicator that the source is binary/not text. By default, the process will extract 5 blocks of 512o each to assess the mess and coherence of a given sequence. And will give up a particular code page after 20% of measured mess. Those criteria are customizable at will. The preemptive behavior DOES NOT replace the traditional detection workflow, it prioritize a particular code page but never take it for granted. Can improve the performance. You may want to focus your attention to some code page or/and not others, use cp_isolation and cp_exclusion for that purpose. This function will strip the SIG in the payload/sequence every time except on UTF-16, UTF-32. By default the library does not setup any handler other than the NullHandler, if you choose to set the 'explain' toggle to True it will alter the logger configuration to add a StreamHandler that is suitable for debugging. Custom logging format and handler can be set manually. z4Expected object of type bytes or bytearray, got: {0}rzTrying to detect encoding from a tiny portion of ({}) byte(s).zIUsing lazy str decoding because the payload is quite large, ({}) byte(s).z@Detected declarative mark in sequence. Priority +1 given for %s.zIDetected a SIG or BOM mark on first %i byte(s). Priority +1 given for %s.ascii>utf_16utf_32z\Encoding %s won't be tested as-is because it require a BOM. Will try some sub-encoder LE/BE.>utf_7zREncoding %s won't be tested as-is because detection is unreliable without BOM/SIG.z2Encoding %s does not provide an IncrementalDecodergA)encodingz9Code page %s does not fit given bytes sequence at ALL. %sTzW%s is deemed too similar to code page %s and was consider unsuited already. Continuing!zpCode page %s is a multi byte encoding table and it appear that at least one character was encoded using n-bytes.zaLazyStr Loading: After MD chunk decode, code page %s does not fit given bytes sequence at ALL. %sgj@strict)errorsz^LazyStr Loading: After final lookup, code page %s does not fit given bytes sequence at ALL. %szc%s was excluded because of initial chaos probing. Gave up %i time(s). Computed mean chaos is %f %%.d)ndigitsz=%s passed initial chaos probing. Mean measured chaos is %f %%z&{} should target any language(s) of {},z We detected language {} using {}皙?z.Encoding detection: %s is most likely the one.zoEncoding detection: %s is most likely the one as we detected a BOM or SIG within the beginning of the sequence.zONothing got out of the detection process. Using ASCII/UTF-8/Specified fallback.z7Encoding detection: %s will be used as a fallback matchz:Encoding detection: utf_8 will be used as a fallback matchz:Encoding detection: ascii will be used as a fallback matchz]Encoding detection: Found %s as plausible (best-candidate) for content. With %i alternatives.z=Encoding detection: Unable to determine any suitable charset.)5 isinstance bytearraybytes TypeErrorformattypeloggerlevel addHandlerexplain_handlersetLevelrlendebug removeHandlerloggingWARNINGrrlogjoinrintrrrappendsetrraddrrModuleNotFoundError ImportErrorstrUnicodeDecodeError LookupErrorrrangemaxrrdecodesumroundr r r r r/ fingerprintbest)0rrrr r!r"r#r$r%r&previous_logger_levellengthcpis_too_small_sequenceis_too_large_sequenceprioritized_encodingsspecified_encodingtestedtested_but_hard_failuretested_but_soft_failurefallback_ascii fallback_u8fallback_specifiedresults sig_encoding sig_payload encoding_ianadecoded_payloadbom_or_sig_availablestrip_sig_or_bomis_multi_byte_decoderesimilar_soft_failure_testencoding_soft_failedr_multi_byte_bonusmax_chunk_gave_upearly_stop_countlazy_str_hard_failure md_chunks md_ratioschunkmean_mess_ratiofallback_entrytarget_languages cd_ratioschunk_languagescd_ratios_mergeds0 M/home/kuhnn/miniconda3/lib/python3.13/site-packages/charset_normalizer/api.py from_bytesr!s < i)U!3 4 4 B I IY   %+\\/*i.F { ST    1 OO1DW__ E|IwUBPRSTUU  5 IIl #  8DD| "e,| D    6 IIl #  8DD| "e,| D   u$%  l       qyV^j0( "%i.3E"E"%i.4D"D  L S S    W ^ ^  (*.By)t%$$%78  N  uF)+)+-1N*.K15,.G 3I >L+$$\2  W       )++$$W-.? M=  M\9  F "  =!)-%1]%B!5" :Q ;  0 09M JJn   I %.B JJd   *@*O ! $)>%)G'50kD *"3{#3c$i@* #&'50"3{#3#56* #"+0!$; ],@AA,0)%< % JJi$    )As;/?     " .t+ .O$v-   JJ-  "%SWq[!1 115 ! %!  ' ),$ %   '  !4GA\1B,G,Ga,GR=I-$)$$(99((-=-F7 V&%) #d)+&--mH-MENY#i.!@SV i '+;?P+P # * *= 9 JJ0 o+Q7   !gw8J%KK-!-}iO"!$66)7&"g-%3N"0K   K  /C' 3  %*<]*K 4]C   JJ8??!3'7#8   G #""1&2BCHH-.#   1#2)<  JJ299$m   $     0'7C C#% LL@- $$_5 56!7=#9":; ; L ( LL1  $$_5 56!7=#9":; ;m@p 7|q .,> JJa   LLI"++  NN- . ^3"++~/I/II' LLU V NN; '  LLU V NN> * k LLN # # L1   TU_--. Nq EE^$[1  JJD    .#K0 a-- O!F  $ * *= 9  l  ) JJsA   1 $( ! )*&  t!F  (..}= sh.h3; h8>i+i+Bk kkk-l8+i('i(+k;A k  k l)ll m" 6mm"fpc F[UR5UUUUUUUUU 5 $)zz Same thing than the function from_bytes but using a file pointer that is already ready. Will not close the file pointer. )rread) rrrr r!r"r#r$r%r&s rfrom_fprs5      pathc x[US5n [U UUUUUUUUU 5 sSSS5 $!,(df  g=f)z Same thing than the function from_bytes but with one extra step. Opening and reading given file path in binary mode. Can raise IOError. rbN)openr) rrrr r!r"r#r$r%r&rs r from_pathrsB dD R              s+ 9fp_or_path_or_payloadc [U[[45(a[UUUUUUUUUU S9 n U (+$[U[[ 45(a[ UUUUUUUUUU S9 n U (+$[UUUUUUUUUU S9 n U (+$)a Detect if the given input (file, bytes, or path) points to a binary file. aka. not a string. Based on the same main heuristic algorithms and default kwargs at the sole exception that fallbacks match are disabled to be stricter around ASCII-compatible but unlikely to be a string. ) rrr r!r"r#r$r%r&)r:rRrrr<r;rr) rrrr r!r"r#r$r%r&guessess r is_binaryr3s"'#x99 !!%%!51+  Z;C       !!%%!51+  4; !!%%!51+  ;r) 皙?NNTFr9T) rrrNNTFr9F)0rHosrtypingrrrrrcdr r r r constantrrrrmdrmodelsrrutilsrrrrrrr getLoggerr@ StreamHandlerrC setFormatter Formatterr<r;rLfloatrRboolrrrrrrrs"77 RQ0   / 0'') AB(,(,!% # RUI%&R RR R 49% R 49% RRRRRRn(,(,!% #    49%  49% @(,(,!% #  UH$ %     49%  49%       B(,(,!% #!? 3%!?@? ?? ? 49% ? 49% ????? ?r